Academic literature on the topic 'Automated test set generation'
Create a spot-on reference in APA, MLA, Chicago, Harvard, and other styles
Consult the lists of relevant articles, books, theses, conference reports, and other scholarly sources on the topic 'Automated test set generation.'
Next to every source in the list of references, there is an 'Add to bibliography' button. Press on it, and we will generate automatically the bibliographic reference to the chosen work in the citation style you need: APA, MLA, Harvard, Chicago, Vancouver, etc.
You can also download the full text of the academic publication as pdf and read online its abstract whenever available in the metadata.
Journal articles on the topic "Automated test set generation"
1
Movva, Himadeep. "Automated Testing Using UiPath Test Suite: A Framework for Scalable and Efficient Testing." International Scientific Journal of Engineering and Management 02, no. 06 (2023): 1–8. https://doi.org/10.55041/isjem01208.
Full textAbstract:
Testing is one of the key components of any software development. RPA, with its advanced features, including those of Artificial Intelligence, can bring state-of-the-art solutions to automate use cases that were never imagined could be automated. This research study, through an in-depth analysis of features of the UiPath Test suite, explores the functionality of automated testing within UiPath and how a robust mechanism of an automated test management system through an efficient testing framework produces an RPA software product that is of robust design and highest quality. This research study also explores, in detail, the essential features of the UiPath Test Suite and how they can be used effectively to develop an effective RPA software testing strategy in UiPath projects. Test case generation is one of the crucial factors in determining how efficient testing would be and how robust a software product would be. This is the main reason for exploring automated test case generation through the UiPath Test suite. Automated software testing has transformed quality assurance, increased productivity, and decreased human labor. This study also examines the advanced features of UiPath Test Suite and how they can be used for end-to-end testing. Keywords: Test Suite, Test Manager, Test Sets, Test Cases, Data-Driven Test Cases, Task Capture, UiPath, Orchestrator, Software Testing, Data Service Entities, Choice set, Framework, JSON, and Test Data Queue
2
CUKIC, BOJAN, BRIAN J. TAYLOR, and HARSHINDER SINGH. "AUTOMATED GENERATION OF TEST TRAJECTORIES FOR EMBEDDED FLIGHT CONTROL SYSTEMS." International Journal of Software Engineering and Knowledge Engineering 12, no. 02 (2002): 175–200. http://dx.doi.org/10.1142/s0218194002000895.
Full textAbstract:
Automated generation of test cases is a prerequisite for fast testing. Whereas the research in automated test data generation addressed the creation of individual test points, test trajectory generation has attracted limited attention. In simple terms, a test trajectory is defined as a series of data points, with each (possibly multidimensional) point relying upon the value(s) of previous point(s). Many embedded systems use data trajectories as inputs, including closed-loop process controllers, robotic manipulators, nuclear monitoring systems, and flight control systems. For these systems, testers can either handcraft test trajectories, use input trajectories from older versions of the system or, perhaps, collect test data in a high fidelity system simulator. While these are valid approaches, they are expensive and time-consuming, especially if the assessment goals require many tests. We developed a framework for expanding a small, conventionally developed set of test trajectories into a large set suitable, for example, for system safety assurance. Statistical regression is the core of this framework. The regression analysis builds a relationship between controllable independent variables and closely correlated dependent variables, which represent test trajectories. By perturbing the independent variables, new test trajectories are generated automatically. Our approach has been applied in the safety assessment of a fault tolerant flight control system. Linear regression, multiple linear regression, and autoregressive techniques are compared. The performance metrics include the speed of test generation and the percentage of "acceptable" trajectories, measured by the domain specific reasonableness checks.
3
Avritzer, A., E. de Souza e Silva, R. M. M. Leão, and E. J. Weyuker. "Automated generation of test cases using a performability model." IET Software 5, no. 2 (2011): 113. http://dx.doi.org/10.1049/iet-sen.2010.0035.
Full text
4
Farooq, M. S., and Tayyaba Tahreem. "Requirement-Based Automated Test Case Generation: Systematic Literature Review." VFAST Transactions on Software Engineering 10, no. 2 (2022): 133–42. http://dx.doi.org/10.21015/vtse.v10i2.940.
Full textAbstract:
There exist multiple techniques of software testing like requirement-based testing (RBT) an approach of software testing from which the tester can generate test cases on the base of requirements without considering the internal system’s structure. In the current area, automation testing is used to minimize time, cost, and human effort. As compared to automated testing, manual testing processes consume more human effort and time. Requirements are documented in natural language so there is no extra training required to understand requirements, RBT is the most used testing technique. Test cases generated with customer requirements are mainly focused on functional test cases. Most approaches focus on real-time embedded systems rather than UML diagrams because non-functional needs are not captured in test cases derived from UML diagrams. Metamodels can be used to extract information from requirements in some cases. Active testing approaches, bounded model checking, activity diagrams, Petri nets round strip strategy, and extended use cases are just a few of the typical ways used to generate test cases. In this article, multiple techniques of automated test case generation have been discussed which are not being addressed in state-of-art literature reviews. Studies included in this systematic literature review (SLR) are built on a set of three research objectives and a variety of high-quality evaluation criteria. Taxonomy has been presented based on test case generation with requirement-based techniques and tools. In the end, gaps and challenges have been discussed to assist researchers to pursue future work.
5
Kodanda, Rami Reddy Manukonda. "Efficient Test Case Generation using Combinatorial Test Design: Towards Enhanced Testing Effectiveness and Resource Utilization." European Journal of Advances in Engineering and Technology 7, no. 12 (2020): 78–83. https://doi.org/10.5281/zenodo.12737422.
Full textAbstract:
Combinatorial testing is a promising approach to software testing that aims to improve testing effectiveness and optimize resource utilization. It involves systematically exploring interactions among input parameters, generating a reduced set of test cases while maintaining adequate coverage. Empirical research shows that most software defects result from a few input parameter interactions, emphasizing the importance of adopting combinatorial testing methodologies. Automated combinatorial testing tools offer consistency, efficiency, and resource optimization in test case generation. However, the paper acknowledges limitations like the need for accurate parameter selection. Practical examples demonstrate its effectiveness in reducing testing times and costs. The paper also provides insights into combinatorial test design algorithms and tools, including the Advanced Combinatorial Testing System (ACTS).
6
Marculescu, Bogdan, Man Zhang, and Andrea Arcuri. "On the Faults Found in REST APIs by Automated Test Generation." ACM Transactions on Software Engineering and Methodology 31, no. 3 (2022): 1–43. http://dx.doi.org/10.1145/3491038.
Full textAbstract:
RESTful web services are often used for building a wide variety of enterprise applications. The diversity and increased number of applications using RESTful APIs means that increasing amounts of resources are spent developing and testing these systems. Automation in test data generation provides a useful way of generating test data in a fast and efficient manner. However, automated test generation often results in large test suites that are hard to evaluate and investigate manually. This article proposes a taxonomy of the faults we have found using search-based software testing techniques applied on RESTful APIs. The taxonomy is a first step in understanding, analyzing, and ultimately fixing software faults in web services and enterprise applications. We propose to apply a density-based clustering algorithm to the test cases evolved during the search to allow a better separation between different groups of faults. This is needed to enable engineers to highlight and focus on the most serious faults. Tests were automatically generated for a set of eight case studies, seven open-source and one industrial. The test cases generated during the search are clustered based on the reported last executed line and based on the error messages returned, when such error messages were available. The tests were manually evaluated to determine their root causes and to obtain additional information. The article presents a taxonomy of the faults found based on the manual analysis of 415 faults in the eight case studies and proposes a method to support the classification using clustering of the resulting test cases.
7
V. Chandra Prakash, Dr, Subhash Tatale, Vrushali Kondhalkar, and Laxmi Bewoor. "A Critical Review on Automated Test Case Generation for Conducting Combinatorial Testing Using Particle Swarm Optimization." International Journal of Engineering & Technology 7, no. 3.8 (2018): 22. http://dx.doi.org/10.14419/ijet.v7i3.8.15212.
Full textAbstract:
In software development life cycle, testing plays the significant role to verify requirement specification, analysis, design, coding and to estimate the reliability of software system. A test manager can write a set of test cases manually for the smaller software systems. However, for the extensive software system, normally the size of test suite is large, and the test suite is prone to an error committed like omissions of important test cases, duplication of some test cases and contradicting test cases etc. When test cases are generated automatically by a tool in an intelligent way, test errors can be eliminated. In addition, it is even possible to reduce the size of test suite and thereby to decrease the cost & time of software testing.It is a challenging job to reduce test suite size. When there are interacting inputs of Software under Test (SUT), combinatorial testing is highly essential to ensure higher reliability from 72 % to 91 % or even more than that. A meta-heuristic algorithm like Particle Swarm Optimization (PSO) solves optimization problem of automated combinatorial test case generation. Many authors have contributed in the field of combinatorial test case generation using PSO algorithms.We have reviewed some important research papers on automated test case generation for combinatorial testing using PSO. This paper provides a critical review of use of PSO and its variants for solving the classical optimization problem of automatic test case generation for conducting combinatorial testing.
8
Gagan, Kumar, and Chopra Vinay. "Automatic Test Data Generation for Basis Path Testing." Indian Journal of Science and Technology 15, no. 41 (2022): 2151–61. https://doi.org/10.17485/IJST/v15i41.1503.
Full textAbstract:
Abstract <strong>Objectives:</strong> This paper presents a new hybrid ACO-NSA algorithm for the automatic test data generation problem with path coverage as an objective function. <strong>Method:</strong> In it, at the first instance, test data (detectors) are generated with the ant colony optimization algorithm (ACO), and then the generated data set (detector set) has been refined by a negative selection algorithm (NSA) with Hamming distance. <strong>Findings:</strong> The algorithm’s performance is tested on several benchmark problems with different data types and variables for metrics average coverage, average generations, average time and success rate, Iteration value 1000 is set for average coverage, average generations, average time and 200 for success rate. The obtained results from the proposed approach are compared with some existing approaches. The results are very efficient with high efficacy, higher path coverage, minimal data redundancy, and less execution time.<strong> Applications:</strong> This approach can be applied in any type of software development process in software engineering to reduce the testing efforts. <strong>Novelty:</strong> The approach is based on two distinct methodologies: metaheuristic search and artificial immune search, and its fitness is measured using path coverage as the fitness function. The approach provides 99.5% average path coverage, 2.72% average number of generations in 0.07 ns, and 99.9% success rate, which is significantly better than comparable approaches. <strong>Keywords:</strong> Test data generation; Metaheuristic search; Artificial immune search; Ant colony optimization; Negative selection algorithm; Path coverage
9
Imam, Muhammad Hasan, Imran Ali Tasadduq, Abdul-Rahim Ahmad, Fahd Aldosari, and Haris Khan. "Automated Generation of Course Improvement Plans Using Expert System." International Journal of Quality Assurance in Engineering and Technology Education 6, no. 1 (2017): 1–12. http://dx.doi.org/10.4018/ijqaete.2017010101.
Full textAbstract:
To satisfy ABET's continuous improvement criterion, an instructor, teaching a course suggests, at the end of the course, an improvement plan to be implemented when the same course is taught next time. Preparation of such a course improvement plan may be mandatory if a pre-specified target level of students' learning is not attained. Since, manual preparation of a course improvement plan is difficult, an idea of generating it using an expert system is presented. The objective is to make the task of improvement plan preparation easier and enjoyable. The proposed expert system has a set of remedies and a set of rules in a data base. A web-based interface queries the instructor about teaching and assessment tools used in the course. The inference engine selects the most appropriate remedy based on instructor's preferences. A cloud implementation of the expert system has been used to test it for a course.
10
Antonelli, Leandro, Mariángeles Hozikian, Guy Camilleri, et al. "Wiki support for automated definition of software test cases." Kybernetes 49, no. 4 (2019): 1305–24. http://dx.doi.org/10.1108/k-10-2018-0548.
Full textAbstract:
Purpose The design of tests is a very important step in the software development process because it allows us to match the users’ expectations with the finished product. Considered as a cumbersome activity, efforts have been made to automatize and alleviate the burden of test generation, but it is still a largely neglected step. The study aims to propose taking advantage of existing requirement artifacts, like scenarios that describe the dynamic of the domain in a very early stage of software development, to obtain tests from them. Design/methodology/approach In particular, the approach proposed complement the scenarios that are textually described with a glossary, the language extended lexicon. Thus, a set of rules to derive tests from scenarios is also proposed. The tests are then described using the task/method model. Findings The main findings of this study consist of an extension of a previously presented set of rules. And, a tool based on a media wiki platform that makes possible to record scenarios and the language extended lexicon and implement the rules to obtain the tests. Originality/value The main originality of this study is the glossary which complements scenarios, the semantic support to obtain tests and the tool to automatize the approach.
Dissertations / Theses on the topic "Automated test set generation"
1
Zhan, Yuan. "A search-based framework for automatic test-set generation for MATLAB/Simulink models." Thesis, University of York, 2005. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.425391.
Full text
2
Holm, Oscar. "Improving the Development of Safety Critical Software : Automated Test Case Generation for MC/DC Coverage using Incremental SAT-Based Model Checking." Thesis, Linköpings universitet, Institutionen för datavetenskap, 2019. http://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-161335.
Full textAbstract:
The importance and requirements of certifying safety critical software is today more apparent than ever. This study focuses on the standards and practices used within the avionics, automotive and medical domain when it comes to safety critical software. We identify critical problems and trends when certifying safety critical software and propose a proof-of-concept using static analysis, model checking and incremental SAT solving as a contribution towards solving the identified problems. We present quantitative execution times and code coverage results of our proposed solution. The proposed solution is developed under the assumptions of safety critical software standards and compared to other studies proposing similar methods. Lastly, we conclude the issues and advantages of our proof-of-concept in perspective of the software developer community
3
Cousins, Michael Anthony. "Automated structural test data generation." Thesis, University of Portsmouth, 1995. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.261234.
Full text
4
Pietschker, Andrej. "Automated test generation from algebraic specifications." Thesis, University of Newcastle Upon Tyne, 2002. http://hdl.handle.net/10443/2015.
Full textAbstract:
This thesis is a contribution to work on the specification-based testing of computing systems. The development of computing systems is a challenging task. A great deal of research has been directed at support for analysis, design and implementation aspects, yielding a wide range of development techniques. However, the crucial area of system testing remains relatively under-explored. Because a project may spend a good part of its budget on testing, even modest improvements to the cost-effectiveness of testing represent substantial improvements in project budgets. Relatively little literature has been devoted to the entire testing process, including specification, generation, execution and validation. Most of the academic literature seems to assume a revolutionary change of the testing framework. On the contrary industry follows a more traditional approach consisting of trusted methods and based on personal experience. There is a need for testing methods that improve the effectiveness of testing but do so at reasonable cost and which do not require a revolutionary change in the development technology. The novel goal of the work described in this thesis is to "lift" traditional testing so that it takes advantage of system specifications. We provide a framework - hepTEsT- which is motivated by this goal. To that end, hepTEsT is a framework consisting of a specification language, a technology for generating tests in accordance with test strategies, a means of applying the tests to the implementations and support for validation of outcomes against the specification-based tests. We will first categorise different testing methodologies and then examine some of the past and present approaches to test data: we develop only the necessary theoretical foundations for hepSPEc and always consider the requirements of testing. The formalism hepSPEc for system description is based upon a well-defined algebraic approach. It utilises a novel approach allowing the description of finite domains in a way suitable for engineering purposes. The engineers' tasks are to provide an adequate description of the system in hepSPEC. The approach proposed in this thesis is grounded in the traditional approach to testing where test data is provided to the system under test and the outcome is compared to the expected outcome. To enhance the capabilities of the framework a general order on test inputs is proposed to be used in test strategies. Traditional testing strategies requiring an order on test inputs are introduced and their realisation in hepTEsT discussed as well as a proposal of new strategies which lend themselves to this particular approach. The manipulation of the specification yields abstract test cases which are then transformed into test cases suitable for the chosen implementation of the system. This transformation, called test reification, is necessary to bridge the "abstraction gap" between the abstract specification-derived tests and the concrete implementation on which the test must run. The transformation is necessary in order for the approach to be practical and is achieved through homomorphisms which are expressed in specially adapted grammars. This transformation is also applied to the generated test outcome and is aimed there at easing test result validation. The utility of the hepTEsT approach is illustrated by means of a simple example, a larger case study and one carried out within the aviation industry.
5
Cheng, Xu. "Supporting automated system-level test scenario generation." Thesis, University of Ottawa (Canada), 2007. http://hdl.handle.net/10393/27821.
Full textAbstract:
Software plays a significant role in society. It penetrates every field such as telecommunications, public administration, cooperation management, etc. In a software development life cycle (abbr., SDLC), software testing is a key phase. It accounts for a large part of software development costs. This is a consequence of testing being performed late in an improvised and impromptu way under the discretion of project managers. Continual testing as proposed by the extreme programming approach advocates that automated testing be performed in the early phases of the SDLC. Automation helps avoid disorderly and unsystematic progress of testing tasks and assignments. This thesis presents an approach for the generation of test cases from use cases---a form of requirements used in the early phases of the SDLC.
We first needed a way to combine related use cases in order to infer system-level test cases spawning over several use cases. We developed an approach to infer use case sequential relations based on a comparison of pre-conditions and post-conditions. This approach offers the benefit of obtaining use case sequential relations without solely relying on the traditional UML use case relationships (i.e., include, extend and generalization). It helps to avoid the functional decomposition of use cases.
We then propose an automated approach for die generation of test scenarios, a step toward complete and concrete test cases. Test scenarios are generated using depth-first traversal of control flow-based state machines obtained from use cases. The construction of these control flow-based state machines considers traditional UML use case relationships as well as inferred sequential relations. Depth-first traversal of control flow-based state machines is controlled by a coverage criterion inspired from traditional white-box code coverage.
6
Morrison, George Campbell. "Automated coverage calculation and test case generation." Thesis, Stellenbosch : Stellenbosch University, 2012. http://hdl.handle.net/10019.1/20041.
Full textAbstract:
Thesis (MScEng)--Stellenbosch University, 2012.<br>ENGLISH ABSTRACT: This research combines symbolic execution, a formal method of static analysis, with various
test adequacy criteria, to explore the e ectiveness of using symbolic execution for calculating
code coverage on a program's existing JUnit test suites. Code coverage is measured with a
number of test adequacy criteria, including statement coverage, branch coverage, condition
coverage, method coverage, class coverage, and loop coverage. The results of the code coverage
calculation is then used to automatically generate JUnit test cases for areas of a program that
are not su ciently covered. The level of redundancy of each test case is also calculated during
coverage calculation, thereby identifying fully redundant, and partially redundant, test cases.
The combination of symbolic execution and code coverage calculation is extended to perform
coverage calculation during a manual execution of a program, allowing testers to measure the
e ectiveness of manual testing.
This is implemented as an Eclipse plug-in, named ATCO, which attempts to take advantage
of the Eclipse workspace and extensible user interface environment to improve usability of the
tool by minimizing the user interaction required to use the tool.
The code coverage calculation process uses constraint solving to determine method parameter
values to reach speci c areas in the program. Constraint solving is an expensive
computation, so the tool was parallellised using Java's Concurrency package, to reduce the
overall execution time of the tool.<br>AFRIKAANSE OPSOMMING: Hierdie navorsing kombineer simboliese uitvoering, 'n formele metode van statiese analise, met
verskeie toets genoegsaamheid kriteria, om die e ektiwiteit van die gebruik van simboliese
uitvoer te ondersoek vir die berekening van kode dekking op 'n program se bestaande JUnit
toets stelle. Kode dekking word gemeet deur verskeie toets genoegsaamheid kriteria, insluited
stelling dekking, tak dekking, kondisie dekking, metode dekking, klas dekking, en lus dekking.
Die resultate van die kode dekking berekeninge word dan gebruik om outomaties JUnit toets
voorbeelde te genereer vir areas van 'n program wat nie doeltre end ondersoek word nie. Die
vlak van oortolligheid van elke toets voorbeeld word ook bereken gedurende die dekkingsberekening,
en daardeur word volledig oortollige, en gedeeltelik oortollige, toets voorbeelde
identi seer. Die kombinasie van simboliese uitvoer en kode dekking berekening is uitgebrei
deur die uitvoer van dekking berekeninge van 'n gebruiker-beheerde uitvoer, om sodoende kode
dekking van 'n gebruiker-beheerde uitvoer van 'n program te meet. Dit laat toetsers toe om
die e ektiwiteit van hulle beheerde uitvoer te meet.
Bogenoemde word ge mplimenteer as 'n Eclipse aanvoegsel, genaamd ATCO, wat poog om
voordeel te trek vanuit die Eclipse werkspasie, en die uitbreibare gebruiker oordrag omgewing,
om die bruikbaarheid van ATCO te verbeter, deur die vermindering van die gebruiker interaksie
wat benodig word om ATCO te gebruik.
Die kode dekking berekeningsproses gebruik beperking oplossing om metode invoer waardes
te bereken, om spesi eke areas in die program te bereik. Beperking oplossing is 'n duur berekening,
so ATCO is geparalleliseer, met behulp van Java se Concurrency pakket, om die algehele
uitvoer tyd van die program te verminder.
7
de, Araujo Rodrigues Vieira Elisangela. "Automated model-based test generation for timed systems." Evry, Institut national des télécommunications, 2007. http://www.theses.fr/2007TELE0011.
Full textAbstract:
Timed Systems are systems with real-time constraints. The correctness of a timed system depends not only upon the operations it performs but also the timing when they are performed. Testing a system aims to guarantee its correctness. Model-based test generation is an approach to generate test cases based on a formal model. Although test generation methods have been far proposed, its timed counterpart is still a new field. In addition, most of the proposed solutions suffer from combinatory explosion which still limits their applicability in practice. Accordingly, it explains why there are so few automatic formal methods for testing generation, for both time and untimed systems. This thesis presents an automatic test generation approach addressed for timed systems using a test-purpose algorithm. Test purpose approach guarantees the generation of test case with regard to critical parts of the system and avoid the state explosion problem. In addition, we propose techniques to generate test sequences with timing-fault detection and with delayed and/or instantaneous transitions. In order to evaluate the applicability and efficiency of the proposed method, we have implemented two prototype tools: one based on an industrial simulator for SDL specifications and other using a free toolset based on IF models. Two real industrial applications are used as case study: a Railroad Crossing and a Vocal Service furnished by France Telecom<br>Les systèmes temporisés sont des systèmes avec des contraintes de temps réel. L'exactitude d'un système temporisé dépend non seulement des opérations qu'il effectue mais également de la synchronisation quand ils sont exécutés. La synchronisation prend en compte non seulement l’ordre des opérations mais surtout le moment quand elles sont exécutées. Tester un système vise à garantir son exactitude. La génération de teste basée sur des modèles c’est une approche pour produire des cas de test basés sur un modèle formel. Bien que d’autres méthodes de génération de test ont déjà été proposés, la génération pour les systèmes temporisés c’est un domaine bien plus récente. En outre, la plupart des solutions proposées souffrent de l'explosion combinatoire, ce qui limite toujours leur applicabilité dans la pratique. En conséquence, cela explique pourquoi il y a tellement peu de méthodes formelles automatiques pour la génération de test dans tout les domaines. Cette thèse présente une approche automatique de génération de teste adressée aux systèmes temporisés. Pour cela, nous proposons un algorithme de génération basé sur des objectives de test. Cette approche permet de générer des tests pour ce qui concerne les parties critiques du système et évite le problème d'explosion combinatoire. En outre, nous proposons des techniques pour produire des tests avec la détection des timing faults et avec des transitions retardées et/ou instantanées. Afin d'évaluer l'applicabilité et l'efficacité de la méthode proposée, nous avons mis en oeuvre deux outils: une en utilisant un simulateur industriel, pour des modèles en LDS et une autre employant un simulateur basé sur le langage IF. Deux applications industrielles sont employées comme étude de cas : Un système de Passage à Niveau et un Service Vocal fourni par France Telecom
8
Sudireddy, Samara Simha Reddy. "Accumulator Based Test Set Embedding." OpenSIUC, 2009. https://opensiuc.lib.siu.edu/theses/18.
Full textAbstract:
In this paper a test set embedding based on accumulator driven by an odd additive constant is presented. The problem is formulated around finding the location of the test pattern in the sequence generated by the accumulator, given a odd constant C and test set T, in terms of linear Diophantine equation of two variables. We show that the search space for finding the best constant corresponding to the shortest length, is greatly reduced. Experimental results show a significant improvement in run time with practically acceptable test length.
9
Wingfield, James. "Approaches to test set generation using binary decision diagrams." Thesis, Texas A&M University, 2003. http://hdl.handle.net/1969.1/20.
Full textAbstract:
This research pursues the use of powerful BDD-based functional circuit analysis to evaluate some approaches to test set generation. Functional representations of the circuit allow the measurement of information about faults that is not directly available through circuit simulation methods, such as probability of random detection and test-space overlap between faults. I have created a software tool that performs experiments to make such measurements and augments existing test generation strategies with this new information. Using this tool, I explored the relationship of fault model difficulty to test set length through fortuitous detection, and I experimented with the application of function-based methods to help reconcile the traditionally opposed goals of making test sets that are both smaller and more effective.
10
Mahmood, Shahid. "A Systematic Review of Automated Test Data Generation Techniques." Thesis, Blekinge Tekniska Högskola, Avdelningen för programvarusystem, 2007. http://urn.kb.se/resolve?urn=urn:nbn:se:bth-4349.
Full textAbstract:
Automated Test Data Generation (ATDG) is an activity that in the course of software testing automatically generates test data for the software under test (SUT). It usually makes the testing more efficient and cost effective. Test Data Generation (TDG) is crucial for software testing because test data is one of the key factors for determining the quality of any software test during its execution. The multi-phased activity of ATDG involves various techniques for each of its phases. This research field is not new by any means, albeit lately new techniques have been devised and a gradual increase in the level of maturity has brought some diversified trends into it. To this end several ATDG techniques are available, but emerging trends in computing have raised the necessity to summarize and assess the current status of this area particularly for practitioners, future researchers and students. Further, analysis of the ATDG techniques becomes even more important when Miller et al. [4] highlight the hardship in general acceptance of these techniques. Under this scenario only a systematic review can address the issues because systematic reviews provide evaluation and interpretation of all available research relevant to a particular research question, topic area, or phenomenon of interest. This thesis, by using a trustworthy, rigorous, and auditable methodology, provides a systematic review that is aimed at presenting a fair evaluation of research concerning ATDG techniques of the period 1997-2006. Moreover it also aims at identifying probable gaps in research about ATDG techniques of defined period so as to suggest the scope for further research. This systematic review is basically presented on the pattern of [5 and 8] and follows the techniques suggested by [1].The articles published in journals and conference proceedings during the defined period are of concern in this review. The motive behind this selection is quite logical in the sense that the techniques that are discussed in literature of this period might reflect their suitability for the prevailing software environment of today and are believed to fulfill the needs of foreseeable future. Furthermore only automated and/or semiautomated ATDG techniques have been chosen for consideration while leaving the manual techniques as they are out of the scope. As a result of the preliminary study the review identifies ATDG techniques and relevant articles of the defined period whereas the detailed study evaluates and interprets all available research relevant to ATDG techniques. For interpretation and elaboration of the discovered ATDG techniques a novel approach called ‘Natural Clustering’ is introduced. To accomplish the task of systematic review a comprehensive research method has been developed. Then on the practical implications of this research method important results have been gained. These results have been presented in statistical/numeric, diagrammatic, and descriptive forms. Additionally the thesis also introduces various criterions for classification of the discovered ATDG techniques and presents a comprehensive analysis of the results of these techniques. Some interesting facts have also been highlighted during the course of discussion. Finally, the discussion culminates with inferences and recommendations which emanate from this analysis. As the research work produced in the thesis is based on a rich amount of trustworthy information, therefore, it could also serve the purpose of being an upto- date guide about ATDG techniques.<br>Shahid Mahmood Folkparksvägen 14:23 372 40 Ronneby Sweden +46 76 2971676
Books on the topic "Automated test set generation"
1
Dislis, Chrssula. A Financially based automated advisor for design for test strategy generation. Brunel University, 1986.
Find full text
2
Gun, I. A study of automated hypothesis generation for a large medical data set. UMIST, 1997.
Find full text
3
Ivanov, Anatoliy. Flexible modular assembly lines on a single structural basis. INFRA-M Academic Publishing LLC., 2022. http://dx.doi.org/10.12737/1196558.
Full textAbstract:
The textbook discusses topical issues of automating the assembly of an extensive range of machine and instrument-making products based on highly efficient robotic reconfigurable systems of a new generation built on a single structural basis. The possibility of fast organization of automated assembly of new types of products, which is provided by the presence of a flexible basic set as part of the complex (line), is shown. A complete set of original technical means for basic and service operations of assembly and control of products is described. Analytical conditions of automatic assembly are given, and recommendations on optimization of design solutions and modeling of projected assembly systems are given.
 It is intended for students studying under the bachelor's degree programs, certified specialists and masters, teachers of technical universities, as well as designers, technologists and scientists dealing with the problem of complex assembly automation.
4
Panischev, Aleksey. The History of Religions in Russia. INFRA-M Academic Publishing LLC., 2025. https://doi.org/10.12737/2160988.
Full textAbstract:
The textbook is one of the first steps towards the methodological support of the discipline "History of Religions of Russia". The introduction of this academic subject into the higher education system was initiated by the Order of the President of Russia on November 4, 2022 and is due to a set of cultural circumstances related to certain geopolitical factors. The textbook is intended to explain the civilizational, multicultural, and ethical foundations of Russia in a religious dimension. The manual also contains self-test tasks. Meets the requirements of the latest generation of federal state educational standards for higher education. For students of higher educational institutions studying in the fields of "Art and Culture", "Philosophy", "Linguistics and literary studies", "Education and pedagogical Sciences", "Mathematical and natural Sciences".
5
Kas'yanova, Svetlana, Zh Kevorkova, M. Safonova, N. V. Laktionova, and N. V. Kulish. Audit. INFRA-M Academic Publishing LLC., 2022. http://dx.doi.org/10.12737/1863115.
Full textAbstract:
The textbook contains a set of developments in the field of audit. All the material is distributed on topics between theoretical, practical and seminar classes, as well as independent work of students in the form of discussions, presentations, test tasks, situational tasks. The theoretical and applied aspects of the organization and conduct of the audit are described, which allow assessing the effectiveness of the management of its affairs with due completeness and reliability. The latest legislative changes have been taken into account.
 The use of methodological materials will allow each student to rationally allocate their time while studying the discipline, get a sufficiently adequate aggregate score and rating assessment and form professional skills.
 Meets the requirements of the federal state educational standards of higher education of the latest generation.
 For undergraduate students studying in the field of training 38.03.01 "Economics".
6
Kas'yanova, Svetlana. Accounting in the restaurant and hotel business and tourism. INFRA-M Academic Publishing LLC., 2022. http://dx.doi.org/10.12737/1171922.
Full textAbstract:
The textbook outlines the theoretical and applied aspects of the organization and accounting features, which allow assessing the effectiveness of its management with a proper degree of completeness and reliability. The latest legislative changes have been taken into account.
 All the material is distributed on topics between theoretical, practical and seminar classes, as well as independent work of students in the form of discussions, presentations, situational tasks, test tasks.
 The use of methodological materials will allow students to rationally allocate their time while studying the discipline, get a sufficiently adequate aggregate score and rating assessment and form professional skills.
 Meets the requirements of the federal state educational standards of higher education of the latest generation.
 The textbook contains a set of developments for the preparation of bachelors in the field of accounting that meet the requirements of the educational program in the field of training 38.03.01 "Economics".
7
Shishkina, Elena. Tactical and forensic support of investigative activities: a workshop. INFRA-M Academic Publishing LLC., 2021. http://dx.doi.org/10.12737/1546031.
Full textAbstract:
The workshop is a set of educational and methodological materials intended for the development of the course "Tactical and forensic support of investigative activities". For each topic of the course, there is a list of studied and control questions, a list of recommended literature, as well as a set of control and measuring materials-test tasks, situational tasks. As elements of the methodological support of the course, the workshop contains samples of scenarios of business games and other interactive forms of conducting practical classes (discussions on problematic issues of the course), materials for performing creative tasks. Practical tasks are compiled on the basis of materials of investigative and judicial practice. Samples of tasks for correspondence students and methodological recommendations for their implementation, as well as sample topics of abstracts and other research papers of students are presented.
 Meets the requirements of the federal state educational standards of higher education of the latest generation.
 For students and undergraduates of law schools and faculties studying under the programs of specialized training of investigative workers. It may also be of interest to the teaching staff of universities as a methodological support for training programs for specialists in various fields of law enforcement activity.
8
Chang, Robert Ching Wei. Functional fault equivalence and automated diagnositc test generation using conventional ATPG. 2005.
Find full text
9
O'leary. Rh Test Generation Software, IBM 3 1/2": Teaching Materials Set (O'LEARY MICROCOMPUTING SERIES). McGraw Hill Higher Education, 1993.
Find full text
10
Williams, ER, AC Matheson, and CE Harwood. Experimental Design and Analysis for Tree Improvement. CSIRO Publishing, 2002. http://dx.doi.org/10.1071/9780643090132.
Full textAbstract:
Experimental Design and Analysis for Tree Improvement provides a set of practical procedures to follow when planning, designing and analysing tree improvement trials. 
 Using many fully-worked examples, it outlines how to: design field, glasshouse and laboratory trials; efficiently collect data and construct electronic data files; pre-process data, screening for data quality and outliers; analyse data from single and across-site trials using either GenStat or SAS; and interpret the results from statistical analyses.
 The authors address the many practical issues often faced in forest tree improvement trials and describe techniques that will give conclusive results with the minimum expense. The techniques provided are applicable to the improvement of not only trees, but to crops in general.
 Building on the success of the first edition, this new edition has been fully revised and updated to relate to the latest commercially-available software packages for design generation (CycDesigN) and data pre-processing and automated generation of programs for statistical analysis (DataPlus). For analysis, it now provides both GenStat and SAS programs as generated by DataPlus.
Book chapters on the topic "Automated test set generation"
1
Bogdanov, K., M. Holcombe, and H. Singh. "Automated Test Set Generation for Statecharts." In Applied Formal Methods — FM-Trends 98. Springer Berlin Heidelberg, 1999. http://dx.doi.org/10.1007/3-540-48257-1_6.
Full text
2
Beyer, Dirk. "Software Testing: 5th Comparative Evaluation: Test-Comp 2023." In Fundamental Approaches to Software Engineering. Springer Nature Switzerland, 2023. http://dx.doi.org/10.1007/978-3-031-30826-0_17.
Full textAbstract:
AbstractThe 5th edition of the Competition on Software Testing (Test-Comp 2023) provides again an overview and comparative evaluation of automatic test-suite generators for C programs. The experiment was performed on a benchmark set of 4 106 test-generation tasks for C programs. Each test-generation task consisted of a program and a test specification (error coverage, branch coverage). There were 13 participating test-suite generators from 6 countries in Test-Comp 2023.
3
Beyer, Dirk. "Advances in Automatic Software Testing: Test-Comp 2025." In Lecture Notes in Computer Science. Springer Nature Switzerland, 2025. https://doi.org/10.1007/978-3-031-90900-9_13.
Full textAbstract:
Abstract The 7th edition of the Competition on Software Testing (Test-Comp 2025) provides an overview and comparative evaluation of automatic test-suite generators for C programs. The experimental evaluation was performed on a benchmark set of 11 226 test-generation tasks for C programs. Each test-generation task consisted of a program and a test specification. The test specifications included error coverage (generate a test suite that exhibits a bug) and branch coverage (generate a test suite that executes as many program branches as possible). Test-Comp 2025 evaluated 20 software systems for test generation that are all freely available. This included 13 test-suite generators that participated with active support from teams led by 12 different representatives from 8 countries (actively maintained software systems, participation in competition jury). Test-Comp 2025 had 1 new participant ( "Image missing" ) and 2 re-entries ( ESBMC-incr , ESBMC-kind ). The evaluation included also 7 test-generation tools from previous years.
4
Paduraru, Ciprian, Marius-Constantin Melemciuc, and Miruna Paduraru. "Automatic Test Data Generation for a Given Set of Applications Using Recurrent Neural Networks." In Communications in Computer and Information Science. Springer International Publishing, 2019. http://dx.doi.org/10.1007/978-3-030-29157-0_14.
Full text
5
Khari, Manju, Anunay Sinha, Enrique Herrerra-Viedma, and Rubén González Crespo. "On the Use of Meta-Heuristic Algorithms for Automated Test Suite Generation in Software Testing." In Toward Humanoid Robots: The Role of Fuzzy Sets. Springer International Publishing, 2021. http://dx.doi.org/10.1007/978-3-030-67163-1_6.
Full text
6
Enoiu, Eduard, Nasir Mehmood Minhas, Michael Felderer, and Wasif Afzal. "Automated Test Generation." In Lecture Notes in Computer Science. Springer Nature Switzerland, 2025. https://doi.org/10.1007/978-3-031-87054-5_3.
Full text
7
Bromberger, Martin, Florent Krasnopol, Sibylle Möhle, and Christoph Weidenbach. "First-Order Automatic Literal Model Generation." In Automated Reasoning. Springer Nature Switzerland, 2024. http://dx.doi.org/10.1007/978-3-031-63498-7_9.
Full textAbstract:
AbstractGiven a finite consistent set of ground literals, we present an algorithm that generates a complete first-order logic interpretation, i.e., an interpretation for all ground literals over the signature and not just those in the input set, that is also a model for the input set. The interpretation is represented by first-order linear literals. It can be effectively used to evaluate clauses. A particular application are SCL stuck states. The SCL (Simple Clause Learning) calculus always computes with respect to a finite number of ground literals. It then finds either a contradiction or a stuck state being a model with respect to the considered ground literals. Our algorithm builds a complete literal interpretation out of such a stuck state model that can then be used to evaluate the clause set. If all clauses are satisfied an overall model has been found. If it does not satisfy some clause, this information can be effectively explored to extend the scope of ground literals considered by SCL.
8
Lim, Jae-Hee, Suk-Hoon Song, Tae-Yong Kuc, Hong-Seong Park, and Hong-Seak Kim. "A Hierarchical Test Model and Automated Test Framework for RTC." In Future Generation Information Technology. Springer Berlin Heidelberg, 2009. http://dx.doi.org/10.1007/978-3-642-10509-8_23.
Full text
9
Nielsen, Brian, and Arne Skou. "Automated Test Generation from Timed Automata." In Tools and Algorithms for the Construction and Analysis of Systems. Springer Berlin Heidelberg, 2001. http://dx.doi.org/10.1007/3-540-45319-9_24.
Full text
10
Fraser, Gordon, and Andrea Arcuri. "Automated Test Generation for Java Generics." In Software Quality. Model-Based Approaches for Advanced Software and Systems Engineering. Springer International Publishing, 2014. http://dx.doi.org/10.1007/978-3-319-03602-1_12.
Full textConference papers on the topic "Automated test set generation"
1
Wagstaff, Harry, Tom Spink, and Björn Franke. "Automated ISA branch coverage analysis and test case generation for retargetable instruction set simulators." In ESWEEK'14: TENTH EMBEDDED SYSTEM WEEK. ACM, 2014. http://dx.doi.org/10.1145/2656106.2656113.
Full text
2
Zhang Guangmei, Chen Rui, Li Xiaowei, and Han Congying. "The Automatic Generation of Basis Set of Path for Path Testing." In 14th Asian Test Symposium (ATS'05). IEEE, 2005. http://dx.doi.org/10.1109/ats.2005.106.
Full text
3
Ferreira, Matheus, Lincoln Costa, and Francisco Carlos Souza. "Search-based Test Data Generation for Mutation Testing: a tool for Python programs." In Escola Regional de Engenharia de Software. Sociedade Brasileira de Computação, 2020. http://dx.doi.org/10.5753/eres.2020.13722.
Full textAbstract:
Test data generation for mutation testing consists of identifying a set of inputs that maximizes the number of mutants killed. Mutation Testing is an excellent test criterion for detecting faults and measuring the effectiveness of test data sets. However, it is not widely used in practice due to the cost and complexity to perform some activities as generating test data. Although test suites can be produced and selected manually by a tester this practice is susceptible to errors and tools are needed to facilitate it. Several tools have been developed to automate mutation testing, but, only a few address the test data generation. The present paper proposes an automated test data generation tool based on weak mutation for Python programming language using the Hill Climbing algorithm. For evaluation, we performed an experiment concerning the effectiveness and cost computational of the tool in a database composed of 348 mutants and we compare it with random generation. Overall, the experiment achieved an average mutation score of 86% for our proposed tool and random testing 64% on average.
4
Shang, Ying, Kun Chang, Ruilian Zhao, and Zhigang Yin. "Template-Based and Coverage-Guided Verification Instruction Set Automatic Generation Method for DSP Chip." In 2023 IEEE 32nd Asian Test Symposium (ATS). IEEE, 2023. http://dx.doi.org/10.1109/ats59501.2023.10317999.
Full text
5
Lahtinen, Jussi. "Automatic Test Set Generation for Function Block Based Systems Using Model Checking." In 2014 9th International Conference on the Quality of Information and Communications Technology (QUATIC). IEEE, 2014. http://dx.doi.org/10.1109/quatic.2014.15.
Full text
6
Mendoza, Isela, Fernando Silva Filho, Gustavo Medeiros, Aline Paes, and Vânia O. Neves. "Comparative Analysis of Large Language Model Tools for Automated Test Data Generation from BDD." In Simpósio Brasileiro de Engenharia de Software. Sociedade Brasileira de Computação, 2024. http://dx.doi.org/10.5753/sbes.2024.3423.
Full textAbstract:
Automating processes reduces human workload, particularly in software testing, where automation enhances quality and efficiency. Behavior-driven development (BDD) focuses on software behavior to define and validate required functionalities, using tools to translate functional requirements into automated tests. However, creating BDD scenarios and associated test data inputs is timeconsuming and heavily reliant on a good input data set. Large Language Models (LLMs) such as Microsoft’s Copilot, OpenAI’s ChatGPT-3.5, ChatGPT-4, and Google’s Gemini offer potential solutions by automating test data generation. This study evaluates these LLMs’ ability to understand BDD scenarios and generate corresponding test data across five scenarios ranked by complexity. It assesses the LLMs’ learning, assertiveness, response structuring, quality, representativeness, and coverage of the generated test data. The results indicate that ChatGPT-4 and Gemini stand out as the best tools that met our expectations, showing promise for advancing the automation of test data generation from BDD scenarios.
7
Arcaini, Paolo, Angelo Gargantini, and Elvinia Riccobene. "Optimizing the automatic test generation by SAT and SMT solving for Boolean expressions." In 2011 26th IEEE/ACM International Conference on Automated Software Engineering (ASE). IEEE, 2011. http://dx.doi.org/10.1109/ase.2011.6100079.
Full text
8
Xu, John, and John Morris. "Procedural Generation in 2D Metroidvania Game with Answer Set Programming." In 13th International Conference on Computer Science, Engineering and Applications (CCSEA 2023). Academy and Industry Research Collaboration Center (AIRCC), 2023. http://dx.doi.org/10.5121/csit.2023.130511.
Full textAbstract:
Video game designers often find themselves at a crossroad when designing levels; namely, many have a difficult time balancing the amount of control they want to have over what their levels look like [1]. If too little control is given, like in the case of pure perlin-noise generation, levels can end up with too much variation and unideal generations [2]. Softlock is an example of unideal generation in the case of metroidvania games, if the placement of keys cannot be easily controlled and end up being placed behind gates, the players can get permanently stuck [3]. Developers may usually hand-make all levels in order to try and prevent this from happening, however they risk spending too much effort and time on designing levels, resulting in a general lack of quantity in levels. Objectively speaking, both methods have their strengths and work well in specific genres of games, but limiting oneself to the boundaries of these methods does not fundamentally achieve both quantity and accuracy. This paper proposes an unique solution to this dilemma, providing automated generation of levels while also giving developers much more control over the overall output. Our method uses Answer Set Programming (ASP) to verify generation based on restrictions we place, guaranteeing the outcome to be what we want [4]. To demonstrate our method, we applied our solution to a 2D metroidvania game made in the Unity game engine and conducted quantitative tests to assess how well our method works as a level generator [5].
9
Greenberg, Rebecca A., and Jeremy J. Dawkins. "Automated Scene Generation for High Fidelity Robotics Simulations." In ASME 2016 Dynamic Systems and Control Conference. American Society of Mechanical Engineers, 2016. http://dx.doi.org/10.1115/dscc2016-9635.
Full textAbstract:
This paper presents a methodology for automatically generating a scene to be used in high fidelity robotic simulators. Modeling and simulation play an important role in the development and testing of robotic motion planning algorithms. Virtual Robotic Experimentation Platform (V-REP) is a robotic simulator that can be used to test state of the art robotics algorithms in environments called scenes. V-REP contains a remote application programming interface (API) for Matlab that allows for control of the simulation from the external application. Using this functionality, an algorithm was developed to automatically create simulation environments. Given the dimensions of the space, the desired total number of rooms, and a room configuration type, the algorithm organizes the layout of the space into a set of rooms and hallways. Using the remote capabilities provided by the Matlab V-REP API, the scene is opened, each of the models is loaded, and the models are put into the appropriate location. The result is a saved V-REP scene file that can be used for testing of any relevant mobile robotic applications. Ultimately this tool can play an important role in running parametric studies and Monte Carlo simulations to test the performance of various motion planning and coordination algorithms.
10
Coles, Mary, Lewis Flanagin, Ben Rathsack, Steve Prins, and James Blatchford. "Accurate OPC model generation through use of a streamlined data flow incorporating automated test-structure layout and CD-SEM recipe generation." In SPIE 31st International Symposium on Advanced Lithography, edited by Alfred K. K. Wong and Vivek K. Singh. SPIE, 2006. http://dx.doi.org/10.1117/12.660600.
Full textReports on the topic "Automated test set generation"
1
Burstein, Jill, Geoffrey LaFlair, Antony Kunnan, and Alina von Davier. A Theoretical Assessment Ecosystem for a Digital-First Assessment - The Duolingo English Test. Duolingo, 2022. http://dx.doi.org/10.46999/kiqf4328.
Full textAbstract:
The Duolingo English Test is a groundbreaking, digitalfirst, computeradaptive measure of English language proficiency for communication and use in Englishmedium settings. The test measures four key English language proficiency constructs: Speaking, Writing, Reading, and Listening (SWRL), and is aligned with the Common European Framework of Reference for Languages (CEFR) proficiency levels and descriptors. As a digitalfirst assessment, the test uses “humanintheloop AI” from end to end for test security, automated item generation, and scoring of testtaker responses. This paper presents a novel theoretical assessment ecosystem for the Duolingo English Test. It is a theoretical representation of language assessment design, measurement, and test security processes, as well as the testtaker experience factors that contribute to the test validity argument and test impact. The test validity argument is constructed with a digitallyinformed chain of inferences that addresses digital affordances applied to the test. The ecosystem is composed of an integrated set of complex frameworks: (1) the Language Assessment Design Framework, (2) the Expanded EvidenceCentered Design Framework, (3) the Computational Psychometrics Framework, and (4) the Test Security Framework. Testtaker experience (TTX) is a test priority throughout the testtaking pipeline, such as low cost, anytime/anywhere, and shorter testing time. The test’s expected impact is aligned with Duolingo’s social mission to lower barriers to education access and offer a secure and delightful test experience, while providing a valid, fair, and reliable test score. The ecosystem leverages principles from assessment theory, computational psychometrics, design, data science, language assessment theory, NLP/AI, and test security.
2
Haas, Robert, and Fred Suzuki. Automated Test Requirement Document Generation. Defense Technical Information Center, 1987. http://dx.doi.org/10.21236/ada195495.
Full text
3
Chalmers, Seth. The Challenges of Next-gen ADAS and ADS and Related Vehicle Safety Topics. SAE International, 2025. https://doi.org/10.4271/epr2025003.
Full textAbstract:
<div class="section abstract"><div class="htmlview paragraph">Advanced driver assistance systems (ADAS) and automated driving systems (ADS) continue to expand into the market at a rapid pace. As improved (i.e., next generation) versions of these systems become available, they will continue to face many challenges in their implementation and benefits for safety and driving operations. The solution will involve many parties, including road safety professionals and researchers who see the potential in these systems but may have difficulties keeping up with them, and safety advocates who are calling for these systems to achieve higher levels of safety now.</div><div class="htmlview paragraph"><b>The Challenges of Next-gen ADAS and ADS and Related Vehicle Safety Topics</b> explores these challenges that will fall on the National Highway Traffic Safety Administration (NHTSA) and automakers as they balance costs and benefits; establish reasonable regulations and standards; and determine how to improve, test, deliver, and use these systems successfully. Perhaps the most formidable challenge will be overcoming the expectation that ADAS—and especially ADS—will always work perfectly in every scenario.</div><div class="htmlview paragraph"><a href="https://www.sae.org/publications/edge-research-reports" target="_blank">Click here to access the full SAE EDGE</a><sup>TM</sup><a href="https://www.sae.org/publications/edge-research-reports" target="_blank"> Research Report portfolio.</a></div></div>
4
Park, Yena, Geoffrey LaFlair, Yigal Attali, Andrew Runge, and Sarah Goodwin. Interactive Reading - The Duolingo English Test. Duolingo, 2022. http://dx.doi.org/10.46999/rcxb1889.
Full textAbstract:
This paper introduces a new item type on the Duolingo English Test called Interactive Reading and grounds the item within the Duolingo English Test’s theoretical language assessment design framework and its assessment ecosystem. The innovative response format and automated item generation methods contribute to the specification of the construct of L2 reading, thereby strengthening the validity claims of the Duolingo English Test.
5
LaFlair, Geoffrey, Andrew Runge, Yigal Attali, Yena Park, Jacqueline Church, and Sarah Goodwin. Interactive Listening - The Duolingo English Test. Duolingo, 2023. http://dx.doi.org/10.46999/egei3342.
Full textAbstract:
This paper introduces a new integrated task type on the Duolingo English Test called Interactive Listening and grounds the task within the Duolingo English Test’s theoretical language assessment design framework and its assessment ecosystem. The task and automated item generation methods contribute to measurement of the constructs of L2 listening, reading, and writing, thereby strengthening the validity claims of the Duolingo English Test.
6
Park, Yena, Ramsey Cardwell, Sarah Goodwin, et al. Assessing Speaking on the Duolingo English Test. Duolingo, 2023. http://dx.doi.org/10.46999/djiy3654.
Full textAbstract:
This paper presents the Duolingo English Test’s speaking construct, situated within the Duolingo English Test assessment ecosystem (Burstein et al., 2022). We describe how the Duolingo English Test defines, operationalizes, and measures speaking through various speaking-related item types. The operationalization and measurement of the speaking construct includes the item-type design process and automated item generation processes.
7
Wang and Zhou. L52334 Curved Wide Plate Test Results and Transferability of Test Specimens. Pipeline Research Council International, Inc. (PRCI), 2011. http://dx.doi.org/10.55274/r0010008.
Full textAbstract:
The work described in this report focuses on the development of data processing routines for curved-wide-plate (CWP) tests, the presentation of test results in a consistent and unified format, generation of fracture resistance curves from, and the examination of transferability between CWP and SENT (single-edge-notched tension) test specimens. The results of this work can be used for: Drafting and implementing consistent test procedures for CWP tests, Formulating test data for consistent presentation and comparison, Understanding the differences and limitations of test specimens of different scales, Making the best selection of test specimens for a given set of objectives, and Making correct interpretation of test data and their relevance to girth weld performance.
8
Lasko, Kristofer, Francis O’Neill, and Elena Sava. Automated mapping of land cover type within international heterogenous landscapes using Sentinel-2 imagery with ancillary geospatial data. Engineer Research and Development Center (U.S.), 2024. http://dx.doi.org/10.21079/11681/49367.
Full textAbstract:
A near-global framework for automated training data generation and land cover classification using shallow machine learning with low-density time series imagery does not exist. This study presents a methodology to map nine-class, six-class, and five-class land cover using two dates of a Sentinel-2 granule across seven international sites. The approach uses a series of spectral, textural, and distance decision functions combined with modified ancillary layers to create binary masks from which to generate a balanced set of training data applied to a random forest classifier. For the land cover masks, stepwise threshold adjustments were applied to reflectance, spectral index values, and Euclidean distance layers, with 62 combinations evaluated. Global and regional adaptive thresholds were computed. An annual 95th and 5th percentile NDVI composite was used to provide temporal corrections to the decision functions, and these corrections were compared against the original model. The accuracy assessment found that the regional adaptive thresholds for both the two-date land cover and the temporally corrected land cover could accurately map land cover type within nine-class, six-class, and five-class schemes. Lastly, the five-class and six-class models were compared with a manually labeled deep learning model (Esri), where they performed with similar accuracies. The results highlight performance in line with an intensive deep learning approach, and reasonably accurate models created without a full annual time series of imagery.
9
Martinez, Kimberly D., and Gaojian Huang. Exploring the Effects of Meaningful Tactile Display on Perception and Preference in Automated Vehicles. Mineta Transportation Institute, 2022. http://dx.doi.org/10.31979/mti.2022.2164.
Full textAbstract:
There is an existing issue in human-machine interaction, such that drivers of semi-autonomous vehicles are still required to take over control of the vehicle during system limitations. A possible solution may lie in tactile displays, which can present status, direction, and position information while avoiding sensory (e.g., visual and auditory) channels overload to reliably help drivers make timely decisions and execute actions to successfully take over. However, limited work has investigated the effects of meaningful tactile signals on takeover performance. This study synthesizes literature investigating the effects of tactile displays on takeover performance in automated vehicles and conducts a human-subject study to design and test the effects of six meaningful tactile signal types and two pattern durations on drivers’ perception and performance during automated driving. The research team performed a literature review of 18 articles that conducted human-subjects experiments on takeover performance utilizing tactile displays as takeover requests. Takeover performance in these studies were highlighted, such as response times, workload, and accuracy. The team then conducted a human-subject experiment, which included 16 participants that used a driving simulator to present 30 meaningful vibrotactile signals, randomly across four driving sessions measuring for reaction times (RTs), interpretation accuracy, and subjective ratings. Results from the literature suggest that tactile displays can present meaningful vibrotactile patterns via various in-vehicle locations to help improve drivers’ performance during the takeover and can be used to assist in the design of human-machine interfaces (HMI) for automated vehicles. The experiment yielded results illustrating higher urgency patterns were associated with shorter RTs and higher intuitive ratings. Also, pedestrian status and headway reduction signals presented shorter RTs and increased confidence ratings compared to other tactile signal types. Finally, the signal types that yielded the highest accuracy were the surrounding vehicle and navigation signal types. Implications of these findings may lie in informing the design of next-generation in-vehicle HMIs and future human factors studies on human-automation interactions.
10
O'Neill, Francis, Kristofer Lasko, and Elena Sava. Snow-covered region improvements to a support vector machine-based semi-automated land cover mapping decision support tool. Engineer Research and Development Center (U.S.), 2022. http://dx.doi.org/10.21079/11681/45842.
Full textAbstract:
This work builds on the original semi-automated land cover mapping algorithm and quantifies improvements to class accuracy, analyzes the results, and conducts a more in-depth accuracy assessment in conjunction with test sites and the National Land Cover Database (NLCD). This algorithm uses support vector machines trained on data collected across the continental United States to generate a pre-trained model for inclusion into a decision support tool within ArcGIS Pro. Version 2 includes an additional snow cover class and accounts for snow cover effects within the other land cover classes. Overall accuracy across the continental United States for Version 2 is 75% on snow-covered pixels and 69% on snow-free pixels, versus 16% and 66% for Version 1. However, combining the “crop” and “low vegetation” classes improves these values to 86% for snow and 83% for snow-free, compared to 19% and 83% for Version 1. This merging is justified by their spectral similarity, the difference between crop and low vegetation falling closer to land use than land cover. The Version 2 tool is built into a Python-based ArcGIS toolbox, allowing users to leverage the pre-trained model—along with image splitting and parallel processing techniques—for their land cover type map generation needs.