14 papers · ranked by Valyu relevance
David Higgins, Christian Johner
The introduction of artificial intelligence / machine learning (AI/ML) products to the regulated fields of pharmaceutical research and development (R&D) and drug manufacture, and medical devices (MD) and in-vitro diagnostics (IVD), poses new regulatory problems: a lack of a common terminology and understanding leads to…
Aleksandr Shefer, Igor Engel, Stanislav Alekseev, Daniil Berezun + 2 more
'Ekaterina Verbitskaia' 'Anton Podkopaev'] Abstract. Although formal methods are capable of producing reliable software, they have seen minimal adoption in everyday programming. Automatic code generation using large language models is becoming increasingly widespread, but it rarely considers producing strong…
Sebastian Stock, Atif Mashkoor, Alexander Egyed
Formal methods play a fundamental role in asserting the correctness of requirements specifications. However, historically, formal method experts have primarily focused on verifying those specifications. Although equally important, validation of requirements specifications often takes the back seat. This paper…
Mario Alviano, Carmine Dodaro, Arnel Zamayla
The development of complex software requires tools promoting fail-fast approaches, so that bugs and unexpected behavior can be quickly identified and fixed. Tools for data validation may save the day of computer programmers. In fact, processing invalid data is a waste of resources at best, and a drama at worst if the…
Sebastian Stock, Fabian Vu, Atif Mashkoor, Michaël Leuschel + 1 more
In the following, we explain various validation techniques, and how they are formalized as validation tasks. There are various validation techniques one can use to validate a requirement. Table 1 contains an overview of VTs we have assembled while conducting or inspecting a variety of case studies. These case studies…
Steven Fraser, P. Silvester
[The original version of this paper initially appeared in the Proceedings of the 1987 IEEE International Conference on Systems, Man, and Cybernetics, October 20-23, 1987, at the Radisson Mark Plaza Hotel in Alexandria, Virginia – and is made available on arXiv with the permission of the IEEE dated Jan 8, 2024…
Hamed Taherkhani, Hadi Hemmati
Large Language Models (LLMs) have demonstrated significant potential in automating software testing, specifically in generating unit test cases. However, the validation of LLM-generated test cases remains a challenge, particularly when the ground truth is unavailable. This paper introduces VALTEST, a novel framework…
Karen Sargsyan
Sequential statistical protocols require meticulous state management and robust error handling—challenges naturally suited to functional programming. We present a functional architecture for structural enforcement of statistical rigor in automated research systems ("AI-Scientists"). These LLM-driven systems risk…
Hongyi Liu, Madhusudan Parthasarathy, Adithya Murali
Formal contracts are essential for software testing and verification, yet writing them remains labor-intensive and error-prone. LLMs offer a promising path toward autoformalization: synthesizing executable assertions from natural-language specifications and thereby bridging the gap between informal developer intent and…
Rumyana Neykova, Derek Groen
Reliable simulations are critical for analyzing and understanding complex systems, but their accuracy depends on correct input data. Incorrect inputs such as invalid or out-of-range values, missing data, and format inconsistencies can cause simulation crashes or unnoticed result distortions, ultimately undermining the…
Hanumanthrao Kannan, Alejandro Salado
This paper presents a formal theory of verification and validation (V&V) within systems engineering, grounded in the axiom that V&V are fundamentally knowledge-building activities. Using dynamic epistemic modal logic, we develop precise definitions of verification and validation, articulating their roles in confirming…
Hieu Huynh, Tri Le, Vu Nguyen, Tien N. Nguyen
In API testing, deriving logical constraints on API response bodies is crucial in generating the test cases to cover various aspects of RESTful APIs. However, existing approaches are limited to dynamic analysis in which constraints are extracted from the execution of APIs as part of the system under test. The key…
José Marcos Gomes, Luis Alberto Vieira Dias
A view on software testing, taken in a broad sense and considered a important activity is presented. We discuss the methods and techniques for applying tests and the reasons we recognize make it difficult for industry to adopt the advances observed in academia. We discuss some advances in the area and briefly point out…
Giovanni Denaro, Luca Guglielmo
—Documenting the functionality of software units with code comments, e.g., Javadoc comments, is a common programmer best-practice in software engineering. This paper introduces a novel test generation technique that exploits the code-comment documentation constructively. We originally address those behaviors as test…