15 papers · ranked by Valyu relevance
Pablo Valle, Shaukat Ali, Aitor Arrieta
Simulation-based testing is widely used to validate Cyber-Physical Systems (CPSs), yet modern CPS simulators frequently exhibit non-deterministic (flaky) behavior, making failures difficult to reproduce and debug. Although delta debugging has proven effective for deterministic systems, its underlying assumptions do not…
Mingyue Jiang, Yongqiang Tian, Tsong Yueh Chen
Delta debugging provides an automatic way to minimize a program input while preserving a certain property. However, its effectiveness fundamentally relies on the availability of test oracles to determine whether a reduced input still preserves the specific property. Consequently, the oracle problem substantially limits…
Yongding Tao, Jingling Xue
Delta debugging assumes search space monotonicity: if a program causes a failure, any supersets of that program will also induce the same failure, permitting the exclusion of subsets of non-failureinducing programs. However, this assumption does not always hold in practice. This paper introduces Probabilistic…
Qinyan Zhou, Peixin Zhang, Jun Sun, Haonan Zhang + 1 more
While safety alignment and guardrails help large language models (LLMs) avoid harmful outputs, they can also induce overrefusal, i.e., unwarranted rejection of benign queries that merely appear risky. We present DDOR (Delta Debugging for OverRefusal), a fully automated and explainable framework for overrefusal testing…
Zhou, Xintong, Zhenyang Xu, Mengxiao Zhang + 2 more
—Delta Debugging is a widely used family of algorithms (e.g., ddmin and ProbDD) to automatically minimize bugtriggering test inputs, thus to facilitate debugging. It takes a list of elements with each element representing a fragment of the test input, systematically partitions the list at different granularities…
Raya Elsaleh, Guy Katz
—Deep neural networks (DNNs) are becoming a key component in diverse systems across the board. However, despite their success, they often err miserably; and this has triggered significant interest in formally verifying them. Unfortunately, DNN verifiers are intricate tools, and are themselves susceptible to soundness…
Dániel Vince, Renáta Hodován, Daniella Bársony, Ákos Kiss
—Minimizing failing test cases is an important preprocessing step on the path of debugging. If much of a test case that triggered a bug does not contribute to the actual failure, then the time required to fix the bug can increase considerably. However, test case reduction itself can be a time consuming task, especially…
Alexander Hoen, Dominik Kamp, Ambros Gleixner
The recent performance improvements in mixed-integer programming (MIP) went along with a significantly increased complexity of the codes of MIP solvers, which poses challenges in fixing implementation errors. In this paper, we introduce MIP-DD, a solver-independent tool, which is, to the best of our knowledge, the…
Charaka Geethal Kapugama
—This paper introduces DDMIN-LOC, a technique that combines Delta Debugging Minimization (DDMIN) with Spectrum-Based Fault Localization (SBFL). It can be applied to programs taking string inputs, even when only a single failure-inducing input is available. DDMIN is an algorithm that systematically explores the minimal…
Pablo Morcelle del Valle, Aitor Arrieta, Maite Arratibel
Elevator systems are one kind of Cyber-Physical Systems (CPSs), and as such, test cases are usually complex and long in time. This is mainly because realistic test scenarios are employed (e.g., for testing elevator dispatching algorithms, typically a full day of passengers traveling through a system of elevators is…
Luyao Ren, Xing Zhang, Ziyue Hua, Yanyan Jiang + 3 more
'Yingfei Xiong' 'Tao Xie'] Reducing test inputs that trigger bugs is crucial for efficient debugging. Delta debugging is the most popular approach for this purpose. When test inputs need to conform to certain specifications, existing delta debugging practice encounters a validity problem: it blindly applies reduction…
Phillip Entin, Wenchao Gu, Alexander Knapp, Chunyang Chen
COBOL remains critical across banking, insurance, and government infrastructure. However, maintenance is increasingly challenging due to outdated technologies, sparse documentation, and developer retirement, necessitating code translation into modern languages like C. Traditional rule-based transcompilers yield outputs…
Dekel Cohen, Amiram Yehudai
—Regression bugs occur whenever software functionality that previously worked as desired stops working, or no longer works as expected. Code changes, such as bug fixes or new feature work, may result in a regression bug. Regression bugs are an annoying and painful phenomena in the software development process…
Renzo Degiovanni, Facundo Molina, Agustín Nolasco, Nazareno Aguirre + 1 more
'Mike Papadakis'] Abstract—Regression tests are often used to ensure that software behaves as intended, as software evolution takes place. However, tests in general and regression tests in particular are inherently partial as behavioural descriptions, and thus regression tests may fail in clearly capturing how software…
Abdulaziz Alaboudi, Thomas D. LaToza
Many studies have long investigated how developers debug, shaping our understanding of debugging and helping motivate the creation of more effective tools. However, less is known about the typical progression of debugging in real world settings. In this study, we focus on characterizing debugging episodes from the…