Mean dependency length — a new metric for requirements quality

• Published in: INCOSE International Symposium Vol. 34; no. 1; pp. 1021 - 1035
• Main Authors: Barbosa, Leonardo de Mello, de Oliveira, Igor Cardozo Amaral, Cerqueira, Christopher Shneider, da Cunha, Antonio Eduardo Carrilho
• Format: Journal Article
• Language: English
• Published: 01-07-2024
• Subjects: dependency grammar; natural language requirements; Requirements quality metrics
• ISSN: 2334-5837; 2334-5837
• DOI: 10.1002/iis2.13193

This paper proposes the mean dependency length (MDL) as a metric for measuring natural language requirements quality. Dependency length is a linguistic feature based on dependency grammar, which natural language researchers have traditionally used to evaluate syntactic complexity in other contexts. In this study, aided by MATLAB‐based algorithms, the authors assessed MDL over a requirements set composed of 249 original statements, rephrased into five pattern systems. Null hypothesis and effect size testings revealed that MDL is sensitive to the application of pattern rules and to the differences among the patterns, both in an absolute approach and in comparison with other metrics. Furthermore, it was also demonstrated that MDL is aligned with users' values, especially for understandability issues, and can be measured automatically. Finally, the work concluded that MDL is a convenient metric for assessing the quality of natural language requirements.