Physical Address
304 North Cardinal St.
Dorchester Center, MA 02124
Physical Address
304 North Cardinal St.
Dorchester Center, MA 02124
ISO/IEC 25019:2023 defines a comprehensive quality-in-use model that extends far beyond traditional usability evaluation. Unlike earlier standards that focused primarily on direct user interaction, this model recognizes that information systems and IT services affect and influence a much broader set of stakeholders, including organizations and society at large. The standard introduces three fundamental quality characteristics: beneficialness, freedom from risk, and acceptability, each with precisely defined sub-characteristics.
The quality-in-use model marks a significant evolution from ISO/IEC 25010:2011, which primarily addressed effectiveness, efficiency, and satisfaction from a direct-user perspective. The new model expands the scope to encompass economic, environmental, societal, and health-related risks, as well as experiential and trust-related acceptability factors. This reflects the growing recognition that software quality cannot be assessed in isolation but must be understood within the broader context of use.
Beneficialness captures the extent of benefit resulting from system use. It comprises three sub-characteristics: usability (effectiveness, efficiency, satisfaction), accessibility (usability for people with the widest range of capabilities), and suitability (alignment of behavior with specified quality requirements). A well-designed drone delivery system, for example, must be easy for operators to control (usability), accessible from multiple locations (accessibility), and capable of successfully completing deliveries under varying conditions (suitability).
This characteristic addresses the mitigation of potential risks across four dimensions: economic risk (financial loss, reputation damage), environmental and societal risk (ecological impact, community disruption), health risk (physical well-being), and human life risk (life-safety). The standard emphasizes that risk monitoring is as important as risk mitigation, particularly for information systems whose influence extends to broad stakeholder groups.
Acceptability encompasses experience (knowledge and skill accumulation over time), trustworthiness (confidence that expectations are met in verifiable ways), and compliance (adherence to rules, regulations, and laws). For AI-driven systems, trustworthiness is especially critical, requiring transparency, accountability, and verifiable behavior even when systems operate autonomously or employ machine learning.
| Quality Characteristic | Sub-Characteristics | Primary Stakeholder Concern |
|---|---|---|
| Beneficialness | Usability, Accessibility, Suitability | Achieving intended goals effectively |
| Freedom from Risk | Economic, Environmental/Societal, Health, Human Life | Mitigating negative consequences |
| Acceptability | Experience, Trustworthiness, Compliance | Building confidence and ensuring compliance |
From an engineering perspective, ISO/IEC 25019 provides a structured framework for specifying, measuring, evaluating, and improving quality-in-use throughout the system lifecycle. The standard emphasizes that context of use is a prerequisite for quality-in-use evaluation. When context changes, the system must adapt, and quality-in-use must be re-evaluated against the new context. This has profound implications for DevOps and continuous deployment practices.
The standard provides detailed annexes with practical examples spanning electric power supply, self-driving buses, retail systems, banking, healthcare, enterprise procurement, and university lecture management. Each example demonstrates how the three quality characteristics map to operator, customer, organization, and society concerns. For instance, in a self-driving bus system, beneficialness for passengers includes ease of use and on-time performance, freedom from risk addresses fall prevention and accident avoidance, and acceptability encompasses trust in autonomous operation and regulatory compliance.