Physical Address
304 North Cardinal St.
Dorchester Center, MA 02124
Physical Address
304 North Cardinal St.
Dorchester Center, MA 02124
ISO 25062:2025, formerly known as ISO/IEC 25062, defines the Common Industry Format (CIF) for usability testing reports. It establishes a standardized structure for reporting the methodology, results, and contextual information of software usability tests. By providing a consistent reporting format, ISO 25062 enables organizations to compare usability findings across products, vendors, and development cycles, transforming usability from a subjective art into an objective engineering discipline.
The Common Industry Format (CIF) specified in ISO 25062:2025 is much more than a report template; it is a structured data model for usability evidence. The CIF requires explicit documentation of: the test participant profile (including demographic and experience characteristics), the test environment and equipment used, the tasks performed by participants, the experimental design (within-subjects or between-subjects), the specific usability metrics collected, and the raw data or summary statistics for each metric.
The 2025 revision modernizes the CIF to address contemporary usability evaluation contexts, including remote unmoderated testing, mobile application usability, and accessibility evaluation for users with disabilities. Earlier editions (dating back to the original 2006 version) were heavily oriented toward laboratory-based, moderated testing of desktop applications. The 2025 edition recognizes that modern usability testing spans multiple paradigms and that the CIF must accommodate these variations while maintaining comparability.
| Usability Metric | Definition | Data Collection Method | CIF Reporting Requirement |
|---|---|---|---|
| Task Success Rate | Percentage of tasks completed without critical errors | Automated logging or observer recording | Mean, standard deviation, and confidence interval |
| Time on Task | Time from task start to successful completion | Screen recording timestamp analysis | Mean, median, and 95th percentile |
| Error Rate | Number of errors per task attempt | Manual error coding from session recordings | Error frequency distribution and severity classification |
| Satisfaction Score | Standardized post-task questionnaire (e.g., SUS, ASQ) | Participant self-report via survey tool | Mean score with normative benchmark comparison |
| Efficiency | Task success per unit time | Derived from task success and time data | Efficiency score with time-based breakdown |
From an engineering design perspective, ISO 25062:2025 introduces the critical concept of contextual completeness. A usability metric reported without its context — user profile, task scenario, environmental conditions — is essentially meaningless for comparative purposes. The CIF mandates a minimum set of contextual attributes that must accompany any reported metric, ensuring that results can be properly interpreted and potentially reproduced by other evaluators.
The standard also provides detailed guidance on statistical reporting rigor. For each usability metric, the CIF requires: (a) the central tendency measure (mean or median), (b) dispersion measure (standard deviation, interquartile range, or confidence interval), (c) sample size, and (d) the specific formula or algorithm used to compute the metric. The 2025 edition adds guidance on Bayesian approaches for small-sample usability studies, which are common in practice but traditionally difficult to analyze with frequentist statistics alone.
Another key engineering insight is the comparability precondition. ISO 25062:2025 defines conditions under which usability test results from different studies can be meaningfully compared: identical metrics definitions, equivalent task difficulty calibration, and overlapping participant demographics. Without meeting these preconditions, quantitative comparisons between studies are statistically invalid — a common mistake in vendor benchmark comparisons.
Implementing ISO 25062 in practice involves structuring usability evaluation reports around the CIF’s seven mandatory sections: (1) Executive Summary, (2) Product Description, (3) Test Objectives, (4) Participant Profile, (5) Test Design and Methodology, (6) Results, and (7) Appendices containing raw data and detailed analysis. Organizations can create CIF templates in their preferred documentation platform (Confluence, SharePoint, LaTeX, or markdown) and populate sections from automated testing tools where possible.
When planning a usability test under ISO 25062, one of the most critical decisions is participant sampling. The standard provides guidance on determining appropriate sample sizes based on the expected effect size, desired statistical power, and the heterogeneity of the target user population. For formative usability testing aimed at identifying interface problems, the standard notes that 5-8 participants per user segment can typically uncover 80% or more of usability issues, consistent with Nielsen’s seminal findings. For summative testing where statistical comparison against benchmarks is required, larger samples of 20-30 participants per segment may be necessary to achieve adequate statistical power.