ISO 25062:2025 — Common Industry Format for Usability Testing

Standardized Methods for Reporting Software Usability Test Results with the CIF Framework

ISO 25062:2025, formerly known as ISO/IEC 25062, defines the Common Industry Format (CIF) for usability testing reports. It establishes a standardized structure for reporting the methodology, results, and contextual information of software usability tests. By providing a consistent reporting format, ISO 25062 enables organizations to compare usability findings across products, vendors, and development cycles, transforming usability from a subjective art into an objective engineering discipline.

ISO 25062 is part of the SQuaRE 2504n evaluation division. It is designed to be used with ISO 9241-11 (usability definitions) and ISO 25066 (usability evaluation report format). The CIF format ensures that usability test results are reproducible, comparable, and auditable.

Understanding the Common Industry Format for Usability Reports

The Common Industry Format (CIF) specified in ISO 25062:2025 is much more than a report template; it is a structured data model for usability evidence. The CIF requires explicit documentation of: the test participant profile (including demographic and experience characteristics), the test environment and equipment used, the tasks performed by participants, the experimental design (within-subjects or between-subjects), the specific usability metrics collected, and the raw data or summary statistics for each metric.

The 2025 revision modernizes the CIF to address contemporary usability evaluation contexts, including remote unmoderated testing, mobile application usability, and accessibility evaluation for users with disabilities. Earlier editions (dating back to the original 2006 version) were heavily oriented toward laboratory-based, moderated testing of desktop applications. The 2025 edition recognizes that modern usability testing spans multiple paradigms and that the CIF must accommodate these variations while maintaining comparability.

Usability MetricDefinitionData Collection MethodCIF Reporting Requirement
Task Success RatePercentage of tasks completed without critical errorsAutomated logging or observer recordingMean, standard deviation, and confidence interval
Time on TaskTime from task start to successful completionScreen recording timestamp analysisMean, median, and 95th percentile
Error RateNumber of errors per task attemptManual error coding from session recordingsError frequency distribution and severity classification
Satisfaction ScoreStandardized post-task questionnaire (e.g., SUS, ASQ)Participant self-report via survey toolMean score with normative benchmark comparison
EfficiencyTask success per unit timeDerived from task success and time dataEfficiency score with time-based breakdown

Engineering Design Insights for Usability Test Reporting

From an engineering design perspective, ISO 25062:2025 introduces the critical concept of contextual completeness. A usability metric reported without its context — user profile, task scenario, environmental conditions — is essentially meaningless for comparative purposes. The CIF mandates a minimum set of contextual attributes that must accompany any reported metric, ensuring that results can be properly interpreted and potentially reproduced by other evaluators.

Adopting the ISO 25062 CIF across an organization creates a cumulative usability knowledge base. After three or more test cycles using the CIF, teams can begin to identify statistically significant trends in usability metrics, moving from anecdotal observations to evidence-based UX decision-making.

The standard also provides detailed guidance on statistical reporting rigor. For each usability metric, the CIF requires: (a) the central tendency measure (mean or median), (b) dispersion measure (standard deviation, interquartile range, or confidence interval), (c) sample size, and (d) the specific formula or algorithm used to compute the metric. The 2025 edition adds guidance on Bayesian approaches for small-sample usability studies, which are common in practice but traditionally difficult to analyze with frequentist statistics alone.

Another key engineering insight is the comparability precondition. ISO 25062:2025 defines conditions under which usability test results from different studies can be meaningfully compared: identical metrics definitions, equivalent task difficulty calibration, and overlapping participant demographics. Without meeting these preconditions, quantitative comparisons between studies are statistically invalid — a common mistake in vendor benchmark comparisons.

Practical Implementation: Creating an ISO 25062-Compliant Report

Implementing ISO 25062 in practice involves structuring usability evaluation reports around the CIF’s seven mandatory sections: (1) Executive Summary, (2) Product Description, (3) Test Objectives, (4) Participant Profile, (5) Test Design and Methodology, (6) Results, and (7) Appendices containing raw data and detailed analysis. Organizations can create CIF templates in their preferred documentation platform (Confluence, SharePoint, LaTeX, or markdown) and populate sections from automated testing tools where possible.

One of the most frequently violated CIF requirements is the documentation of participant exclusions and missing data handling. ISO 25062 requires explicit reporting of how many participants were recruited, how many completed the study, how many were excluded (and why), and how missing data points were treated in the analysis. Failure to document this undermines the credibility of the entire usability report.

When planning a usability test under ISO 25062, one of the most critical decisions is participant sampling. The standard provides guidance on determining appropriate sample sizes based on the expected effect size, desired statistical power, and the heterogeneity of the target user population. For formative usability testing aimed at identifying interface problems, the standard notes that 5-8 participants per user segment can typically uncover 80% or more of usability issues, consistent with Nielsen’s seminal findings. For summative testing where statistical comparison against benchmarks is required, larger samples of 20-30 participants per segment may be necessary to achieve adequate statistical power.

Q1: Is ISO 25062 applicable to agile UX research?
A: Yes. The CIF format can be scaled for agile sprints by using a lightweight version focusing on the three core metrics (task success, time on task, satisfaction) while still maintaining the CIF contextual completeness requirements.
Q2: How does ISO 25062 relate to ISO 9241?
A: ISO 9241-11 defines the conceptual framework of usability (effectiveness, efficiency, satisfaction), while ISO 25062 provides the operational reporting format for usability test results. They are complementary standards within the broader usability engineering landscape.
Q3: What software tools support ISO 25062 CIF generation?
A: Specialized UX research tools like UserZoom, UserTesting, and Morae can export results in CIF-compatible formats. General tools like R and Python with UX research libraries can also generate CIF-structured reports programmatically.
Q4: What changed in the 2025 revision for remote testing?
A: The 2025 edition adds specific guidance for remote unmoderated testing, including requirements for documenting technology-mediated observation, automated data quality screening, and handling of participant attrition in unsupervised settings.

📥 Standard Documents Download

🔒
Please wait 10 seconds, the download links will appear after the ad loads

Leave a Reply

Your email address will not be published. Required fields are marked *