Physical Address
304 North Cardinal St.
Dorchester Center, MA 02124
IEC TR 62970:2016 — Guide for Round Robin Testing of Household Electrical Appliances
IEC TR 62970:2016 is a Technical Report that provides comprehensive guidance on the planning, execution, and statistical analysis of round robin tests (interlaboratory comparisons) for household and similar electrical appliances. Published by IEC Technical Committee 59, this document addresses a critical gap in the quality assurance ecosystem: ensuring that test results for appliance performance, safety, and energy efficiency are comparable across different laboratories worldwide.
💡 Key Insight: Round robin tests are the backbone of laboratory accreditation under ISO/IEC 17025. Without standardized protocols, interlaboratory variability in appliance testing can exceed 20%, undermining consumer confidence and regulatory enforcement.
🎯 Purpose and Importance of Round Robin Testing
Round robin testing — also known as interlaboratory comparison or proficiency testing — involves multiple laboratories measuring the same parameters on identical test samples under predefined conditions. The primary objectives are:
The IEC TR 62970 provides a framework specifically adapted to the unique challenges of household appliance testing, where parameters such as energy consumption, noise emission, temperature rise, and wash/dry performance can be influenced by subtle differences in test setup, environmental conditions, and operator technique.
⚠️ Critical Consideration: Appliance testing is inherently more variable than pure materials testing. Factors such as water hardness (for washing machines), ambient temperature (for refrigeration), and voltage waveform harmonics significantly influence results. The TR emphasizes controlling these variables through detailed test protocols.
🔧 Organizing a Round Robin Test — Step by Step
| Phase | Activity | Key Deliverable | Typical Duration |
|---|---|---|---|
| 1. Planning | Define scope, select parameters, recruit participants | Test protocol document | 4–8 weeks |
| 2. Sample Preparation | Select/condition identical test samples, verify homogeneity | Homogeneity report | 2–4 weeks |
| 3. Sample Distribution | Ship samples with handling instructions, monitor transport | Shipping log | 1–2 weeks |
| 4. Testing Phase | Participants execute tests, submit raw data and reports | Individual test reports | 4–12 weeks |
| 5. Statistical Analysis | Compute mean, SD, repeatability, reproducibility, z-scores | Statistical evaluation | 2–4 weeks |
| 6. Reporting | Draft final report, identify outliers, recommend actions | Final round robin report | 2–4 weeks |
📈 Statistical Evaluation Methods
🎲 Key Metrics Defined in the Standard
The TR describes the following statistical measures in detail:
Repeatability (r): The value below which the absolute difference between two single test results obtained under repeatability conditions (same lab, same operator, same equipment) may be expected to lie with a 95% probability. For most household appliance tests, r is typically 5%–10% of the measured value.
Reproducibility (R): The value below which the absolute difference between two single test results obtained under reproducibility conditions (different labs, different operators) may be expected to lie with a 95% probability. R values for appliance tests often range from 10% to 25% of the measured value.
z-score: A normalized performance statistic calculated as (xi − Xref) / σpt, where |z| ≤ 2 indicates satisfactory performance, 2 < |z| < 3 indicates questionable performance, and |z| ≥ 3 indicates unsatisfactory performance.
✅ Best Practice: The TR recommends a minimum of 8 participating laboratories for statistically meaningful results. For energy efficiency testing (e.g., IEC 60436 dishwashers), 12–15 labs are recommended due to the higher inherent variability of energy consumption measurements.
⚙️ Engineering Insights for Practitioners
🏖 Sample Homogeneity Is Paramount
One of the most critical — and often underestimated — aspects highlighted in IEC TR 62970 is sample homogeneity verification. Before distribution, a minimum of 10% of the test samples (or at least 10 units) must be tested under repeatability conditions to ensure that any interlaboratory variation is due to laboratory differences rather than sample-to-sample variation. For appliances, this is especially challenging because individual units of the same model can show genuine performance differences due to manufacturing tolerances.
🏁 Temperature and Environmental Control
The TR dedicates significant attention to environmental conditioning. Household appliance tests are highly sensitive to ambient conditions: a 1 °C rise in ambient temperature can increase refrigerator energy consumption by approximately 2%–3%. The standard recommends that all participating laboratories calibrate their environmental chambers and data loggers before commencing the round robin.
🚨 Common Pitfall: Failure to properly stabilize test samples at the specified conditioning environment (typically 23 °C ± 2 °C, 50% ± 5% RH) is the single largest source of interlaboratory variation in appliance round robin tests. Allow a minimum of 24 hours stabilization time.
📜 FAQ
❓ How many laboratories are needed for a meaningful round robin test?
IEC TR 62970 recommends a minimum of 8 laboratories. Fewer than 6 participants makes statistical evaluation unreliable, particularly for outlier detection using Grubbs’ or Cochran’s tests. For international standards development, 15–20 laboratories is typical to ensure global representativeness.
❓ What statistical methods are used for outlier detection?
The TR recommends using Grubbs’ test for detecting univariate outliers (one extreme value in a data set), Cochran’s test for identifying laboratories with excessively high variance, and Mandel’s h and k statistics for graphical analysis of interlaboratory consistency. These methods are described in detail in ISO 5725-2.
❓ Can round robin results be used for product certification?
Round robin tests themselves do not certify products — they assess laboratory competence. However, a laboratory’s satisfactory performance in relevant round robin tests is a prerequisite for ISO/IEC 17025 accreditation, which is itself required for many product certification schemes (e.g., IECEE CB Scheme for electrical appliances).
❓ How is the assigned value (reference value) determined?
The TR describes three approaches: (1) consensus value from participant results (most common), (2) value determined by a reference laboratory using a certified reference method, and (3) theoretical value based on calculation or specification. The consensus approach, using the robust mean per Algorithm A of ISO 13528, is preferred for appliance testing as it minimizes the influence of outliers.
