ASHRAE 140: Complete Guide to Standard Method of Test for Building Energy Analysis Computer Programs

ASHRAE Standard 140 provides a method of test for evaluating the technical capabilities and range of applicability of computer programs that calculate the thermal performance of buildings and their HVAC systems. This standard enables validation, comparison, and certification of energy analysis software. Understanding ASHRAE 140 is essential for software developers, energy modelers, and program users.

The standard provides test procedures, analytical verification, empirical validation, and comparative testing methods. It addresses various building types, system configurations, and calculation methods. This comprehensive guide covers test procedures, validation methods, and practical applications.

Introduction to ASHRAE 140

Purpose and Scope

ASHRAE Standard 140 serves multiple functions:

Software Validation:

• Test program capabilities
• Verify calculation accuracy
• Identify limitations
• Ensure reliability

Comparative Testing:

• Compare different programs
• Benchmark performance
• Identify differences
• Understand capabilities

Certification:

• Program certification basis
• Quality assurance
• User confidence
• Regulatory acceptance

Test Categories

Analytical Tests:

• Exact solutions
• Simple geometries
• Known results
• Verification

Comparative Tests:

• Multiple programs
• Standard test cases
• Comparison of results
• Validation

Empirical Tests:

• Measured data
• Real buildings
• Field validation
• Calibration

Test Procedures

Analytical Verification

Purpose:

• Verify fundamental calculations
• Test basic algorithms
• Validate physics
• Ensure correctness

Test Cases:

• Steady-state heat transfer
• Transient heat transfer
• Solar calculations
• Infiltration calculations

Comparative Testing

Standard Test Suites:

• Building envelope tests
• HVAC system tests
• Load calculation tests
• Energy calculation tests

Test Results:

• Comparison reports
• Deviation analysis
• Acceptance criteria
• Documentation

Empirical Validation

Field Testing:

• Real building data
• Measured performance
• Calibration procedures
• Validation metrics

Test Cases

Building Envelope Tests

Test Case 600: Steady-State Heat Loss

Simple one-zone building with steady-state conditions:

Building Description:

• Single zone: 6 m × 6 m × 2.7 m (20 ft × 20 ft × 9 ft)
• Wall U-value: 0.5 W/m²·K (0.088 BTU/hr·ft²·°F)
• Window area: 10 m² (108 ft²), U-value: 3.0 W/m²·K
• Roof U-value: 0.3 W/m²·K
• Floor: Adiabatic

Test Conditions:

• Indoor temperature: 20°C (68°F)
• Outdoor temperature: 0°C (32°F)
• No internal gains
• No solar gains
• No infiltration

Expected Heat Loss:

Gross wall area (perimeter × height) is 64.8 m²; net wall area excludes the 10 m² window opening: 64.8 − 10 = 54.8 m².

Acceptance Criteria:

• Exact match required (±0.1%)
• No tolerance for analytical tests

Test Case 900: Transient Response

Building with thermal mass, transient temperature response:

Building Description:

• Same as Test 600
• Heavy construction (concrete walls)
• Thermal mass: 200 kJ/K

Test Conditions:

• Step change in outdoor temperature
• Indoor temperature response
• Time constant calculation

Expected Response:

Where:

• $\tau$ = Time constant (hours)
• $C$ = Thermal capacity (kJ/K)
• $U$ = Overall U-value (W/m²·K)
• $A$ = Area (m²)

Acceptance Criteria:

• Time constant: ±5%
• Temperature response: ±2%

Test Case 195: Solar Heat Gain

Building with solar radiation:

Building Description:

• South-facing window
• Solar radiation: 800 W/m²
• SHGC: 0.6

Expected Solar Gain:

Acceptance Criteria:

• Solar gain: ±2%
• Time-dependent: ±5%

HVAC System Tests

Test Case 105: Chiller Performance

System Description:

• Water-cooled chiller
• Capacity: 1000 kW (285 tons)
• COP: 5.0
• Part-load ratio: 0.5

Expected Performance:

Where $f(PLR)$ = Part-load efficiency factor

Typical Part-Load Factors:

Acceptance Criteria:

• Full-load COP: ±1%
• Part-load performance: ±5%

Test Case 195: VAV System

System Description:

• Variable air volume system
• Minimum outdoor air: 20%
• Economizer operation
• Fan power: Variable

Expected Fan Power:

Where:

• $P_{fan}$ = Fan power (W)
• $V$ = Airflow rate (m³/s)
• Cubic relationship for variable speed

Acceptance Criteria:

• Fan power: ±5%
• System efficiency: ±3%

Load Calculation Tests

Test Case 600FF: Free Float Temperature

Building Description:

• Same as Test 600
• Internal gains: 2000 W
• Solar gains: Variable
• No HVAC system

Expected Internal Temperature:

Where $Q_{gain}$ = Total heat gains

Acceptance Criteria:

• Temperature: ±0.5°C
• Time-dependent: ±1°C

Test Case 900FF: Free Float with Mass

Building Description:

• Same as Test 900
• Thermal mass included
• Transient response

Expected Response:

• Delayed temperature response
• Reduced peak temperatures
• Time lag calculation

Acceptance Criteria:

• Peak temperature: ±1°C
• Time lag: ±10%

Standard Test Suites

BESTEST (Building Energy Simulation Test)

Test Suite Structure:

Test Case Naming:

• Format: Series-Number (e.g., 600FF, 900FF)
• FF = Free float
• HF = Heating only
• CL = Cooling only

Comparative Test Results

Typical Program Comparison:

Acceptance Criteria:

• Within ±5% of reference
• Documented differences
• Explanation of variations

Validation Criteria

Analytical Verification

Test Requirements:

• Exact solutions available
• Simple geometries
• Known boundary conditions
• No approximations

Acceptance Criteria:

Failure Criteria:

• Deviation > tolerance
• Systematic errors
• Missing features

Comparative Testing

Test Requirements:

• Multiple programs tested
• Standard test cases
• Documented results
• Analysis of differences

Acceptance Criteria:

Typical Variations:

Empirical Validation

Test Requirements:

• Real building data
• Measured performance
• Calibration procedures
• Statistical analysis

Calibration Metrics:

Mean Bias Error (MBE):

Where:

• $C_i$ = Calculated value
• $M_i$ = Measured value
• $n$ = Number of data points

Coefficient of Variation of Root Mean Square Error (CV(RMSE)):

Where $\bar{M}$ = Mean of measured values

Acceptance Criteria:

ASHRAE Guideline 14 Criteria:

• Monthly MBE: ±5%
• Monthly CV(RMSE): 15%
• Hourly MBE: ±10%
• Hourly CV(RMSE): 30%

Test Procedures

Analytical Test Procedure

Step 1: Test Case Setup

1. Define building geometry
2. Specify material properties
3. Set boundary conditions
4. Define initial conditions

Step 2: Calculation

1. Run simulation
2. Extract results
3. Calculate metrics
4. Compare to reference

Step 3: Validation

1. Check tolerance
2. Document results
3. Identify issues
4. Report findings

Comparative Test Procedure

Step 1: Test Suite Selection

1. Select standard test cases
2. Define test matrix
3. Prepare input files
4. Coordinate with participants

Step 2: Program Execution

1. Run all programs
2. Collect results
3. Standardize output format
4. Verify completeness

Step 3: Analysis

1. Compare results
2. Calculate differences
3. Identify patterns
4. Document findings

Step 4: Reporting

1. Prepare comparison tables
2. Create graphs
3. Analyze differences
4. Publish results

Empirical Validation Procedure

Step 1: Data Collection

1. Select test building
2. Install monitoring equipment
3. Collect measured data
4. Verify data quality

Step 2: Model Development

1. Create building model
2. Input measured data
3. Calibrate model
4. Verify calibration

Step 3: Validation

1. Compare calculated to measured
2. Calculate metrics
3. Assess accuracy
4. Document results

Test Case Database

Standard Test Cases

Building Envelope Tests:

HVAC System Tests:

Test Results Database

Typical Test Results:

Software Certification

Certification Process

Requirements:

1. Pass analytical tests
2. Complete comparative tests
3. Demonstrate capabilities
4. Document results

Certification Levels:

Certification Criteria

Analytical Tests:

• 100% pass rate required
• No tolerance for error
• All test cases must pass

Comparative Tests:

• Results within acceptable range
• Documented differences
• Explanation of variations

Empirical Tests:

• Meet calibration criteria
• Statistical validation
• Real building verification

Best Practices

Software Development

Testing Strategy:

• Implement all test cases
• Regular validation
• Continuous improvement
• Version control

Quality Assurance:

• Code review
• Unit testing
• Integration testing
• System testing

Documentation:

• Test procedures
• Results documentation
• User manuals
• Technical notes

Software Use

Model Development:

• Understand program capabilities
• Verify input data
• Check results reasonableness
• Calibrate to measured data

Validation:

• Run standard test cases
• Compare to benchmarks
• Verify calculations
• Document assumptions

Quality Control:

• Peer review
• Independent verification
• Sensitivity analysis
• Uncertainty analysis

Practical Application Examples

Example 1: Program Validation

Objective: Validate new energy modeling program

Procedure:

1. Run all analytical test cases
2. Compare to reference solutions
3. Run comparative test suite
4. Document results

Results:

• Analytical tests: 100% pass
• Comparative tests: Within ±3%
• Certification: Standard level

Example 2: Model Calibration

Objective: Calibrate model to measured data

Building:

• Office building
• 5,000 m²
• Measured energy: 150 kWh/m²·a

Procedure:

1. Create initial model
2. Compare to measured
3. Adjust parameters
4. Verify calibration

Calibration Results:

• Initial: 180 kWh/m²·a (20% high)
• Calibrated: 152 kWh/m²·a (1.3% difference)
• MBE: -1.3%
• CV(RMSE): 8.5%

Acceptance:

• MBE: -1.3% < ±5% ✓
• CV(RMSE): 8.5% < 15% ✓
• Calibrated

Conclusion

ASHRAE Standard 140 provides essential testing procedures for building energy analysis software. Key aspects include:

Test Procedures:

• Analytical verification
• Comparative testing
• Empirical validation

Validation Criteria:

• Acceptance tolerances
• Calibration metrics
• Certification requirements

Best Practices:

• Software development
• Model development
• Quality assurance

By following ASHRAE 140, software developers and users can ensure reliable and accurate energy analysis results, enabling confident use of energy modeling tools for building design, code compliance, and performance assessment.