Validation Report · Thermal Systems
DHW Heat Pump Water Heater Module Validation
Two validation stages across 28 in-scope scenarios, cross-validated against EnergyPlus 26.1. The heat-pump water-heater model is scored on ANNUAL and MONTHLY energy — the basis a techno-economic analysis rests on. Stage 2, the annual real-building test across four climates, passes 15 / 16 (annual energy ±5%, monthly NMBE ±5%, monthly CV(RMSE) ≤15%, with monthly NMBE and CV(RMSE) at 16/16). Stage 1, a 30-day constant-draw steady-state shakedown, passes 4 / 12 — every one of its six pumped-condenser failures shares a single documented cause. All four exception classes are named, mechanism-characterised, and published below rather than excluded from the count. A 16-scenario timestep control test confirms the mechanism behind the single Stage-2 exception, with no counter-example.
In-Scope Scenarios
28
Pass Rate
67.9%
EnergyPlus Cross-Validated Stages
2
Analytically Validated Stages
0
Stage-by-Stage Results
| Stage | Scope | In-Scope | Passed | Reference Engine |
|---|---|---|---|---|
| Stage 1 | Single heat-pump water heater at constant ambient and constant draw over 30 days (720 h). Two condenser archetypes (wrapped-condenser residential, pumped-condenser stratified) × three ambient temperatures (10 / 20 / 30 °C) × two continuous draw rates, each sized inside the heat pump's sustainable capacity so the resistance backup never fires. EnergyPlus defines the thermal load; the two engines are then compared on heat-pump compressor electricity. Because a 30-day constant-draw run has neither an annual nor a monthly dimension, only the total-energy gate applies — this stage is a model shakedown, not the headline validation. | 12 | 4/12 | EnergyPlus 26.1.0 — WaterHeater:HeatPump:WrappedCondenser and :PumpedCondenser coupled to a 12-node WaterHeater:Stratified tank, geometry and control-sensor heights taken verbatim from EnergyPlus's own shipped example files. Scored against ASHRAE Guideline 14-2023. |
| Stage 2 | Full 8,760-hour annual simulation driven by the DHW draw of the DOE / ASHRAE 90.1-2019 Large Hotel prototype building, run as shipped so the load is an authority's rather than an assumption. Two condenser archetypes × four climates (Chicago 5A, San Francisco 3C, Tampa 2A, Golden CO semi-arid) × two evaporator ambient sources (indoor mechanical room, outdoor weather-driven). Equipment is a commercial 4 × 20 kW bank with 3.0 m³ storage, sized from the measured load against the element-trip threshold rather than a rule of thumb. This is the headline validation. | 16 | 15/16 | EnergyPlus 26.1.0 — WaterHeater:HeatPump:* + WaterHeater:Stratified, driven by the Large Hotel prototype's own SWHSys1 use-side heat delivery. Wet-bulb evaporator inlet cross-checked against EnergyPlus's own System Node Wetbulb Temperature output to within 0.024 K over 8,760 hours. Scored against ASHRAE Guideline 14-2023. |
Reference Engines
Every gate in this report compares the CogenS simulator output against an independent, openly-documented reference. We do not validate against ourselves.
- EnergyPlus 26.1.0 — WaterHeater:HeatPump:WrappedCondenser / :PumpedCondenser + WaterHeater:Stratified (12-node)
- DOE / ASHRAE 90.1-2019 Large Hotel prototype building (annual DHW draw)
Stage Details
Stage 1 — Steady-state single-tank shakedown
Single heat-pump water heater at constant ambient and constant draw over 30 days (720 h). Two condenser archetypes (wrapped-condenser residential, pumped-condenser stratified) × three ambient temperatures (10 / 20 / 30 °C) × two continuous draw rates, each sized inside the heat pump's sustainable capacity so the resistance backup never fires. EnergyPlus defines the thermal load; the two engines are then compared on heat-pump compressor electricity. Because a 30-day constant-draw run has neither an annual nor a monthly dimension, only the total-energy gate applies — this stage is a model shakedown, not the headline validation.
Matrix
12
In-Scope
12
Passed
4
Wall Time
approx. 4 minutes (12 EnergyPlus runs, 720 h each)
Gates Exercised
| Gate | Tolerance | Result |
|---|---|---|
| EnergyPlus reference integrity | zero Severe, zero Fatal; tank energy balance ≤ 1% of load | 12 / 12 clean. Energy balance −0.05% to −0.30% of load; backup resistance element 0.00 kWh in every case. |
| Total compressor electricity over the run | ±5% (ASHRAE Guideline 14-2023 annual-sum band) | 4 / 12 within band. Wrapped-condenser: 4 / 6 (−2.97% to −5.72%). Pumped-condenser: 0 / 6, all under-predicting by 6.74% to 11.10% — one shared cause, see Limitations. |
| Coefficient of performance, physical plausibility | COP in the 2–6 band, rising monotonically with ambient temperature | Satisfied for both archetypes. Wrapped 3.90 → 5.13 → 6.30 and pumped 2.97 → 3.84 → 4.73 across 10 / 20 / 30 °C. |
What this stage is for
Stage 1 holds ambient and draw constant so that any disagreement is attributable to the equipment model rather than to load or weather. It is deliberately synthetic. Its value was diagnostic: it surfaced and closed four defects — a draw schedule sized beyond heat-pump capacity, a dry-bulb temperature fed to a wet-bulb performance curve, a humidity ratio misread as relative humidity, and un-normalised curve coefficients — before any annual result was trusted.
Why the pumped-condenser cases fail here and pass at annual scale
All six pumped failures are under-predictions of 6.74% to 11.10% on a 0.189 m³ (50 gal) tank. The pumped condenser draws from the tank's bottom node; at that small volume the sump node runs cooler than EnergyPlus's, raising the modelled coefficient of performance and lowering predicted electricity. The same archetype on the 3.0 m³ commercial bank in Stage 2 does not exhibit it. The limitation is therefore specific to small-volume pumped-condenser configurations.
Stage 2 — Annual realistic building load, four climates
Full 8,760-hour annual simulation driven by the DHW draw of the DOE / ASHRAE 90.1-2019 Large Hotel prototype building, run as shipped so the load is an authority's rather than an assumption. Two condenser archetypes × four climates (Chicago 5A, San Francisco 3C, Tampa 2A, Golden CO semi-arid) × two evaporator ambient sources (indoor mechanical room, outdoor weather-driven). Equipment is a commercial 4 × 20 kW bank with 3.0 m³ storage, sized from the measured load against the element-trip threshold rather than a rule of thumb. This is the headline validation.
Matrix
16
In-Scope
16
Passed
15
Wall Time
approx. 40 minutes (16 annual EnergyPlus runs plus prototype load extraction)
Gates Exercised
| Gate | Tolerance | Result |
|---|---|---|
| Annual compressor electricity | ±5% (ASHRAE Guideline 14-2023 annual-sum band) | 15 / 16 within band, spanning −2.14% to +3.79%. The single exception is a pumped-condenser indoor case at +5.29%, whose mechanism is characterised and demonstrated below. |
| Monthly NMBE | ±5% (ASHRAE Guideline 14-2023 monthly band) | 16 / 16 within band. |
| Monthly CV(RMSE) | ≤ 15% (ASHRAE Guideline 14-2023 monthly band) | 16 / 16 within band, spanning 1.75% to 9.49%. |
| EnergyPlus reference integrity | zero Severe, zero Fatal; tank energy balance ≤ 1% of load | 16 / 16 clean. Energy balance −0.02% to −0.04% of load; EnergyPlus's own Net Heat Transfer Rate −0.9 to −3.9 W. |
| Cold-ambient lockout and backup behaviour | reported against EnergyPlus, not gated | Modelled lockout hours match EnergyPlus exactly once the compressor cut-out is tested against dry-bulb rather than wet-bulb temperature (598 h at Golden CO, outdoor). Backup resistance energy tracks EnergyPlus within 1% on the cold-outdoor cases. |
| Peak hourly demand | ±10% — REPORTED, NOT GATED (see Limitations) | 14 / 16 within band. The two misses are wrapped-condenser indoor cases in mild climates (−13.39% and −19.42%), both with annual energy inside 2.2%. |
| Timestep-sensitivity control test | falsifiable prediction — the wrapped archetype must show ~0% shift | Confirmed on all 16 scenarios with no counter-example. Re-running every case at EnergyPlus's own 15-minute timestep shifts the wrapped archetype by +0.19% on average (range +0.10% to +0.28%) and the pumped archetype by −6.21% (range −8.13% to −3.90%). The two families do not overlap. |
How the load was established
The DOE Large Hotel prototype is run unmodified and its own water heater's hourly use-side heat delivery becomes the DHW load. Nothing about the draw profile is authored for this study. The resulting load is 161 to 219 MWh per year with a load factor near 0.43 — roughly 55 litres per room per day across about 200 rooms. Its variation across the four climates is pure mains-water temperature: predicted ratios of 1.000 / 0.915 / 0.734 against observed 1.000 / 0.918 / 0.739, which independently confirms that climate enters only where it physically should.
Why the model is scored on annual and monthly energy
A techno-economic analysis rests on annual energy and monthly utility bills, not on which hour within a month a compressor happens to fire. Hourly agreement was measured and found to be dominated by intra-hour phase differences between two tank solvers rather than by any energy disagreement: hourly CV(RMSE) of 43% to 104% collapses to 1.8% to 9.5% when the identical arrays are binned monthly, while NMBE passes 16 of 16 at both resolutions. Hourly and sub-hourly agreement are therefore outside the scope of this validation, and are stated as such rather than quietly omitted.
Timestep-sensitivity control test — all 16 scenarios
For a single-speed compressor the part-load ratio is its fractional on-time, and the part-load efficiency curve penalises low part-load. That penalty is evaluated at the simulation timestep, so a coarser timestep averages the on-time into a lower part-load ratio and charges a larger penalty. EnergyPlus runs 15-minute steps; the model runs 60-minute steps by default. This yields a prediction that can be falsified: the wrapped-condenser archetype carries a FLAT part-load curve and therefore cannot be timestep-sensitive, while the pumped-condenser archetype carries a sloped one and must shift. Every scenario was re-run at 15 minutes to test it.
| Scenario | Annual dev. @ 60 min | Annual dev. @ 15 min | Shift |
|---|---|---|---|
| WRAPPED · Chicago · indoor | −2.14% | −1.94% | +0.20% |
| WRAPPED · Chicago · outdoor | −1.77% | −1.60% | +0.17% |
| WRAPPED · San Francisco · indoor | −2.11% | −1.92% | +0.19% |
| WRAPPED · San Francisco · outdoor | −2.11% | −1.90% | +0.22% |
| WRAPPED · Tampa · indoor | −1.92% | −1.75% | +0.17% |
| WRAPPED · Tampa · outdoor | −1.90% | −1.80% | +0.10% |
| WRAPPED · Golden · indoor | −2.09% | −1.88% | +0.22% |
| WRAPPED · Golden · outdoor | −1.73% | −1.45% | +0.28% |
| PUMPED · Chicago · indoor | +2.09% | −4.42% | −6.38% |
| PUMPED · Chicago · outdoor | −0.74% | −4.86% | −4.15% |
| PUMPED · San Francisco · indoor | +2.89% | −4.21% | −6.89% |
| PUMPED · San Francisco · outdoor | +2.21% | −4.22% | −6.29% |
| PUMPED · Tampa · indoor | +5.29% | −3.28% | −8.13% |
| PUMPED · Tampa · outdoor | +3.79% | −3.92% | −7.44% |
| PUMPED · Golden · indoor | +2.12% | −4.52% | −6.50% |
| PUMPED · Golden · outdoor | −1.27% | −5.13% | −3.90% |
The result is unambiguous. Wrapped: mean +0.19%, range +0.10% to +0.28%, across all eight scenarios — no timestep sensitivity, as the flat part-load curve requires. Pumped: mean −6.21%, range −8.13% to −3.90%, negative in all eight. The two families do not overlap at any point, and there is no counter-example.
One consequence is reported because it bears on how the result should be read: the finer timestep does not produce a clean sweep. At 15 minutes the score is also 15 of 16, but a DIFFERENT scenario falls outside the band (pumped · Golden · outdoor, at −5.13%). Moving to the finer timestep is therefore a re-calibration of the part-load treatment rather than a correction, which is why it has not been adopted as a fix. The practical figure for a user is that pumped-condenser annual energy carries a timestep sensitivity of roughly 6% to 8%, and wrapped-condenser carries none.
What the validation covers, and what it does not
Where the engineering envelope ends, in plain English.
What this validation covers
The heat-pump equipment type of the CogenS domestic-hot-water module, in both condenser architectures EnergyPlus models — wrapped and pumped — across residential and commercial scale, four climates, and both indoor and outdoor evaporator air sources. Agreement is established on annual and monthly energy against EnergyPlus 26.1.
What it does not cover
Hourly and sub-hourly agreement are out of scope, for the reason given in Stage 2. The electric-resistance, natural-gas and indirect (hydronic) water-heater equipment types are not covered by this receipt and are validated separately. Peak hourly demand is reported but not gated.
Exception 1 — pumped-condenser indoor, Tampa: +5.29% annual
The single Stage-2 case outside the annual band. The mechanism is characterised and demonstrated rather than estimated. For a single-speed compressor the part-load ratio is its fractional on-time, and the part-load efficiency curve penalises low part-load. That penalty is evaluated at the simulation timestep, so a coarser timestep averages the on-time into a lower part-load ratio and charges a larger penalty. EnergyPlus runs 15-minute steps; the model runs 60-minute steps by default. Re-running the identical case at EnergyPlus's own 15-minute timestep moves it from +5.29% to −3.28%, inside the band. The wrapped-condenser archetype carries a flat part-load curve and is therefore timestep-independent, which is precisely why only pumped-condenser cases exhibit this. Practically: pumped-condenser annual energy carries a timestep sensitivity of roughly 7% to 8%; wrapped-condenser does not.
Exception 2 — two wrapped-condenser indoor peak misses
Peak hourly demand misses by 13.39% and 19.42% on two mild-climate indoor cases, both of which pass annual energy within 2.2% and monthly CV(RMSE) within 2.2%. Three candidate causes were tested and eliminated: it is not unit staging (an N-unit consistency test returns +0.04% on energy), not tank geometry (a single unit with geometry identical to EnergyPlus's own module still peaks 16.95% low), and not an energy error. The model's operating distribution is compressed rather than biased — above EnergyPlus at the median and below it at the extreme — so the excess in the middle offsets the deficit in the tail. This is the aggregate-versus-extremum signature of two different tank solvers. Consequence for users: annual and monthly energy are sound, but a demand-charge analysis that turns on the single worst hour of a mild-climate indoor wrapped-condenser installation should not rely on the modelled peak.
Exception 3 — pumped-condenser at small tank volume
All six Stage-1 pumped-condenser cases under-predict compressor electricity by 6.74% to 11.10% on a 0.189 m³ (50 gal) tank. The pumped condenser draws from the tank's bottom node, and at that volume the sump runs cooler than EnergyPlus's, raising the modelled coefficient of performance. The same archetype on the 3.0 m³ commercial bank in Stage 2 does not show it, so the limitation is specific to small-volume pumped-condenser configurations.
Exception 4 — one Stage-1 wrapped case at the band edge
Two Stage-1 wrapped-condenser cases sit just outside the ±5% band at −5.40% and −5.72%, under the most demanding combination in that stage: the lowest continuous draw at the coldest ambient. No separate mechanism is claimed for them beyond the general reduced-order tank behaviour.
Multi-unit operation
Every Stage-2 scenario runs a four-unit bank, so multi-unit operation is exercised throughout rather than in a separate stage. The staging algorithm was additionally measured against the assumption EnergyPlus embodies — N identical modules cycling in phase — and agrees to +0.04% on annual energy for the wrapped archetype and −2.26% for the pumped archetype.
Independent certification
Equipment performance data underlying the catalogue is manufacturer-declared. A survey of commercial heat-pump vendors conducted alongside this validation found no vendor substantiating an AHRI certification for heating performance, so catalogue figures carry their stated rating conditions and are labelled as vendor-declared.
Dig into the test matrix
Report last updated: 2026-07-29
Try the validated platform
CogenS™ runs 8,760-hour simulations using the same engines validated on this page. Independent-engineer-grade evidence, lender-friendly.