LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
electricalwith-tool

Stormwater Pumping Outage Resilience Package

Calculates source-bound stormwater pumping outage resilience metrics from a deterministic SSC-17 task-owned source pack. The template combines storm inflow volume, pumpable volume, storage margin, pump hydraulic/input power, critical controls load, BESS and generator energy autonomy, feeder voltage drop, and an overall synthetic pass score.

with-tool: The model is given an executable Python calculator script.

Standards

EPA SWMMNREL REoptbackup energy dispatch workflowsstormwater pumping outage workflows

Tags

bessdeterministicelectricalfeedergeneratoroutagepumpingresiliencestormwater

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

19 inputs

Always given

Included directly in every task prompt.

19
Show 19 inputs

  • Storm inflow

    storm_inflow_m3_s

    RAIN-17-HYETO-01 average inflow during SCEN-17-STORM-OUTAGE-01

    0.18 m3/s

  • Outage duration hr

    outage_duration_hr

    TIME-17-OUTAGE-LEDGER-01 outage duration

    6 h

  • Pump capacity

    pump_capacity_m3_s

    PUMP-17-STORM-01 pump capacity during backup operation

    0.24 m3/s

  • Allowed pump runtime hr

    allowed_pump_runtime_hr

    Allowed PUMP-17-STORM-01 runtime during the outage scenario

    3.2 h

  • Available storage volume

    available_storage_volume_m3

    BASIN-17-WETWELL-01 available wet-well/storage volume

    1250 m3

  • Pump total head

    pump_total_head_m

    PUMP-17-STORM-01 total dynamic head

    8.5 m

  • Pump efficiency

    pump_efficiency

    PUMP-17-STORM-01 source-owned pump efficiency

    0.72

  • Controls load

    controls_load_kw

    CTRL-17-RTU-01 controls load

    1.8 kW

  • Telemetry load

    telemetry_load_kw

    CTRL-17-RTU-01 telemetry load

    0.6 kW

  • Bess nominal

    bess_nominal_kwh

    BESS-17-BACKUP-01 nominal energy

    210 kWh

  • Max depth of discharge

    max_depth_of_discharge

    BESS-17-BACKUP-01 maximum depth of discharge

    0.82

  • Inverter efficiency

    inverter_efficiency

    BESS-17-BACKUP-01 inverter efficiency

    0.94

  • Generator

    generator_kw

    GEN-17-BACKUP-01 output during the outage scenario

    42 kW

  • Generator runtime hr

    generator_runtime_hr

    GEN-17-BACKUP-01 available runtime

    2 h

  • Feeder voltage

    feeder_voltage_v

    FEEDER-17-480V-01 nominal three-phase feeder voltage

    480 V

  • Feeder length

    feeder_length_m

    FEEDER-17-480V-01 one-way conductor length

    185 m

  • Feeder current

    feeder_current_a

    FEEDER-17-480V-01 operating current for voltage-drop check

    68 A

  • Conductor resistance

    conductor_resistance_ohm_km

    FEEDER-17-480V-01 source-owned conductor resistance

    0.321 ohm/km

  • Max voltage drop percent

    max_voltage_drop_percent

    FEEDER-17-480V-01 maximum allowed voltage drop

    4 %

Scored outputs

18 outputs

Storm inflow volume m3

storm_inflow_volume_m3

Storm inflow volume during the outage

Scores if within ±3% of the reference value.

Pumpable volume m3

pumpable_volume_m3

Volume pumpable during allowed backup pump runtime

Scores if within ±3% of the reference value.

Residual storage volume m3

residual_storage_volume_m3

Storm volume remaining for storage after pumping

Scores if within ±3% of the reference value.

Storage margin m3

storage_margin_m3

Available storage minus residual storage volume

Scores if within ±3% of the reference value.

Pump hydraulic power

pump_hydraulic_power_kw

Hydraulic power for PUMP-17-STORM-01

Scores if within ±3% of the reference value.

Pump input power

pump_input_power_kw

Electrical input power for PUMP-17-STORM-01

Scores if within ±3% of the reference value.

Critical mixed load

critical_mixed_load_kw

Pump plus controls and telemetry mixed critical load

Scores if within ±3% of the reference value.

Pump energy required kwh

pump_energy_required_kwh

Pump energy required during allowed pump runtime

Scores if within ±3% of the reference value.

Controls energy required kwh

controls_energy_required_kwh

Controls and telemetry energy required across full outage

Scores if within ±3% of the reference value.

Total energy required kwh

total_energy_required_kwh

Total backup energy required

Scores if within ±3% of the reference value.

Usable bess energy kwh

usable_bess_energy_kwh

Usable BESS energy after depth-of-discharge and inverter efficiency

Scores if within ±3% of the reference value.

Generator energy kwh

generator_energy_kwh

Backup generator energy available

Scores if within ±3% of the reference value.

Backup energy available kwh

backup_energy_available_kwh

Usable BESS energy plus generator energy

Scores if within ±3% of the reference value.

Backup energy margin kwh

backup_energy_margin_kwh

Backup energy available minus total backup energy required

Scores if within ±3% of the reference value.

Battery only mixed load runtime hr

battery_only_mixed_load_runtime_hr

Runtime using BESS only at mixed pump, controls, and telemetry load

Scores if within ±3% of the reference value.

Feeder voltage drop

feeder_voltage_drop_percent

Source-owned three-phase feeder voltage-drop percentage

Scores if within ±3% of the reference value.

Voltage drop margin

voltage_drop_margin_percent

Maximum allowed voltage drop minus calculated voltage drop

Scores if within ±3% of the reference value.

Overall pass score

overall_pass_score

1.0 when storage, backup energy, and voltage drop margins are non-negative

Scores if within ±0.1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All source-pack values given for the SSC-17 stormwater pumping outage resilience package
medium:
All source-pack values given for the SSC-17 stormwater pumping outage resilience package
hard:
All source-pack values given for the SSC-17 stormwater pumping outage resilience package

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • stormwater-pumping-outage-resilience-package_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are an electrical and stormwater resilience engineer checking a task-owned synthetic SSC-17 stormwater pumping outage package for one storm event and utility outage.2 3Use only the task-owned synthetic source pack values shown below for numeric grading. EPA SWMM and NREL REopt style workflows shape the context only: this instance does not run SWMM, REopt, or a real source-pack parser.4 5## Scene6 7- Resilience case: `CASE-SSC17-PUMP-OUTAGE-001`8- Operating scenario: `SCEN-17-STORM-OUTAGE-01`9- Outage ledger: `TIME-17-OUTAGE-LEDGER-01`10- Rainfall/inflow trace: `RAIN-17-HYETO-01`11- Stormwater pump: `PUMP-17-STORM-01`12- Wet-well/storage basin: `BASIN-17-WETWELL-01`13- Critical load schedule: `LOAD-17-CRITICAL-01`14- Battery energy storage: `BESS-17-BACKUP-01`15- Backup generator: `GEN-17-BACKUP-01`16- Pump feeder: `FEEDER-17-480V-01`17- Controls and telemetry node: `CTRL-17-RTU-01`18- Resilience memo: `MEMO-17-RESILIENCE-01`19 20## Stormwater And Pumping Basis21 22| Item | Value |23|------|-------|24| Storm inflow | {{ storm_inflow_m3_s }} m3/s |25| Outage duration | {{ outage_duration_hr }} h |26| Pump capacity | {{ pump_capacity_m3_s }} m3/s |27| Allowed pump runtime during outage | {{ allowed_pump_runtime_hr }} h |28| Available wet-well/storage volume | {{ available_storage_volume_m3 }} m3 |29| Pump total head | {{ pump_total_head_m }} m |30| Pump efficiency | {{ pump_efficiency }} |31 32Stormwater and pump checks:33 34- Storm inflow volume equals `storm_inflow_m3_s x outage_duration_hr x 3600`.35- Pumpable volume equals `pump_capacity_m3_s x allowed_pump_runtime_hr x 3600`.36- Residual storage volume equals `max(storm_inflow_volume_m3 - pumpable_volume_m3, 0)`.37- Storage margin equals available storage volume minus residual storage volume.38- Pump hydraulic power equals `1000 x 9.81 x pump_capacity_m3_s x pump_total_head_m / 1000` in kW.39- Pump input power equals pump hydraulic power divided by pump efficiency.40 41## Backup Energy And Feeder Basis42 43| Item | Value |44|------|-------|45| Controls load | {{ controls_load_kw }} kW |46| Telemetry load | {{ telemetry_load_kw }} kW |47| BESS nominal energy | {{ bess_nominal_kwh }} kWh |48| Maximum BESS depth of discharge | {{ max_depth_of_discharge }} |49| Inverter efficiency | {{ inverter_efficiency }} |50| Generator output | {{ generator_kw }} kW |51| Generator runtime | {{ generator_runtime_hr }} h |52| Feeder voltage | {{ feeder_voltage_v }} V |53| Feeder length | {{ feeder_length_m }} m |54| Feeder current | {{ feeder_current_a }} A |55| Conductor resistance | {{ conductor_resistance_ohm_km }} ohm/km |56| Maximum voltage drop | {{ max_voltage_drop_percent }} % |57 58Backup energy and feeder checks:59 60- Critical mixed load equals pump input power plus controls load plus telemetry load.61- Pump energy required equals pump input power times allowed pump runtime.62- Controls energy required equals `(controls_load_kw + telemetry_load_kw) x outage_duration_hr`.63- Total energy required equals pump energy required plus controls energy required.64- Usable BESS energy equals `bess_nominal_kwh x max_depth_of_discharge x inverter_efficiency`.65- Generator energy equals `generator_kw x generator_runtime_hr`.66- Backup energy available equals usable BESS energy plus generator energy.67- Backup energy margin equals backup energy available minus total energy required.68- Battery-only mixed-load runtime equals usable BESS energy divided by critical mixed load.69- Feeder voltage drop percent uses the source-owned three-phase approximation `sqrt(3) x feeder_current_a x feeder_length_m x conductor_resistance_ohm_km / 1000 / feeder_voltage_v x 100`.70- Voltage drop margin equals maximum voltage drop percent minus feeder voltage drop percent.71- Overall pass score is `1.0` only when storage margin, backup energy margin, and voltage drop margin are all non-negative; otherwise it is `0.0`.72 73## Output Format74 75Write a compact memo to `/workspace/output.md`. Include a source-boundary statement that this is a task-owned synthetic source pack. Explain the calculations briefly, preserve the object IDs above, and state whether the baseline source pack passes the current docs-only checks.76 77Do not claim authority approval, accepted project evidence, software export validity, full standards compliance, executable real source-pack parsing, generated SWMM or REopt evidence, generated benchmark readiness, or benchmark readiness.78 79Include a fenced JSON block with exactly these numeric keys:80 81```json82{83 "storm_inflow_volume_m3": <numeric_value>,84 "pumpable_volume_m3": <numeric_value>,85 "residual_storage_volume_m3": <numeric_value>,86 "storage_margin_m3": <numeric_value>,87 "pump_hydraulic_power_kw": <numeric_value>,88 "pump_input_power_kw": <numeric_value>,89 "critical_mixed_load_kw": <numeric_value>,90 "pump_energy_required_kwh": <numeric_value>,91 "controls_energy_required_kwh": <numeric_value>,92 "total_energy_required_kwh": <numeric_value>,93 "usable_bess_energy_kwh": <numeric_value>,94 "generator_energy_kwh": <numeric_value>,95 "backup_energy_available_kwh": <numeric_value>,96 "backup_energy_margin_kwh": <numeric_value>,97 "battery_only_mixed_load_runtime_hr": <numeric_value>,98 "feeder_voltage_drop_percent": <numeric_value>,99 "voltage_drop_margin_percent": <numeric_value>,100 "overall_pass_score": <numeric_value>101}102```103

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Ssc17 stormwater pump outage case

ssc17_stormwater_pump_outage_case

Stormwater pump station outage case with wet-well storage, BESS, generator, controls load, and feeder voltage drop

stormwater-pumping-outage-resiliencebackup-energy-pump-control-check
Parameter ranges
storm_inflow_m3_s
0.18
outage_duration_hr
6
pump_capacity_m3_s
0.24
allowed_pump_runtime_hr
3.2
available_storage_volume_m3
1250
pump_total_head_m
8.5
pump_efficiency
0.72
controls_load_kw
1.8
telemetry_load_kw
0.6
bess_nominal_kwh
210
max_depth_of_discharge
0.82
inverter_efficiency
0.94
generator_kw
42
generator_runtime_hr
2
feeder_voltage_v
480
feeder_length_m
185
feeder_current_a
68
conductor_resistance_ohm_km
0.321
max_voltage_drop_percent
4

Example task

stormwater-pumping-outage-resilience-ssc17-stormwater-pump-outage-case-preview — hard difficulty, all inputs given.

Stormwater pump station outage case with wet-well storage, BESS, generator, controls load, and feeder voltage drop. stormwater-pumping-outage-resilience. Required outputs: storm_inflow_volume_m3, pumpable_volume_m3, residual_storage_volume_m3, storage_margin_m3, pump_hydraulic_power_kw, pump_input_power_kw

The model sees

Scenario context and visible inputs.

storm_inflow_m3_s
0.18 to 0.18 m3/s
outage_duration_hr
6 to 6 h
pump_capacity_m3_s
0.24 to 0.24 m3/s
allowed_pump_runtime_hr
3.2 to 3.2 h
available_storage_volume_m3
1250 to 1250 m3
pump_total_head_m
8.5 to 8.5 m
pump_efficiency
0.72 to 0.72
controls_load_kw
1.8 to 1.8 kW
telemetry_load_kw
0.6 to 0.6 kW
bess_nominal_kwh
210 to 210 kWh
max_depth_of_discharge
0.82 to 0.82
inverter_efficiency
0.94 to 0.94
generator_kw
42 to 42 kW
generator_runtime_hr
2 to 2 h
feeder_voltage_v
480 to 480 V
feeder_length_m
185 to 185 m
feeder_current_a
68 to 68 A
conductor_resistance_ohm_km
0.321 to 0.321 ohm/km
max_voltage_drop_percent
4 to 4 %

Executable tool: stormwater-pumping-outage-resilience-package_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "storm_inflow_volume_m3": <number>,
  "pumpable_volume_m3": <number>,
  "residual_storage_volume_m3": <number>,
  "storage_margin_m3": <number>,
  "pump_hydraulic_power_kw": <number>,
  "pump_input_power_kw": <number>,
  "critical_mixed_load_kw": <number>,
  "pump_energy_required_kwh": <number>,
  "controls_energy_required_kwh": <number>,
  "total_energy_required_kwh": <number>,
  "usable_bess_energy_kwh": <number>,
  "generator_energy_kwh": <number>,
  "backup_energy_available_kwh": <number>,
  "backup_energy_margin_kwh": <number>,
  "battery_only_mixed_load_runtime_hr": <number>,
  "feeder_voltage_drop_percent": <number>,
  "voltage_drop_margin_percent": <number>,
  "overall_pass_score": <number>
}
  • storm_inflow_volume_m3 · scored within ±3%
  • pumpable_volume_m3 · scored within ±3%
  • residual_storage_volume_m3 · scored within ±3%
  • storage_margin_m3 · scored within ±3%
  • pump_hydraulic_power_kw · scored within ±3%
  • pump_input_power_kw · scored within ±3%
  • critical_mixed_load_kw · scored within ±3%
  • pump_energy_required_kwh · scored within ±3%
  • controls_energy_required_kwh · scored within ±3%
  • total_energy_required_kwh · scored within ±3%
  • usable_bess_energy_kwh · scored within ±3%
  • generator_energy_kwh · scored within ±3%
  • backup_energy_available_kwh · scored within ±3%
  • backup_energy_margin_kwh · scored within ±3%
  • battery_only_mixed_load_runtime_hr · scored within ±3%
  • feeder_voltage_drop_percent · scored within ±3%
  • voltage_drop_margin_percent · scored within ±3%
  • overall_pass_score · scored within ±0.1%