LIVEdataset aec-bench@releasetasks 552models 18last submission · built
electricalwith-tool

Road Its Field Equipment Energy Resilience Package

Calculates source-bound road ITS field equipment resilience metrics from a deterministic SSC-17 task-owned source pack. The template combines lighting, VMS, CCTV, communications, cabinet battery/PV autonomy, flood freeboard, PoE budget, and an overall synthetic pass score.

with-tool: The model is given an executable Python calculator script.

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

20 inputs

Always given

Included directly in every task prompt.

20
Show 20 inputs
  • Luminaire count

    luminaire_count

    DEVICE-SSC17-005 luminaire count

    8
  • Luminaire kw each

    luminaire_kw_each

    DEVICE-SSC17-005 luminaire load

    0.12 kW
  • Vms

    vms_kw

    DEVICE-SSC17-005 VMS load

    0.9 kW
  • Cctv count

    cctv_count

    DEVICE-SSC17-005 CCTV camera count

    4
  • Cctv kw each

    cctv_kw_each

    DEVICE-SSC17-005 CCTV load

    0.045 kW
  • Comms

    comms_kw

    NET-SSC17-005 communications load

    0.18 kW
  • Outage duration hr

    outage_duration_hr

    FLOOD-SSC17-005 outage duration

    10 h
  • Cabinet battery

    cabinet_battery_kwh

    CAB-SSC17-005 cabinet battery energy

    36 kWh
  • Max depth of discharge

    max_depth_of_discharge

    CAB-SSC17-005 maximum depth of discharge

    0.8
  • Inverter efficiency

    inverter_efficiency

    CAB-SSC17-005 inverter efficiency

    0.92
  • Pv

    pv_kw

    CAB-SSC17-005 cabinet PV rating

    1.5 kW
  • Solar hours

    solar_hours

    FLOOD-SSC17-005 solar hours during event

    2 h
  • Pv performance ratio

    pv_performance_ratio

    CAB-SSC17-005 PV performance ratio

    0.85
  • Cabinet threshold level

    cabinet_threshold_level_m

    CAB-SSC17-005 cabinet threshold level

    24.2 m
  • Flood hgl

    flood_hgl_m

    FLOOD-SSC17-005 flood HGL

    23.55 m
  • Required freeboard

    required_freeboard_m

    FLOOD-SSC17-005 required cabinet freeboard

    0.3 m
  • Poe budget

    poe_budget_w

    NET-SSC17-005 PoE budget

    80 W
  • Poe camera w each

    poe_camera_w_each

    NET-SSC17-005 PoE camera load

    8 W
  • Poe switch

    poe_switch_w

    NET-SSC17-005 PoE switch load

    44 W
  • Required vms runtime hr

    required_vms_runtime_hr

    MEMO-SSC17-005 required VMS runtime

    8 h

Scored outputs

13 outputs

Field device load

field_device_load_kw

Lighting, VMS, CCTV, and communications load

Scores if within ±3% of the reference value.

Outage energy required kwh

outage_energy_required_kwh

Energy required during outage

Scores if within ±3% of the reference value.

Usable battery energy kwh

usable_battery_energy_kwh

Usable cabinet battery energy

Scores if within ±3% of the reference value.

Pv energy available kwh

pv_energy_available_kwh

PV energy available during event

Scores if within ±3% of the reference value.

Backup energy available kwh

backup_energy_available_kwh

Battery plus PV energy available

Scores if within ±3% of the reference value.

Backup energy margin kwh

backup_energy_margin_kwh

Available backup energy minus required outage energy

Scores if within ±3% of the reference value.

Battery only runtime hr

battery_only_runtime_hr

Battery-only runtime at field device load

Scores if within ±3% of the reference value.

Vms runtime margin hr

vms_runtime_margin_hr

Battery-only runtime minus required VMS runtime

Scores if within ±3% of the reference value.

Cabinet freeboard

cabinet_freeboard_m

Cabinet threshold minus flood HGL

Scores if within ±3% of the reference value.

Cabinet freeboard margin

cabinet_freeboard_margin_m

Cabinet freeboard minus required freeboard

Scores if within ±3% of the reference value.

Poe load w

poe_load_w

PoE camera plus switch load

Scores if within ±3% of the reference value.

Poe margin w

poe_margin_w

PoE budget minus PoE load

Scores if within ±3% of the reference value.

Overall pass score

overall_pass_score

1.0 when energy, runtime, freeboard, and PoE margins are non-negative

Scores if within ±0.1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All source-pack values given for the SSC-17 road ITS field equipment energy package
medium:
All source-pack values given for the SSC-17 road ITS field equipment energy package
hard:
All source-pack values given for the SSC-17 road ITS field equipment energy package

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • road-its-field-equipment-energy-resilience-package_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a road ITS and electrical resilience engineer checking a task-owned synthetic SSC-17 field equipment energy package.2 3Use only the task-owned synthetic source pack values shown below for numeric grading. Road, ITS, CCTV, PV, BESS, and storm exposure workflows shape the context only: this instance does not run external software or a real source-pack parser.4 5## Scene6 7- Product: `SSC-17-LH-05`8- Road plan/profile: `ROAD-SSC17-005`9- Field device schedule: `DEVICE-SSC17-005`10- Network topology: `NET-SSC17-005`11- Cabinet load schedule: `CAB-SSC17-005`12- Storm/flood exposure note: `FLOOD-SSC17-005`13- Operations memo: `MEMO-SSC17-005`14 15## Source Values16 17| Item | Value |18| --- | --- |19| Luminaire count | {{ luminaire_count }} |20| Luminaire load | {{ luminaire_kw_each }} kW each |21| VMS load | {{ vms_kw }} kW |22| CCTV count | {{ cctv_count }} |23| CCTV load | {{ cctv_kw_each }} kW each |24| Communications load | {{ comms_kw }} kW |25| Outage duration | {{ outage_duration_hr }} h |26| Cabinet battery | {{ cabinet_battery_kwh }} kWh |27| Maximum depth of discharge | {{ max_depth_of_discharge }} |28| Inverter efficiency | {{ inverter_efficiency }} |29| PV rating | {{ pv_kw }} kW |30| Solar hours during event | {{ solar_hours }} h |31| PV performance ratio | {{ pv_performance_ratio }} |32| Cabinet threshold level | {{ cabinet_threshold_level_m }} m |33| Flood HGL | {{ flood_hgl_m }} m |34| Required freeboard | {{ required_freeboard_m }} m |35| PoE budget | {{ poe_budget_w }} W |36| PoE camera load | {{ poe_camera_w_each }} W each |37| PoE switch load | {{ poe_switch_w }} W |38| Required VMS runtime | {{ required_vms_runtime_hr }} h |39 40## Output Format41 42Write a compact memo to `/workspace/output.md`. Include a source-boundary statement that this is a task-owned synthetic source pack. Preserve the source IDs above and state whether the baseline source pack passes the current docs-only checks.43 44Do not claim authority approval, accepted project evidence, software export validity, full standards compliance, executable real source-pack parsing, generated benchmark readiness, or benchmark readiness.45 46Include a fenced JSON block with exactly these numeric keys:47 48```json49{50 "field_device_load_kw": <numeric_value>,51 "outage_energy_required_kwh": <numeric_value>,52 "usable_battery_energy_kwh": <numeric_value>,53 "pv_energy_available_kwh": <numeric_value>,54 "backup_energy_available_kwh": <numeric_value>,55 "backup_energy_margin_kwh": <numeric_value>,56 "battery_only_runtime_hr": <numeric_value>,57 "vms_runtime_margin_hr": <numeric_value>,58 "cabinet_freeboard_m": <numeric_value>,59 "cabinet_freeboard_margin_m": <numeric_value>,60 "poe_load_w": <numeric_value>,61 "poe_margin_w": <numeric_value>,62 "overall_pass_score": <numeric_value>63}64```65

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Ssc17 road its energy case

ssc17_road_its_energy_case

Road ITS field equipment resilience case with cabinet battery, PV, flood level, and PoE budget

road-its-field-equipment-energycabinet-bess-pv-flood-check
Parameter ranges
luminaire_count
8
luminaire_kw_each
0.12
vms_kw
0.9
cctv_count
4
cctv_kw_each
0.045
comms_kw
0.18
outage_duration_hr
10
cabinet_battery_kwh
36
max_depth_of_discharge
0.8
inverter_efficiency
0.92
pv_kw
1.5
solar_hours
2
pv_performance_ratio
0.85
cabinet_threshold_level_m
24.2
flood_hgl_m
23.55
required_freeboard_m
0.3
poe_budget_w
80
poe_camera_w_each
8
poe_switch_w
44
required_vms_runtime_hr
8

Example task

road-its-field-equipment-energy-ssc17-road-its-energy-case-previewhard difficulty, all inputs given.

Road ITS field equipment resilience case with cabinet battery, PV, flood level, and PoE budget. road-its-field-equipment-energy. Required outputs: field_device_load_kw, outage_energy_required_kwh, usable_battery_energy_kwh, pv_energy_available_kwh, backup_energy_available_kwh, backup_energy_margin_kwh

The model sees

Scenario context and visible inputs.

luminaire_count
8 to 8
luminaire_kw_each
0.12 to 0.12 kW
vms_kw
0.9 to 0.9 kW
cctv_count
4 to 4
cctv_kw_each
0.045 to 0.045 kW
comms_kw
0.18 to 0.18 kW
outage_duration_hr
10 to 10 h
cabinet_battery_kwh
36 to 36 kWh
max_depth_of_discharge
0.8 to 0.8
inverter_efficiency
0.92 to 0.92
pv_kw
1.5 to 1.5 kW
solar_hours
2 to 2 h
pv_performance_ratio
0.85 to 0.85
cabinet_threshold_level_m
24.2 to 24.2 m
flood_hgl_m
23.55 to 23.55 m
required_freeboard_m
0.3 to 0.3 m
poe_budget_w
80 to 80 W
poe_camera_w_each
8 to 8 W
poe_switch_w
44 to 44 W
required_vms_runtime_hr
8 to 8 h

Executable tool: road-its-field-equipment-energy-resilience-package_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "field_device_load_kw": <number>,
  "outage_energy_required_kwh": <number>,
  "usable_battery_energy_kwh": <number>,
  "pv_energy_available_kwh": <number>,
  "backup_energy_available_kwh": <number>,
  "backup_energy_margin_kwh": <number>,
  "battery_only_runtime_hr": <number>,
  "vms_runtime_margin_hr": <number>,
  "cabinet_freeboard_m": <number>,
  "cabinet_freeboard_margin_m": <number>,
  "poe_load_w": <number>,
  "poe_margin_w": <number>,
  "overall_pass_score": <number>
}
  • field_device_load_kw · scored within ±3%
  • outage_energy_required_kwh · scored within ±3%
  • usable_battery_energy_kwh · scored within ±3%
  • pv_energy_available_kwh · scored within ±3%
  • backup_energy_available_kwh · scored within ±3%
  • backup_energy_margin_kwh · scored within ±3%
  • battery_only_runtime_hr · scored within ±3%
  • vms_runtime_margin_hr · scored within ±3%
  • cabinet_freeboard_m · scored within ±3%
  • cabinet_freeboard_margin_m · scored within ±3%
  • poe_load_w · scored within ±3%
  • poe_margin_w · scored within ±3%
  • overall_pass_score · scored within ±0.1%