LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
electricalwith-tool

Emergency Detour Roadside Device Continuity Package

Calculates task-owned synthetic SSC-01 detour VMS legibility, network headroom, RF link margin, battery runtime, and feeder voltage-drop metrics.

with-tool: The model is given an executable Python calculator script.

Standards

FHWA MUTCDITS architectureNTCIP

Tags

batterydeterministicdetourelectricalitsrfvms

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

28 inputs

Always given

Included directly in every task prompt.

28
Show 28 inputs

  • Vms character height

    vms_character_height_in

    DEV-SSC01-004 VMS character height

    10 in

  • Detour speed kmh

    detour_speed_kmh

    DETOUR-SSC01-004 detour approach speed

    80 km/h

  • Reading rate

    reading_rate_chars_s

    MEMO-SSC01-004 reading rate

    4 chars/s

  • Detour message length

    detour_message_length_chars

    DEV-SSC01-004 detour message length

    20 chars

  • Cctv count

    cctv_count

    DEV-SSC01-004 active CCTV count

    3

  • Cctv load

    cctv_load_mbps

    DEV-SSC01-004 load per CCTV stream

    4 Mbps

  • Vms count

    vms_count

    DEV-SSC01-004 active VMS count

    2

  • Vms load

    vms_load_mbps

    DEV-SSC01-004 load per VMS

    2 Mbps

  • Radio load

    radio_load_mbps

    RF-SSC01-004 radio telemetry load

    1.2 Mbps

  • Controller load

    controller_load_mbps

    DEV-SSC01-004 traffic controller load

    0.8 Mbps

  • Network overhead pct

    network_overhead_pct

    MEMO-SSC01-004 network overhead

    20 %

  • Uplink capacity

    uplink_capacity_mbps

    PWR-SSC01-004 uplink capacity

    35 Mbps

  • Rf tx power

    rf_tx_power_dbm

    RF-SSC01-004 transmit power

    20 dBm

  • Rf tx gain

    rf_tx_gain_db

    RF-SSC01-004 transmit antenna gain

    12 dB

  • Rf rx gain

    rf_rx_gain_db

    RF-SSC01-004 receive antenna gain

    12 dB

  • Rf path loss

    rf_path_loss_db

    RF-SSC01-004 path loss

    108 dB

  • Rf misc loss

    rf_misc_loss_db

    RF-SSC01-004 cable and connector loss

    3 dB

  • Rf fade margin

    rf_fade_margin_db

    RF-SSC01-004 reserved fade margin

    10 dB

  • Rf receiver sensitivity

    rf_receiver_sensitivity_dbm

    RF-SSC01-004 receiver sensitivity

    -90 dBm

  • Battery capacity

    battery_capacity_kwh

    PWR-SSC01-004 battery capacity

    8 kWh

  • Battery efficiency

    battery_efficiency

    PWR-SSC01-004 battery efficiency

    0.9

  • Critical load

    critical_load_w

    PWR-SSC01-004 critical detour load

    650 W

  • Required detour duration

    required_detour_duration_h

    MEMO-SSC01-004 required detour operating duration

    8 h

  • Feeder length

    feeder_length_km

    PWR-SSC01-004 feeder length

    0.12 km

  • Conductor resistance

    conductor_resistance_ohm_km

    PWR-SSC01-004 conductor resistance

    0.8 ohm/km

  • Feeder voltage

    feeder_voltage_v

    PWR-SSC01-004 nominal feeder voltage

    230 V

  • Power factor

    power_factor

    PWR-SSC01-004 load power factor

    0.95

  • Allowable voltage drop pct

    allowable_voltage_drop_pct

    PWR-SSC01-004 allowable voltage drop

    5 %

Scored outputs

11 outputs

Vms reading time s

vms_reading_time_s

Available reading time for the detour VMS

Scores if within ±3% of the reference value.

Vms message margin chars

vms_message_margin_chars

Readable character capacity minus detour message length

Scores if within ±3% of the reference value.

Required network mbps

required_network_mbps

Required detour network load

Scores if within ±3% of the reference value.

Network headroom mbps

network_headroom_mbps

Available uplink capacity minus required network load

Scores if within ±3% of the reference value.

Rf received power dbm

rf_received_power_dbm

RF received power

Scores if within ±3% of the reference value.

Rf link margin db

rf_link_margin_db

RF received power minus receiver sensitivity

Scores if within ±3% of the reference value.

Battery runtime h

battery_runtime_h

Battery runtime for selected critical load

Scores if within ±3% of the reference value.

Battery margin h

battery_margin_h

Battery runtime minus required detour duration

Scores if within ±3% of the reference value.

Feeder voltage drop

feeder_voltage_drop_percent

Feeder voltage drop at the detour device load

Scores if within ±3% of the reference value.

Voltage drop margin

voltage_drop_margin_percent

Allowable voltage drop minus computed voltage drop

Scores if within ±3% of the reference value.

Overall pass score

overall_pass_score

1.0 when detour VMS, network, RF, battery, and voltage checks pass

Scores if within ±1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All source-pack values visible
medium:
Same deterministic source-pack values with package-level aggregation
hard:
Same deterministic source-pack values with cross-discipline handoff checks

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • emergency-detour-roadside-device-continuity-package_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are an ITS and emergency traffic operations engineer checking a task-owned synthetic SSC-01 detour device continuity package.2 3Use only the task-owned synthetic source pack values below for numeric grading. MUTCD detour practice, ITS network design, RF link-budget workflows, and roadside power checks shape the context only; they are not extra data sources for this instance.4 5## Scene6 7- Product: `SSC-01-LH-04`8- Detour plan: `DETOUR-SSC01-004`9- Device inventory: `DEV-SSC01-004`10- RF link sheet: `RF-SSC01-004`11- Power topology: `PWR-SSC01-004`12- Operations memo: `MEMO-SSC01-004`13- Selected message: `DETOUR USE RAMP B`14 15## Source Values16 17- VMS character height: {{ vms_character_height_in }} in18- Detour speed: {{ detour_speed_kmh }} km/h19- Reading rate: {{ reading_rate_chars_s }} chars/s20- Message length: {{ detour_message_length_chars }} chars21- CCTV count and load: {{ cctv_count }} at {{ cctv_load_mbps }} Mbps22- VMS count and load: {{ vms_count }} at {{ vms_load_mbps }} Mbps23- Radio and controller load: {{ radio_load_mbps }} Mbps and {{ controller_load_mbps }} Mbps24- Network overhead and uplink: {{ network_overhead_pct }} % and {{ uplink_capacity_mbps }} Mbps25- RF transmit power, gains, path loss, misc loss, fade margin, and sensitivity: {{ rf_tx_power_dbm }} dBm, {{ rf_tx_gain_db }} dB, {{ rf_rx_gain_db }} dB, {{ rf_path_loss_db }} dB, {{ rf_misc_loss_db }} dB, {{ rf_fade_margin_db }} dB, {{ rf_receiver_sensitivity_dbm }} dBm26- Battery capacity and efficiency: {{ battery_capacity_kwh }} kWh and {{ battery_efficiency }}27- Critical load and required duration: {{ critical_load_w }} W and {{ required_detour_duration_h }} h28- Feeder length, resistance, voltage, power factor, and voltage-drop limit: {{ feeder_length_km }} km, {{ conductor_resistance_ohm_km }} ohm/km, {{ feeder_voltage_v }} V, {{ power_factor }}, {{ allowable_voltage_drop_pct }} %29 30## Required Calculations31 32- VMS reading time is character height times 40 ft/in, converted to metres, divided by detour speed.33- Message margin is readable characters minus selected message length.34- Required network load is base device load times the overhead factor.35- RF received power is transmit power plus gains minus path, miscellaneous, and fade losses.36- RF link margin is received power minus receiver sensitivity.37- Battery runtime is `capacity x efficiency / (critical load / 1000)`.38- Feeder voltage drop is `2 x length x resistance x current / voltage x 100`.39- Overall pass score is `1.0` only when VMS, network, RF, battery, and voltage-drop margins pass.40 41Write a compact memo to `/workspace/output.md`. Include a source-boundary statement that this is a task-owned synthetic source pack. Preserve the source IDs above and state that the baseline source pack passes the current synthetic checks.42 43Do not claim authority approval, accepted project evidence, software export validity, full standards compliance, executable source-pack hardening, generated benchmark readiness, or benchmark readiness.44 45Include a fenced JSON block with exactly these numeric keys:46 47```json48{49 "vms_reading_time_s": <numeric_value>,50 "vms_message_margin_chars": <numeric_value>,51 "required_network_mbps": <numeric_value>,52 "network_headroom_mbps": <numeric_value>,53 "rf_received_power_dbm": <numeric_value>,54 "rf_link_margin_db": <numeric_value>,55 "battery_runtime_h": <numeric_value>,56 "battery_margin_h": <numeric_value>,57 "feeder_voltage_drop_percent": <numeric_value>,58 "voltage_drop_margin_percent": <numeric_value>,59 "overall_pass_score": <numeric_value>60}61```62

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Ssc01 detour device continuity

ssc01_detour_device_continuity

SSC-01 task-owned synthetic emergency detour device continuity package

emergency-detour-roadside-device-continuity
Parameter ranges

Example task

emergency-detour-roadside-device-continuity-ssc01-detour-device-continuity-preview — hard difficulty, all inputs given.

SSC-01 task-owned synthetic emergency detour device continuity package. emergency-detour-roadside-device-continuity. Required outputs: vms_reading_time_s, vms_message_margin_chars, required_network_mbps, network_headroom_mbps, rf_received_power_dbm, rf_link_margin_db

The model sees

Scenario context and visible inputs.

vms_character_height_in
10 to 10 in
detour_speed_kmh
80 to 80 km/h
reading_rate_chars_s
4 to 4 chars/s
detour_message_length_chars
20 to 20 chars
cctv_count
3 to 3
cctv_load_mbps
4 to 4 Mbps
vms_count
2 to 2
vms_load_mbps
2 to 2 Mbps
radio_load_mbps
1.2 to 1.2 Mbps
controller_load_mbps
0.8 to 0.8 Mbps
network_overhead_pct
20 to 20 %
uplink_capacity_mbps
35 to 35 Mbps
rf_tx_power_dbm
20 to 20 dBm
rf_tx_gain_db
12 to 12 dB
rf_rx_gain_db
12 to 12 dB
rf_path_loss_db
108 to 108 dB
rf_misc_loss_db
3 to 3 dB
rf_fade_margin_db
10 to 10 dB
rf_receiver_sensitivity_dbm
-90 to -90 dBm
battery_capacity_kwh
8 to 8 kWh
battery_efficiency
0.9 to 0.9
critical_load_w
650 to 650 W
required_detour_duration_h
8 to 8 h
feeder_length_km
0.12 to 0.12 km
conductor_resistance_ohm_km
0.8 to 0.8 ohm/km
feeder_voltage_v
230 to 230 V
power_factor
0.95 to 0.95
allowable_voltage_drop_pct
5 to 5 %

Executable tool: emergency-detour-roadside-device-continuity-package_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "vms_reading_time_s": <number>,
  "vms_message_margin_chars": <number>,
  "required_network_mbps": <number>,
  "network_headroom_mbps": <number>,
  "rf_received_power_dbm": <number>,
  "rf_link_margin_db": <number>,
  "battery_runtime_h": <number>,
  "battery_margin_h": <number>,
  "feeder_voltage_drop_percent": <number>,
  "voltage_drop_margin_percent": <number>,
  "overall_pass_score": <number>
}
  • vms_reading_time_s · scored within ±3%
  • vms_message_margin_chars · scored within ±3%
  • required_network_mbps · scored within ±3%
  • network_headroom_mbps · scored within ±3%
  • rf_received_power_dbm · scored within ±3%
  • rf_link_margin_db · scored within ±3%
  • battery_runtime_h · scored within ±3%
  • battery_margin_h · scored within ±3%
  • feeder_voltage_drop_percent · scored within ±3%
  • voltage_drop_margin_percent · scored within ±3%
  • overall_pass_score · scored within ±1%