LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
electricalwith-tool

Vms Message Legibility Power Package

Calculates source-bound VMS operations metrics from a deterministic SSC-13 task-owned source pack. The template combines a VMS schedule, message library, road speed/geometry table, network topology, and power schedule.

with-tool: The model is given an executable Python calculator script.

Standards

MUTCD message workflowNTCIP workflowVMS legibility reviewpower schedule review

Tags

deterministicelectricalitslegibilitymessagenetworkpowervms

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

14 inputs

Always given

Included directly in every task prompt.

14
Show 14 inputs

  • Letter height

    letter_height_mm

    VMS-13-SCHED-05 display letter height

    320 mm

  • Legibility factor m per mm

    legibility_factor_m_per_mm

    MSG-13-LIB-05 legibility distance factor

    0.6 m/mm

  • Available viewing distance

    available_viewing_distance_m

    ROAD-13-SPEED-05 available VMS viewing distance

    225 m

  • Road speed kmh

    road_speed_kmh

    ROAD-13-SPEED-05 road speed

    80 km/h

  • Required read time

    required_read_time_s

    MSG-13-LIB-05 required read time

    6.5 s

  • Display power

    display_power_w

    PWR-13-SCHED-05 VMS display power

    650 W

  • Controller power

    controller_power_w

    PWR-13-SCHED-05 VMS controller power

    85 W

  • Modem power

    modem_power_w

    PWR-13-SCHED-05 VMS modem power

    25 W

  • Circuit capacity

    circuit_capacity_w

    PWR-13-SCHED-05 circuit capacity

    1200 W

  • Vms network

    vms_network_mbps

    NET-13-TOPO-05 VMS network load

    2.8 Mbps

  • Controller network

    controller_network_mbps

    NET-13-TOPO-05 controller network load

    0.4 Mbps

  • Network capacity

    network_capacity_mbps

    NET-13-TOPO-05 network capacity

    10 Mbps

  • Compliant message

    compliant_message_count

    MSG-13-LIB-05 compliant message rows

    12 count

  • Required message

    required_message_count

    MSG-13-LIB-05 required message rows

    12 count

Scored outputs

10 outputs

Required legibility distance

required_legibility_distance_m

Required legibility distance

Scores if within ±0.3% of the reference value.

Legibility distance margin

legibility_distance_margin_m

Available viewing distance minus required distance

Scores if within ±0.3% of the reference value.

Available read time s

available_read_time_s

Available read time at road speed

Scores if within ±0.3% of the reference value.

Read time margin s

read_time_margin_s

Available read time minus required read time

Scores if within ±0.3% of the reference value.

Vms power load w

vms_power_load_w

VMS display/controller/modem power load

Scores if within ±0.3% of the reference value.

Power headroom w

power_headroom_w

Circuit capacity minus VMS load

Scores if within ±0.3% of the reference value.

Network load mbps

network_load_mbps

VMS network load

Scores if within ±0.3% of the reference value.

Network headroom mbps

network_headroom_mbps

Network capacity minus VMS network load

Scores if within ±0.3% of the reference value.

Message policy match fraction

message_policy_match_fraction

Compliant message rows divided by required rows

Scores if within ±0.3% of the reference value.

Overall pass score

overall_pass_score

1.0 when VMS legibility, read-time, network, and power checks pass

Scores if within ±0.1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All source-pack values given for the SSC-13 VMS package
medium:
All source-pack values given for the SSC-13 VMS package
hard:
All source-pack values given for the SSC-13 VMS package

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • vms-message-legibility-power-package_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are an ITS/VMS engineer checking a task-owned synthetic SSC-13 message legibility and power package.2 3Use only the task-owned synthetic source pack values shown below for numeric grading. External MUTCD, owner message policy, NTCIP, and power tools shape the workflow context only; they are not extra data sources for this instance.4 5## Scene6 7- Product: `SSC-13-LH-05`8- VMS schedule: `VMS-13-SCHED-05`9- Message library: `MSG-13-LIB-05`10- Road speed and geometry: `ROAD-13-SPEED-05`11- Network topology: `NET-13-TOPO-05`12- Power schedule: `PWR-13-SCHED-05`13- VMS operations memo: `MEMO-13-VMS-05`14 15All checks use the same sign identity, message library, viewing-speed case, network path, and power schedule.16 17## Source Values18 19| Item | Value |20|------|-------|21| Letter height | {{ letter_height_mm }} mm |22| Legibility factor | {{ legibility_factor_m_per_mm }} m/mm |23| Available viewing distance | {{ available_viewing_distance_m }} m |24| Road speed | {{ road_speed_kmh }} km/h |25| Required read time | {{ required_read_time_s }} s |26| Display/controller/modem power | {{ display_power_w }} W / {{ controller_power_w }} W / {{ modem_power_w }} W |27| Circuit capacity | {{ circuit_capacity_w }} W |28| VMS/controller network load | {{ vms_network_mbps }} Mbps / {{ controller_network_mbps }} Mbps |29| Network capacity | {{ network_capacity_mbps }} Mbps |30| Compliant message rows | {{ compliant_message_count }} of {{ required_message_count }} |31 32## Output Format33 34Write a compact VMS operations memo to `/workspace/output.md`. Include a source-boundary statement that this is a task-owned synthetic source pack. Do not claim authority approval, accepted project evidence, software export validity, full standards compliance, executable real source-pack parsing, generated benchmark readiness, or benchmark readiness.35 36Include a fenced JSON block with exactly these numeric keys:37 38```json39{40 "required_legibility_distance_m": <numeric_value>,41 "legibility_distance_margin_m": <numeric_value>,42 "available_read_time_s": <numeric_value>,43 "read_time_margin_s": <numeric_value>,44 "vms_power_load_w": <numeric_value>,45 "power_headroom_w": <numeric_value>,46 "network_load_mbps": <numeric_value>,47 "network_headroom_mbps": <numeric_value>,48 "message_policy_match_fraction": <numeric_value>,49 "overall_pass_score": <numeric_value>50}51```52

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Ssc13 vms message case

ssc13_vms_message_case

VMS message legibility and power case

ssc13-vms-message
Parameter ranges

Example task

ssc13-vms-message-ssc13-vms-message-case-preview — hard difficulty, all inputs given.

VMS message legibility and power case. ssc13-vms-message. Required outputs: required_legibility_distance_m, legibility_distance_margin_m, available_read_time_s, read_time_margin_s, vms_power_load_w, power_headroom_w

The model sees

Scenario context and visible inputs.

letter_height_mm
320 to 320 mm
legibility_factor_m_per_mm
0.6 to 0.6 m/mm
available_viewing_distance_m
225 to 225 m
road_speed_kmh
80 to 80 km/h
required_read_time_s
6.5 to 6.5 s
display_power_w
650 to 650 W
controller_power_w
85 to 85 W
modem_power_w
25 to 25 W
circuit_capacity_w
1200 to 1200 W
vms_network_mbps
2.8 to 2.8 Mbps
controller_network_mbps
0.4 to 0.4 Mbps
network_capacity_mbps
10 to 10 Mbps
compliant_message_count
12 to 12 count
required_message_count
12 to 12 count

Executable tool: vms-message-legibility-power-package_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "required_legibility_distance_m": <number>,
  "legibility_distance_margin_m": <number>,
  "available_read_time_s": <number>,
  "read_time_margin_s": <number>,
  "vms_power_load_w": <number>,
  "power_headroom_w": <number>,
  "network_load_mbps": <number>,
  "network_headroom_mbps": <number>,
  "message_policy_match_fraction": <number>,
  "overall_pass_score": <number>
}
  • required_legibility_distance_m · scored within ±0.3%
  • legibility_distance_margin_m · scored within ±0.3%
  • available_read_time_s · scored within ±0.3%
  • read_time_margin_s · scored within ±0.3%
  • vms_power_load_w · scored within ±0.3%
  • power_headroom_w · scored within ±0.3%
  • network_load_mbps · scored within ±0.3%
  • network_headroom_mbps · scored within ±0.3%
  • message_policy_match_fraction · scored within ±0.3%
  • overall_pass_score · scored within ±0.1%