LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
electricalwith-tool

All Red Interval Calculation

Calculates the all-red clearance interval for a vehicle to clear an intersection after yellow. The reduced method divides intersection width plus vehicle length by vehicle speed, rounds the operational interval to one decimal place, and caps it at six seconds.

with-tool: The model is given an executable Python calculator script.

Standards

AS 1742.14MUTCD

Tags

all-redclearancedeterministicelectricaltraffic-signals

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

3 inputs

Always given

Included directly in every task prompt.

2

  • Intersection width

    intersection_width_m

    Distance across the conflict area

    3 – 80 m

  • Vehicle length

    vehicle_length_m

    Design vehicle length

    3 – 30 m

Hidden at higher difficulty

Visible in easier tasks and withheld in one or more harder tiers.

1

  • Vehicle speed

    vehicle_speed_m_s

    Vehicle clearance speed

    Hidden at hard difficulty.

    1 – 35 m/s

Scored outputs

3 outputs

Clearance distance

clearance_distance_m

Total clearance distance

Scores if within ±3% of the reference value.

Raw all red interval s

raw_all_red_interval_s

Uncapped clearance interval

Scores if within ±3% of the reference value.

All red interval s

all_red_interval_s

Rounded all-red interval capped at six seconds

Scores if within ±1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

easy

All inputs given

Urban intersection with all values visible

medium

All inputs given

Urban or wide intersection

hard

Some inputs hidden

Vehicle speed hidden in clearance context

Hidden inputs

  • Vehicle speed m svehicle_speed_m_s

Prompt replacement text

Use the clearance speed implied by {{ archetype.description }}.

Vehicle speed m s restricted to: 12

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • all-red-interval-calculation_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a senior traffic signals engineer calculating an all-red clearance interval.2 3## Given4 5| Parameter | Value | Unit |6|-----------|-------|------|7| Intersection width | {{ intersection_width_m }} | m |8| Vehicle length | {{ vehicle_length_m }} | m |9{% if vehicle_speed_m_s is defined %}10| Vehicle speed | {{ vehicle_speed_m_s }} | m/s |11{% endif %}12 13## Constraints14 15- Clearance distance equals intersection width plus vehicle length.16- Raw all-red interval equals clearance distance divided by vehicle speed.17- Round the operational all-red interval to one decimal place and cap it at 6.0 s.18 19## Output Format20 21Include a JSON block with exactly these keys:22 23```json24{25 "clearance_distance_m": <numeric_value>,26 "raw_all_red_interval_s": <numeric_value>,27 "all_red_interval_s": <numeric_value>28}29```30 31Write your complete solution to `/workspace/output.md`.32

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Urban intersection

urban_intersection

Urban signalised intersection

urban-intersectionarterial-road
Parameter ranges
intersection_width_m
8 – 25
vehicle_length_m
4 – 12
vehicle_speed_m_s
6 – 16

Wide intersection

wide_intersection

Wide intersection with longer design vehicles

freight-routemulti-lane-arterial
Parameter ranges
intersection_width_m
20 – 60
vehicle_length_m
8 – 25
vehicle_speed_m_s
5 – 18

Example task

freight-route-wide-intersection-preview — hard difficulty, some inputs hidden.

Wide intersection with longer design vehicles. freight-route. Required outputs: clearance_distance_m, raw_all_red_interval_s, all_red_interval_s

The model sees

Scenario context and visible inputs.

intersection_width_m
20 to 60 m
vehicle_length_m
8 to 25 m

Executable tool: all-red-interval-calculation_calc.py

The model must infer

Inputs withheld at this difficulty.

  • Vehicle speed m s

    vehicle_speed_m_s

Stand-in text in the prompt

Use the clearance speed implied by {{ archetype.description }}.

The model must produce

The scored JSON answer schema.

{
  "clearance_distance_m": <number>,
  "raw_all_red_interval_s": <number>,
  "all_red_interval_s": <number>
}
  • clearance_distance_m · scored within ±3%
  • raw_all_red_interval_s · scored within ±3%
  • all_red_interval_s · scored within ±1%