LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
electricalwith-tool

Yellow Interval Calculation

Calculates the yellow change interval for a traffic signal approach using the metric ITE kinematic equation. The template converts approach speed to m/s, applies perception-reaction time, deceleration rate, and road grade, then reports both raw and one-decimal rounded yellow interval.

with-tool: The model is given an executable Python calculator script.

Standards

AS 1742.14ITE Yellow Interval EquationMUTCD

Tags

deterministicelectricalkinematicssignal-timingtraffic-signalsyellow-interval

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

4 inputs

Always given

Included directly in every task prompt.

3

  • Approach speed kmh

    approach_speed_kmh

    Approach speed

    10 – 120 km/h

  • Perception reaction time

    perception_reaction_time_s

    Driver perception-reaction time

    0.5 – 2.5 s

  • Deceleration rate

    deceleration_rate_m_s2

    Comfortable deceleration rate

    1.5 – 5 m/s2

Hidden at higher difficulty

Visible in easier tasks and withheld in one or more harder tiers.

1

  • Road grade pct

    road_grade_pct

    Approach grade, positive for upgrade and negative for downgrade

    Hidden at hard difficulty.

    -10 – 10 %

Scored outputs

4 outputs

Approach speed m s

approach_speed_m_s

Approach speed converted to metres per second

Scores if within ±1% of the reference value.

Grade adjusted denominator

grade_adjusted_denominator

Denominator in the metric ITE stopping term

Scores if within ±3% of the reference value.

Yellow interval s

yellow_interval_s

Calculated yellow interval

Scores if within ±3% of the reference value.

Yellow interval rounded s

yellow_interval_rounded_s

Yellow interval rounded to one decimal place

Scores if within ±1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

easy

All inputs given

Urban approach with all kinematic inputs given

medium

All inputs given

Mixed speed approaches and grade effects

hard

Some inputs hidden

Grade value hidden in the site context

Hidden inputs

  • Road grade pctroad_grade_pct

Prompt replacement text

Use the approach grade implied by {{ archetype.description }}.

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • yellow-interval-calculation_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a senior traffic signals engineer calculating a yellow change interval.2 3## Problem4 5Calculate the yellow interval duration for the signal approach using the metric ITE kinematic equation.6 7## Given8 9| Parameter | Value | Unit |10|-----------|-------|------|11| Approach speed | {{ approach_speed_kmh }} | km/h |12| Perception-reaction time | {{ perception_reaction_time_s }} | s |13| Deceleration rate | {{ deceleration_rate_m_s2 }} | m/s2 |14{% if road_grade_pct is defined %}15| Road grade | {{ road_grade_pct }} | % |16{% endif %}17{% if archetype_description is defined %}18 19### Site Context20 21{{ archetype_description }}22{% endif %}23 24{% if tool_available %}25## Available Tool26 27A yellow interval calculation tool is available at `/workspace/yellow-interval-calculation_calc.py`. Run it with:28 29```bash30python3 /workspace/yellow-interval-calculation_calc.py --help31```32{% endif %}33 34## Required35 36Calculate:37 381. Approach speed in m/s392. Grade-adjusted denominator in the stopping term403. Yellow interval in seconds414. Yellow interval rounded to one decimal place42 43## Constraints44 45- Convert speed using `v_m_s = v_km_h / 3.6`.46- Use the metric ITE form `Y = t + v / (2a + 19.62G)`.47- `G` is grade as a decimal, positive for upgrade and negative for downgrade.48- Round the final signal timing value to one decimal place.49 50## Output Format51 52Show your working in Markdown. At the end, include a JSON block with exactly these keys:53 54```json55{56 "approach_speed_m_s": <numeric_value>,57 "grade_adjusted_denominator": <numeric_value>,58 "yellow_interval_s": <numeric_value>,59 "yellow_interval_rounded_s": <numeric_value>60}61```62 63Write your complete solution to `/workspace/output.md`.64

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Urban arterial

urban_arterial

Urban arterial signal approach

urban-intersectionarterial-road
Parameter ranges
approach_speed_kmh
40 – 70
perception_reaction_time_s
0.8 – 1.2
deceleration_rate_m_s2
2.5 – 3.5
road_grade_pct
-4 – 4

High speed approach

high_speed_approach

High-speed signalised approach

rural-highwayouter-urban-arterial
Parameter ranges
approach_speed_kmh
70 – 110
perception_reaction_time_s
1 – 1.5
deceleration_rate_m_s2
2 – 3.2
road_grade_pct
-6 – 6

Steep grade approach

steep_grade_approach

Signal approach with material grade effect

hilly-arterialbridge-approach
Parameter ranges
approach_speed_kmh
40 – 90
perception_reaction_time_s
1 – 1.5
deceleration_rate_m_s2
2 – 3
road_grade_pct
-10 – 10

Example task

hilly-arterial-steep-grade-approach-preview — hard difficulty, some inputs hidden.

Signal approach with material grade effect. hilly-arterial. Required outputs: approach_speed_m_s, grade_adjusted_denominator, yellow_interval_s, yellow_interval_rounded_s

The model sees

Scenario context and visible inputs.

approach_speed_kmh
40 to 90 km/h
perception_reaction_time_s
1 to 1.5 s
deceleration_rate_m_s2
2 to 3 m/s2

Executable tool: yellow-interval-calculation_calc.py

The model must infer

Inputs withheld at this difficulty.

  • Road grade pct

    road_grade_pct

Stand-in text in the prompt

Use the approach grade implied by {{ archetype.description }}.

The model must produce

The scored JSON answer schema.

{
  "approach_speed_m_s": <number>,
  "grade_adjusted_denominator": <number>,
  "yellow_interval_s": <number>,
  "yellow_interval_rounded_s": <number>
}
  • approach_speed_m_s · scored within ±1%
  • grade_adjusted_denominator · scored within ±3%
  • yellow_interval_s · scored within ±3%
  • yellow_interval_rounded_s · scored within ±1%