LIVEdataset aec-bench@releasetasks 552models 18last submission · built
electricalwith-tool

Pedestrian Clearance Time

Calculates the pedestrian clearance interval for a signalised crossing from crosswalk length and assumed walking speed. The deterministic relation divides crossing distance by walking speed and reports both exact and whole-second rounded flashing clearance time.

with-tool: The model is given an executable Python calculator script.

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

2 inputs

Always given

Included directly in every task prompt.

1
  • Crosswalk length

    crosswalk_length_m

    Crosswalk length

    3 – 60 m

Hidden at higher difficulty

Visible in easier tasks and withheld in one or more harder tiers.

1
  • Walking speed

    walking_speed_m_s

    Design pedestrian walking speed

    Hidden at hard difficulty.

    0.6 – 1.8 m/s

Scored outputs

2 outputs

Pedestrian clearance time s

pedestrian_clearance_time_s

Calculated pedestrian clearance time

Scores if within ±3% of the reference value.

Pedestrian clearance rounded s

pedestrian_clearance_rounded_s

Clearance time rounded up to a whole second

Scores if within ±1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

easy

All inputs given

Short crossing with all inputs visible

medium

All inputs given

Urban or arterial crossing

hard

Some inputs hidden

Walking speed hidden in accessibility context

Hidden inputs

  • Walking speed m swalking_speed_m_s

Prompt replacement text

Use the design walking speed implied by {{ archetype.description }}.

Walking speed m s restricted to: 0.8

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • pedestrian-clearance-time_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a senior traffic signals engineer calculating pedestrian clearance timing.2 3## Given4 5| Parameter | Value | Unit |6|-----------|-------|------|7| Crosswalk length | {{ crosswalk_length_m }} | m |8{% if walking_speed_m_s is defined %}9| Walking speed | {{ walking_speed_m_s }} | m/s |10{% endif %}11 12## Constraints13 14- Use `clearance_time = crosswalk_length / walking_speed`.15- Round the operational flashing clearance value up to the next whole second.16 17## Output Format18 19Include a JSON block with exactly these keys:20 21```json22{23 "pedestrian_clearance_time_s": <numeric_value>,24 "pedestrian_clearance_rounded_s": <numeric_value>25}26```27 28Write your complete solution to `/workspace/output.md`.29

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Short crossing

short_crossing

Short urban pedestrian crossing

urban-intersectionlocal-street
Parameter ranges
crosswalk_length_m
3 – 12
walking_speed_m_s
1 – 1.5

Wide crossing

wide_crossing

Wide arterial or staged crossing

arterial-roadtransport-interchange
Parameter ranges
crosswalk_length_m
12 – 35
walking_speed_m_s
0.9 – 1.3

Accessible crossing

accessible_crossing

Accessible design crossing with slower walking speed

hospital-precinctaged-care-frontage
Parameter ranges
crosswalk_length_m
8 – 35
walking_speed_m_s
0.6 – 1

Example task

hospital-precinct-accessible-crossing-previewhard difficulty, some inputs hidden.

Accessible design crossing with slower walking speed. hospital-precinct. Required outputs: pedestrian_clearance_time_s, pedestrian_clearance_rounded_s

The model sees

Scenario context and visible inputs.

crosswalk_length_m
8 to 35 m

Executable tool: pedestrian-clearance-time_calc.py

The model must infer

Inputs withheld at this difficulty.

  • Walking speed m s

    walking_speed_m_s

Stand-in text in the prompt

Use the design walking speed implied by {{ archetype.description }}.

The model must produce

The scored JSON answer schema.

{
  "pedestrian_clearance_time_s": <number>,
  "pedestrian_clearance_rounded_s": <number>
}
  • pedestrian_clearance_time_s · scored within ±3%
  • pedestrian_clearance_rounded_s · scored within ±1%