LIVEdataset aec-bench@releasetasks 552models 18disciplines 5last submission … · built …

civilwith-tool

Intersection Sight Distance

Calculates the required intersection sight distance (ISD) along the major road at unsignalised intersections using ISD = V × t_gap / 3.6 per AGRD Part 4A. Adjusts the base gap acceptance time for control type, vehicle class, approach grade, and number of crossing lanes, then derives sight-triangle dimensions for clearance verification.

with-tool: The model is given an executable Python calculator script.

Standards

AGRD Part 4A §3

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

01
Template
The reusable contract shown on this page.
02
Scenario
An archetype and site context are sampled.
03
Difficulty tier
Inputs may be hidden at harder tiers.
04
Task prompt
The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

6 inputs

Always given

Included directly in every task prompt.

Design speed kmh
design_speed_kmh
Design speed of the major road V
40 – 130 km/h
Control type
control_type
Traffic control on the minor approach
give_waystop
Approach grade pct
approach_grade_pct
Grade of the minor-road approach (positive = upgrade from intersection)
-6 – 10 %
Num lanes to cross
num_lanes_to_cross
Number of lanes on the major road the minor-road vehicle must cross
2 – 6 lanes

Hidden at higher difficulty

Visible in easier tasks and withheld in one or more harder tiers.

Vehicle type
vehicle_type
Design vehicle entering from the minor road
Hidden at hard difficulty.
passengersingle_unit_trucksemi_trailer
Setback distance
setback_distance_m
Distance from major-road edge to driver eye on the minor approach
Hidden at hard difficulty.
3 – 15 m

Scored outputs

4 outputs

Gap time s

gap_time_s

Total gap acceptance time including all corrections (s)

Scores if within ±3% of the reference value.

Required isd

required_isd_m

Required intersection sight distance along the major road (m)

Scores if within ±3% of the reference value.

Sight triangle major

sight_triangle_major_m

Sight triangle leg along the major road (m)

Scores if within ±3% of the reference value.

Sight triangle minor

sight_triangle_minor_m

Sight triangle leg along the minor road (m)

Scores if within ±3% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

easy

All inputs given

All parameters given, flat grade, passenger vehicle on a two-lane road

medium

All inputs given

All parameters given, any intersection type including steep grades and extra lanes

hard

Some inputs hidden

Vehicle type and setback distance hidden — agent must infer from intersection context

Hidden inputs

Vehicle typevehicle_type
Setback distancesetback_distance_m

Prompt replacement text

The intersection serves {{ archetype.description }} ({{ archetype.site_context }}). Select an appropriate design vehicle and setback distance for this context.

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

instruction.md
intersection-sight-distance_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a senior civil engineer specializing in road geometry and intersection design.2 3## Problem4 5Calculate the required intersection sight distance (ISD) for a minor-road approach at an unsignalised intersection.6 7## Given8 9| Parameter | Value | Unit |10|-----------|-------|------|11| Major road design speed (V) | {{ design_speed_kmh }} | km/h |12| Control type | {{ control_type }} | - |13| Approach grade | {{ approach_grade_pct }} | % |14| Lanes to cross | {{ num_lanes_to_cross }} | lanes |15{% if vehicle_type is defined %}16| Design vehicle | {{ vehicle_type }} | - |17{% endif %}18{% if setback_distance_m is defined %}19| Setback distance | {{ setback_distance_m }} | m |20{% endif %}21{% if archetype_description is defined %}22 23### Site Conditions24 25{{ archetype_description }}26{% endif %}27 28{% if tool_available %}29## Available Tool30 31An intersection sight distance calculation tool is available at `/workspace/{{ meta.name }}_calc.py`. Run it with:32 33```bash34python3 /workspace/{{ meta.name }}_calc.py --help35```36 37You may use this tool to verify your calculations or compute values directly.38{% endif %}39 40## Required41 42Calculate the following:43 441. Total gap acceptance time t_gap (s)452. Required intersection sight distance ISD (m)463. Sight triangle leg along the major road (m)474. Sight triangle leg along the minor road (m)48 49## Applicable Standards50 51- Austroads Guide to Road Design Part 4A (AGRD Part 4A §3)52 53## Constraints54 55- No internet access is available. Work from engineering knowledge and the provided tool.56- The intersection sight distance is calculated as:57  - ISD = V × t_gap / 3.658  - where V is the major road design speed in km/h and t_gap is the total gap acceptance time in seconds59- Base gap acceptance times (for a 2-lane major road, grade ≤ 3%):60  - **Give way** — passenger: 6.5 s, single-unit truck: 8.5 s, semi-trailer: 10.5 s61  - **Stop** — passenger: 7.5 s, single-unit truck: 9.5 s, semi-trailer: 11.5 s62- **Grade correction**: for minor-road upgrade grades exceeding 3%, add 0.2 s per percent grade above 3%63  - e.g. a 5% upgrade adds 0.2 × (5 − 3) = 0.4 s64  - Downgrades receive no additional time65- **Lane correction**: for major roads with more than 2 lanes, add time per extra lane:66  - Passenger vehicles: +0.5 s per extra lane67  - Trucks: +0.7 s per extra lane68- Total gap time: t_gap = t_base + t_grade + t_lane69- The sight triangle has two legs:70  - Major-road leg = ISD71  - Minor-road leg = setback distance (distance from major-road edge to driver eye position)72{% if vehicle_type is not defined %}73- Design vehicle type is not provided; select an appropriate vehicle based on the intersection context. Use "passenger" for typical urban/suburban roads, "single_unit_truck" where goods vehicles are common, and "semi_trailer" for industrial or freight routes.74{% endif %}75{% if setback_distance_m is not defined %}76- Setback distance is not provided; use a value appropriate for the intersection geometry. Typical values: 5–8 m for urban streets, 8–15 m for industrial accesses with larger turning radii.77{% endif %}78 79## Output Format80 81Show your step-by-step working in Markdown. At the end of your solution, include a JSON block with your final answers in exactly this format:82 83```json84{85  "gap_time_s": <numeric_value>,86  "required_isd_m": <numeric_value>,87  "sight_triangle_major_m": <numeric_value>,88  "sight_triangle_minor_m": <numeric_value>89}90```91 92Write your complete solution to `/workspace/output.md`.93

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Suburban t intersection

suburban_t_intersection

T-intersection on a suburban arterial with give-way control and flat approach

sydney-suburban-arterialmelbourne-local-collectorbrisbane-suburban-road

Parameter ranges

design_speed_kmh: 50 – 70
control_type: {'values': ['give_way']}
approach_grade_pct: -3 – 3
num_lanes_to_cross: 2 – 4
vehicle_type: {'values': ['passenger']}
setback_distance_m: 5 – 8

Rural crossroad

rural_crossroad

Rural crossroads intersection with stop control on the minor road serving passenger vehicles

bruce-highway-side-road-qldprinces-highway-crossroad-vicnew-england-highway-nsw

Parameter ranges

design_speed_kmh: 80 – 110
control_type: {'values': ['stop']}
approach_grade_pct: -4 – 6
num_lanes_to_cross: 2
vehicle_type: {'values': ['passenger']}
setback_distance_m: 5 – 7

Urban multilane

urban_multilane

Urban multilane road with stop-controlled side street serving passenger and single-unit truck traffic

sydney-pacific-highway-side-roadmelbourne-punt-road-lanegold-coast-highway-access

Parameter ranges

design_speed_kmh: 60 – 80
control_type: {'values': ['stop']}
approach_grade_pct: 3 – 8
num_lanes_to_cross: 4 – 6
vehicle_type: {'values': ['single_unit_truck']}
setback_distance_m: 5 – 8

Industrial access

industrial_access

Industrial estate access onto a collector road designed for semi-trailer turning movements

wetherill-park-industrial-nswlaverton-north-industrial-vicacacia-ridge-industrial-qld

Parameter ranges

design_speed_kmh: 50 – 80
control_type: {'values': ['give_way', 'stop']}
approach_grade_pct: -2 – 5
num_lanes_to_cross: 2 – 4
vehicle_type: {'values': ['semi_trailer']}
setback_distance_m: 10 – 15

Example task

bruce-highway-side-road-qld-rural-crossroad-preview — hard difficulty, some inputs hidden.

Rural crossroads intersection with stop control on the minor road serving passenger vehicles. bruce-highway-side-road-qld. Required outputs: gap_time_s, required_isd_m, sight_triangle_major_m, sight_triangle_minor_m

The model sees

Scenario context and visible inputs.

design_speed_kmh: 80 to 110 km/h
control_type: {'values': ['stop']}
approach_grade_pct: -4 to 6 %
num_lanes_to_cross: 2 to 2 lanes

Executable tool: intersection-sight-distance_calc.py

The model must infer

Inputs withheld at this difficulty.

Setback distance
setback_distance_m
Vehicle type
vehicle_type

Stand-in text in the prompt

The intersection serves {{ archetype.description }} ({{ archetype.site_context }}). Select an appropriate design vehicle and setback distance for this context.

The model must produce

The scored JSON answer schema.

{
  "gap_time_s": <number>,
  "required_isd_m": <number>,
  "sight_triangle_major_m": <number>,
  "sight_triangle_minor_m": <number>
}

gap_time_s · scored within ±3%
required_isd_m · scored within ±3%
sight_triangle_major_m · scored within ±3%
sight_triangle_minor_m · scored within ±3%

Intersection Sight Distance

How this task is generated

Template

Scenario

Difficulty tier

Task prompt

Parameters

Inputs

Scored outputs

Gap time s

Required isd

Sight triangle major

Sight triangle minor

Difficulty

easy

medium

hard

Task bundle

Scenario archetypes

Suburban t intersection

Rural crossroad

Urban multilane

Industrial access

Example task

The model sees

The model must infer

The model must produce