LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
electricalwith-tool

Signal Overlap Approach Speed Sighting Photo Package

Calculates deterministic SSC-02 signal sighting metrics from a task-owned synthetic source pack. The template combines approach speed, grade-adjusted stopping distance, sighting time, stopping-distance margin, overlap margin, photo chainage offset, warning distance, and an overall synthetic pass score.

with-tool: The model is given an executable Python calculator script.

Standards

operator overlap review workflowrail signal sighting workflow

Tags

approach-speeddeterministicelectricaloverlapphotorailsightingsignal

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

12 inputs

Always given

Included directly in every task prompt.

12
Show 12 inputs

  • Approach speed kmh

    approach_speed_kmh

    SPEED-02-APPROACH-06 approach speed

    100 km/h

  • Reaction time

    reaction_time_s

    CRIT-02-SIGHT-06 reaction allowance

    3 s

  • Braking rate m s2

    braking_rate_m_s2

    SPEED-02-APPROACH-06 braking rate

    0.78 m/s^2

  • Grade percent

    grade_percent

    GRADE-02-ROUTE-06 adverse route grade

    0.5 %

  • Available sighting distance

    available_sighting_distance_m

    PHOTO-02-SIGHT-06 available sighting distance

    720 m

  • Required sighting time

    required_sighting_time_s

    CRIT-02-SIGHT-06 required sighting time

    8 s

  • Provided overlap

    provided_overlap_m

    SIG-02-ARRANGE-06 provided overlap

    300 m

  • Danger point distance

    danger_point_distance_m

    SIG-02-ARRANGE-06 distance to danger point

    220 m

  • Photo chainage

    photo_chainage_m

    PHOTO-02-SIGHT-06 sighting photo chainage

    12540 m

  • Signal chainage

    signal_chainage_m

    SIG-02-ARRANGE-06 signal chainage

    12480 m

  • Max photo offset

    max_photo_offset_m

    CRIT-02-SIGHT-06 maximum allowed photo offset

    80 m

  • Warning time

    warning_time_s

    CRIT-02-SIGHT-06 warning-time equivalent for distance ledger

    35 s

Scored outputs

11 outputs

Approach speed m s

approach_speed_m_s

Approach speed in metres per second

Scores if within ±3% of the reference value.

Effective braking deceleration m s2

effective_braking_deceleration_m_s2

Braking rate after adverse grade allowance

Scores if within ±0.3% of the reference value.

Stopping distance

stopping_distance_m

Reaction plus stopping distance

Scores if within ±3% of the reference value.

Sighting time s

sighting_time_s

Available sighting time

Scores if within ±3% of the reference value.

Sighting time margin s

sighting_time_margin_s

Available sighting time minus required sighting time

Scores if within ±3% of the reference value.

Stopping distance margin

stopping_distance_margin_m

Available sighting distance minus stopping distance

Scores if within ±3% of the reference value.

Overlap margin

overlap_margin_m

Provided overlap minus distance to danger point

Scores if within ±3% of the reference value.

Photo offset

photo_offset_m

Absolute offset between photo chainage and signal chainage

Scores if within ±3% of the reference value.

Photo offset margin

photo_offset_margin_m

Maximum allowed photo offset minus actual photo offset

Scores if within ±3% of the reference value.

Warning distance

warning_distance_m

Approach speed times warning time

Scores if within ±3% of the reference value.

Overall pass score

overall_pass_score

1.0 when sighting, stopping, overlap, and photo-offset margins are non-negative

Scores if within ±0.1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All source-pack values given for the SSC-02 signal overlap and sighting package
medium:
All source-pack values given for the SSC-02 signal overlap and sighting package
hard:
All source-pack values given for the SSC-02 signal overlap and sighting package

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • signal-overlap-approach-speed-sighting-photo-package_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a signalling design reviewer checking `SSC-02-LH-06`, a task-owned synthetic SSC-02 signal overlap, approach speed, and sighting photo package.2 3Use only the task-owned synthetic source pack values below for numeric grading. Signal sighting and overlap workflows shape the context only; this instance does not run signalling software, parse a real photo log, or validate an operator standard.4 5## Scene6 7- Design case: `CASE-SSC02-SIGHT-06`8- Signal arrangement: `SIG-02-ARRANGE-06`9- Approach speed table: `SPEED-02-APPROACH-06`10- Sighting photo log: `PHOTO-02-SIGHT-06`11- Route grade data: `GRADE-02-ROUTE-06`12- Sighting criterion: `CRIT-02-SIGHT-06`13- Sighting review response: `MEMO-02-SIGHT-06`14 15## Source Values16 17| Item | Value |18|------|-------|19| Approach speed | {{ approach_speed_kmh }} km/h |20| Reaction time | {{ reaction_time_s }} s |21| Braking rate | {{ braking_rate_m_s2 }} m/s^2 |22| Adverse grade | {{ grade_percent }} % |23| Available sighting distance | {{ available_sighting_distance_m }} m |24| Required sighting time | {{ required_sighting_time_s }} s |25| Provided overlap | {{ provided_overlap_m }} m |26| Distance to danger point | {{ danger_point_distance_m }} m |27| Photo chainage | {{ photo_chainage_m }} m |28| Signal chainage | {{ signal_chainage_m }} m |29| Maximum photo offset | {{ max_photo_offset_m }} m |30| Warning time | {{ warning_time_s }} s |31 32Checks:33 34- Approach speed in m/s equals approach speed divided by 3.6.35- Stopping distance uses the grade-adjusted braking deceleration.36- Sighting time equals available sighting distance divided by approach speed.37- Overlap margin equals provided overlap minus distance to danger point.38- Photo offset equals the absolute difference between photo chainage and signal chainage.39- Overall pass score is `1.0` only when sighting, stopping-distance, overlap, and photo-offset margins are non-negative; otherwise it is `0.0`.40 41## Output Format42 43Write a compact memo to `/workspace/output.md`. Preserve the object IDs above, state the task-owned synthetic source-pack boundary, and explain whether the baseline source pack passes the docs-only checks.44 45Do not claim authority approval, accepted project evidence, signal-plan validity, full standards compliance, executable real source-pack parsing, generated benchmark readiness, or benchmark readiness.46 47Include a fenced JSON block with exactly these numeric keys:48 49```json50{51 "approach_speed_m_s": <numeric_value>,52 "effective_braking_deceleration_m_s2": <numeric_value>,53 "stopping_distance_m": <numeric_value>,54 "sighting_time_s": <numeric_value>,55 "sighting_time_margin_s": <numeric_value>,56 "stopping_distance_margin_m": <numeric_value>,57 "overlap_margin_m": <numeric_value>,58 "photo_offset_m": <numeric_value>,59 "photo_offset_margin_m": <numeric_value>,60 "warning_distance_m": <numeric_value>,61 "overall_pass_score": <numeric_value>62}63```64

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Ssc02 signal overlap sighting case

ssc02_signal_overlap_sighting_case

Signal sighting package tied to one signal arrangement, approach speed table, photo log, route grade data, sighting criterion, and response memo

signal-overlap-sighting
Parameter ranges
approach_speed_kmh
100
reaction_time_s
3
braking_rate_m_s2
0.78
grade_percent
0.5
available_sighting_distance_m
720
required_sighting_time_s
8
provided_overlap_m
300
danger_point_distance_m
220
photo_chainage_m
12540
signal_chainage_m
12480
max_photo_offset_m
80
warning_time_s
35

Example task

signal-overlap-sighting-ssc02-signal-overlap-sighting-case-preview — hard difficulty, all inputs given.

Signal sighting package tied to one signal arrangement, approach speed table, photo log, route grade data, sighting criterion, and response memo. signal-overlap-sighting. Required outputs: approach_speed_m_s, effective_braking_deceleration_m_s2, stopping_distance_m, sighting_time_s, sighting_time_margin_s, stopping_distance_margin_m

The model sees

Scenario context and visible inputs.

approach_speed_kmh
100 to 100 km/h
reaction_time_s
3 to 3 s
braking_rate_m_s2
0.78 to 0.78 m/s^2
grade_percent
0.5 to 0.5 %
available_sighting_distance_m
720 to 720 m
required_sighting_time_s
8 to 8 s
provided_overlap_m
300 to 300 m
danger_point_distance_m
220 to 220 m
photo_chainage_m
12540 to 12540 m
signal_chainage_m
12480 to 12480 m
max_photo_offset_m
80 to 80 m
warning_time_s
35 to 35 s

Executable tool: signal-overlap-approach-speed-sighting-photo-package_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "approach_speed_m_s": <number>,
  "effective_braking_deceleration_m_s2": <number>,
  "stopping_distance_m": <number>,
  "sighting_time_s": <number>,
  "sighting_time_margin_s": <number>,
  "stopping_distance_margin_m": <number>,
  "overlap_margin_m": <number>,
  "photo_offset_m": <number>,
  "photo_offset_margin_m": <number>,
  "warning_distance_m": <number>,
  "overall_pass_score": <number>
}
  • approach_speed_m_s · scored within ±3%
  • effective_braking_deceleration_m_s2 · scored within ±0.3%
  • stopping_distance_m · scored within ±3%
  • sighting_time_s · scored within ±3%
  • sighting_time_margin_s · scored within ±3%
  • stopping_distance_margin_m · scored within ±3%
  • overlap_margin_m · scored within ±3%
  • photo_offset_m · scored within ±3%
  • photo_offset_margin_m · scored within ±3%
  • warning_distance_m · scored within ±3%
  • overall_pass_score · scored within ±0.1%