LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
electricalwith-tool

Shaft Dimensions

Calculates a reduced lift shaft envelope from car dimensions, clearances, counterweight allowance, rated speed, and car count. The template reports shaft width, shaft depth, pit depth, and headroom using explicit clearance formulas for vertical transportation planning.

with-tool: The model is given an executable Python calculator script.

Standards

AS 1735.1EN 81-20ISO 4190-1

Tags

deterministicdimensionselectricalliftshaftvertical-transportation

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

9 inputs

Always given

Included directly in every task prompt.

8
Show 8 inputs

  • Car internal width

    car_internal_width_mm

    Lift car internal width

    600 – 3000 mm

  • Car internal depth

    car_internal_depth_mm

    Lift car internal depth

    800 – 4000 mm

  • Side clearance

    side_clearance_mm

    Clearance on each side of the car

    50 – 500 mm

  • Front clearance

    front_clearance_mm

    Front shaft clearance allowance

    50 – 800 mm

  • Counterweight width

    counterweight_width_mm

    Counterweight width allowance

    0 – 800 mm

  • Rated speed

    rated_speed_m_s

    Lift rated speed

    0.4 – 8 m/s

  • Car

    car_count

    Number of cars in the shaft group

    1 – 8 count

  • Inter car clearance

    inter_car_clearance_mm

    Clearance between adjacent cars

    0 – 800 mm

Hidden at higher difficulty

Visible in easier tasks and withheld in one or more harder tiers.

1

  • Rear clearance

    rear_clearance_mm

    Rear shaft clearance allowance

    Hidden at hard difficulty.

    50 – 800 mm

Scored outputs

4 outputs

Shaft width

shaft_width_mm

Required shaft width

Scores if within ±3% of the reference value.

Shaft depth

shaft_depth_mm

Required shaft depth

Scores if within ±3% of the reference value.

Pit depth

pit_depth_mm

Reduced pit depth allowance

Scores if within ±3% of the reference value.

Headroom

headroom_mm

Reduced headroom allowance

Scores if within ±3% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

easy

All inputs given

Passenger lift with all values visible

medium

All inputs given

Lift shaft selected from passenger or goods cases

hard

Some inputs hidden

Goods lift with rear clearance embedded in context

Hidden inputs

  • Rear clearancerear_clearance_mm

Prompt replacement text

Use the rear clearance allowance implied by {{ archetype.description }}.

Rear clearance restricted to: 300

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • shaft-dimensions_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1# ABOUTME: Prompt template for reduced lift shaft dimension tasks.2# ABOUTME: Presents car dimensions, clearances, counterweight allowance, speed, and count.3 4You are a senior vertical transportation engineer sizing a reduced lift shaft envelope.5 6## Given7 8| Parameter | Value | Unit |9|-----------|-------|------|10| Car internal width | {{ car_internal_width_mm }} | mm |11| Car internal depth | {{ car_internal_depth_mm }} | mm |12| Side clearance | {{ side_clearance_mm }} | mm |13| Front clearance | {{ front_clearance_mm }} | mm |14| Rear clearance | {{ rear_clearance_mm }} | mm |15| Counterweight width allowance | {{ counterweight_width_mm }} | mm |16| Rated speed | {{ rated_speed_m_s }} | m/s |17| Number of cars in shaft group | {{ car_count }} | count |18| Inter-car clearance | {{ inter_car_clearance_mm }} | mm |19 20## Constraints21 22- Shaft width equals car count times `(car width + 2 * side clearance + counterweight width)` plus inter-car clearances between cars.23- Shaft depth equals car depth plus front and rear clearances.24- Reduced pit depth equals `1200 + rated speed * 250`.25- Reduced headroom equals `3600 + rated speed * 500`.26 27## Output Format28 29Include a JSON block with exactly these keys:30 31```json32{33 "shaft_width_mm": <numeric_value>,34 "shaft_depth_mm": <numeric_value>,35 "pit_depth_mm": <numeric_value>,36 "headroom_mm": <numeric_value>37}38```39 40Write your complete solution to `/workspace/output.md`.41

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Passenger lift

passenger_lift

Passenger lift shaft

passenger-liftshaft-planning
Parameter ranges
car_internal_width_mm
1000 – 1800
car_internal_depth_mm
1200 – 2200
side_clearance_mm
150 – 300
front_clearance_mm
200 – 500
rear_clearance_mm
100 – 350
counterweight_width_mm
250 – 500
rated_speed_m_s
1 – 2.5
car_count
1 – 3
inter_car_clearance_mm
150 – 350

Goods lift

goods_lift

Goods lift shaft

goods-liftshaft-planning
Parameter ranges
car_internal_width_mm
1600 – 2800
car_internal_depth_mm
2000 – 3600
side_clearance_mm
200 – 450
front_clearance_mm
300 – 700
rear_clearance_mm
150 – 500
counterweight_width_mm
300 – 700
rated_speed_m_s
0.5 – 1.6
car_count
1 – 2
inter_car_clearance_mm
200 – 500

Example task

goods-lift-goods-lift-preview — hard difficulty, some inputs hidden.

Goods lift shaft. goods-lift. Required outputs: shaft_width_mm, shaft_depth_mm, pit_depth_mm, headroom_mm

The model sees

Scenario context and visible inputs.

car_internal_width_mm
1600 to 2800 mm
car_internal_depth_mm
2000 to 3600 mm
side_clearance_mm
200 to 450 mm
front_clearance_mm
300 to 700 mm
counterweight_width_mm
300 to 700 mm
rated_speed_m_s
0.5 to 1.6 m/s
car_count
1 to 2 count
inter_car_clearance_mm
200 to 500 mm

Executable tool: shaft-dimensions_calc.py

The model must infer

Inputs withheld at this difficulty.

  • Rear clearance

    rear_clearance_mm

Stand-in text in the prompt

Use the rear clearance allowance implied by {{ archetype.description }}.

The model must produce

The scored JSON answer schema.

{
  "shaft_width_mm": <number>,
  "shaft_depth_mm": <number>,
  "pit_depth_mm": <number>,
  "headroom_mm": <number>
}
  • shaft_width_mm · scored within ±3%
  • shaft_depth_mm · scored within ±3%
  • pit_depth_mm · scored within ±3%
  • headroom_mm · scored within ±3%