LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
electricalwith-tool

Car Dimensions Check

Calculates numeric margins for lift car internal width, internal depth, and clear door opening against explicit minimum requirements. The template also reports car floor area and rated load density for reduced vertical transportation checks.

with-tool: The model is given an executable Python calculator script.

Standards

AS 1735.12EN 81-70ISO 4190-1

Tags

accessibilitydeterministicdimensionselectricalliftvertical-transportation

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

7 inputs

Always given

Included directly in every task prompt.

6

  • Car internal width

    car_internal_width_mm

    Lift car internal width

    600 – 3000 mm

  • Car internal depth

    car_internal_depth_mm

    Lift car internal depth

    800 – 4000 mm

  • Door clear opening

    door_clear_opening_mm

    Clear door opening width

    500 – 2000 mm

  • Rated load

    rated_load_kg

    Lift rated load

    100 – 5000 kg

  • Minimum width

    minimum_width_mm

    Required minimum car width

    500 – 2500 mm

  • Minimum depth

    minimum_depth_mm

    Required minimum car depth

    500 – 3500 mm

Hidden at higher difficulty

Visible in easier tasks and withheld in one or more harder tiers.

1

  • Minimum door opening

    minimum_door_opening_mm

    Required minimum clear door opening

    Hidden at hard difficulty.

    500 – 1800 mm

Scored outputs

5 outputs

Width margin

width_margin_mm

Actual car width minus minimum width

Scores if within ±3% of the reference value.

Depth margin

depth_margin_mm

Actual car depth minus minimum depth

Scores if within ±3% of the reference value.

Door opening margin

door_opening_margin_mm

Actual door opening minus minimum door opening

Scores if within ±3% of the reference value.

Car floor area m2

car_floor_area_m2

Car floor area

Scores if within ±3% of the reference value.

Rated load density kg m2

rated_load_density_kg_m2

Rated load divided by car floor area

Scores if within ±3% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

easy

All inputs given

Accessible passenger lift with all values visible

medium

All inputs given

Lift car selected from passenger or goods cases

hard

Some inputs hidden

Goods lift car with minimum door opening embedded in context

Hidden inputs

  • Minimum door openingminimum_door_opening_mm

Prompt replacement text

Use the minimum clear door opening implied by {{ archetype.description }}.

Minimum door opening restricted to: 1400

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • car-dimensions-check_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1# ABOUTME: Prompt template for lift car dimension margin tasks.2# ABOUTME: Presents actual and minimum car dimensions plus rated load.3 4You are a senior vertical transportation engineer checking lift car dimension margins.5 6## Given7 8| Parameter | Value | Unit |9|-----------|-------|------|10| Car internal width | {{ car_internal_width_mm }} | mm |11| Car internal depth | {{ car_internal_depth_mm }} | mm |12| Door clear opening | {{ door_clear_opening_mm }} | mm |13| Rated load | {{ rated_load_kg }} | kg |14| Minimum internal width | {{ minimum_width_mm }} | mm |15| Minimum internal depth | {{ minimum_depth_mm }} | mm |16| Minimum door opening | {{ minimum_door_opening_mm }} | mm |17 18## Constraints19 20- Width margin equals actual car width minus minimum width.21- Depth margin equals actual car depth minus minimum depth.22- Door opening margin equals actual clear opening minus minimum clear opening.23- Car floor area equals internal width times internal depth, converted from mm2 to m2.24- Rated load density equals rated load divided by car floor area.25 26## Output Format27 28Include a JSON block with exactly these keys:29 30```json31{32 "width_margin_mm": <numeric_value>,33 "depth_margin_mm": <numeric_value>,34 "door_opening_margin_mm": <numeric_value>,35 "car_floor_area_m2": <numeric_value>,36 "rated_load_density_kg_m2": <numeric_value>37}38```39 40Write your complete solution to `/workspace/output.md`.41

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Accessible passenger lift

accessible_passenger_lift

Accessible passenger lift car

passenger-liftaccessibility
Parameter ranges
car_internal_width_mm
1100 – 1800
car_internal_depth_mm
1400 – 2200
door_clear_opening_mm
850 – 1200
rated_load_kg
630 – 1600
minimum_width_mm
1000 – 1200
minimum_depth_mm
1300 – 1500
minimum_door_opening_mm
800 – 950

Goods lift car

goods_lift_car

Goods lift car

goods-liftcar-sizing
Parameter ranges
car_internal_width_mm
1600 – 2800
car_internal_depth_mm
2000 – 3600
door_clear_opening_mm
1200 – 2400
rated_load_kg
1000 – 4000
minimum_width_mm
1400 – 2200
minimum_depth_mm
1800 – 3000
minimum_door_opening_mm
1000 – 1800

Example task

goods-lift-goods-lift-car-preview — hard difficulty, some inputs hidden.

Goods lift car. goods-lift. Required outputs: width_margin_mm, depth_margin_mm, door_opening_margin_mm, car_floor_area_m2, rated_load_density_kg_m2

The model sees

Scenario context and visible inputs.

car_internal_width_mm
1600 to 2800 mm
car_internal_depth_mm
2000 to 3600 mm
door_clear_opening_mm
1200 to 2400 mm
rated_load_kg
1000 to 4000 kg
minimum_width_mm
1400 to 2200 mm
minimum_depth_mm
1800 to 3000 mm

Executable tool: car-dimensions-check_calc.py

The model must infer

Inputs withheld at this difficulty.

  • Minimum door opening

    minimum_door_opening_mm

Stand-in text in the prompt

Use the minimum clear door opening implied by {{ archetype.description }}.

The model must produce

The scored JSON answer schema.

{
  "width_margin_mm": <number>,
  "depth_margin_mm": <number>,
  "door_opening_margin_mm": <number>,
  "car_floor_area_m2": <number>,
  "rated_load_density_kg_m2": <number>
}
  • width_margin_mm · scored within ±3%
  • depth_margin_mm · scored within ±3%
  • door_opening_margin_mm · scored within ±3%
  • car_floor_area_m2 · scored within ±3%
  • rated_load_density_kg_m2 · scored within ±3%