LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
structuralwith-tool

Lap Splice Length

Calculates lap splice length from a provided development length and explicit splice, bar-location, and coating factors. The template rounds the required lap length up to the nearest 10 mm and compares it with a provided lap length.

with-tool: The model is given an executable Python calculator script.

Standards

ACI 318AS 3600

Tags

detailingdeterministiclap-splicerebarstructural

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

5 inputs

Always given

Included directly in every task prompt.

5

  • Development length

    development_length_mm

    Base development length

    100 – 4000 mm

  • Splice class factor

    splice_class_factor

    Explicit splice class factor

    0.5 – 2.5

  • Bar location factor

    bar_location_factor

    Explicit bar location factor

    0.5 – 2

  • Coating factor

    coating_factor

    Explicit coating factor

    0.5 – 2

  • Provided lap length

    provided_lap_length_mm

    Provided lap length to compare against the rounded requirement

    0 – 8000 mm

Scored outputs

4 outputs

Calculated lap length

calculated_lap_length_mm

Calculated unrounded lap splice length

Scores if within ±3% of the reference value.

Rounded lap length

rounded_lap_length_mm

Required lap length rounded up to the nearest 10 mm

Scores if within ±1% of the reference value.

Provided margin

provided_margin_mm

Provided lap length minus rounded required lap length

Scores if within ±3% of the reference value.

Provided lap satisfies

provided_lap_satisfies

Numeric flag where 1 means the provided lap satisfies the requirement

Scores if within ±1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All parameters given for slab reinforcement
medium:
All parameters given across reinforcement elements
hard:
All parameters given for wall reinforcement

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • lap-splice-length_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a senior structural engineer specializing in reinforcement detailing.2 3## Problem4 5Calculate reduced lap splice length from a provided development length and explicit splice factors.6 7## Given8 9| Parameter | Value | Unit |10|-----------|-------|------|11| Development length | {{ development_length_mm }} | mm |12| Splice class factor | {{ splice_class_factor }} | - |13| Bar location factor | {{ bar_location_factor }} | - |14| Coating factor | {{ coating_factor }} | - |15| Provided lap length | {{ provided_lap_length_mm }} | mm |16 17{% if archetype_description is defined %}18### Detailing Context19 20{{ archetype_description }}21{% endif %}22 23{% if tool_available %}24## Available Tool25 26A lap splice length calculation tool is available at `/workspace/{{ meta.name }}_calc.py`. Run it with:27 28```bash29python3 /workspace/{{ meta.name }}_calc.py --help30```31 32You may use this tool to verify your calculations or compute values directly.33{% endif %}34 35## Required36 37Calculate the following:38 391. Calculated lap length402. Required lap length rounded up to the nearest 10 mm413. Provided lap margin424. Numeric pass flag, where 1 means the provided lap satisfies the rounded required lap43 44## Constraints45 46- No internet access is available. Work from engineering knowledge and the provided tool.47- Use only the explicit factors given in the prompt.48- Use calculated lap length = development length x splice class factor x bar location factor x coating factor.49- Round required lap length up to the nearest 10 mm.50 51## Output Format52 53Show your step-by-step working in Markdown. At the end of your solution, include a JSON block with your final answers in exactly this format:54 55```json56{57 "calculated_lap_length_mm": <numeric_value>,58 "rounded_lap_length_mm": <numeric_value>,59 "provided_margin_mm": <numeric_value>,60 "provided_lap_satisfies": <numeric_value>61}62```63 64Write your complete solution to `/workspace/output.md`.65 66

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Slab rebar

slab_rebar

Slab reinforcement lap splice check

concrete-slabreinforcement-detailing
Parameter ranges
development_length_mm
300 – 1600
splice_class_factor
1 – 1.6
bar_location_factor
1 – 1.3
coating_factor
1 – 1.5
provided_lap_length_mm
400 – 3000

Wall rebar

wall_rebar

Wall reinforcement lap splice check

concrete-wallvertical-reinforcement
Parameter ranges
development_length_mm
500 – 2500
splice_class_factor
1 – 1.8
bar_location_factor
1 – 1.4
coating_factor
1 – 1.5
provided_lap_length_mm
700 – 5000

Example task

concrete-wall-wall-rebar-preview — hard difficulty, all inputs given.

Wall reinforcement lap splice check. concrete-wall. Required outputs: calculated_lap_length_mm, rounded_lap_length_mm, provided_margin_mm, provided_lap_satisfies

The model sees

Scenario context and visible inputs.

development_length_mm
500 to 2500 mm
splice_class_factor
1 to 1.8 -
bar_location_factor
1 to 1.4 -
coating_factor
1 to 1.5 -
provided_lap_length_mm
700 to 5000 mm

Executable tool: lap-splice-length_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "calculated_lap_length_mm": <number>,
  "rounded_lap_length_mm": <number>,
  "provided_margin_mm": <number>,
  "provided_lap_satisfies": <number>
}
  • calculated_lap_length_mm · scored within ±3%
  • rounded_lap_length_mm · scored within ±1%
  • provided_margin_mm · scored within ±3%
  • provided_lap_satisfies · scored within ±1%