LIVEdataset aec-bench@releasetasks 552models 18disciplines 5last submission … · built …

civilwith-tool

Pipe Invert Calculation

Calculates the downstream invert level, obvert (crown) level, cover depth, and grade fall for a stormwater drainage pipe given upstream invert, length, grade, diameter, and downstream surface level. Checks cover adequacy against minimum requirements for the installation context per Australian local-authority stormwater drainage standards.

with-tool: The model is given an executable Python calculator script.

Standards

AS/NZS 3500.3 QUDM Section 7

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

01
Template
The reusable contract shown on this page.
02
Scenario
An archetype and site context are sampled.
03
Difficulty tier
Inputs may be hidden at harder tiers.
04
Task prompt
The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

6 inputs

Always given

Included directly in every task prompt.

Upstream invert m
upstream_invert_m
Upstream invert level IL_us
0 – 500 m AHD
Pipe length
pipe_length_m
Pipe length between pits L
1 – 200 m
Pipe grade percent
pipe_grade_percent
Pipe longitudinal grade as a percentage
0.1 – 10 %
Pipe diameter
pipe_diameter_mm
Nominal pipe internal diameter D
225300375450600750900
Surface level ds m
surface_level_ds_m
Surface level at downstream pit
0 – 500 m AHD

Optional

Used only when the sampled task needs this part of the contract.

Minimum cover
minimum_cover_mm
Minimum required cover depth over pipe crown
Derived from the archetype scenario. Optional input. Hidden at hard difficulty.
150 – 1200 mm

Scored outputs

5 outputs

Downstream invert

downstream_invert_m

Downstream invert level IL_ds (m AHD)

Scores if within ±3% of the reference value.

Obvert level

obvert_level_m

Obvert (crown) level at downstream end OL_ds (m AHD)

Scores if within ±3% of the reference value.

Cover depth

cover_depth_mm

Cover depth at downstream end (mm)

Scores if within ±500% of the reference value.

Grade fall

grade_fall_m

Total fall over pipe length (m)

Scores if within ±3% of the reference value.

Cover adequate

cover_adequate

Cover adequacy (1.0 = adequate, 0.0 = insufficient)

Scores if within ±1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

easy

All inputs given

Small pipe under footpath, all parameters given, generous cover

medium

All inputs given

Any pipe size and archetype, all parameters given

hard

Some inputs hidden

Minimum cover hidden, agent must infer from installation context

Hidden inputs

Minimum coverminimum_cover_mm

Prompt replacement text

The pipe is {{ archetype.description }} installed at {{ archetype.site_context }}

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

instruction.md
pipe-invert-calculation_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a senior civil engineer specializing in stormwater drainage design in Australia.2 3## Problem4 5Calculate the downstream invert level, obvert (crown) level, cover depth, and grade fall for a stormwater drainage pipe. Determine whether the cover depth at the downstream end meets the minimum requirement for the installation context.6 7## Given8 9| Parameter | Value | Unit |10|-----------|-------|------|11| Upstream invert level (IL_us) | {{ upstream_invert_m }} | m AHD |12| Pipe length (L) | {{ pipe_length_m }} | m |13| Pipe grade | {{ pipe_grade_percent }} | % |14| Pipe diameter (D) | {{ pipe_diameter_mm }} | mm |15| Surface level at downstream pit | {{ surface_level_ds_m }} | m AHD |16{%- if minimum_cover_mm is defined %}17| Minimum cover requirement | {{ minimum_cover_mm }} | mm |18{%- endif %}19{%- if archetype_description is defined %}20 21### Installation Context22 23{{ archetype_description }}24{% endif %}25 26{% if tool_available %}27## Available Tool28 29A pipe invert calculation tool is available at `/workspace/pipe-invert-calculation_calc.py`. Run it with:30 31```bash32python3 /workspace/pipe-invert-calculation_calc.py --help33```34 35You may use this tool to verify your calculations or compute values directly.36{% endif %}37 38## Required39 40Calculate the following:41 421. Grade fall over the pipe length (m)432. Downstream invert level IL_ds (m AHD)443. Obvert (crown) level at the downstream end OL_ds (m AHD)454. Cover depth at the downstream end (mm)465. Cover adequacy (1.0 if cover >= minimum requirement, 0.0 if insufficient)47 48## Applicable Standards49 50- AS/NZS 3500.3 — Stormwater drainage51- QUDM Section 7 — Pipe drainage design52 53## Minimum Cover Requirements (Typical Australian Practice)54 55| Installation Context | Minimum Cover (mm) |56|---------------------|-------------------|57| Under road pavement | 600 |58| Under verge or footpath | 450 |59| Under heavy traffic / trunk mains | 600–900 |60 61## Constraints62 63- No internet access is available. Work from engineering knowledge and the provided tool.64- Use the following formulae:65  - **Grade fall:** fall = (grade / 100) × L66  - **Downstream invert:** IL_ds = IL_us − fall67  - **Obvert (crown) level:** OL_ds = IL_ds + D, where D is the diameter in metres (convert from mm)68  - **Cover depth:** cover_mm = (surface_level_ds − OL_ds) × 100069  - **Cover adequacy:** 1.0 if cover_mm ≥ minimum_cover_mm, otherwise 0.070- Round all numerical outputs to 2 decimal places.71 72## Output Format73 74Show your step-by-step working in Markdown, including unit conversions, grade fall, invert calculation, obvert calculation, cover depth, and adequacy check. At the end of your solution, include a JSON block with your final answers in exactly this format:75 76```json77{78  "downstream_invert_m": <numeric_value>,79  "obvert_level_m": <numeric_value>,80  "cover_depth_mm": <numeric_value>,81  "grade_fall_m": <numeric_value>,82  "cover_adequate": <numeric_value>83}84```85 86Write your complete solution to `/workspace/output.md`.87

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Suburban road drainage

suburban_road_drainage

PVC stormwater pipe under suburban road pavement

brisbane-suburban-road-drainagesydney-residential-road-stormwater

Parameter ranges

upstream_invert_m: 8 – 50
pipe_length_m: 20 – 80
pipe_grade_percent: 0.5 – 3
pipe_diameter_mm: 300, 375, 450
surface_level_ds_m: 9 – 52
minimum_cover_mm: 600

Verge and footpath

verge_and_footpath

PVC stormwater pipe under grass verge or footpath

perth-verge-drainageadelaide-footpath-stormwater

Parameter ranges

upstream_invert_m: 8 – 50
pipe_length_m: 5 – 40
pipe_grade_percent: 0.5 – 5
pipe_diameter_mm: 225, 300, 375
surface_level_ds_m: 8.5 – 51
minimum_cover_mm: 450

Trunk stormwater

trunk_stormwater

Reinforced concrete trunk stormwater main under road reserve

melbourne-trunk-stormwatergold-coast-catchment-drainage

Parameter ranges

upstream_invert_m: 5 – 40
pipe_length_m: 40 – 150
pipe_grade_percent: 0.2 – 1.5
pipe_diameter_mm: 600, 750, 900
surface_level_ds_m: 6.5 – 42
minimum_cover_mm: 600 – 900

Steep hillside

steep_hillside

HDPE or PVC stormwater pipe on steep hillside terrain

cairns-hillside-subdivisionhobart-steep-terrain-drainage

Parameter ranges

upstream_invert_m: 20 – 80
pipe_length_m: 10 – 60
pipe_grade_percent: 3 – 10
pipe_diameter_mm: 225, 300, 375, 450
surface_level_ds_m: 18 – 76
minimum_cover_mm: 450 – 600

Example task

brisbane-suburban-road-drainage-suburban-road-drainage-preview — hard difficulty, some inputs hidden.

PVC stormwater pipe under suburban road pavement. brisbane-suburban-road-drainage. Required outputs: downstream_invert_m, obvert_level_m, cover_depth_mm, grade_fall_m, cover_adequate

The model sees

Scenario context and visible inputs.

upstream_invert_m: 8 to 50 m AHD
pipe_length_m: 20 to 80 m
pipe_grade_percent: 0.5 to 3 %
pipe_diameter_mm: 300 mm
surface_level_ds_m: 9 to 52 m AHD

Executable tool: pipe-invert-calculation_calc.py

The model must infer

Inputs withheld at this difficulty.

Minimum cover
minimum_cover_mm

Stand-in text in the prompt

The pipe is {{ archetype.description }} installed at {{ archetype.site_context }}

The model must produce

The scored JSON answer schema.

{
  "downstream_invert_m": <number>,
  "obvert_level_m": <number>,
  "cover_depth_mm": <number>,
  "grade_fall_m": <number>,
  "cover_adequate": <number>
}

downstream_invert_m · scored within ±3%
obvert_level_m · scored within ±3%
cover_depth_mm · scored within ±500%
grade_fall_m · scored within ±3%
cover_adequate · scored within ±1%

Pipe Invert Calculation

How this task is generated

Template

Scenario

Difficulty tier

Task prompt

Parameters

Inputs

Scored outputs

Downstream invert

Obvert level

Cover depth

Grade fall

Cover adequate

Difficulty

easy

medium

hard

Task bundle

Scenario archetypes

Suburban road drainage

Verge and footpath

Trunk stormwater

Steep hillside

Example task

The model sees

The model must infer

The model must produce