LIVEdataset aec-bench@releasetasks 552models 18disciplines 5last submission … · built …

civilwith-tool

Sewer Slope Check

Verifies that a gravity sewer pipe's installed slope produces a full-pipe velocity within the self-cleansing range (0.6-4.0 m/s) required by WSAA WSA 02. Uses Manning's equation V = (1/n)*R_h^(2/3)*S^(1/2) for a circular pipe at full flow to compute velocity and capacity, then reports compliance status.

with-tool: The model is given an executable Python calculator script.

Standards

BS EN 752 WSAA WSA 02

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

01
Template
The reusable contract shown on this page.
02
Scenario
An archetype and site context are sampled.
03
Difficulty tier
Inputs may be hidden at harder tiers.
04
Task prompt
The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

3 inputs

Always given

Included directly in every task prompt.

Pipe diameter
pipe_diameter_mm
Internal pipe diameter D
100 – 900 mm
Pipe slope pct
pipe_slope_pct
Pipe longitudinal slope as a percentage
0.1 – 10 %

Derived from scenario

Sampled from the scenario and inferable from its description.

Mannings n
mannings_n
Manning's roughness coefficient n
Derived from the archetype scenario. Hidden at hard difficulty.
0.009 – 0.025

Scored outputs

3 outputs

Full pipe velocity m s

full_pipe_velocity_m_s

Full-pipe flow velocity V (m/s)

Scores if within ±3% of the reference value.

Full pipe capacity

full_pipe_capacity_l_s

Full-pipe flow capacity Q (L/s)

Scores if within ±3% of the reference value.

Compliance

compliance

Self-cleansing compliance (1.0 = adequate, 0.0 = non-compliant)

Scores if within ±1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

easy

All inputs given

Small residential pipe, all parameters given, gentle slope

medium

All inputs given

Any pipe size and archetype, all parameters given

hard

Some inputs hidden

Manning's n hidden, agent must infer from pipe material description

Hidden inputs

Mannings nmannings_n

Prompt replacement text

The pipe is {{ archetype.description }} installed at {{ archetype.site_context }}

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

instruction.md
sewer-slope-check_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a senior civil engineer specializing in water and wastewater infrastructure design.2 3## Problem4 5Verify that a gravity sewer pipe has adequate slope for self-cleansing velocity. Calculate the full-pipe flow velocity and capacity using Manning's equation, then determine compliance with WSAA WSA 02 velocity limits.6 7## Given8 9| Parameter | Value | Unit |10|-----------|-------|------|11| Pipe diameter (D) | {{ pipe_diameter_mm }} | mm |12| Pipe slope | {{ pipe_slope_pct }} | % |13{%- if mannings_n is defined %}14| Manning's roughness (n) | {{ mannings_n }} | - |15{%- endif %}16{%- if archetype_description is defined %}17 18### Pipe Conditions19 20{{ archetype_description }}21{% endif %}22 23{% if tool_available %}24## Available Tool25 26A sewer slope calculation tool is available at `/workspace/sewer-slope-check_calc.py`. Run it with:27 28```bash29python3 /workspace/sewer-slope-check_calc.py --help30```31 32You may use this tool to verify your calculations or compute values directly.33{% endif %}34 35## Required36 37Calculate the following:38 391. Full-pipe flow velocity V (m/s)402. Full-pipe flow capacity Q (L/s)413. Self-cleansing compliance (1.0 if adequate, 0.0 if non-compliant)42 43## Applicable Standards44 45- WSAA WSA 02 — Gravity Sewerage Code of Australia46- BS EN 752 — Drain and sewer systems outside buildings47 48## Velocity Limits (WSAA WSA 02)49 50| Criterion | Velocity (m/s) |51|-----------|---------------|52| Minimum self-cleansing | 0.6 |53| Maximum (scour limit) | 4.0 |54 55## Constraints56 57- No internet access is available. Work from engineering knowledge and the provided tool.58- Use Manning's equation for a full circular pipe (SI units):59  - **Hydraulic radius (full pipe):** R_h = D / 4, where D is the diameter in metres (convert from mm)60  - **Slope conversion:** S = pipe_slope_pct / 100 (convert from % to m/m)61  - **Velocity:** V = (1/n) × R_h^(2/3) × S^(1/2)62  - **Cross-sectional area:** A = π × (D/2)²63  - **Flow capacity:** Q = V × A (m³/s), then convert to L/s by multiplying by 100064- Compliance: 1.0 if 0.6 m/s ≤ V ≤ 4.0 m/s, otherwise 0.065 66## Output Format67 68Show your step-by-step working in Markdown, including unit conversions, hydraulic radius, velocity, capacity, and compliance check. At the end of your solution, include a JSON block with your final answers in exactly this format:69 70```json71{72  "full_pipe_velocity_m_s": <numeric_value>,73  "full_pipe_capacity_l_s": <numeric_value>,74  "compliance": <numeric_value>75}76```77 78Write your complete solution to `/workspace/output.md`.79

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Residential reticulation

residential_reticulation

PVC residential sewer reticulation main

brisbane-suburban-subdivisionperth-residential-infill

Parameter ranges

pipe_diameter_mm: 150 – 225
pipe_slope_pct: 0.5 – 3
mannings_n: 0.011 – 0.013

Trunk sewer

trunk_sewer

Reinforced concrete or vitrified clay trunk sewer

melbourne-trunk-sewersydney-catchment-sewer

Parameter ranges

pipe_diameter_mm: 300 – 600
pipe_slope_pct: 0.2 – 1.5
mannings_n: 0.011 – 0.015

Rising main connection

rising_main_connection

Gravity sewer downstream of a rising main discharge point

adelaide-pump-station-outletgold-coast-rising-main-junction

Parameter ranges

pipe_diameter_mm: 150 – 300
pipe_slope_pct: 1 – 5
mannings_n: 0.011 – 0.013

Industrial sewer

industrial_sewer

Industrial gravity sewer on steep grade with heavy solids

darwin-industrial-estatecairns-food-processing-plant

Parameter ranges

pipe_diameter_mm: 225 – 450
pipe_slope_pct: 2 – 10
mannings_n: 0.013 – 0.025

Example task

brisbane-suburban-subdivision-residential-reticulation-preview — hard difficulty, some inputs hidden.

PVC residential sewer reticulation main. brisbane-suburban-subdivision. Required outputs: full_pipe_velocity_m_s, full_pipe_capacity_l_s, compliance

The model sees

Scenario context and visible inputs.

pipe_diameter_mm: 150 to 225 mm
pipe_slope_pct: 0.5 to 3 %

Executable tool: sewer-slope-check_calc.py

The model must infer

Inputs withheld at this difficulty.

Mannings n
mannings_n

Stand-in text in the prompt

The pipe is {{ archetype.description }} installed at {{ archetype.site_context }}

The model must produce

The scored JSON answer schema.

{
  "full_pipe_velocity_m_s": <number>,
  "full_pipe_capacity_l_s": <number>,
  "compliance": <number>
}

full_pipe_velocity_m_s · scored within ±3%
full_pipe_capacity_l_s · scored within ±3%
compliance · scored within ±1%

Sewer Slope Check

How this task is generated

Template

Scenario

Difficulty tier

Task prompt

Parameters

Inputs

Scored outputs

Full pipe velocity m s

Full pipe capacity

Compliance

Difficulty

easy

medium

hard

Task bundle

Scenario archetypes

Residential reticulation

Trunk sewer

Rising main connection

Industrial sewer

Example task

The model sees

The model must infer

The model must produce