LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
civilwith-tool

Pipe Velocity Check

Calculates full-bore pipe flow velocity from V = Q/A and checks compliance against minimum and maximum velocity limits specified in AS/NZS 3500.1 for water supply, gravity sewer, stormwater, and fire service pipes. Ensures velocities remain within self-cleansing and scour-prevention bounds for the given service type.

with-tool: The model is given an executable Python calculator script.

Standards

AS/NZS 3500.1 Clause 3.4

Tags

civilcompliancedeterministicpipe-hydraulicsvelocity

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

3 inputs

Always given

Included directly in every task prompt.

2

  • Pipe diameter

    pipe_diameter_mm

    Internal pipe diameter D

    15 – 1200 mm

  • Flow rate

    flow_rate_l_s

    Volumetric flow rate Q

    0.1 – 2000 L/s

Derived from scenario

Sampled from the scenario and inferable from its description.

1

  • Service type

    service_type

    Pipe service type per AS/NZS 3500.1

    Derived from the archetype scenario. Hidden at hard difficulty.

    water_supplysewer_gravitystormwaterfire_services

Scored outputs

2 outputs

Velocity m s

velocity_m_s

Flow velocity V (m/s)

Scores if within ±3% of the reference value.

Compliance

compliance

Velocity compliance (1.0 = within limits, 0.0 = outside limits)

Scores if within ±1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

easy

All inputs given

All parameters given, water supply only, small residential pipes

Service type restricted to: water_supply

medium

All inputs given

All parameters given, any service type and pipe size

hard

Some inputs hidden

Service type hidden, agent must infer from site description

Hidden inputs

  • Service typeservice_type

Prompt replacement text

The pipe is {{ archetype.description }} serving {{ archetype.site_context }}

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • pipe-velocity-check_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a senior civil engineer specializing in water infrastructure and pipe hydraulics.2 3## Problem4 5Verify that the flow velocity in a pipe meets the minimum and maximum velocity limits per AS/NZS 3500.1 for the given service type. Calculate the flow velocity and determine whether it complies with the applicable limits.6 7## Given8 9| Parameter | Value | Unit |10|-----------|-------|------|11| Pipe diameter (D) | {{ pipe_diameter_mm }} | mm |12| Flow rate (Q) | {{ flow_rate_l_s }} | L/s |13{%- if service_type is defined %}14| Service type | {{ service_type }} | - |15{%- endif %}16{%- if archetype_description is defined %}17 18### Site Conditions19 20{{ archetype_description }}21{% endif %}22 23{% if tool_available %}24## Available Tool25 26A pipe velocity calculation tool is available at `/workspace/pipe-velocity-check_calc.py`. Run it with:27 28```bash29python3 /workspace/pipe-velocity-check_calc.py --help30```31 32You may use this tool to verify your calculations or compute values directly.33{% endif %}34 35## Required36 37Calculate the following:38 391. Flow velocity V (m/s)402. Velocity compliance (1.0 if within limits, 0.0 if outside limits)41 42## Applicable Standards43 44- AS/NZS 3500.1 Clause 3.4 — velocity limits by service type45 46## Velocity Limits (AS/NZS 3500.1)47 48| Service Type | Min Velocity (m/s) | Max Velocity (m/s) |49|---|---|---|50| Water supply | 0.6 | 3.0 |51| Sewer (gravity) | 0.6 | 4.0 |52| Stormwater | 0.6 | 6.0 |53| Fire services | 0.5 | 4.0 |54 55## Constraints56 57- No internet access is available. Work from engineering knowledge and the provided tool.58- Use the following formulas:59 - Cross-sectional area: A = pi * (D/2)^2 where D is the diameter in metres (convert from mm)60 - Flow velocity: V = Q / A where Q is in m^3/s (convert from L/s by dividing by 1000)61 - Compliance: compare V against the min and max velocity for the given service type62- Compliance is 1.0 if min_velocity <= V <= max_velocity, otherwise 0.063 64## Output Format65 66Show your step-by-step working in Markdown, including the unit conversions, area calculation, velocity calculation, and compliance check. At the end of your solution, include a JSON block with your final answers in exactly this format:67 68```json69{70 "velocity_m_s": <numeric_value>,71 "compliance": <numeric_value>72}73```74 75Write your complete solution to `/workspace/output.md`.76

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Residential water supply

residential_water_supply

Residential water supply reticulation in PVC or copper

sydney-suburban-estatebrisbane-residential-infill
Parameter ranges
pipe_diameter_mm
15 – 100
flow_rate_l_s
0.1 – 10
service_type
water_supply

Trunk sewer

trunk_sewer

Trunk gravity sewer main in reinforced concrete or vitrified clay

melbourne-trunk-seweradelaide-catchment-sewer
Parameter ranges
pipe_diameter_mm
225 – 900
flow_rate_l_s
10 – 800
service_type
sewer_gravity

Stormwater main

stormwater_main

Stormwater drainage main in reinforced concrete pipe

perth-urban-drainagedarwin-monsoon-drainage
Parameter ranges
pipe_diameter_mm
300 – 1200
flow_rate_l_s
50 – 2000
service_type
stormwater

Fire hydrant main

fire_hydrant_main

Fire hydrant main in ductile iron or HDPE

canberra-commercial-precincthobart-industrial-park
Parameter ranges
pipe_diameter_mm
100 – 300
flow_rate_l_s
5 – 150
service_type
fire_services

Example task

sydney-suburban-estate-residential-water-supply-preview — hard difficulty, some inputs hidden.

Residential water supply reticulation in PVC or copper. sydney-suburban-estate. Required outputs: velocity_m_s, compliance

The model sees

Scenario context and visible inputs.

pipe_diameter_mm
15 to 100 mm
flow_rate_l_s
0.1 to 10 L/s

Executable tool: pipe-velocity-check_calc.py

The model must infer

Inputs withheld at this difficulty.

  • Service type

    service_type

Stand-in text in the prompt

The pipe is {{ archetype.description }} serving {{ archetype.site_context }}

The model must produce

The scored JSON answer schema.

{
  "velocity_m_s": <number>,
  "compliance": <number>
}
  • velocity_m_s · scored within ±3%
  • compliance · scored within ±1%