LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
mechanicalwith-tool

Velocity Check

Calculates pipe velocity from flow rate and internal diameter, then compares it with explicit minimum and maximum velocity criteria. The template reports pipe area, velocity, margins, and a numeric range flag.

with-tool: The model is given an executable Python calculator script.

Standards

AWWA M11Crane TP-410

Tags

deterministichydraulicsmechanicalpipevelocity

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

4 inputs

Always given

Included directly in every task prompt.

4

  • Flow rate

    flow_rate_l_s

    Pipe flow rate

    0 – 100000 L/s

  • Pipe internal diameter

    pipe_internal_diameter_mm

    Pipe internal diameter

    10 – 5000 mm

  • Minimum velocity

    minimum_velocity_m_s

    Minimum acceptable velocity

    0 – 20 m/s

  • Maximum velocity

    maximum_velocity_m_s

    Maximum acceptable velocity

    0.1 – 50 m/s

Scored outputs

5 outputs

Pipe area m2

pipe_area_m2

Pipe internal area

Scores if within ±3% of the reference value.

Velocity m s

velocity_m_s

Calculated pipe velocity

Scores if within ±3% of the reference value.

Min margin m s

min_margin_m_s

Velocity margin above minimum criterion

Scores if within ±3% of the reference value.

Max margin m s

max_margin_m_s

Velocity margin below maximum criterion

Scores if within ±3% of the reference value.

Velocity within range

velocity_within_range

Numeric flag where 1 means velocity is within the explicit range

Scores if within ±1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All parameters given for water distribution pipes
medium:
All parameters given across pipe types
hard:
All parameters given for process pipe velocity checks

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • velocity-check_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a senior mechanical engineer specializing in pipe hydraulic checks.2 3## Problem4 5Calculate pipe velocity from flow and diameter, then compare it with explicit minimum and maximum velocity criteria.6 7## Given8 9| Parameter | Value | Unit |10|-----------|-------|------|11| Flow rate | {{ flow_rate_l_s }} | L/s |12| Pipe internal diameter | {{ pipe_internal_diameter_mm }} | mm |13| Minimum velocity | {{ minimum_velocity_m_s }} | m/s |14| Maximum velocity | {{ maximum_velocity_m_s }} | m/s |15 16{% if archetype_description is defined %}17### Pipe Context18 19{{ archetype_description }}20{% endif %}21 22{% if tool_available %}23## Available Tool24 25A velocity check tool is available at `/workspace/{{ meta.name }}_calc.py`. Run it with:26 27```bash28python3 /workspace/{{ meta.name }}_calc.py --help29```30 31You may use this tool to verify your calculations or compute values directly.32{% endif %}33 34## Required35 36Calculate the following:37 381. Pipe internal area392. Flow velocity403. Margin above minimum velocity414. Margin below maximum velocity425. Numeric pass flag, where 1 means velocity is within the explicit range43 44## Constraints45 46- No internet access is available. Work from engineering knowledge and the provided tool.47- Use pipe area = pi x diameter squared / 4.48- Convert flow from L/s to m3/s before calculating velocity.49- Use only the explicit velocity criteria provided.50 51## Output Format52 53Show your step-by-step working in Markdown. At the end of your solution, include a JSON block with your final answers in exactly this format:54 55```json56{57 "pipe_area_m2": <numeric_value>,58 "velocity_m_s": <numeric_value>,59 "min_margin_m_s": <numeric_value>,60 "max_margin_m_s": <numeric_value>,61 "velocity_within_range": <numeric_value>62}63```64 65Write your complete solution to `/workspace/output.md`.66 67

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Water distribution

water_distribution

Water distribution pipe velocity check

water-distribution-mainpump-discharge
Parameter ranges
flow_rate_l_s
1 – 1000
pipe_internal_diameter_mm
50 – 1200
minimum_velocity_m_s
0.1 – 0.8
maximum_velocity_m_s
1.5 – 4

Process pipe

process_pipe

Industrial process pipe velocity check

process-pipeutility-pipe
Parameter ranges
flow_rate_l_s
0.5 – 500
pipe_internal_diameter_mm
25 – 600
minimum_velocity_m_s
0.1 – 1
maximum_velocity_m_s
2 – 8

Example task

process-pipe-process-pipe-preview — hard difficulty, all inputs given.

Industrial process pipe velocity check. process-pipe. Required outputs: pipe_area_m2, velocity_m_s, min_margin_m_s, max_margin_m_s, velocity_within_range

The model sees

Scenario context and visible inputs.

flow_rate_l_s
0.5 to 500 L/s
pipe_internal_diameter_mm
25 to 600 mm
minimum_velocity_m_s
0.1 to 1 m/s
maximum_velocity_m_s
2 to 8 m/s

Executable tool: velocity-check_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "pipe_area_m2": <number>,
  "velocity_m_s": <number>,
  "min_margin_m_s": <number>,
  "max_margin_m_s": <number>,
  "velocity_within_range": <number>
}
  • pipe_area_m2 · scored within ±3%
  • velocity_m_s · scored within ±3%
  • min_margin_m_s · scored within ±3%
  • max_margin_m_s · scored within ±3%
  • velocity_within_range · scored within ±1%