LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
mechanicalwith-tool

Available Flow Calculation

Calculates available flow at a target residual pressure from static pressure, residual pressure, and measured test flow using the standard hydrant flow extrapolation exponent. The template reports pressure drops and available flow in L/s and m3/h.

with-tool: The model is given an executable Python calculator script.

Standards

NFPA 291

Tags

available-flowdeterministicfire-serviceshydrantmechanical

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

4 inputs

Always given

Included directly in every task prompt.

4

  • Static pressure

    static_pressure_kpa

    Static pressure before flow test

    1 – 5000 kPa

  • Residual pressure

    residual_pressure_kpa

    Residual pressure during flow test

    0 – 5000 kPa

  • Test flow

    test_flow_l_s

    Measured test flow

    0 – 10000 L/s

  • Target residual pressure

    target_residual_pressure_kpa

    Target residual pressure for available flow

    0 – 5000 kPa

Scored outputs

4 outputs

Pressure drop test

pressure_drop_test_kpa

Pressure drop during the flow test

Scores if within ±3% of the reference value.

Pressure drop target

pressure_drop_target_kpa

Pressure drop from static to target residual

Scores if within ±3% of the reference value.

Available flow

available_flow_l_s

Available flow at target residual pressure

Scores if within ±3% of the reference value.

Available flow

available_flow_m3_h

Available flow in cubic metres per hour

Scores if within ±3% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All parameters given for an urban hydrant
medium:
All parameters given across hydrant flow tests
hard:
All parameters given for industrial fire water systems

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • available-flow-calculation_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a senior fire services engineer specializing in hydrant flow tests.2 3## Problem4 5Calculate available fire flow at a target residual pressure from a hydrant flow test.6 7## Given8 9| Parameter | Value | Unit |10|-----------|-------|------|11| Static pressure | {{ static_pressure_kpa }} | kPa |12| Residual pressure during test | {{ residual_pressure_kpa }} | kPa |13| Test flow | {{ test_flow_l_s }} | L/s |14| Target residual pressure | {{ target_residual_pressure_kpa }} | kPa |15 16{% if archetype_description is defined %}17### Hydrant Context18 19{{ archetype_description }}20{% endif %}21 22{% if tool_available %}23## Available Tool24 25An available flow calculation tool is available at `/workspace/{{ meta.name }}_calc.py`. Run it with:26 27```bash28python3 /workspace/{{ meta.name }}_calc.py --help29```30 31You may use this tool to verify your calculations or compute values directly.32{% endif %}33 34## Required35 36Calculate test pressure drop, target pressure drop, available flow in L/s, and available flow in m3/h.37 38## Constraints39 40- No internet access is available. Work from engineering knowledge and the provided tool.41- Use available flow = test flow x ((static - target residual) / (static - test residual))^0.54.42- Use 1 L/s = 3.6 m3/h.43 44## Output Format45 46Show your step-by-step working in Markdown. At the end of your solution, include a JSON block with your final answers in exactly this format:47 48```json49{50 "pressure_drop_test_kpa": <numeric_value>,51 "pressure_drop_target_kpa": <numeric_value>,52 "available_flow_l_s": <numeric_value>,53 "available_flow_m3_h": <numeric_value>54}55```56 57Write your complete solution to `/workspace/output.md`.58 59

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Urban hydrant

urban_hydrant

Urban hydrant available flow estimate

urban-hydrantfire-flow-test
Parameter ranges
static_pressure_kpa
600 – 1000
residual_pressure_kpa
100 – 500
test_flow_l_s
5 – 300
target_residual_pressure_kpa
100 – 500

Industrial site

industrial_site

Industrial fire water available flow estimate

industrial-fire-waterhydrant-flow-test
Parameter ranges
static_pressure_kpa
900 – 1500
residual_pressure_kpa
100 – 700
test_flow_l_s
20 – 1000
target_residual_pressure_kpa
100 – 700

Example task

industrial-fire-water-industrial-site-preview — hard difficulty, all inputs given.

Industrial fire water available flow estimate. industrial-fire-water. Required outputs: pressure_drop_test_kpa, pressure_drop_target_kpa, available_flow_l_s, available_flow_m3_h

The model sees

Scenario context and visible inputs.

static_pressure_kpa
900 to 1500 kPa
residual_pressure_kpa
100 to 700 kPa
test_flow_l_s
20 to 1000 L/s
target_residual_pressure_kpa
100 to 700 kPa

Executable tool: available-flow-calculation_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "pressure_drop_test_kpa": <number>,
  "pressure_drop_target_kpa": <number>,
  "available_flow_l_s": <number>,
  "available_flow_m3_h": <number>
}
  • pressure_drop_test_kpa · scored within ±3%
  • pressure_drop_target_kpa · scored within ±3%
  • available_flow_l_s · scored within ±3%
  • available_flow_m3_h · scored within ±3%