LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
mechanicalwith-tool

Air Demand

Calculates connected and simultaneous compressed air demand from explicit tool flows, quantities, and simultaneity factor. The template reports demand in L/s and m3/min.

with-tool: The model is given an executable Python calculator script.

Standards

ISO 8573

Tags

compressed-airdemanddeterministicmechanical

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

7 inputs

Always given

Included directly in every task prompt.

7
Show 7 inputs

  • Tool 1 flow

    tool_1_flow_l_s

    Air flow for first tool group

    0 – 1000 L/s

  • Tool 1 quantity

    tool_1_quantity

    Quantity of first tool group

    0 – 1000

  • Tool 2 flow

    tool_2_flow_l_s

    Air flow for second tool group

    0 – 1000 L/s

  • Tool 2 quantity

    tool_2_quantity

    Quantity of second tool group

    0 – 1000

  • Tool 3 flow

    tool_3_flow_l_s

    Air flow for third tool group

    0 – 1000 L/s

  • Tool 3 quantity

    tool_3_quantity

    Quantity of third tool group

    0 – 1000

  • Simultaneity factor

    simultaneity_factor

    Fraction of connected demand operating simultaneously

    0.01 – 1

Scored outputs

4 outputs

Connected demand

connected_demand_l_s

Connected compressed air demand

Scores if within ±3% of the reference value.

Simultaneous demand

simultaneous_demand_l_s

Simultaneous compressed air demand

Scores if within ±3% of the reference value.

Connected demand m3 min

connected_demand_m3_min

Connected compressed air demand in cubic metres per minute

Scores if within ±3% of the reference value.

Simultaneous demand m3 min

simultaneous_demand_m3_min

Simultaneous compressed air demand in cubic metres per minute

Scores if within ±3% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All parameters given for workshop air demand
medium:
All parameters given across compressed air systems
hard:
All parameters given for process air demand

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • air-demand_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a senior mechanical engineer specializing in compressed air services.2 3## Problem4 5Calculate connected and simultaneous compressed air demand from explicit tool flows, quantities, and simultaneity factor.6 7## Given8 9| Parameter | Value | Unit |10|-----------|-------|------|11| Tool group 1 flow | {{ tool_1_flow_l_s }} | L/s |12| Tool group 1 quantity | {{ tool_1_quantity }} | - |13| Tool group 2 flow | {{ tool_2_flow_l_s }} | L/s |14| Tool group 2 quantity | {{ tool_2_quantity }} | - |15| Tool group 3 flow | {{ tool_3_flow_l_s }} | L/s |16| Tool group 3 quantity | {{ tool_3_quantity }} | - |17| Simultaneity factor | {{ simultaneity_factor }} | - |18 19{% if archetype_description is defined %}20### Compressed Air Context21 22{{ archetype_description }}23{% endif %}24 25{% if tool_available %}26## Available Tool27 28A compressed air demand calculation tool is available at `/workspace/{{ meta.name }}_calc.py`. Run it with:29 30```bash31python3 /workspace/{{ meta.name }}_calc.py --help32```33 34You may use this tool to verify your calculations or compute values directly.35{% endif %}36 37## Required38 39Calculate the following:40 411. Connected air demand in L/s422. Simultaneous air demand in L/s433. Connected air demand in m3/min444. Simultaneous air demand in m3/min45 46## Constraints47 48- No internet access is available. Work from engineering knowledge and the provided tool.49- Use connected demand = sum of each tool flow multiplied by quantity.50- Use simultaneous demand = connected demand x simultaneity factor.51- Use 1 L/s = 0.06 m3/min.52 53## Output Format54 55Show your step-by-step working in Markdown. At the end of your solution, include a JSON block with your final answers in exactly this format:56 57```json58{59 "connected_demand_l_s": <numeric_value>,60 "simultaneous_demand_l_s": <numeric_value>,61 "connected_demand_m3_min": <numeric_value>,62 "simultaneous_demand_m3_min": <numeric_value>63}64```65 66Write your complete solution to `/workspace/output.md`.67 68

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Workshop

workshop

Maintenance workshop compressed air demand

maintenance-workshopcompressed-air-ring-main
Parameter ranges
tool_1_flow_l_s
2 – 50
tool_1_quantity
1 – 30
tool_2_flow_l_s
1 – 30
tool_2_quantity
0 – 30
tool_3_flow_l_s
0 – 20
tool_3_quantity
0 – 20
simultaneity_factor
0.2 – 0.8

Process air

process_air

Process plant compressed air demand

process-plantinstrument-air
Parameter ranges
tool_1_flow_l_s
20 – 300
tool_1_quantity
1 – 20
tool_2_flow_l_s
10 – 200
tool_2_quantity
0 – 20
tool_3_flow_l_s
5 – 100
tool_3_quantity
0 – 20
simultaneity_factor
0.4 – 1

Example task

process-plant-process-air-preview — hard difficulty, all inputs given.

Process plant compressed air demand. process-plant. Required outputs: connected_demand_l_s, simultaneous_demand_l_s, connected_demand_m3_min, simultaneous_demand_m3_min

The model sees

Scenario context and visible inputs.

tool_1_flow_l_s
20 to 300 L/s
tool_1_quantity
1 to 20 -
tool_2_flow_l_s
10 to 200 L/s
tool_2_quantity
0 to 20 -
tool_3_flow_l_s
5 to 100 L/s
tool_3_quantity
0 to 20 -
simultaneity_factor
0.4 to 1 -

Executable tool: air-demand_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "connected_demand_l_s": <number>,
  "simultaneous_demand_l_s": <number>,
  "connected_demand_m3_min": <number>,
  "simultaneous_demand_m3_min": <number>
}
  • connected_demand_l_s · scored within ±3%
  • simultaneous_demand_l_s · scored within ±3%
  • connected_demand_m3_min · scored within ±3%
  • simultaneous_demand_m3_min · scored within ±3%