LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
mechanicalwith-tool

Air Changes

Calculates room air changes per hour from supplied ventilation airflow and room volume. The template provides a deterministic closed-form ventilation rate check using ACH = supply airflow / room volume.

with-tool: The model is given an executable Python calculator script.

Standards

ASHRAE 62.1

Tags

achair-changesdeterministicmechanicalventilation

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

2 inputs

Always given

Included directly in every task prompt.

2

  • Supply airflow

    supply_airflow_m3_h

    Supply ventilation airflow rate

    10 – 200000 m3/h

  • Room volume

    room_volume_m3

    Room air volume

    5 – 100000 m3

Scored outputs

1 output

Air changes per h

air_changes_per_h

Air changes per hour

Scores if within ±3% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All parameters given for a small ventilated room
medium:
All parameters given across small and large ventilated spaces
hard:
All parameters given for larger process ventilation checks

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • air-changes_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a senior mechanical engineer specializing in ventilation design.2 3## Problem4 5Calculate the room air change rate from the supplied outdoor or ventilation airflow.6 7## Given8 9| Parameter | Value | Unit |10|-----------|-------|------|11| Supply airflow | {{ supply_airflow_m3_h }} | m3/h |12| Room volume | {{ room_volume_m3 }} | m3 |13 14{% if archetype_description is defined %}15### Ventilation Context16 17{{ archetype_description }}18{% endif %}19 20{% if tool_available %}21## Available Tool22 23An air changes calculation tool is available at `/workspace/{{ meta.name }}_calc.py`. Run it with:24 25```bash26python3 /workspace/{{ meta.name }}_calc.py --help27```28 29You may use this tool to verify your calculations or compute values directly.30{% endif %}31 32## Required33 34Calculate the air changes per hour (1/h).35 36## Constraints37 38- No internet access is available. Work from engineering knowledge and the provided tool.39- Use air changes per hour = supply airflow / room volume.40- Keep units consistent: m3/h divided by m3 gives changes per hour.41 42## Output Format43 44Show your step-by-step working in Markdown. At the end of your solution, include a JSON block with your final answer in exactly this format:45 46```json47{48 "air_changes_per_h": <numeric_value>49}50```51 52Write your complete solution to `/workspace/output.md`.53

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Small plant room

small_plant_room

Small mechanical or electrical plant room ventilation check

mechanical-plant-roomelectrical-switchroom
Parameter ranges
supply_airflow_m3_h
200 – 2500
room_volume_m3
30 – 500

Large process space

large_process_space

Large process or utility space with dilution ventilation

water-treatment-process-hallindustrial-utility-building
Parameter ranges
supply_airflow_m3_h
3000 – 80000
room_volume_m3
1000 – 30000

Example task

water-treatment-process-hall-large-process-space-preview — hard difficulty, all inputs given.

Large process or utility space with dilution ventilation. water-treatment-process-hall. Required outputs: air_changes_per_h

The model sees

Scenario context and visible inputs.

supply_airflow_m3_h
3000 to 80000 m3/h
room_volume_m3
1000 to 30000 m3

Executable tool: air-changes_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "air_changes_per_h": <number>
}
  • air_changes_per_h · scored within ±3%