LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
mechanicalwith-tool

Gas Load Calculation

Calculates connected and diversified gas demand from explicit appliance gas loads, quantities, and diversity factor. The template reports demand in MJ/h and kW.

with-tool: The model is given an executable Python calculator script.

Standards

AS/NZS 5601.1

Tags

demanddeterministicgas-servicesloadmechanical

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

7 inputs

Always given

Included directly in every task prompt.

7
Show 7 inputs

  • Appliance 1 load

    appliance_1_load_mj_h

    Gas load for first appliance group

    0 – 10000 MJ/h

  • Appliance 1 quantity

    appliance_1_quantity

    Quantity of first appliance group

    0 – 1000

  • Appliance 2 load

    appliance_2_load_mj_h

    Gas load for second appliance group

    0 – 10000 MJ/h

  • Appliance 2 quantity

    appliance_2_quantity

    Quantity of second appliance group

    0 – 1000

  • Appliance 3 load

    appliance_3_load_mj_h

    Gas load for third appliance group

    0 – 10000 MJ/h

  • Appliance 3 quantity

    appliance_3_quantity

    Quantity of third appliance group

    0 – 1000

  • Diversity factor

    diversity_factor

    Demand diversity factor

    0.01 – 1

Scored outputs

4 outputs

Connected load mj h

connected_load_mj_h

Total connected gas load

Scores if within ±3% of the reference value.

Diversified load mj h

diversified_load_mj_h

Diversified gas load

Scores if within ±3% of the reference value.

Connected load

connected_load_kw

Connected gas load in kilowatts

Scores if within ±3% of the reference value.

Diversified load

diversified_load_kw

Diversified gas load in kilowatts

Scores if within ±3% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All parameters given for a commercial kitchen
medium:
All parameters given across gas services settings
hard:
All parameters given for plant room gas loads

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • gas-load-calculation_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a senior mechanical engineer specializing in building gas services.2 3## Problem4 5Calculate connected and diversified gas load from explicit appliance loads and quantities.6 7## Given8 9| Parameter | Value | Unit |10|-----------|-------|------|11| Appliance 1 gas load | {{ appliance_1_load_mj_h }} | MJ/h |12| Appliance 1 quantity | {{ appliance_1_quantity }} | - |13| Appliance 2 gas load | {{ appliance_2_load_mj_h }} | MJ/h |14| Appliance 2 quantity | {{ appliance_2_quantity }} | - |15| Appliance 3 gas load | {{ appliance_3_load_mj_h }} | MJ/h |16| Appliance 3 quantity | {{ appliance_3_quantity }} | - |17| Diversity factor | {{ diversity_factor }} | - |18 19{% if archetype_description is defined %}20### Gas Services Context21 22{{ archetype_description }}23{% endif %}24 25{% if tool_available %}26## Available Tool27 28A gas load calculation tool is available at `/workspace/{{ meta.name }}_calc.py`. Run it with:29 30```bash31python3 /workspace/{{ meta.name }}_calc.py --help32```33 34You may use this tool to verify your calculations or compute values directly.35{% endif %}36 37## Required38 39Calculate the following:40 411. Connected gas load in MJ/h422. Diversified gas load in MJ/h433. Connected gas load in kW444. Diversified gas load in kW45 46## Constraints47 48- No internet access is available. Work from engineering knowledge and the provided tool.49- Use connected load = sum of each appliance load multiplied by its quantity.50- Use diversified load = connected load x diversity factor.51- Use 1 kW = 3.6 MJ/h.52 53## Output Format54 55Show your step-by-step working in Markdown. At the end of your solution, include a JSON block with your final answers in exactly this format:56 57```json58{59 "connected_load_mj_h": <numeric_value>,60 "diversified_load_mj_h": <numeric_value>,61 "connected_load_kw": <numeric_value>,62 "diversified_load_kw": <numeric_value>63}64```65 66Write your complete solution to `/workspace/output.md`.67 68

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Commercial kitchen

commercial_kitchen

Commercial kitchen appliance gas load

commercial-kitchenfood-service
Parameter ranges
appliance_1_load_mj_h
50 – 500
appliance_1_quantity
1 – 20
appliance_2_load_mj_h
20 – 300
appliance_2_quantity
0 – 20
appliance_3_load_mj_h
10 – 200
appliance_3_quantity
0 – 20
diversity_factor
0.5 – 1

Plant room

plant_room

Plant room gas-fired equipment load

boiler-roomgas-plant
Parameter ranges
appliance_1_load_mj_h
200 – 5000
appliance_1_quantity
1 – 10
appliance_2_load_mj_h
50 – 2000
appliance_2_quantity
0 – 10
appliance_3_load_mj_h
0 – 1000
appliance_3_quantity
0 – 10
diversity_factor
0.6 – 1

Example task

boiler-room-plant-room-preview — hard difficulty, all inputs given.

Plant room gas-fired equipment load. boiler-room. Required outputs: connected_load_mj_h, diversified_load_mj_h, connected_load_kw, diversified_load_kw

The model sees

Scenario context and visible inputs.

appliance_1_load_mj_h
200 to 5000 MJ/h
appliance_1_quantity
1 to 10 -
appliance_2_load_mj_h
50 to 2000 MJ/h
appliance_2_quantity
0 to 10 -
appliance_3_load_mj_h
0 to 1000 MJ/h
appliance_3_quantity
0 to 10 -
diversity_factor
0.6 to 1 -

Executable tool: gas-load-calculation_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "connected_load_mj_h": <number>,
  "diversified_load_mj_h": <number>,
  "connected_load_kw": <number>,
  "diversified_load_kw": <number>
}
  • connected_load_mj_h · scored within ±3%
  • diversified_load_mj_h · scored within ±3%
  • connected_load_kw · scored within ±3%
  • diversified_load_kw · scored within ±3%