LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
mechanicalwith-tool

Nac Load Calculation

Calculates fire alarm notification appliance circuit load from strobe, horn, and speaker quantities and device currents. The template reports total load, circuit utilisation, spare capacity, and whether the load is within the circuit capacity.

with-tool: The model is given an executable Python calculator script.

Standards

NFPA 72

Tags

deterministicfire-servicesmechanicalnacnotification-appliance-circuit

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

7 inputs

Always given

Included directly in every task prompt.

7
Show 7 inputs

  • Strobe quantity

    strobe_quantity

    Number of strobes on the circuit

    0 – 200

  • Strobe current

    strobe_current_a

    Current draw per strobe

    0 – 0.5 A

  • Horn quantity

    horn_quantity

    Number of horns on the circuit

    0 – 200

  • Horn current

    horn_current_a

    Current draw per horn

    0 – 0.3 A

  • Speaker quantity

    speaker_quantity

    Number of speakers on the circuit

    0 – 200

  • Speaker current

    speaker_current_a

    Current draw per speaker

    0 – 0.2 A

  • Circuit capacity

    circuit_capacity_a

    Available circuit current capacity

    0.5 – 10 A

Scored outputs

4 outputs

Total load

total_load_a

Total notification appliance current load

Scores if within ±3% of the reference value.

Utilisation pct

utilisation_pct

Circuit load as a percentage of capacity

Scores if within ±3% of the reference value.

Spare capacity

spare_capacity_a

Remaining circuit current capacity

Scores if within ±3% of the reference value.

Passes capacity check

passes_capacity_check

Whether total load is within circuit capacity

Scores if within ±0% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All parameters given for a small notification circuit
medium:
All parameters given across conventional and voice evacuation circuits
hard:
All parameters given for higher-load voice evacuation circuits

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • nac-load-calculation_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a senior fire services engineer specializing in fire alarm notification circuits.2 3## Problem4 5Calculate the notification appliance circuit load, utilisation, spare capacity, and pass status.6 7## Given8 9| Parameter | Value | Unit |10|-----------|-------|------|11| Strobe quantity | {{ strobe_quantity }} | count |12| Strobe current | {{ strobe_current_a }} | A |13| Horn quantity | {{ horn_quantity }} | count |14| Horn current | {{ horn_current_a }} | A |15| Speaker quantity | {{ speaker_quantity }} | count |16| Speaker current | {{ speaker_current_a }} | A |17| Circuit capacity | {{ circuit_capacity_a }} | A |18 19{% if archetype_description is defined %}20### Circuit Context21 22{{ archetype_description }}23{% endif %}24 25{% if tool_available %}26## Available Tool27 28A NAC load calculation tool is available at `/workspace/{{ meta.name }}_calc.py`. Run it with:29 30```bash31python3 /workspace/{{ meta.name }}_calc.py --help32```33 34You may use this tool to verify your calculations or compute values directly.35{% endif %}36 37## Required38 39Calculate the following:40 411. Total circuit load (A)422. Circuit utilisation (%)433. Spare capacity (A)444. Whether the circuit passes the capacity check45 46## Constraints47 48- No internet access is available. Work from engineering knowledge and the provided tool.49- Use total load = strobe quantity x strobe current + horn quantity x horn current + speaker quantity x speaker current.50- Use utilisation = total load / circuit capacity x 100.51- Use spare capacity = circuit capacity - total load.52- The circuit passes when total load is less than or equal to circuit capacity.53 54## Output Format55 56Show your step-by-step working in Markdown. At the end of your solution, include a JSON block with your final answers in exactly this format:57 58```json59{60 "total_load_a": <numeric_value>,61 "utilisation_pct": <numeric_value>,62 "spare_capacity_a": <numeric_value>,63 "passes_capacity_check": <true_or_false>64}65```66 67Write your complete solution to `/workspace/output.md`.68

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Small notification circuit

small_notification_circuit

Small notification circuit with modest appliance count

office-fire-alarm-zonesmall-public-building
Parameter ranges
strobe_quantity
2 – 20
strobe_current_a
0.04 – 0.12
horn_quantity
2 – 20
horn_current_a
0.02 – 0.08
speaker_quantity
0 – 8
speaker_current_a
0 – 0.05
circuit_capacity_a
2 – 6

Voice evacuation circuit

voice_evacuation_circuit

Voice evacuation notification circuit with speakers and strobes

station-public-address-fire-modelarge-assembly-building
Parameter ranges
strobe_quantity
10 – 60
strobe_current_a
0.05 – 0.18
horn_quantity
0 – 20
horn_current_a
0 – 0.08
speaker_quantity
10 – 80
speaker_current_a
0.02 – 0.08
circuit_capacity_a
4 – 10

Example task

station-public-address-fire-mode-voice-evacuation-circuit-preview — hard difficulty, all inputs given.

Voice evacuation notification circuit with speakers and strobes. station-public-address-fire-mode. Required outputs: total_load_a, utilisation_pct, spare_capacity_a, passes_capacity_check

The model sees

Scenario context and visible inputs.

strobe_quantity
10 to 60
strobe_current_a
0.05 to 0.18 A
horn_quantity
0 to 20
horn_current_a
0 to 0.08 A
speaker_quantity
10 to 80
speaker_current_a
0.02 to 0.08 A
circuit_capacity_a
4 to 10 A

Executable tool: nac-load-calculation_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "total_load_a": <number>,
  "utilisation_pct": <number>,
  "spare_capacity_a": <number>,
  "passes_capacity_check": <number>
}
  • total_load_a · scored within ±3%
  • utilisation_pct · scored within ±3%
  • spare_capacity_a · scored within ±3%
  • passes_capacity_check · scored within ±0%