LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
electricalwith-tool

Fire Pump Pressure Signal Alarm Package

Calculates source-bound fire pump control metrics from a deterministic SSC-18 task-owned source pack. The template combines pressure transmitter signal scaling, alarm threshold margins, NAC panel load, battery required energy, and an overall synthetic pass score.

with-tool: The model is given an executable Python calculator script.

Standards

ISA-5alarm battery workflowfire pump control workflow

Tags

alarmbatterydeterministicelectricalfire-pumpinstrumentationnacpressure

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

14 inputs

Always given

Included directly in every task prompt.

14
Show 14 inputs

  • Residual pressure

    residual_pressure_kpa

    FIRE-18-PUMP-06 residual pressure

    520 kPa

  • Pressure lower

    pressure_lower_kpa

    PRESS-18-SENSOR-06 pressure transmitter lower range

    0 kPa

  • Pressure upper

    pressure_upper_kpa

    PRESS-18-SENSOR-06 pressure transmitter upper range

    1000 kPa

  • Low alarm pressure

    low_alarm_pressure_kpa

    ALM-18-THRESH-06 low alarm pressure

    420 kPa

  • Pump start pressure

    pump_start_pressure_kpa

    ALM-18-THRESH-06 pump start pressure

    450 kPa

  • Nac device count

    nac_device_count

    NAC-18-LOAD-06 NAC device count

    12

  • Nac device current

    nac_device_current_a

    NAC-18-LOAD-06 current per NAC device

    0.15 A

  • Nac panel capacity

    nac_panel_capacity_a

    NAC-18-LOAD-06 NAC panel capacity

    3 A

  • Control load

    control_load_w

    NAC-18-LOAD-06 fire control load

    95 W

  • Standby duration

    standby_duration_h

    CRIT-18-FIRE-06 standby duration

    24 h

  • Alarm duration

    alarm_duration_h

    CRIT-18-FIRE-06 alarm duration

    0.5 h

  • Battery capacity

    battery_capacity_kwh

    NAC-18-LOAD-06 battery capacity

    3 kWh

  • Dc voltage

    dc_voltage_v

    NAC-18-LOAD-06 DC voltage

    24 V

  • Charger efficiency

    charger_efficiency

    NAC-18-LOAD-06 charger efficiency

    0.85

Scored outputs

10 outputs

Pressure signal ma

pressure_signal_ma

4-20 mA signal at residual pressure

Scores if within ±3% of the reference value.

Low alarm current ma

low_alarm_current_ma

4-20 mA signal at low alarm pressure

Scores if within ±3% of the reference value.

Pump start current ma

pump_start_current_ma

4-20 mA signal at pump-start pressure

Scores if within ±3% of the reference value.

Low alarm margin

low_alarm_margin_kpa

Residual pressure minus low alarm pressure

Scores if within ±3% of the reference value.

Pump start margin

pump_start_margin_kpa

Residual pressure minus pump-start pressure

Scores if within ±3% of the reference value.

Nac load

nac_load_a

Total NAC current

Scores if within ±3% of the reference value.

Nac panel margin

nac_panel_margin_a

NAC panel capacity minus NAC load

Scores if within ±3% of the reference value.

Battery required kwh

battery_required_kwh

Battery energy required for standby and alarm

Scores if within ±3% of the reference value.

Battery margin kwh

battery_margin_kwh

Battery capacity minus required energy

Scores if within ±3% of the reference value.

Overall pass score

overall_pass_score

Pass score for fire pump pressure signal and alarm checks

Scores if within ±3% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All source-pack values given for the SSC-18 fire pump signal alarm package
medium:
All source-pack values given for the SSC-18 fire pump signal alarm package
hard:
All source-pack values given for the SSC-18 fire pump signal alarm package

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • fire-pump-pressure-signal-alarm-package_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are checking `SSC-18-LH-06`, a task-owned synthetic fire pump pressure signal and alarm package.2 3Use only the task-owned synthetic source pack values shown below for numeric grading. Fire pump, pressure sensor, alarm threshold, NAC load, and battery workflow context shapes this instance only; it does not parse a real fire pump schematic, alarm panel export, or authority-approved fire design.4 5Source pack:6 7- Fire pump schematic: `FIRE-18-PUMP-06`8- Pressure sensor data sheet: `PRESS-18-SENSOR-06`9- Alarm threshold table: `ALM-18-THRESH-06`10- NAC/load schedule: `NAC-18-LOAD-06`11- Fire authority criterion: `CRIT-18-FIRE-06`12- Fire control memo: `MEMO-18-FIRE-06`13 14Given values:15 16| Field | Value |17| --- | ---: |18| Residual pressure | {{ residual_pressure_kpa }} kPa |19| Pressure range | {{ pressure_lower_kpa }} to {{ pressure_upper_kpa }} kPa |20| Low alarm pressure | {{ low_alarm_pressure_kpa }} kPa |21| Pump start pressure | {{ pump_start_pressure_kpa }} kPa |22| NAC devices/current | {{ nac_device_count }} at {{ nac_device_current_a }} A |23| NAC panel capacity | {{ nac_panel_capacity_a }} A |24| Control load | {{ control_load_w }} W |25| Standby/alarm duration | {{ standby_duration_h }} / {{ alarm_duration_h }} h |26| Battery capacity | {{ battery_capacity_kwh }} kWh |27| DC voltage / charger efficiency | {{ dc_voltage_v }} V / {{ charger_efficiency }} |28 29Required calculations:30 31- 4-20 mA pressure signal equals `4 + 16 x (pressure - lower range) / pressure span`.32- Alarm margins compare residual pressure to the low-alarm and pump-start thresholds.33- NAC load equals device count times device current.34- Battery required energy combines standby control load and alarm NAC load, divided by charger efficiency.35 36Return one JSON object with keys:37 38```json39{40 "pressure_signal_ma": <numeric_value>,41 "low_alarm_current_ma": <numeric_value>,42 "pump_start_current_ma": <numeric_value>,43 "low_alarm_margin_kpa": <numeric_value>,44 "pump_start_margin_kpa": <numeric_value>,45 "nac_load_a": <numeric_value>,46 "nac_panel_margin_a": <numeric_value>,47 "battery_required_kwh": <numeric_value>,48 "battery_margin_kwh": <numeric_value>,49 "overall_pass_score": <numeric_value>50}51```52 53Do not claim authority approval, accepted project evidence, fire-system acceptance, executable real source-pack parsing, full standards compliance, generated benchmark readiness, or benchmark readiness.54

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Ssc18 fire pump signal alarm case

ssc18_fire_pump_signal_alarm_case

Fire pump pressure signal and alarm source pack

fire-pump-pressure-signalfire-alarm-control
Parameter ranges
residual_pressure_kpa
520
pressure_lower_kpa
0
pressure_upper_kpa
1000
low_alarm_pressure_kpa
420
pump_start_pressure_kpa
450
nac_device_count
12
nac_device_current_a
0.15
nac_panel_capacity_a
3
control_load_w
95
standby_duration_h
24
alarm_duration_h
0.5
battery_capacity_kwh
3
dc_voltage_v
24
charger_efficiency
0.85

Example task

fire-pump-pressure-signal-ssc18-fire-pump-signal-alarm-case-preview — hard difficulty, all inputs given.

Fire pump pressure signal and alarm source pack. fire-pump-pressure-signal. Required outputs: pressure_signal_ma, low_alarm_current_ma, pump_start_current_ma, low_alarm_margin_kpa, pump_start_margin_kpa, nac_load_a

The model sees

Scenario context and visible inputs.

residual_pressure_kpa
520 to 520 kPa
pressure_lower_kpa
0 to 0 kPa
pressure_upper_kpa
1000 to 1000 kPa
low_alarm_pressure_kpa
420 to 420 kPa
pump_start_pressure_kpa
450 to 450 kPa
nac_device_count
12 to 12
nac_device_current_a
0.15 to 0.15 A
nac_panel_capacity_a
3 to 3 A
control_load_w
95 to 95 W
standby_duration_h
24 to 24 h
alarm_duration_h
0.5 to 0.5 h
battery_capacity_kwh
3 to 3 kWh
dc_voltage_v
24 to 24 V
charger_efficiency
0.85 to 0.85

Executable tool: fire-pump-pressure-signal-alarm-package_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "pressure_signal_ma": <number>,
  "low_alarm_current_ma": <number>,
  "pump_start_current_ma": <number>,
  "low_alarm_margin_kpa": <number>,
  "pump_start_margin_kpa": <number>,
  "nac_load_a": <number>,
  "nac_panel_margin_a": <number>,
  "battery_required_kwh": <number>,
  "battery_margin_kwh": <number>,
  "overall_pass_score": <number>
}
  • pressure_signal_ma · scored within ±3%
  • low_alarm_current_ma · scored within ±3%
  • pump_start_current_ma · scored within ±3%
  • low_alarm_margin_kpa · scored within ±3%
  • pump_start_margin_kpa · scored within ±3%
  • nac_load_a · scored within ±3%
  • nac_panel_margin_a · scored within ±3%
  • battery_required_kwh · scored within ±3%
  • battery_margin_kwh · scored within ±3%
  • overall_pass_score · scored within ±3%