LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
electricalwith-tool

Stormwater Treatment Telemetry Control Package

Calculates source-bound telemetry control metrics from a deterministic SSC-18 task-owned source pack. The template combines level transmitter 4-20 mA scaling, pump setpoint currents, communications load, battery backup energy, and an overall synthetic pass score.

with-tool: The model is given an executable Python calculator script.

Standards

ISA-5SCADA telemetry workflowcontrol narrative workflow

Tags

4-20mabackup-powercontrolsdeterministicelectricalinstrumentationtelemetry

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

15 inputs

Always given

Included directly in every task prompt.

15
Show 15 inputs

  • Current level

    current_level_m

    LEVEL-18-TABLE-02 current stormwater/treatment level

    3.2 m

  • Lower range level

    lower_range_level_m

    SENSOR-18-SCHED-02 level transmitter lower range

    0 m

  • Upper range level

    upper_range_level_m

    SENSOR-18-SCHED-02 level transmitter upper range

    5 m

  • High level alarm

    high_level_alarm_m

    NARR-18-CTRL-02 high-level alarm setpoint

    4.2 m

  • Pump start level

    pump_start_level_m

    NARR-18-CTRL-02 pump start setpoint

    3.5 m

  • Pump stop level

    pump_stop_level_m

    NARR-18-CTRL-02 pump stop setpoint

    1.2 m

  • Sensor accuracy pct span

    sensor_accuracy_pct_span

    SENSOR-18-SCHED-02 transmitter accuracy as percent of span

    0.25 %

  • Device count

    device_count

    COMMS-18-TOPO-02 telemetry device count

    6

  • Device power

    device_power_w

    PWR-18-SCHED-02 power per telemetry device

    18 W

  • Radio power

    radio_power_w

    COMMS-18-TOPO-02 radio power

    35 W

  • Backup duration

    backup_duration_h

    PWR-18-SCHED-02 required backup duration

    12 h

  • Battery voltage

    battery_voltage_v

    PWR-18-SCHED-02 battery voltage

    24 V

  • Battery capacity

    battery_capacity_ah

    PWR-18-SCHED-02 battery capacity

    120 Ah

  • Battery usable fraction

    battery_usable_fraction

    PWR-18-SCHED-02 usable battery fraction

    0.8

  • Inverter efficiency

    inverter_efficiency

    PWR-18-SCHED-02 inverter efficiency

    0.9

Scored outputs

12 outputs

Level span

level_span_m

Transmitter level span

Scores if within ±3% of the reference value.

Current signal ma

current_signal_ma

4-20 mA signal at the current level

Scores if within ±3% of the reference value.

High level current ma

high_level_current_ma

4-20 mA signal at the high-level alarm setpoint

Scores if within ±3% of the reference value.

Pump start current ma

pump_start_current_ma

4-20 mA signal at the pump-start setpoint

Scores if within ±3% of the reference value.

Pump stop current ma

pump_stop_current_ma

4-20 mA signal at the pump-stop setpoint

Scores if within ±3% of the reference value.

Sensor accuracy

sensor_accuracy_m

Sensor accuracy converted to metres

Scores if within ±3% of the reference value.

Pump start margin

pump_start_margin_m

Pump-start level minus current level

Scores if within ±3% of the reference value.

Telemetry load w

telemetry_load_w

Total telemetry load

Scores if within ±3% of the reference value.

Backup energy required kwh

backup_energy_required_kwh

Backup energy required

Scores if within ±3% of the reference value.

Battery usable kwh

battery_usable_kwh

Usable battery energy

Scores if within ±3% of the reference value.

Backup energy margin kwh

backup_energy_margin_kwh

Usable battery energy minus required energy

Scores if within ±3% of the reference value.

Overall pass score

overall_pass_score

Pass score for telemetry control checks

Scores if within ±3% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All source-pack values given for the SSC-18 telemetry control package
medium:
All source-pack values given for the SSC-18 telemetry control package
hard:
All source-pack values given for the SSC-18 telemetry control package

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • stormwater-treatment-telemetry-control-package_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are checking `SSC-18-LH-02`, a task-owned synthetic stormwater or treatment telemetry control package.2 3Use only the task-owned synthetic source pack values shown below for numeric grading. Telemetry, control narrative, communications, and backup-power workflows shape the context only; this instance does not parse real PLC, SCADA, telemetry, or authority-approved records.4 5Source pack:6 7- Sensor schedule: `SENSOR-18-SCHED-02`8- Level/flow table: `LEVEL-18-TABLE-02`9- Control narrative: `NARR-18-CTRL-02`10- Communications topology: `COMMS-18-TOPO-02`11- Power schedule: `PWR-18-SCHED-02`12- Telemetry memo: `MEMO-18-TEL-02`13 14Given values:15 16| Field | Value |17| --- | ---: |18| Current level | {{ current_level_m }} m |19| Level range | {{ lower_range_level_m }} to {{ upper_range_level_m }} m |20| High level alarm | {{ high_level_alarm_m }} m |21| Pump start/stop | {{ pump_start_level_m }} / {{ pump_stop_level_m }} m |22| Sensor accuracy | {{ sensor_accuracy_pct_span }} percent of span |23| Telemetry devices | {{ device_count }} at {{ device_power_w }} W |24| Radio power | {{ radio_power_w }} W |25| Backup duration | {{ backup_duration_h }} h |26| Battery | {{ battery_voltage_v }} V, {{ battery_capacity_ah }} Ah, usable fraction {{ battery_usable_fraction }} |27| Inverter efficiency | {{ inverter_efficiency }} |28 29Required calculations:30 31- Level span equals upper range minus lower range.32- 4-20 mA signal equals `4 + 16 x (level - lower range) / level span`.33- Sensor accuracy in metres equals level span times accuracy percent divided by 100.34- Telemetry load equals device count times device power plus radio power.35- Backup energy required equals telemetry load times duration divided by inverter efficiency.36- Battery usable energy equals voltage times Ah times usable fraction.37 38Return one JSON object with keys:39 40```json41{42 "level_span_m": <numeric_value>,43 "current_signal_ma": <numeric_value>,44 "high_level_current_ma": <numeric_value>,45 "pump_start_current_ma": <numeric_value>,46 "pump_stop_current_ma": <numeric_value>,47 "sensor_accuracy_m": <numeric_value>,48 "pump_start_margin_m": <numeric_value>,49 "telemetry_load_w": <numeric_value>,50 "backup_energy_required_kwh": <numeric_value>,51 "battery_usable_kwh": <numeric_value>,52 "backup_energy_margin_kwh": <numeric_value>,53 "overall_pass_score": <numeric_value>54}55```56 57Do not claim authority approval, accepted project evidence, PLC/SCADA export validity, executable real source-pack parsing, full standards compliance, generated benchmark readiness, or benchmark readiness.58

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Ssc18 telemetry control case

ssc18_telemetry_control_case

Stormwater/treatment telemetry control source pack

telemetry-controlstormwater-level-signal
Parameter ranges
current_level_m
3.2
lower_range_level_m
0
upper_range_level_m
5
high_level_alarm_m
4.2
pump_start_level_m
3.5
pump_stop_level_m
1.2
sensor_accuracy_pct_span
0.25
device_count
6
device_power_w
18
radio_power_w
35
backup_duration_h
12
battery_voltage_v
24
battery_capacity_ah
120
battery_usable_fraction
0.8
inverter_efficiency
0.9

Example task

telemetry-control-ssc18-telemetry-control-case-preview — hard difficulty, all inputs given.

Stormwater/treatment telemetry control source pack. telemetry-control. Required outputs: level_span_m, current_signal_ma, high_level_current_ma, pump_start_current_ma, pump_stop_current_ma, sensor_accuracy_m

The model sees

Scenario context and visible inputs.

current_level_m
3.2 to 3.2 m
lower_range_level_m
0 to 0 m
upper_range_level_m
5 to 5 m
high_level_alarm_m
4.2 to 4.2 m
pump_start_level_m
3.5 to 3.5 m
pump_stop_level_m
1.2 to 1.2 m
sensor_accuracy_pct_span
0.25 to 0.25 %
device_count
6 to 6
device_power_w
18 to 18 W
radio_power_w
35 to 35 W
backup_duration_h
12 to 12 h
battery_voltage_v
24 to 24 V
battery_capacity_ah
120 to 120 Ah
battery_usable_fraction
0.8 to 0.8
inverter_efficiency
0.9 to 0.9

Executable tool: stormwater-treatment-telemetry-control-package_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "level_span_m": <number>,
  "current_signal_ma": <number>,
  "high_level_current_ma": <number>,
  "pump_start_current_ma": <number>,
  "pump_stop_current_ma": <number>,
  "sensor_accuracy_m": <number>,
  "pump_start_margin_m": <number>,
  "telemetry_load_w": <number>,
  "backup_energy_required_kwh": <number>,
  "battery_usable_kwh": <number>,
  "backup_energy_margin_kwh": <number>,
  "overall_pass_score": <number>
}
  • level_span_m · scored within ±3%
  • current_signal_ma · scored within ±3%
  • high_level_current_ma · scored within ±3%
  • pump_start_current_ma · scored within ±3%
  • pump_stop_current_ma · scored within ±3%
  • sensor_accuracy_m · scored within ±3%
  • pump_start_margin_m · scored within ±3%
  • telemetry_load_w · scored within ±3%
  • backup_energy_required_kwh · scored within ±3%
  • battery_usable_kwh · scored within ±3%
  • backup_energy_margin_kwh · scored within ±3%
  • overall_pass_score · scored within ±3%