LIVEdataset aec-bench@releasetasks 552models 18last submission · built
electricalwith-tool

Control Loop Signal Package

Calculates source-bound control-loop metrics from a deterministic SSC-18 task-owned source pack. The template combines valve pressure drop and Cv sizing, linear 4-20 mA signal scaling, alarm and trip current conversion, and control-loop headroom checks for a compact generated task instance.

with-tool: The model is given an executable Python calculator script.

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

13 inputs

Always given

Included directly in every task prompt.

13
Show 13 inputs
  • Flow rate

    flow_rate_m3_h

    OP-SSC18-LOOP-001 flow rate through FCV-18-101

    86 m3/h
  • Upstream pressure

    upstream_pressure_bar

    VDS-18-FCV-101 upstream pressure

    6.2 bar
  • Downstream pressure

    downstream_pressure_bar

    VDS-18-FCV-101 downstream pressure

    3.1 bar
  • Fluid specific gravity

    fluid_specific_gravity

    OP-SSC18-LOOP-001 fluid specific gravity

    1
  • Fluid vapor pressure

    fluid_vapor_pressure_bar

    OP-SSC18-LOOP-001 fluid vapor pressure

    0.031 bar
  • Fluid critical pressure

    fluid_critical_pressure_bar

    OP-SSC18-LOOP-001 fluid critical pressure

    220.64 bar
  • Fl recovery factor

    fl_recovery_factor

    VDS-18-FCV-101 valve liquid pressure recovery factor

    0.9
  • Selected valve cv

    selected_valve_cv

    VDS-18-FCV-101 selected control valve Cv

    63
  • Process value

    process_value_m3_h

    FIT-18-101 current process value

    68.8 m3/h
  • Lower range value

    lower_range_value_m3_h

    LS-18-FIC-101 lower range value

    0 m3/h
  • Upper range value

    upper_range_value_m3_h

    LS-18-FIC-101 upper range value

    120 m3/h
  • High alarm flow

    high_alarm_flow_m3_h

    ALM-18-FLOW-101 high alarm setpoint

    95 m3/h
  • High high trip flow

    high_high_trip_flow_m3_h

    ALM-18-FLOW-101 high-high trip setpoint

    108 m3/h

Scored outputs

13 outputs

Pressure drop bar

pressure_drop_bar

Actual pressure drop across FCV-18-101

Scores if within ±3% of the reference value.

Choked pressure drop bar

choked_pressure_drop_bar

Choked pressure drop limit from the task-owned valve data

Scores if within ±3% of the reference value.

Cv required

cv_required

Required valve Cv for the operating case

Scores if within ±3% of the reference value.

Selected cv headroom

selected_cv_headroom

Selected valve Cv minus required Cv

Scores if within ±3% of the reference value.

Valve travel pct

valve_travel_pct

Required Cv divided by selected Cv

Scores if within ±3% of the reference value.

Span pct

span_pct

Current process value as percent of the loop range

Scores if within ±3% of the reference value.

Current signal ma

current_signal_ma

4-20 mA signal for the current process value

Scores if within ±3% of the reference value.

Reconstructed process value

reconstructed_process_value

Process value reconstructed from the 4-20 mA signal

Scores if within ±3% of the reference value.

High alarm current ma

high_alarm_current_ma

4-20 mA signal at the high alarm setpoint

Scores if within ±3% of the reference value.

High high trip current ma

high_high_trip_current_ma

4-20 mA signal at the high-high trip setpoint

Scores if within ±3% of the reference value.

Alarm current headroom ma

alarm_current_headroom_ma

High alarm current minus current signal

Scores if within ±3% of the reference value.

Trip flow headroom

trip_flow_headroom_m3_h

High-high trip setpoint minus current process value

Scores if within ±3% of the reference value.

Overall pass score

overall_pass_score

Pass score for the task-owned valve, signal, and alarm checks

Scores if within ±3% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All source-pack values given for the SSC-18 control-loop signal package
medium:
All source-pack values given for the SSC-18 control-loop signal package
hard:
All source-pack values given for the SSC-18 control-loop signal package

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • control-loop-signal-package_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are an instrumentation and controls engineer checking a task-owned synthetic SSC-18 loop package for one valve, process value, 4-20 mA signal range, and alarm/trip handoff.2 3Use only the task-owned synthetic source pack values shown below for numeric grading. External ISA-5, ISA-75, ISA-84, Siemens TIA Portal, Rockwell Studio 5000, and Endress+Hauser routes shape the workflow context only; they are not extra data sources for this instance.4 5## Scene6 7- Operating case: `OP-SSC18-LOOP-001`8- P&ID sheet: `PID-18-101`9- Loop controller: `FIC-18-101`10- Flow transmitter: `FIT-18-101`11- Control valve: `FCV-18-101`12- Valve datasheet: `VDS-18-FCV-101`13- Loop sheet: `LS-18-FIC-101`14- Control narrative: `CN-18-001`15- Alarm register: `ALM-18-FLOW-101`16- Commissioning record: `COM-18-LOOP-101`17- Loop memo: `MEMO-18-LOOP-001`18 19## Valve And Process Basis20 21| Item | Value |22|------|-------|23| Flow rate through FCV-18-101 | {{ flow_rate_m3_h }} m3/h |24| Upstream pressure | {{ upstream_pressure_bar }} bar |25| Downstream pressure | {{ downstream_pressure_bar }} bar |26| Fluid specific gravity | {{ fluid_specific_gravity }} |27| Fluid vapor pressure | {{ fluid_vapor_pressure_bar }} bar |28| Fluid critical pressure | {{ fluid_critical_pressure_bar }} bar |29| Valve liquid pressure recovery factor, FL | {{ fl_recovery_factor }} |30| Selected valve Cv | {{ selected_valve_cv }} |31 32Valve checks:33 34- Pressure drop equals upstream pressure minus downstream pressure.35- Liquid critical pressure ratio factor equals `0.96 - 0.28 x sqrt(fluid_vapor_pressure_bar / fluid_critical_pressure_bar)`.36- Choked pressure drop equals `FL^2 x (upstream_pressure_bar - liquid_critical_pressure_ratio_factor x fluid_vapor_pressure_bar)`.37- Effective pressure drop is the smaller of actual pressure drop and choked pressure drop.38- Required Cv equals `1.156 x flow_rate_m3_h x sqrt(fluid_specific_gravity / effective_pressure_drop_bar)`.39- Selected Cv headroom equals selected valve Cv minus required Cv.40- Valve travel percent equals required Cv divided by selected valve Cv, multiplied by 100.41 42## Loop Signal And Alarm Basis43 44| Item | Value |45|------|-------|46| Current process value at FIT-18-101 | {{ process_value_m3_h }} m3/h |47| Lower range value | {{ lower_range_value_m3_h }} m3/h |48| Upper range value | {{ upper_range_value_m3_h }} m3/h |49| High alarm setpoint | {{ high_alarm_flow_m3_h }} m3/h |50| High-high trip setpoint | {{ high_high_trip_flow_m3_h }} m3/h |51 52Signal checks:53 54- Span percent equals `(process_value_m3_h - lower_range_value_m3_h) / (upper_range_value_m3_h - lower_range_value_m3_h) x 100`.55- Current signal equals `4 + 16 x span_fraction`.56- Reconstructed process value equals `lower_range_value_m3_h + (current_signal_ma - 4) / 16 x range_span`.57- High alarm and high-high trip currents use the same 4-20 mA range.58- Alarm current headroom equals high alarm current minus current signal.59- Trip flow headroom equals high-high trip setpoint minus current process value.60- Overall pass score is `1.0` only when selected Cv headroom, alarm current headroom, and trip flow headroom are non-negative; otherwise it is `0.0`.61 62## Output Format63 64Write a compact memo to `/workspace/output.md`. Include a source-boundary statement that this is a task-owned synthetic source pack. Explain the calculations briefly, preserve the object IDs above, and state whether the baseline source pack passes the current docs-only checks.65 66Do not claim authority approval, accepted project evidence, software export validity, full standards compliance, executable real source-pack parsing, generated benchmark readiness, or benchmark readiness.67 68Include a fenced JSON block with exactly these numeric keys:69 70```json71{72 "pressure_drop_bar": <numeric_value>,73 "choked_pressure_drop_bar": <numeric_value>,74 "cv_required": <numeric_value>,75 "selected_cv_headroom": <numeric_value>,76 "valve_travel_pct": <numeric_value>,77 "span_pct": <numeric_value>,78 "current_signal_ma": <numeric_value>,79 "reconstructed_process_value": <numeric_value>,80 "high_alarm_current_ma": <numeric_value>,81 "high_high_trip_current_ma": <numeric_value>,82 "alarm_current_headroom_ma": <numeric_value>,83 "trip_flow_headroom_m3_h": <numeric_value>,84 "overall_pass_score": <numeric_value>85}86```87

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Ssc18 control loop case

ssc18_control_loop_case

Valve Cv, process value, signal scaling, and alarm handoff package

valve-signal-loopalarm-trip-handoff
Parameter ranges
flow_rate_m3_h
86
upstream_pressure_bar
6.2
downstream_pressure_bar
3.1
fluid_specific_gravity
1
fluid_vapor_pressure_bar
0.031
fluid_critical_pressure_bar
220.64
fl_recovery_factor
0.9
selected_valve_cv
63
process_value_m3_h
68.8
lower_range_value_m3_h
0
upper_range_value_m3_h
120
high_alarm_flow_m3_h
95
high_high_trip_flow_m3_h
108

Example task

valve-signal-loop-ssc18-control-loop-case-previewhard difficulty, all inputs given.

Valve Cv, process value, signal scaling, and alarm handoff package. valve-signal-loop. Required outputs: pressure_drop_bar, choked_pressure_drop_bar, cv_required, selected_cv_headroom, valve_travel_pct, span_pct

The model sees

Scenario context and visible inputs.

flow_rate_m3_h
86 to 86 m3/h
upstream_pressure_bar
6.2 to 6.2 bar
downstream_pressure_bar
3.1 to 3.1 bar
fluid_specific_gravity
1 to 1
fluid_vapor_pressure_bar
0.031 to 0.031 bar
fluid_critical_pressure_bar
220.64 to 220.64 bar
fl_recovery_factor
0.9 to 0.9
selected_valve_cv
63 to 63
process_value_m3_h
68.8 to 68.8 m3/h
lower_range_value_m3_h
0 to 0 m3/h
upper_range_value_m3_h
120 to 120 m3/h
high_alarm_flow_m3_h
95 to 95 m3/h
high_high_trip_flow_m3_h
108 to 108 m3/h

Executable tool: control-loop-signal-package_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "pressure_drop_bar": <number>,
  "choked_pressure_drop_bar": <number>,
  "cv_required": <number>,
  "selected_cv_headroom": <number>,
  "valve_travel_pct": <number>,
  "span_pct": <number>,
  "current_signal_ma": <number>,
  "reconstructed_process_value": <number>,
  "high_alarm_current_ma": <number>,
  "high_high_trip_current_ma": <number>,
  "alarm_current_headroom_ma": <number>,
  "trip_flow_headroom_m3_h": <number>,
  "overall_pass_score": <number>
}
  • pressure_drop_bar · scored within ±3%
  • choked_pressure_drop_bar · scored within ±3%
  • cv_required · scored within ±3%
  • selected_cv_headroom · scored within ±3%
  • valve_travel_pct · scored within ±3%
  • span_pct · scored within ±3%
  • current_signal_ma · scored within ±3%
  • reconstructed_process_value · scored within ±3%
  • high_alarm_current_ma · scored within ±3%
  • high_high_trip_current_ma · scored within ±3%
  • alarm_current_headroom_ma · scored within ±3%
  • trip_flow_headroom_m3_h · scored within ±3%
  • overall_pass_score · scored within ±3%