LIVEdataset aec-bench@releasetasks 552models 18last submission · built
mechanicalwith-tool

Piping Network Repair Negative Case Package

Calculates source-bound piping network repair metrics from a deterministic SSC-11 task-owned source pack. The template combines baseline and variant hydraulic values, velocity and headloss deltas, bend thrust, support shift margin, negative-case capture, unresolved repair count, and an overall synthetic pass score.

with-tool: The model is given an executable Python calculator script.

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

16 inputs

Always given

Included directly in every task prompt.

16
Show 16 inputs
  • Baseline flow

    baseline_flow_l_s

    BASE-SSC11-008 baseline flow

    54.977871437821385 L/s
  • Variant flow

    variant_flow_l_s

    VAR-SSC11-008 repair variant flow

    67.98602851909162 L/s
  • Pipe internal diameter

    pipe_internal_diameter_mm

    BASE-SSC11-008 pipe internal diameter

    250 mm
  • Pipe length

    pipe_length_m

    BASE-SSC11-008 checked pipe length

    90 m
  • Darcy friction factor

    darcy_friction_factor

    BASE-SSC11-008 Darcy friction factor

    0.02
  • Baseline valve loss coefficient

    baseline_valve_loss_coefficient

    BASE-SSC11-008 baseline valve loss coefficient

    3.607892219387754
  • Variant valve loss coefficient

    variant_valve_loss_coefficient

    VAR-SSC11-008 variant valve loss coefficient

    4.807913565926833
  • Measured support shift

    measured_support_shift_m

    SUP-SSC11-008 measured support shift after repair

    0.05 m
  • Allowed support shift

    allowed_support_shift_m

    SUP-SSC11-008 allowed support shift

    0.12 m
  • Bend pressure

    bend_pressure_kpa

    VAR-SSC11-008 bend pressure

    779.9838540354903 kPa
  • Bend angle deg

    bend_angle_deg

    VAR-SSC11-008 bend angle

    30 degrees
  • Thrust allowable

    thrust_allowable_kn

    SUP-SSC11-008 thrust allowable

    120 kN
  • Expected negative cases

    expected_negative_cases

    VERIFY-SSC11-008 expected negative cases

    4 count
  • Localized negative cases

    localized_negative_cases

    VERIFY-SSC11-008 localized negative cases

    4 count
  • Unresolved repair

    unresolved_repair_count

    MEMO-SSC11-008 unresolved repairs

    0 count
  • Maximum variant velocity

    maximum_variant_velocity_m_s

    MEMO-SSC11-008 maximum allowed variant velocity

    1.5 m/s

Scored outputs

12 outputs

Baseline velocity m s

baseline_velocity_m_s

Baseline pipe velocity

Scores if within ±3% of the reference value.

Variant velocity m s

variant_velocity_m_s

Repair variant pipe velocity

Scores if within ±3% of the reference value.

Velocity delta m s

velocity_delta_m_s

Variant velocity minus baseline velocity

Scores if within ±3% of the reference value.

Baseline headloss

baseline_headloss_m

Baseline major and valve headloss

Scores if within ±3% of the reference value.

Variant headloss

variant_headloss_m

Variant major and valve headloss

Scores if within ±3% of the reference value.

Headloss delta

headloss_delta_m

Variant headloss minus baseline headloss

Scores if within ±3% of the reference value.

Bend thrust kn

bend_thrust_kn

Variant bend thrust

Scores if within ±3% of the reference value.

Thrust utilization

thrust_utilization

Bend thrust divided by allowable thrust

Scores if within ±3% of the reference value.

Support shift margin

support_shift_margin_m

Allowed support shift minus measured support shift

Scores if within ±3% of the reference value.

Negative case capture

negative_case_capture_percent

Localized negative cases divided by expected cases

Scores if within ±3% of the reference value.

Unresolved repair count

unresolved_repair_count

Unresolved repair count

Scores if within ±3% of the reference value.

Overall pass score

overall_pass_score

Pass score for the task-owned repair, support, and negative-case checks

Scores if within ±3% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All source-pack values given for the SSC-11 piping repair package
medium:
All source-pack values given for the SSC-11 piping repair package
hard:
All source-pack values given for the SSC-11 piping repair package

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • piping-network-repair-negative-case-package_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a mechanical piping reviewer checking a task-owned synthetic SSC-11 piping network repair and negative-case portfolio.2 3Use only the task-owned synthetic source pack values shown below for numeric grading. Piping network hydraulic review, repair option comparison workflows, pipe thrust support checks, and negative-case verification portfolios shape the workflow context only; they are not extra data sources for this instance.4 5## Scene6 7- Product family: `SSC-11-LH-08`8- Baseline network case: `BASE-SSC11-008`9- Repair variant case: `VAR-SSC11-008`10- Support movement note: `SUP-SSC11-008`11- Negative-case register: `VERIFY-SSC11-008`12- Coordination memo: `MEMO-SSC11-008`13 14## Source Values15 16| Item | Value |17|------|-------|18| Baseline flow | {{ baseline_flow_l_s }} L/s |19| Variant flow | {{ variant_flow_l_s }} L/s |20| Pipe internal diameter | {{ pipe_internal_diameter_mm }} mm |21| Pipe length | {{ pipe_length_m }} m |22| Darcy friction factor | {{ darcy_friction_factor }} |23| Baseline valve loss coefficient | {{ baseline_valve_loss_coefficient }} |24| Variant valve loss coefficient | {{ variant_valve_loss_coefficient }} |25| Measured support shift | {{ measured_support_shift_m }} m |26| Allowed support shift | {{ allowed_support_shift_m }} m |27| Bend pressure | {{ bend_pressure_kpa }} kPa |28| Bend angle | {{ bend_angle_deg }} degrees |29| Thrust allowable | {{ thrust_allowable_kn }} kN |30| Expected negative cases | {{ expected_negative_cases }} |31| Localized negative cases | {{ localized_negative_cases }} |32| Unresolved repair count | {{ unresolved_repair_count }} |33| Maximum variant velocity | {{ maximum_variant_velocity_m_s }} m/s |34 35## Checks36 37- Baseline and variant velocity each equal flow divided by pipe area.38- Baseline and variant headloss each include Darcy major loss and valve minor loss.39- Velocity delta equals variant velocity minus baseline velocity.40- Headloss delta equals variant headloss minus baseline headloss.41- Bend thrust equals `2 x pressure x pipe_area x sin(bend_angle / 2)`.42- Negative-case capture percent equals localized negative cases divided by expected cases times 100.43- Overall pass score is `1.0` only when variant velocity, thrust utilization, support shift, negative-case capture, and unresolved repair checks pass; otherwise it is `0.0`.44 45## Output Format46 47Write a compact memo to `/workspace/output.md`. Include a source-boundary statement that this is a task-owned synthetic source pack. Preserve the object IDs above and state whether the baseline source pack passes the current docs-only checks.48 49Do not claim authority approval, accepted project evidence, software export validity, full standards compliance, executable real source-pack parsing, generated benchmark readiness, or benchmark readiness.50 51Include a fenced JSON block with exactly these numeric keys:52 53```json54{55 "baseline_velocity_m_s": <numeric_value>,56 "variant_velocity_m_s": <numeric_value>,57 "velocity_delta_m_s": <numeric_value>,58 "baseline_headloss_m": <numeric_value>,59 "variant_headloss_m": <numeric_value>,60 "headloss_delta_m": <numeric_value>,61 "bend_thrust_kn": <numeric_value>,62 "thrust_utilization": <numeric_value>,63 "support_shift_margin_m": <numeric_value>,64 "negative_case_capture_percent": <numeric_value>,65 "unresolved_repair_count": <numeric_value>,66 "overall_pass_score": <numeric_value>67}68```69

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Ssc11 piping repair case

ssc11_piping_repair_case

Piping network repair and negative-case portfolio case

piping-repairnegative-case-portfolio
Parameter ranges
baseline_flow_l_s
54.977871437821385
variant_flow_l_s
67.98602851909162
pipe_internal_diameter_mm
250
pipe_length_m
90
darcy_friction_factor
0.02
baseline_valve_loss_coefficient
3.607892219387754
variant_valve_loss_coefficient
4.807913565926833
measured_support_shift_m
0.05
allowed_support_shift_m
0.12
bend_pressure_kpa
779.9838540354903
bend_angle_deg
30
thrust_allowable_kn
120
expected_negative_cases
4
localized_negative_cases
4
unresolved_repair_count
0
maximum_variant_velocity_m_s
1.5

Example task

piping-repair-ssc11-piping-repair-case-previewhard difficulty, all inputs given.

Piping network repair and negative-case portfolio case. piping-repair. Required outputs: baseline_velocity_m_s, variant_velocity_m_s, velocity_delta_m_s, baseline_headloss_m, variant_headloss_m, headloss_delta_m

The model sees

Scenario context and visible inputs.

baseline_flow_l_s
54.9779 to 54.9779 L/s
variant_flow_l_s
67.986 to 67.986 L/s
pipe_internal_diameter_mm
250 to 250 mm
pipe_length_m
90 to 90 m
darcy_friction_factor
0.02 to 0.02
baseline_valve_loss_coefficient
3.60789 to 3.60789
variant_valve_loss_coefficient
4.80791 to 4.80791
measured_support_shift_m
0.05 to 0.05 m
allowed_support_shift_m
0.12 to 0.12 m
bend_pressure_kpa
779.984 to 779.984 kPa
bend_angle_deg
30 to 30 degrees
thrust_allowable_kn
120 to 120 kN
expected_negative_cases
4 to 4 count
localized_negative_cases
4 to 4 count
unresolved_repair_count
0 to 0 count
maximum_variant_velocity_m_s
1.5 to 1.5 m/s

Executable tool: piping-network-repair-negative-case-package_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "baseline_velocity_m_s": <number>,
  "variant_velocity_m_s": <number>,
  "velocity_delta_m_s": <number>,
  "baseline_headloss_m": <number>,
  "variant_headloss_m": <number>,
  "headloss_delta_m": <number>,
  "bend_thrust_kn": <number>,
  "thrust_utilization": <number>,
  "support_shift_margin_m": <number>,
  "negative_case_capture_percent": <number>,
  "unresolved_repair_count": <number>,
  "overall_pass_score": <number>
}
  • baseline_velocity_m_s · scored within ±3%
  • variant_velocity_m_s · scored within ±3%
  • velocity_delta_m_s · scored within ±3%
  • baseline_headloss_m · scored within ±3%
  • variant_headloss_m · scored within ±3%
  • headloss_delta_m · scored within ±3%
  • bend_thrust_kn · scored within ±3%
  • thrust_utilization · scored within ±3%
  • support_shift_margin_m · scored within ±3%
  • negative_case_capture_percent · scored within ±3%
  • unresolved_repair_count · scored within ±3%
  • overall_pass_score · scored within ±3%