LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
mechanicalwith-tool

Pipe Material Velocity Compliance Package

Calculates source-bound pipe product compliance metrics from a deterministic SSC-11 task-owned source pack. The template combines line velocity, pressure loss, pressure class, lining velocity, carbon equivalent, certificate match, support reaction, and an overall synthetic pass score.

with-tool: The model is given an executable Python calculator script.

Standards

Darcy-Weisbach calculationsPipe material certificate reviewPipe support coordinationVelocity and pressure-loss checks

Tags

deterministicmaterial-certificatemechanicalpipe-productsupportvelocity

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

25 inputs

Always given

Included directly in every task prompt.

25
Show 25 inputs

  • Flow

    flow_l_s

    LINE-SSC11-007 line design flow

    42.00309377849555 L/s

  • Pipe internal diameter

    pipe_internal_diameter_mm

    LINE-SSC11-007 hydraulic internal diameter

    200 mm

  • Maximum velocity

    maximum_velocity_m_s

    CRIT-SSC11-007 maximum line velocity

    2.5 m/s

  • Pipe length

    pipe_length_m

    LINE-SSC11-007 checked pipe length

    120.8955239820622 m

  • Darcy friction factor

    darcy_friction_factor

    CRIT-SSC11-007 Darcy friction factor

    0.022

  • Maximum pressure loss

    maximum_pressure_loss_kpa

    CRIT-SSC11-007 maximum pressure loss

    90 kPa

  • Design pressure

    design_pressure_kpa

    LINE-SSC11-007 design pressure

    880 kPa

  • Pipe pressure class

    pipe_pressure_class_kpa

    MAT-SSC11-007 pipe pressure class

    1600 kPa

  • Lining max velocity

    lining_max_velocity_m_s

    MAT-SSC11-007 lining maximum velocity

    3 m/s

  • Carbon percent

    carbon_percent

    MAT-SSC11-007 carbon percentage

    0.2 %

  • Manganese percent

    manganese_percent

    MAT-SSC11-007 manganese percentage

    1.2 %

  • Chromium percent

    chromium_percent

    MAT-SSC11-007 chromium percentage

    0.1 %

  • Molybdenum percent

    molybdenum_percent

    MAT-SSC11-007 molybdenum percentage

    0.06 %

  • Vanadium percent

    vanadium_percent

    MAT-SSC11-007 vanadium percentage

    0.04 %

  • Nickel percent

    nickel_percent

    MAT-SSC11-007 nickel percentage

    0.05 %

  • Copper percent

    copper_percent

    MAT-SSC11-007 copper percentage

    0.055 %

  • Carbon equivalent limit

    carbon_equivalent_limit

    CRIT-SSC11-007 carbon equivalent limit

    0.5

  • Required certificate items

    required_certificate_items

    MAT-SSC11-007 required certificate fields

    5 count

  • Matching certificate items

    matching_certificate_items

    MAT-SSC11-007 matching certificate fields

    5 count

  • Support span

    support_span_m

    SUP-SSC11-007 support span

    4.448988932962285 m

  • Pipe outer diameter

    pipe_outer_diameter_mm

    SUP-SSC11-007 support pipe outer diameter

    219.1 mm

  • Pipe wall thickness

    pipe_wall_thickness_mm

    SUP-SSC11-007 support pipe wall thickness

    8.18 mm

  • Steel density

    steel_density_kg_m3

    SUP-SSC11-007 steel density

    7850 kg/m3

  • Contents density

    contents_density_kg_m3

    LINE-SSC11-007 contents density

    1000 kg/m3

  • Support vertical allowable

    support_vertical_allowable_kn

    SUP-SSC11-007 vertical support allowable

    9.5 kN

Scored outputs

12 outputs

Pipe velocity m s

pipe_velocity_m_s

Line velocity

Scores if within ±3% of the reference value.

Velocity margin m s

velocity_margin_m_s

Velocity limit minus line velocity

Scores if within ±3% of the reference value.

Pressure loss

pressure_loss_kpa

Darcy pressure-loss screening value

Scores if within ±3% of the reference value.

Pressure loss margin

pressure_loss_margin_kpa

Pressure-loss allowance minus calculated loss

Scores if within ±3% of the reference value.

Pressure class margin

pressure_class_margin_kpa

Pipe pressure class minus design pressure

Scores if within ±3% of the reference value.

Lining velocity margin m s

lining_velocity_margin_m_s

Lining maximum velocity minus line velocity

Scores if within ±3% of the reference value.

Carbon equivalent

carbon_equivalent

Carbon equivalent from certificate chemistry

Scores if within ±3% of the reference value.

Carbon equivalent margin

carbon_equivalent_margin

Carbon equivalent limit minus calculated value

Scores if within ±3% of the reference value.

Certificate match

certificate_match_percent

Matching certificate fields divided by required fields

Scores if within ±3% of the reference value.

Support vertical reaction kn

support_vertical_reaction_kn

Pipe support vertical reaction

Scores if within ±3% of the reference value.

Support margin kn

support_margin_kn

Support allowable minus vertical reaction

Scores if within ±3% of the reference value.

Overall pass score

overall_pass_score

Pass score for the task-owned material, hydraulic, certificate, and support checks

Scores if within ±3% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All source-pack values given for the SSC-11 pipe material package
medium:
All source-pack values given for the SSC-11 pipe material package
hard:
All source-pack values given for the SSC-11 pipe material package

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • pipe-material-velocity-compliance-package_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a mechanical piping product reviewer checking a task-owned synthetic SSC-11 pipe material, velocity, certificate, and support package.2 3Use only the task-owned synthetic source pack values shown below for numeric grading. Pipe material certificate review, velocity and pressure-loss checks, Darcy-Weisbach calculations, and pipe support coordination routes shape the workflow context only; they are not extra data sources for this instance.4 5## Scene6 7- Product family: `SSC-11-LH-07`8- Line list: `LINE-SSC11-007`9- Material certificate: `MAT-SSC11-007`10- Design criteria excerpt: `CRIT-SSC11-007`11- Support detail: `SUP-SSC11-007`12- Coordination memo: `MEMO-SSC11-007`13 14## Source Values15 16| Item | Value |17|------|-------|18| Flow | {{ flow_l_s }} L/s |19| Hydraulic internal diameter | {{ pipe_internal_diameter_mm }} mm |20| Maximum velocity | {{ maximum_velocity_m_s }} m/s |21| Pipe length | {{ pipe_length_m }} m |22| Darcy friction factor | {{ darcy_friction_factor }} |23| Maximum pressure loss | {{ maximum_pressure_loss_kpa }} kPa |24| Design pressure | {{ design_pressure_kpa }} kPa |25| Pipe pressure class | {{ pipe_pressure_class_kpa }} kPa |26| Lining maximum velocity | {{ lining_max_velocity_m_s }} m/s |27| Carbon | {{ carbon_percent }} percent |28| Manganese | {{ manganese_percent }} percent |29| Chromium | {{ chromium_percent }} percent |30| Molybdenum | {{ molybdenum_percent }} percent |31| Vanadium | {{ vanadium_percent }} percent |32| Nickel | {{ nickel_percent }} percent |33| Copper | {{ copper_percent }} percent |34| Carbon equivalent limit | {{ carbon_equivalent_limit }} |35| Required certificate fields | {{ required_certificate_items }} |36| Matching certificate fields | {{ matching_certificate_items }} |37| Support span | {{ support_span_m }} m |38| Support pipe outer diameter | {{ pipe_outer_diameter_mm }} mm |39| Support pipe wall thickness | {{ pipe_wall_thickness_mm }} mm |40| Steel density | {{ steel_density_kg_m3 }} kg/m3 |41| Contents density | {{ contents_density_kg_m3 }} kg/m3 |42| Support vertical allowable | {{ support_vertical_allowable_kn }} kN |43 44## Checks45 46- Pipe velocity equals flow divided by pipe area.47- Darcy pressure loss uses friction factor, length over diameter, and velocity head.48- Pressure-class margin equals pipe pressure class minus design pressure.49- Carbon equivalent equals `C + Mn/6 + (Cr + Mo + V)/5 + (Ni + Cu)/15`.50- Certificate match percent equals matching fields divided by required fields times 100.51- Support reaction includes steel annulus weight and contents weight over the support span.52- Overall pass score is `1.0` only when velocity, pressure loss, pressure class, lining velocity, carbon equivalent, certificate, and support checks pass; otherwise it is `0.0`.53 54## Output Format55 56Write a compact memo to `/workspace/output.md`. Include a source-boundary statement that this is a task-owned synthetic source pack. Preserve the object IDs above and state whether the baseline source pack passes the current docs-only checks.57 58Do not claim authority approval, accepted project evidence, software export validity, full standards compliance, executable real source-pack parsing, generated benchmark readiness, or benchmark readiness.59 60Include a fenced JSON block with exactly these numeric keys:61 62```json63{64 "pipe_velocity_m_s": <numeric_value>,65 "velocity_margin_m_s": <numeric_value>,66 "pressure_loss_kpa": <numeric_value>,67 "pressure_loss_margin_kpa": <numeric_value>,68 "pressure_class_margin_kpa": <numeric_value>,69 "lining_velocity_margin_m_s": <numeric_value>,70 "carbon_equivalent": <numeric_value>,71 "carbon_equivalent_margin": <numeric_value>,72 "certificate_match_percent": <numeric_value>,73 "support_vertical_reaction_kn": <numeric_value>,74 "support_margin_kn": <numeric_value>,75 "overall_pass_score": <numeric_value>76}77```78

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Ssc11 pipe material case

ssc11_pipe_material_case

Pipe material and velocity compliance case

pipe-productmaterial-velocity-compliance-check
Parameter ranges
flow_l_s
42.00309377849555
pipe_internal_diameter_mm
200
maximum_velocity_m_s
2.5
pipe_length_m
120.8955239820622
darcy_friction_factor
0.022
maximum_pressure_loss_kpa
90
design_pressure_kpa
880
pipe_pressure_class_kpa
1600
lining_max_velocity_m_s
3
carbon_percent
0.2
manganese_percent
1.2
chromium_percent
0.1
molybdenum_percent
0.06
vanadium_percent
0.04
nickel_percent
0.05
copper_percent
0.055
carbon_equivalent_limit
0.5
required_certificate_items
5
matching_certificate_items
5
support_span_m
4.448988932962285
pipe_outer_diameter_mm
219.1
pipe_wall_thickness_mm
8.18
steel_density_kg_m3
7850
contents_density_kg_m3
1000
support_vertical_allowable_kn
9.5

Example task

pipe-product-ssc11-pipe-material-case-preview — hard difficulty, all inputs given.

Pipe material and velocity compliance case. pipe-product. Required outputs: pipe_velocity_m_s, velocity_margin_m_s, pressure_loss_kpa, pressure_loss_margin_kpa, pressure_class_margin_kpa, lining_velocity_margin_m_s

The model sees

Scenario context and visible inputs.

flow_l_s
42.0031 to 42.0031 L/s
pipe_internal_diameter_mm
200 to 200 mm
maximum_velocity_m_s
2.5 to 2.5 m/s
pipe_length_m
120.896 to 120.896 m
darcy_friction_factor
0.022 to 0.022
maximum_pressure_loss_kpa
90 to 90 kPa
design_pressure_kpa
880 to 880 kPa
pipe_pressure_class_kpa
1600 to 1600 kPa
lining_max_velocity_m_s
3 to 3 m/s
carbon_percent
0.2 to 0.2 %
manganese_percent
1.2 to 1.2 %
chromium_percent
0.1 to 0.1 %
molybdenum_percent
0.06 to 0.06 %
vanadium_percent
0.04 to 0.04 %
nickel_percent
0.05 to 0.05 %
copper_percent
0.055 to 0.055 %
carbon_equivalent_limit
0.5 to 0.5
required_certificate_items
5 to 5 count
matching_certificate_items
5 to 5 count
support_span_m
4.44899 to 4.44899 m
pipe_outer_diameter_mm
219.1 to 219.1 mm
pipe_wall_thickness_mm
8.18 to 8.18 mm
steel_density_kg_m3
7850 to 7850 kg/m3
contents_density_kg_m3
1000 to 1000 kg/m3
support_vertical_allowable_kn
9.5 to 9.5 kN

Executable tool: pipe-material-velocity-compliance-package_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "pipe_velocity_m_s": <number>,
  "velocity_margin_m_s": <number>,
  "pressure_loss_kpa": <number>,
  "pressure_loss_margin_kpa": <number>,
  "pressure_class_margin_kpa": <number>,
  "lining_velocity_margin_m_s": <number>,
  "carbon_equivalent": <number>,
  "carbon_equivalent_margin": <number>,
  "certificate_match_percent": <number>,
  "support_vertical_reaction_kn": <number>,
  "support_margin_kn": <number>,
  "overall_pass_score": <number>
}
  • pipe_velocity_m_s · scored within ±3%
  • velocity_margin_m_s · scored within ±3%
  • pressure_loss_kpa · scored within ±3%
  • pressure_loss_margin_kpa · scored within ±3%
  • pressure_class_margin_kpa · scored within ±3%
  • lining_velocity_margin_m_s · scored within ±3%
  • carbon_equivalent · scored within ±3%
  • carbon_equivalent_margin · scored within ±3%
  • certificate_match_percent · scored within ±3%
  • support_vertical_reaction_kn · scored within ±3%
  • support_margin_kn · scored within ±3%
  • overall_pass_score · scored within ±3%