LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
civilwith-tool

Pipe Product Velocity Slope Certificate Package

Calculates source-bound pipe product compliance metrics from a deterministic SSC-15 task-owned source pack. The template combines one pipe datasheet, pipe schedule, long section, hydraulic criteria sheet, certificate, and pipe product memo.

with-tool: The model is given an executable Python calculator script.

Standards

gravity pipe slope reviewpipe velocity reviewproduct certificate review

Tags

certificatecivildeterministicmanningpipeproduct-complianceslopevelocity

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

11 inputs

Always given

Included directly in every task prompt.

11
Show 11 inputs

  • Flow

    flow_l_s

    CRIT-15-HYD-05 design flow through the pipe

    18 L/s

  • Internal diameter

    internal_diameter_mm

    PIPE-15-DATA-05 certified internal pipe diameter

    200 mm

  • Pipe slope

    pipe_slope

    LONG-15-SECTION-05 pipe grade

    0.008

  • Minimum slope

    minimum_slope

    CRIT-15-HYD-05 minimum accepted pipe grade

    0.006

  • Manning n

    manning_n

    PIPE-15-DATA-05 pipe roughness value

    0.013

  • Min velocity

    min_velocity_m_s

    CRIT-15-HYD-05 minimum velocity criterion

    0.5 m/s

  • Max velocity

    max_velocity_m_s

    CRIT-15-HYD-05 maximum velocity criterion

    3 m/s

  • Design pressure

    design_pressure_kpa

    PIPE-15-SCHED-05 design pressure at the product use case

    830 kPa

  • Certificate pressure rating

    certificate_pressure_rating_kpa

    CERT-15-PIPE-05 certificate pressure rating

    1200 kPa

  • Design temperature c

    design_temperature_c

    PIPE-15-SCHED-05 design fluid temperature

    45 degC

  • Lining temperature rating c

    lining_temperature_rating_c

    CERT-15-PIPE-05 lining temperature rating

    60 degC

Scored outputs

9 outputs

Flow velocity m s

flow_velocity_m_s

Design flow divided by pipe area

Scores if within ±0.3% of the reference value.

Velocity low margin m s

velocity_low_margin_m_s

Flow velocity minus minimum velocity

Scores if within ±0.3% of the reference value.

Velocity high margin m s

velocity_high_margin_m_s

Maximum velocity minus flow velocity

Scores if within ±0.3% of the reference value.

Manning capacity

manning_capacity_l_s

Full-pipe Manning capacity

Scores if within ±3% of the reference value.

Capacity margin

capacity_margin_l_s

Manning capacity minus design flow

Scores if within ±3% of the reference value.

Slope margin

slope_margin

Pipe slope minus minimum slope

Scores if within ±0.03% of the reference value.

Pressure certificate margin

pressure_certificate_margin_kpa

Certificate pressure rating minus design pressure

Scores if within ±3% of the reference value.

Lining temperature margin c

lining_temperature_margin_c

Lining temperature rating minus design temperature

Scores if within ±3% of the reference value.

Overall pass score

overall_pass_score

1.0 when velocity, capacity, slope, pressure, and lining checks pass

Scores if within ±0.1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All source-pack values given for the SSC-15 pipe product compliance package
medium:
All source-pack values given for the SSC-15 pipe product compliance package
hard:
All source-pack values given for the SSC-15 pipe product compliance package

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • pipe-product-velocity-slope-certificate-package_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a civil pipe reviewer checking a task-owned synthetic SSC-15 pipe product certificate package.2 3Use only the task-owned synthetic source pack values shown below for numeric grading. Pipe product certificate and hydraulic workflow routes shape the context only; they are not extra data sources for this instance.4 5## Scene6 7- Product: `SSC-15-LH-05`8- Pipe datasheet: `PIPE-15-DATA-05`9- Pipe schedule: `PIPE-15-SCHED-05`10- Long section: `LONG-15-SECTION-05`11- Hydraulic criteria: `CRIT-15-HYD-05`12- Product certificate: `CERT-15-PIPE-05`13- Pipe product memo: `MEMO-15-PIPE-05`14 15All checks use the same pipe product, long-section grade, and use-case boundary. Do not change the product identity, pipe segment, grade, certificate, or criteria unless you explicitly flag a source conflict.16 17## Source Values18 19| Item | Value |20|------|-------|21| Design flow | {{ flow_l_s }} L/s |22| Internal diameter | {{ internal_diameter_mm }} mm |23| Pipe slope | {{ pipe_slope }} |24| Minimum slope | {{ minimum_slope }} |25| Manning n | {{ manning_n }} |26| Minimum velocity | {{ min_velocity_m_s }} m/s |27| Maximum velocity | {{ max_velocity_m_s }} m/s |28| Design pressure | {{ design_pressure_kpa }} kPa |29| Certificate pressure rating | {{ certificate_pressure_rating_kpa }} kPa |30| Design temperature | {{ design_temperature_c }} degC |31| Lining temperature rating | {{ lining_temperature_rating_c }} degC |32 33Velocity equals flow divided by pipe area. Manning capacity uses full-pipe area, hydraulic radius `diameter / 4`, the source slope, and the source roughness.34 35## Output Format36 37Write a compact pipe product memo to `/workspace/output.md`. Include a source-boundary statement that this is a task-owned synthetic source pack. Do not claim authority approval, accepted project evidence, software export validity, full standards compliance, executable real source-pack parsing, generated benchmark readiness, or benchmark readiness.38 39Include a fenced JSON block with exactly these numeric keys:40 41```json42{43 "flow_velocity_m_s": <numeric_value>,44 "velocity_low_margin_m_s": <numeric_value>,45 "velocity_high_margin_m_s": <numeric_value>,46 "manning_capacity_l_s": <numeric_value>,47 "capacity_margin_l_s": <numeric_value>,48 "slope_margin": <numeric_value>,49 "pressure_certificate_margin_kpa": <numeric_value>,50 "lining_temperature_margin_c": <numeric_value>,51 "overall_pass_score": <numeric_value>52}53```54

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Ssc15 pipe certificate case

ssc15_pipe_certificate_case

Pipe product velocity, slope, and certificate compliance case

ssc15-pipe-certificate
Parameter ranges

Example task

ssc15-pipe-certificate-ssc15-pipe-certificate-case-preview — hard difficulty, all inputs given.

Pipe product velocity, slope, and certificate compliance case. ssc15-pipe-certificate. Required outputs: flow_velocity_m_s, velocity_low_margin_m_s, velocity_high_margin_m_s, manning_capacity_l_s, capacity_margin_l_s, slope_margin

The model sees

Scenario context and visible inputs.

flow_l_s
18 to 18 L/s
internal_diameter_mm
200 to 200 mm
pipe_slope
0.008 to 0.008
minimum_slope
0.006 to 0.006
manning_n
0.013 to 0.013
min_velocity_m_s
0.5 to 0.5 m/s
max_velocity_m_s
3 to 3 m/s
design_pressure_kpa
830 to 830 kPa
certificate_pressure_rating_kpa
1200 to 1200 kPa
design_temperature_c
45 to 45 degC
lining_temperature_rating_c
60 to 60 degC

Executable tool: pipe-product-velocity-slope-certificate-package_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "flow_velocity_m_s": <number>,
  "velocity_low_margin_m_s": <number>,
  "velocity_high_margin_m_s": <number>,
  "manning_capacity_l_s": <number>,
  "capacity_margin_l_s": <number>,
  "slope_margin": <number>,
  "pressure_certificate_margin_kpa": <number>,
  "lining_temperature_margin_c": <number>,
  "overall_pass_score": <number>
}
  • flow_velocity_m_s · scored within ±0.3%
  • velocity_low_margin_m_s · scored within ±0.3%
  • velocity_high_margin_m_s · scored within ±0.3%
  • manning_capacity_l_s · scored within ±3%
  • capacity_margin_l_s · scored within ±3%
  • slope_margin · scored within ±0.03%
  • pressure_certificate_margin_kpa · scored within ±3%
  • lining_temperature_margin_c · scored within ±3%
  • overall_pass_score · scored within ±0.1%