LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
civilwith-tool

Drainage Long Section Hgl Road Low Point Package

Calculates source-bound road low-point drainage metrics from a deterministic stormwater task-owned source pack. The template combines pipe slope, Manning capacity, HGL, low-point freeboard, roadway spread, equipment freeboard, and an overall synthetic pass score.

with-tool: The model is given an executable Python calculator script.

Standards

FHWA HEC-22Manning drainage calculationsroad low-point drainage reviewstormwater HGL workflows

Tags

civildeterministichglroad-low-pointspreadstormwater

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

14 inputs

Always given

Included directly in every task prompt.

14
Show 14 inputs

  • Upstream invert

    upstream_invert_m

    PITPIPE-SSC03-002 upstream pipe invert

    22.15 m

  • Downstream invert

    downstream_invert_m

    PITPIPE-SSC03-002 downstream pipe invert

    21.65 m

  • Pipe length

    pipe_length_m

    DRAIN-SSC03-002 pipe reach length

    80 m

  • Pipe diameter

    pipe_diameter_m

    PITPIPE-SSC03-002 pipe diameter

    0.6 m

  • Design flow

    design_flow_m3_s

    HGL-SSC03-002 design pipe flow

    0.42 m3/s

  • Manning n

    manning_n

    DRAIN-SSC03-002 Manning roughness

    0.013

  • Downstream tailwater

    downstream_tailwater_m

    HGL-SSC03-002 downstream tailwater

    21.95 m

  • Minor loss coefficient

    minor_loss_coefficient

    HGL-SSC03-002 pit/minor loss coefficient

    0.65

  • Road low point level

    road_low_point_level_m

    ROAD-SSC03-002 road low-point level

    22.8 m

  • Minimum freeboard

    minimum_freeboard_m

    MEMO-SSC03-002 minimum low-point freeboard

    0.3 m

  • Gutter approach flow

    gutter_approach_flow_m3_s

    ROAD-SSC03-002 gutter approach flow

    0.18 m3/s

  • Roadway spread factor

    roadway_spread_factor

    ROAD-SSC03-002 source-owned roadway spread factor

    4.2

  • Allowable spread

    allowable_spread_m

    MEMO-SSC03-002 allowable roadway spread

    2.4 m

  • Equipment threshold level

    equipment_threshold_level_m

    MEMO-SSC03-002 roadside equipment threshold level

    23.05 m

Scored outputs

13 outputs

Pipe slope

pipe_slope_percent

Pipe slope from invert schedule

Scores if within ±3% of the reference value.

Pipe velocity m s

pipe_velocity_m_s

Pipe velocity at design flow

Scores if within ±3% of the reference value.

Manning capacity

manning_capacity_m3_s

Full-pipe Manning capacity

Scores if within ±3% of the reference value.

Capacity margin

capacity_margin_m3_s

Manning capacity minus design flow

Scores if within ±3% of the reference value.

Friction loss

friction_loss_m

Pipe friction loss at design flow

Scores if within ±3% of the reference value.

Minor loss

minor_loss_m

Pit/minor loss at design flow

Scores if within ±3% of the reference value.

Upstream hgl

upstream_hgl_m

Upstream hydraulic grade line

Scores if within ±3% of the reference value.

Low point freeboard

low_point_freeboard_m

Road low-point level minus upstream HGL

Scores if within ±3% of the reference value.

Freeboard margin

freeboard_margin_m

Low-point freeboard minus minimum freeboard

Scores if within ±3% of the reference value.

Roadway spread

roadway_spread_m

Source-owned roadway spread estimate

Scores if within ±3% of the reference value.

Spread margin

spread_margin_m

Allowable spread minus roadway spread

Scores if within ±3% of the reference value.

Equipment freeboard

equipment_freeboard_m

Equipment threshold level minus upstream HGL

Scores if within ±3% of the reference value.

Overall pass score

overall_pass_score

Pass score for capacity, HGL, spread, and equipment freeboard checks

Scores if within ±3% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All source-pack values given for the stormwater road low-point HGL package
medium:
All source-pack values given for the stormwater road low-point HGL package
hard:
All source-pack values given for the stormwater road low-point HGL package

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • drainage-long-section-hgl-road-low-point-package_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a civil drainage engineer checking a task-owned synthetic stormwater drainage long-section, HGL, and road low-point package.2 3Use only the task-owned synthetic source pack values shown below for numeric grading. FHWA HEC-22, Manning drainage calculations, road low-point drainage review, and stormwater HGL workflows shape the workflow context only; they are not extra data sources for this instance.4 5## Scene6 7- Product family: `SSC-03-LH-02`8- Road long section: `ROAD-SSC03-002`9- Drainage long section: `DRAIN-SSC03-002`10- Pit and pipe schedule: `PITPIPE-SSC03-002`11- HGL table: `HGL-SSC03-002`12- Low-point memo: `MEMO-SSC03-002`13 14## Source Values15 16| Item | Value |17|------|-------|18| Upstream invert | {{ upstream_invert_m }} m |19| Downstream invert | {{ downstream_invert_m }} m |20| Pipe length | {{ pipe_length_m }} m |21| Pipe diameter | {{ pipe_diameter_m }} m |22| Design flow | {{ design_flow_m3_s }} m3/s |23| Manning n | {{ manning_n }} |24| Downstream tailwater | {{ downstream_tailwater_m }} m |25| Minor loss coefficient | {{ minor_loss_coefficient }} |26| Road low-point level | {{ road_low_point_level_m }} m |27| Minimum freeboard | {{ minimum_freeboard_m }} m |28| Gutter approach flow | {{ gutter_approach_flow_m3_s }} m3/s |29| Roadway spread factor | {{ roadway_spread_factor }} |30| Allowable spread | {{ allowable_spread_m }} m |31| Equipment threshold level | {{ equipment_threshold_level_m }} m |32 33## Checks34 35- Pipe slope equals upstream invert minus downstream invert divided by pipe length.36- Manning capacity uses full-pipe area and hydraulic radius.37- Upstream HGL equals downstream tailwater plus friction and minor losses.38- Road low-point freeboard, roadway spread, and equipment freeboard must all remain positive.39- Overall pass score is `1.0` only when capacity, freeboard, spread, and equipment freeboard checks pass; otherwise it is `0.0`.40 41## Output Format42 43Write a compact memo to `/workspace/output.md`. Include a source-boundary statement that this is a task-owned synthetic source pack. Preserve the object IDs above and state whether the baseline source pack passes the current docs-only checks.44 45Do not claim authority approval, accepted project evidence, software export validity, full standards compliance, executable real source-pack parsing, generated SWMM report-output evidence, generated benchmark readiness, or benchmark readiness.46 47Include a fenced JSON block with exactly these numeric keys:48 49```json50{51 "pipe_slope_percent": <numeric_value>,52 "pipe_velocity_m_s": <numeric_value>,53 "manning_capacity_m3_s": <numeric_value>,54 "capacity_margin_m3_s": <numeric_value>,55 "friction_loss_m": <numeric_value>,56 "minor_loss_m": <numeric_value>,57 "upstream_hgl_m": <numeric_value>,58 "low_point_freeboard_m": <numeric_value>,59 "freeboard_margin_m": <numeric_value>,60 "roadway_spread_m": <numeric_value>,61 "spread_margin_m": <numeric_value>,62 "equipment_freeboard_m": <numeric_value>,63 "overall_pass_score": <numeric_value>64}65```66

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Stormwater low point hgl case

stormwater_low_point_hgl_case

Road low-point HGL and spread case

road-low-pointdrainage-hgl-check
Parameter ranges
upstream_invert_m
22.15
downstream_invert_m
21.65
pipe_length_m
80
pipe_diameter_m
0.6
design_flow_m3_s
0.42
manning_n
0.013
downstream_tailwater_m
21.95
minor_loss_coefficient
0.65
road_low_point_level_m
22.8
minimum_freeboard_m
0.3
gutter_approach_flow_m3_s
0.18
roadway_spread_factor
4.2
allowable_spread_m
2.4
equipment_threshold_level_m
23.05

Example task

road-low-point-stormwater-low-point-hgl-case-preview — hard difficulty, all inputs given.

Road low-point HGL and spread case. road-low-point. Required outputs: pipe_slope_percent, pipe_velocity_m_s, manning_capacity_m3_s, capacity_margin_m3_s, friction_loss_m, minor_loss_m

The model sees

Scenario context and visible inputs.

upstream_invert_m
22.15 to 22.15 m
downstream_invert_m
21.65 to 21.65 m
pipe_length_m
80 to 80 m
pipe_diameter_m
0.6 to 0.6 m
design_flow_m3_s
0.42 to 0.42 m3/s
manning_n
0.013 to 0.013
downstream_tailwater_m
21.95 to 21.95 m
minor_loss_coefficient
0.65 to 0.65
road_low_point_level_m
22.8 to 22.8 m
minimum_freeboard_m
0.3 to 0.3 m
gutter_approach_flow_m3_s
0.18 to 0.18 m3/s
roadway_spread_factor
4.2 to 4.2
allowable_spread_m
2.4 to 2.4 m
equipment_threshold_level_m
23.05 to 23.05 m

Executable tool: drainage-long-section-hgl-road-low-point-package_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "pipe_slope_percent": <number>,
  "pipe_velocity_m_s": <number>,
  "manning_capacity_m3_s": <number>,
  "capacity_margin_m3_s": <number>,
  "friction_loss_m": <number>,
  "minor_loss_m": <number>,
  "upstream_hgl_m": <number>,
  "low_point_freeboard_m": <number>,
  "freeboard_margin_m": <number>,
  "roadway_spread_m": <number>,
  "spread_margin_m": <number>,
  "equipment_freeboard_m": <number>,
  "overall_pass_score": <number>
}
  • pipe_slope_percent · scored within ±3%
  • pipe_velocity_m_s · scored within ±3%
  • manning_capacity_m3_s · scored within ±3%
  • capacity_margin_m3_s · scored within ±3%
  • friction_loss_m · scored within ±3%
  • minor_loss_m · scored within ±3%
  • upstream_hgl_m · scored within ±3%
  • low_point_freeboard_m · scored within ±3%
  • freeboard_margin_m · scored within ±3%
  • roadway_spread_m · scored within ±3%
  • spread_margin_m · scored within ±3%
  • equipment_freeboard_m · scored within ±3%
  • overall_pass_score · scored within ±3%