LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
civilwith-tool

Sediment Basin Storm Readiness Package

Calculates source-bound construction basin storage, weir capacity, freeboard, drawdown, pollutant load, and inspection window metrics from a deterministic SSC-16 task-owned source pack.

with-tool: The model is given an executable Python calculator script.

Standards

CGP/SWPPP workflowconstruction inspection recordssediment basin readiness

Tags

civilconstructiondeterministicinspectionsediment-basinstormwater

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

16 inputs

Always given

Included directly in every task prompt.

16
Show 16 inputs

  • Catchment area

    catchment_area_ha

    CATCH-16-STAGE-05 disturbed catchment area

    1.8 ha

  • Storm depth

    storm_depth_mm

    STORM-16-EVENT-05 storm depth

    75 mm

  • Runoff coefficient

    runoff_coefficient

    STORM-16-EVENT-05 runoff coefficient

    0.82

  • Sediment allowance

    sediment_allowance_m3

    BASIN-16-DETAIL-05 sediment storage allowance

    180 m3

  • Provided basin volume

    provided_basin_volume_m3

    BASIN-16-DETAIL-05 provided basin volume

    1450 m3

  • Weir coefficient

    weir_coefficient

    BASIN-16-DETAIL-05 weir coefficient

    1.7

  • Weir length

    weir_length_m

    BASIN-16-DETAIL-05 weir length

    2.4 m

  • Weir head

    weir_head_m

    BASIN-16-DETAIL-05 weir head

    0.45 m

  • Peak inflow

    peak_inflow_m3_s

    STORM-16-EVENT-05 peak inflow

    0.95 m3/s

  • Provided freeboard

    provided_freeboard_m

    BASIN-16-DETAIL-05 provided freeboard

    0.65 m

  • Required freeboard

    required_freeboard_m

    DISCH-16-CRIT-05 required freeboard

    0.45 m

  • Outlet drawdown flow

    outlet_drawdown_flow_m3_s

    BASIN-16-DETAIL-05 outlet drawdown flow

    0.018 m3/s

  • Maximum drawdown time

    maximum_drawdown_time_h

    DISCH-16-CRIT-05 maximum drawdown time

    24 h

  • Tss event mean concentration

    tss_event_mean_concentration_mg_l

    DISCH-16-CRIT-05 TSS event mean concentration

    220 mg/L

  • Inspection due window

    inspection_due_window_h

    INSP-16-CHECK-05 inspection due window after storm

    24 h

  • Hours since storm end

    hours_since_storm_end

    INSP-16-CHECK-05 hours since storm end

    18 h

Scored outputs

11 outputs

Runoff volume m3

runoff_volume_m3

Runoff volume to the sediment basin

Scores if within ±3% of the reference value.

Required basin volume m3

required_basin_volume_m3

Required basin volume including sediment allowance

Scores if within ±3% of the reference value.

Basin headroom m3

basin_headroom_m3

Provided basin volume minus required basin volume

Scores if within ±3% of the reference value.

Weir capacity

weir_capacity_m3_s

Outlet weir capacity

Scores if within ±0.3% of the reference value.

Weir capacity margin

weir_capacity_margin_m3_s

Weir capacity minus peak inflow

Scores if within ±0.3% of the reference value.

Freeboard margin

freeboard_margin_m

Provided freeboard minus required freeboard

Scores if within ±0.3% of the reference value.

Drawdown time h

drawdown_time_h

Basin drawdown time

Scores if within ±3% of the reference value.

Drawdown margin h

drawdown_margin_h

Maximum drawdown time minus calculated drawdown time

Scores if within ±3% of the reference value.

Tss load kg

tss_load_kg

Estimated event TSS load

Scores if within ±3% of the reference value.

Inspection window margin h

inspection_window_margin_h

Inspection due window minus elapsed time since storm

Scores if within ±3% of the reference value.

Overall pass score

overall_pass_score

1.0 when basin, weir, freeboard, drawdown, and inspection checks pass

Scores if within ±0.1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All source-pack values given for the SSC-16 sediment basin storm readiness package
medium:
All source-pack values given for the SSC-16 sediment basin storm readiness package
hard:
All source-pack values given for the SSC-16 sediment basin storm readiness package

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • sediment-basin-storm-readiness-package_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a construction stormwater engineer checking a task-owned synthetic SSC-16 package for sediment basin volume, overflow readiness, drawdown, pollutant load, and post-storm inspection timing.2 3Use only the task-owned synthetic source pack values shown below for numeric grading. External CGP/SWPPP, erosion-control, basin-readiness, and inspection workflows shape the context only; they are not extra data sources for this instance.4 5## Source Objects6 7- Product: `SSC-16-LH-05`8- Catchment and staging plan: `CATCH-16-STAGE-05`9- Storm event table: `STORM-16-EVENT-05`10- Basin detail: `BASIN-16-DETAIL-05`11- Inspection checklist: `INSP-16-CHECK-05`12- Discharge criterion: `DISCH-16-CRIT-05`13- Readiness memo: `MEMO-16-READY-05`14 15## Source Values16 17| Item | Value |18|------|-------|19| Catchment area | {{ catchment_area_ha }} ha |20| Storm depth | {{ storm_depth_mm }} mm |21| Runoff coefficient | {{ runoff_coefficient }} |22| Sediment storage allowance | {{ sediment_allowance_m3 }} m3 |23| Provided basin volume | {{ provided_basin_volume_m3 }} m3 |24| Weir coefficient | {{ weir_coefficient }} |25| Weir length | {{ weir_length_m }} m |26| Weir head | {{ weir_head_m }} m |27| Peak inflow | {{ peak_inflow_m3_s }} m3/s |28| Provided freeboard | {{ provided_freeboard_m }} m |29| Required freeboard | {{ required_freeboard_m }} m |30| Outlet drawdown flow | {{ outlet_drawdown_flow_m3_s }} m3/s |31| Maximum drawdown time | {{ maximum_drawdown_time_h }} h |32| TSS event mean concentration | {{ tss_event_mean_concentration_mg_l }} mg/L |33| Inspection due window | {{ inspection_due_window_h }} h |34| Hours since storm end | {{ hours_since_storm_end }} h |35 36## Required Checks37 38- Runoff volume equals catchment area times storm depth times runoff coefficient.39- Required basin volume equals runoff volume plus sediment allowance.40- Weir capacity equals source-owned coefficient times length times head to the 1.5 power.41- Drawdown time equals required basin volume divided by outlet drawdown flow.42- TSS load uses runoff volume and event mean concentration.43 44## Output Format45 46Write a compact memo to `/workspace/output.md`. Include a source-boundary statement that this is a task-owned synthetic source pack, preserve the source object IDs above, and state whether the baseline checks pass.47 48Do not claim authority approval, accepted project evidence, software export validity, full standards compliance, executable source-pack hardening, generated benchmark readiness, or benchmark readiness.49 50Include a fenced JSON block with exactly these numeric keys:51 52```json53{54 "runoff_volume_m3": <numeric_value>,55 "required_basin_volume_m3": <numeric_value>,56 "basin_headroom_m3": <numeric_value>,57 "weir_capacity_m3_s": <numeric_value>,58 "weir_capacity_margin_m3_s": <numeric_value>,59 "freeboard_margin_m": <numeric_value>,60 "drawdown_time_h": <numeric_value>,61 "drawdown_margin_h": <numeric_value>,62 "tss_load_kg": <numeric_value>,63 "inspection_window_margin_h": <numeric_value>,64 "overall_pass_score": <numeric_value>65}66```67

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Ssc16 sediment basin storm case

ssc16_sediment_basin_storm_case

Sediment basin and storm event readiness case

Parameter ranges
catchment_area_ha
1.8
storm_depth_mm
75
runoff_coefficient
0.82
sediment_allowance_m3
180
provided_basin_volume_m3
1450
weir_coefficient
1.7
weir_length_m
2.4
weir_head_m
0.45
peak_inflow_m3_s
0.95
provided_freeboard_m
0.65
required_freeboard_m
0.45
outlet_drawdown_flow_m3_s
0.018
maximum_drawdown_time_h
24
tss_event_mean_concentration_mg_l
220
inspection_due_window_h
24
hours_since_storm_end
18

Example task

ssc16-sediment-basin-storm-case-preview — hard difficulty, all inputs given.

Sediment basin and storm event readiness case. Required outputs: runoff_volume_m3, required_basin_volume_m3, basin_headroom_m3, weir_capacity_m3_s, weir_capacity_margin_m3_s, freeboard_margin_m

The model sees

Scenario context and visible inputs.

catchment_area_ha
1.8 to 1.8 ha
storm_depth_mm
75 to 75 mm
runoff_coefficient
0.82 to 0.82
sediment_allowance_m3
180 to 180 m3
provided_basin_volume_m3
1450 to 1450 m3
weir_coefficient
1.7 to 1.7
weir_length_m
2.4 to 2.4 m
weir_head_m
0.45 to 0.45 m
peak_inflow_m3_s
0.95 to 0.95 m3/s
provided_freeboard_m
0.65 to 0.65 m
required_freeboard_m
0.45 to 0.45 m
outlet_drawdown_flow_m3_s
0.018 to 0.018 m3/s
maximum_drawdown_time_h
24 to 24 h
tss_event_mean_concentration_mg_l
220 to 220 mg/L
inspection_due_window_h
24 to 24 h
hours_since_storm_end
18 to 18 h

Executable tool: sediment-basin-storm-readiness-package_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "runoff_volume_m3": <number>,
  "required_basin_volume_m3": <number>,
  "basin_headroom_m3": <number>,
  "weir_capacity_m3_s": <number>,
  "weir_capacity_margin_m3_s": <number>,
  "freeboard_margin_m": <number>,
  "drawdown_time_h": <number>,
  "drawdown_margin_h": <number>,
  "tss_load_kg": <number>,
  "inspection_window_margin_h": <number>,
  "overall_pass_score": <number>
}
  • runoff_volume_m3 · scored within ±3%
  • required_basin_volume_m3 · scored within ±3%
  • basin_headroom_m3 · scored within ±3%
  • weir_capacity_m3_s · scored within ±0.3%
  • weir_capacity_margin_m3_s · scored within ±0.3%
  • freeboard_margin_m · scored within ±0.3%
  • drawdown_time_h · scored within ±3%
  • drawdown_margin_h · scored within ±3%
  • tss_load_kg · scored within ±3%
  • inspection_window_margin_h · scored within ±3%
  • overall_pass_score · scored within ±0.1%