LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
civilwith-tool

Roof Drainage Gutter Downpipe Facade Interface Package

Calculates source-bound roof drainage metrics from deterministic stormwater and SSC-09 task-owned source packs. The template combines roof runoff, gutter capacity margin, downpipe capacity margin, overflow route capacity, parapet freeboard, facade fixing pressure margin, and an overall synthetic pass score.

with-tool: The model is given an executable Python calculator script.

Standards

AS/NZS 3500.3-style roof drainage workflowsfacade interface coordinationgutter and downpipe sizingroof overflow review

Tags

civildeterministicdownpipefacadegutteroverflowroof-drainage

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

13 inputs

Always given

Included directly in every task prompt.

13
Show 13 inputs

  • Roof catchment area

    roof_catchment_area_m2

    ROOF-SSC03-004 roof catchment area

    1280 m2

  • Rainfall intensity

    rainfall_intensity_mm_h

    RAIN-SSC03-004 design rainfall intensity

    165 mm/h

  • Runoff coefficient

    runoff_coefficient

    ROOF-SSC03-004 roof runoff coefficient

    0.95

  • Gutter capacity

    gutter_capacity_l_s

    GUTTER-SSC03-004 total gutter capacity

    68 L/s

  • Downpipe

    downpipe_count

    GUTTER-SSC03-004 downpipe count

    6 count

  • Downpipe capacity

    downpipe_capacity_l_s

    GUTTER-SSC03-004 capacity per downpipe

    13.5 L/s

  • Overflow weir coefficient

    overflow_weir_coefficient

    ROOF-SSC03-004 overflow weir coefficient

    1.7

  • Overflow weir length

    overflow_weir_length_m

    ROOF-SSC03-004 overflow weir length

    3.2 m

  • Overflow head

    overflow_head_m

    ROOF-SSC03-004 overflow head

    0.08 m

  • Parapet freeboard

    parapet_freeboard_m

    FACADE-SSC03-004 parapet freeboard

    0.22 m

  • Minimum freeboard

    minimum_freeboard_m

    MEMO-SSC03-004 minimum freeboard

    0.12 m

  • Facade zone pressure

    facade_zone_pressure_kpa

    FACADE-SSC03-004 local facade pressure at drainage interface

    1.4 kPa

  • Fixing allowable pressure

    fixing_allowable_pressure_kpa

    FACADE-SSC03-004 fixing allowable pressure

    2.1 kPa

Scored outputs

9 outputs

Roof runoff

roof_runoff_l_s

Roof runoff at design rainfall

Scores if within ±3% of the reference value.

Gutter capacity margin

gutter_capacity_margin_l_s

Gutter capacity minus roof runoff

Scores if within ±3% of the reference value.

Downpipe total capacity

downpipe_total_capacity_l_s

Total downpipe capacity

Scores if within ±3% of the reference value.

Downpipe capacity margin

downpipe_capacity_margin_l_s

Downpipe capacity minus roof runoff

Scores if within ±3% of the reference value.

Overflow capacity

overflow_capacity_l_s

Overflow weir capacity

Scores if within ±3% of the reference value.

Overflow capacity margin

overflow_capacity_margin_l_s

Overflow capacity minus overflow demand

Scores if within ±3% of the reference value.

Freeboard margin

freeboard_margin_m

Parapet freeboard minus minimum freeboard

Scores if within ±3% of the reference value.

Facade fixing pressure margin

facade_fixing_pressure_margin_kpa

Facade fixing allowable pressure minus zone pressure

Scores if within ±3% of the reference value.

Overall pass score

overall_pass_score

Pass score for roof drainage and facade interface checks

Scores if within ±3% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All source-pack values given for the stormwater roof drainage package
medium:
All source-pack values given for the stormwater roof drainage package
hard:
All source-pack values given for the stormwater roof drainage package

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • roof-drainage-gutter-downpipe-facade-interface-package_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a civil roof drainage engineer checking a task-owned synthetic roof drainage, gutter/downpipe, and facade interface package.2 3Use only the task-owned synthetic source pack values shown below for numeric grading. AS/NZS 3500.3-style roof drainage workflows, gutter and downpipe sizing, roof overflow review, and facade interface coordination shape the workflow context only; they are not extra data sources for this instance.4 5## Scene6 7- stormwater product family: `SSC-03-LH-04`8- stormwater roof catchment markup: `ROOF-SSC03-004`9- stormwater gutter and downpipe schedule: `GUTTER-SSC03-004`10- stormwater facade/parapet section: `FACADE-SSC03-004`11- stormwater rainfall table: `RAIN-SSC03-004`12- stormwater roof drainage memo: `MEMO-SSC03-004`13- SSC-09 product family: `SSC-09-LH-07`14- SSC-09 roof fall plan: `ROOF-09-FALL-07`15- SSC-09 gutter repair schedule: `GUTTER-09-REPAIR-07`16- SSC-09 downpipe schedule: `DOWNPIPE-09-SCHED-07`17- SSC-09 overflow sketch: `OVERFLOW-09-SKETCH-07`18- SSC-09 facade/equipment exposure note: `FACADE-09-EXPOSE-07`19- SSC-09 repair memo: `MEMO-09-REPAIR-07`20 21## Source Values22 23| Item | Value |24|------|-------|25| Roof catchment area | {{ roof_catchment_area_m2 }} m2 |26| Rainfall intensity | {{ rainfall_intensity_mm_h }} mm/h |27| Runoff coefficient | {{ runoff_coefficient }} |28| Gutter capacity | {{ gutter_capacity_l_s }} L/s |29| Downpipe count | {{ downpipe_count }} |30| Downpipe capacity | {{ downpipe_capacity_l_s }} L/s |31| Overflow weir coefficient | {{ overflow_weir_coefficient }} |32| Overflow weir length | {{ overflow_weir_length_m }} m |33| Overflow head | {{ overflow_head_m }} m |34| Parapet freeboard | {{ parapet_freeboard_m }} m |35| Minimum freeboard | {{ minimum_freeboard_m }} m |36| Facade zone pressure | {{ facade_zone_pressure_kpa }} kPa |37| Fixing allowable pressure | {{ fixing_allowable_pressure_kpa }} kPa |38 39## Checks40 41- Roof runoff equals area times rainfall intensity times runoff coefficient divided by 3600.42- Downpipe capacity equals downpipe count times capacity per downpipe.43- Overflow capacity equals source-owned coefficient times length times head to the power 1.5.44- Overall pass score is `1.0` only when gutter, downpipe, overflow, freeboard, and facade fixing checks pass; otherwise it is `0.0`.45 46## Output Format47 48Write a compact memo to `/workspace/output.md`. Include a source-boundary statement that this is a task-owned synthetic source pack. Preserve the object IDs above and state whether the baseline source pack passes the current docs-only checks.49 50Do not claim authority approval, accepted project evidence, software export validity, full standards compliance, executable real source-pack parsing, generated SWMM report-output evidence, generated benchmark readiness, or benchmark readiness.51 52Include a fenced JSON block with exactly these numeric keys:53 54```json55{56 "roof_runoff_l_s": <numeric_value>,57 "gutter_capacity_margin_l_s": <numeric_value>,58 "downpipe_total_capacity_l_s": <numeric_value>,59 "downpipe_capacity_margin_l_s": <numeric_value>,60 "overflow_capacity_l_s": <numeric_value>,61 "overflow_capacity_margin_l_s": <numeric_value>,62 "freeboard_margin_m": <numeric_value>,63 "facade_fixing_pressure_margin_kpa": <numeric_value>,64 "overall_pass_score": <numeric_value>65}66```67

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Stormwater roof drainage case

stormwater_roof_drainage_case

Roof gutter/downpipe and facade interface case

roof-drainagefacade-interface-check
Parameter ranges
roof_catchment_area_m2
1280
rainfall_intensity_mm_h
165
runoff_coefficient
0.95
gutter_capacity_l_s
68
downpipe_count
6
downpipe_capacity_l_s
13.5
overflow_weir_coefficient
1.7
overflow_weir_length_m
3.2
overflow_head_m
0.08
parapet_freeboard_m
0.22
minimum_freeboard_m
0.12
facade_zone_pressure_kpa
1.4
fixing_allowable_pressure_kpa
2.1

Example task

roof-drainage-stormwater-roof-drainage-case-preview — hard difficulty, all inputs given.

Roof gutter/downpipe and facade interface case. roof-drainage. Required outputs: roof_runoff_l_s, gutter_capacity_margin_l_s, downpipe_total_capacity_l_s, downpipe_capacity_margin_l_s, overflow_capacity_l_s, overflow_capacity_margin_l_s

The model sees

Scenario context and visible inputs.

roof_catchment_area_m2
1280 to 1280 m2
rainfall_intensity_mm_h
165 to 165 mm/h
runoff_coefficient
0.95 to 0.95
gutter_capacity_l_s
68 to 68 L/s
downpipe_count
6 to 6 count
downpipe_capacity_l_s
13.5 to 13.5 L/s
overflow_weir_coefficient
1.7 to 1.7
overflow_weir_length_m
3.2 to 3.2 m
overflow_head_m
0.08 to 0.08 m
parapet_freeboard_m
0.22 to 0.22 m
minimum_freeboard_m
0.12 to 0.12 m
facade_zone_pressure_kpa
1.4 to 1.4 kPa
fixing_allowable_pressure_kpa
2.1 to 2.1 kPa

Executable tool: roof-drainage-gutter-downpipe-facade-interface-package_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "roof_runoff_l_s": <number>,
  "gutter_capacity_margin_l_s": <number>,
  "downpipe_total_capacity_l_s": <number>,
  "downpipe_capacity_margin_l_s": <number>,
  "overflow_capacity_l_s": <number>,
  "overflow_capacity_margin_l_s": <number>,
  "freeboard_margin_m": <number>,
  "facade_fixing_pressure_margin_kpa": <number>,
  "overall_pass_score": <number>
}
  • roof_runoff_l_s · scored within ±3%
  • gutter_capacity_margin_l_s · scored within ±3%
  • downpipe_total_capacity_l_s · scored within ±3%
  • downpipe_capacity_margin_l_s · scored within ±3%
  • overflow_capacity_l_s · scored within ±3%
  • overflow_capacity_margin_l_s · scored within ±3%
  • freeboard_margin_m · scored within ±3%
  • facade_fixing_pressure_margin_kpa · scored within ±3%
  • overall_pass_score · scored within ±3%