LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
civilwith-tool

Roof Drainage Pv Uplift Package

Calculates source-bound roof drainage and PV uplift metrics from a deterministic SSC-09 task-owned source pack. The template combines roof runoff, gutter and downpipe capacity margins, PV wind uplift, dead load, fixing capacity margin, drainage obstruction margin, and an overall synthetic pass score.

with-tool: The model is given an executable Python calculator script.

Standards

PV wind-uplift workflowsroof drainage workflowsroof equipment coordination

Tags

civildeterministicdownpipedrainagegutterpvroofwind-uplift

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

12 inputs

Always given

Included directly in every task prompt.

12
Show 12 inputs

  • Roof catchment area

    roof_catchment_area_m2

    ROOF-09-CATCH-02 roof catchment area

    1450 m2

  • Rainfall intensity

    rainfall_intensity_mm_h

    ROOF-09-CATCH-02 design rainfall intensity

    150 mm/h

  • Runoff coefficient

    runoff_coefficient

    ROOF-09-CATCH-02 runoff coefficient

    0.95

  • Gutter capacity

    gutter_capacity_l_s

    GUTTER-09-SCHED-02 gutter capacity

    72 L/s

  • Downpipe count

    downpipe_count

    GUTTER-09-SCHED-02 downpipe count

    6

  • Downpipe capacity

    downpipe_capacity_l_s

    GUTTER-09-SCHED-02 capacity per downpipe

    12.5 L/s

  • Pv array area

    pv_array_area_m2

    PV-09-LAYOUT-02 PV array area

    180 m2

  • Pv uplift pressure

    pv_uplift_pressure_kpa

    WIND-09-UPLIFT-02 PV uplift pressure

    1.1 kPa

  • Pv dead load

    pv_dead_load_kpa

    PV-09-LAYOUT-02 PV dead load

    0.35 kPa

  • Pv fixing capacity

    pv_fixing_capacity_kn

    FIX-09-PV-02 PV fixing capacity

    240 kN

  • Drainage obstruction area

    drainage_obstruction_area_m2

    PV-09-LAYOUT-02 drainage obstruction area

    12 m2

  • Max drainage obstruction area

    max_drainage_obstruction_area_m2

    MEMO-09-ROOF-PV-02 maximum drainage obstruction area

    18 m2

Scored outputs

9 outputs

Roof runoff

roof_runoff_l_s

Roof runoff at design rainfall

Scores if within ±3% of the reference value.

Gutter capacity margin

gutter_capacity_margin_l_s

Gutter capacity minus roof runoff

Scores if within ±3% of the reference value.

Downpipe total capacity

downpipe_total_capacity_l_s

Total downpipe capacity

Scores if within ±3% of the reference value.

Downpipe capacity margin

downpipe_capacity_margin_l_s

Downpipe capacity minus roof runoff

Scores if within ±3% of the reference value.

Pv uplift force kn

pv_uplift_force_kn

PV array uplift force

Scores if within ±3% of the reference value.

Pv dead load kn

pv_dead_load_kn

PV array dead load

Scores if within ±3% of the reference value.

Pv fixing margin kn

pv_fixing_margin_kn

PV fixing capacity minus uplift force

Scores if within ±3% of the reference value.

Drainage obstruction margin m2

drainage_obstruction_margin_m2

Maximum obstruction area minus PV obstruction area

Scores if within ±3% of the reference value.

Overall pass score

overall_pass_score

1.0 when drainage, PV fixing, and obstruction checks pass

Scores if within ±0.1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All source-pack values given for the SSC-09 roof drainage and PV uplift package
medium:
All source-pack values given for the SSC-09 roof drainage and PV uplift package
hard:
All source-pack values given for the SSC-09 roof drainage and PV uplift package

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • roof-drainage-pv-uplift-package_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a civil roof and envelope engineer checking a task-owned synthetic SSC-09 roof drainage, PV layout, and wind uplift package.2 3Use only the task-owned synthetic source pack values shown below for numeric grading. Roof drainage, PV layout, wind uplift, and fixing workflows shape the context only; this instance does not run external software, parse real roof plans, or validate a standards clause.4 5## Scene6 7- Product: `SSC-09-LH-02`8- Roof catchment source: `ROOF-09-CATCH-02`9- PV layout: `PV-09-LAYOUT-02`10- Gutter/downpipe schedule: `GUTTER-09-SCHED-02`11- Wind uplift basis: `WIND-09-UPLIFT-02`12- PV fixing schedule: `FIX-09-PV-02`13- Roof/PV memo: `MEMO-09-ROOF-PV-02`14 15## Source Values16 17| Item | Value |18| --- | --- |19| Roof catchment area | {{ roof_catchment_area_m2 }} m2 |20| Rainfall intensity | {{ rainfall_intensity_mm_h }} mm/h |21| Runoff coefficient | {{ runoff_coefficient }} |22| Gutter capacity | {{ gutter_capacity_l_s }} L/s |23| Downpipe count | {{ downpipe_count }} |24| Downpipe capacity | {{ downpipe_capacity_l_s }} L/s |25| PV array area | {{ pv_array_area_m2 }} m2 |26| PV uplift pressure | {{ pv_uplift_pressure_kpa }} kPa |27| PV dead load | {{ pv_dead_load_kpa }} kPa |28| PV fixing capacity | {{ pv_fixing_capacity_kn }} kN |29| Drainage obstruction area | {{ drainage_obstruction_area_m2 }} m2 |30| Maximum drainage obstruction area | {{ max_drainage_obstruction_area_m2 }} m2 |31 32## Checks33 34- Roof runoff equals catchment area times rainfall intensity times runoff coefficient divided by 3600.35- Downpipe total capacity equals downpipe count times downpipe capacity.36- PV uplift force equals PV array area times uplift pressure.37- PV fixing margin equals fixing capacity minus uplift force.38- Drainage obstruction margin equals maximum obstruction area minus obstruction area.39 40## Output Format41 42Write a compact memo to `/workspace/output.md`. Include a source-boundary statement that this is a task-owned synthetic source pack. Preserve the source IDs above and state whether the baseline source pack passes the current docs-only checks.43 44Do not claim authority approval, accepted project evidence, software export validity, full standards compliance, executable real source-pack parsing, generated benchmark readiness, or benchmark readiness.45 46Include a fenced JSON block with exactly these numeric keys:47 48```json49{50 "roof_runoff_l_s": <numeric_value>,51 "gutter_capacity_margin_l_s": <numeric_value>,52 "downpipe_total_capacity_l_s": <numeric_value>,53 "downpipe_capacity_margin_l_s": <numeric_value>,54 "pv_uplift_force_kn": <numeric_value>,55 "pv_dead_load_kn": <numeric_value>,56 "pv_fixing_margin_kn": <numeric_value>,57 "drainage_obstruction_margin_m2": <numeric_value>,58 "overall_pass_score": <numeric_value>59}60```61

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Ssc09 roof pv uplift case

ssc09_roof_pv_uplift_case

Roof drainage, PV layout, and wind uplift case

Parameter ranges
roof_catchment_area_m2
1450
rainfall_intensity_mm_h
150
runoff_coefficient
0.95
gutter_capacity_l_s
72
downpipe_count
6
downpipe_capacity_l_s
12.5
pv_array_area_m2
180
pv_uplift_pressure_kpa
1.1
pv_dead_load_kpa
0.35
pv_fixing_capacity_kn
240
drainage_obstruction_area_m2
12
max_drainage_obstruction_area_m2
18

Example task

ssc09-roof-pv-uplift-case-preview — hard difficulty, all inputs given.

Roof drainage, PV layout, and wind uplift case. Required outputs: roof_runoff_l_s, gutter_capacity_margin_l_s, downpipe_total_capacity_l_s, downpipe_capacity_margin_l_s, pv_uplift_force_kn, pv_dead_load_kn

The model sees

Scenario context and visible inputs.

roof_catchment_area_m2
1450 to 1450 m2
rainfall_intensity_mm_h
150 to 150 mm/h
runoff_coefficient
0.95 to 0.95
gutter_capacity_l_s
72 to 72 L/s
downpipe_count
6 to 6
downpipe_capacity_l_s
12.5 to 12.5 L/s
pv_array_area_m2
180 to 180 m2
pv_uplift_pressure_kpa
1.1 to 1.1 kPa
pv_dead_load_kpa
0.35 to 0.35 kPa
pv_fixing_capacity_kn
240 to 240 kN
drainage_obstruction_area_m2
12 to 12 m2
max_drainage_obstruction_area_m2
18 to 18 m2

Executable tool: roof-drainage-pv-uplift-package_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "roof_runoff_l_s": <number>,
  "gutter_capacity_margin_l_s": <number>,
  "downpipe_total_capacity_l_s": <number>,
  "downpipe_capacity_margin_l_s": <number>,
  "pv_uplift_force_kn": <number>,
  "pv_dead_load_kn": <number>,
  "pv_fixing_margin_kn": <number>,
  "drainage_obstruction_margin_m2": <number>,
  "overall_pass_score": <number>
}
  • roof_runoff_l_s · scored within ±3%
  • gutter_capacity_margin_l_s · scored within ±3%
  • downpipe_total_capacity_l_s · scored within ±3%
  • downpipe_capacity_margin_l_s · scored within ±3%
  • pv_uplift_force_kn · scored within ±3%
  • pv_dead_load_kn · scored within ±3%
  • pv_fixing_margin_kn · scored within ±3%
  • drainage_obstruction_margin_m2 · scored within ±3%
  • overall_pass_score · scored within ±0.1%