LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
civilwith-tool

Sea Level Rise Asset Review Package

Calculates source-bound sea-level-rise asset review metrics from a deterministic SSC-04 task-owned source pack. The template combines future stillwater level, design level, freeboard margin, service threshold exceedance, adaptation raise, cost margin, benefit-cost ratio, scenario trace, and an overall synthetic pass score.

with-tool: The model is given an executable Python calculator script.

Standards

adaptation option screeningcoastal asset reviewsea-level-rise scenario workflowservice threshold review

Tags

adaptationasset-reviewcivilcoastaldeterministicsea-level-rise

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

12 inputs

Always given

Included directly in every task prompt.

12
Show 12 inputs

  • Present high tide level

    present_high_tide_level_m

    STORM-04-TIDE-06 present high tide level

    1.4 m

  • Sea level rise allowance

    sea_level_rise_allowance_m

    SLR-04-SCENARIO-06 sea-level-rise allowance

    0.65 m

  • Storm surge allowance

    storm_surge_allowance_m

    STORM-04-TIDE-06 storm surge allowance

    0.85 m

  • Wave allowance

    wave_allowance_m

    SLR-04-SCENARIO-06 wave allowance

    0.35 m

  • Asset elevation

    asset_elevation_m

    ASSET-04-REGISTER-06 asset elevation

    3.75 m

  • Required freeboard

    required_freeboard_m

    SERVICE-04-CRITERION-06 required freeboard

    0.3 m

  • Service threshold

    service_threshold_m

    SERVICE-04-CRITERION-06 service threshold

    2.7 m

  • Adaptation budget

    adaptation_budget_usd

    ADAPT-04-OPTION-06 adaptation budget

    250000 USD

  • Selected adaptation cost

    selected_adaptation_cost_usd

    ADAPT-04-OPTION-06 selected adaptation cost

    180000 USD

  • Avoided damage

    avoided_damage_usd

    ADAPT-04-OPTION-06 avoided damage

    320000 USD

  • Traced scenarios

    traced_scenarios

    MEMO-04-REVIEW-06 traced scenario count

    4

  • Required scenarios

    required_scenarios

    MEMO-04-REVIEW-06 required scenario count

    4

Scored outputs

9 outputs

Future stillwater level

future_stillwater_level_m

Future stillwater level

Scores if within ±3% of the reference value.

Future design level

future_design_level_m

Future stillwater level plus wave allowance

Scores if within ±3% of the reference value.

Asset freeboard margin

asset_freeboard_margin_m

Asset elevation minus future design level and freeboard

Scores if within ±3% of the reference value.

Service threshold exceedance

service_threshold_exceedance_m

Future stillwater level exceedance over service threshold

Scores if within ±3% of the reference value.

Adaptation raise required

adaptation_raise_required_m

Asset raising required to meet future design level and freeboard

Scores if within ±3% of the reference value.

Adaptation cost margin usd

adaptation_cost_margin_usd

Adaptation budget minus selected adaptation cost

Scores if within ±3% of the reference value.

Benefit cost ratio

benefit_cost_ratio

Avoided damage divided by selected adaptation cost

Scores if within ±0.3% of the reference value.

Scenario trace score

scenario_trace_score

Traced scenarios divided by required scenarios

Scores if within ±0.3% of the reference value.

Overall pass score

overall_pass_score

1.0 when asset review checks pass

Scores if within ±0.1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All source-pack values given for the SSC-04 sea-level-rise asset review package
medium:
All source-pack values given for the SSC-04 sea-level-rise asset review package
hard:
All source-pack values given for the SSC-04 sea-level-rise asset review package

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • sea-level-rise-asset-review-package_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a civil/coastal engineer checking a task-owned synthetic SSC-04 sea-level-rise scenario and asset-level review package.2 3Use only the task-owned synthetic source pack values shown below for numeric grading. External climate-scenario, storm-tide, service-threshold, adaptation-option, and asset-review workflows shape the practice context only; they are not extra data sources for this instance.4 5## Scene6 7- Product family: `SSC-04-LH-06`8- Asset register: `ASSET-04-REGISTER-06`9- Sea-level-rise scenario table: `SLR-04-SCENARIO-06`10- Storm tide table: `STORM-04-TIDE-06`11- Service criterion: `SERVICE-04-CRITERION-06`12- Adaptation option sheet: `ADAPT-04-OPTION-06`13- Asset review memo: `MEMO-04-REVIEW-06`14 15## Source Values16 17| Item | Value |18|------|-------|19| Present high tide level | {{ present_high_tide_level_m }} m |20| Sea-level-rise allowance | {{ sea_level_rise_allowance_m }} m |21| Storm surge allowance | {{ storm_surge_allowance_m }} m |22| Wave allowance | {{ wave_allowance_m }} m |23| Asset elevation | {{ asset_elevation_m }} m |24| Required freeboard | {{ required_freeboard_m }} m |25| Service threshold | {{ service_threshold_m }} m |26| Adaptation budget | {{ adaptation_budget_usd }} USD |27| Selected adaptation cost | {{ selected_adaptation_cost_usd }} USD |28| Avoided damage | {{ avoided_damage_usd }} USD |29| Traced scenarios | {{ traced_scenarios }} |30| Required scenarios | {{ required_scenarios }} |31 32## Checks33 34- Future stillwater level equals present high tide plus sea-level-rise allowance plus storm surge allowance.35- Future design level equals future stillwater level plus wave allowance.36- Asset freeboard margin equals asset elevation minus future design level and required freeboard.37- Service threshold exceedance equals future stillwater level minus service threshold, clipped at zero.38- Adaptation raise required equals future design level plus required freeboard minus asset elevation, clipped at zero.39- Adaptation cost margin equals adaptation budget minus selected adaptation cost.40- Benefit-cost ratio equals avoided damage divided by selected adaptation cost.41- Scenario trace score equals traced scenarios divided by required scenarios.42- Overall pass score is `1.0` only when freeboard, cost, benefit-cost, and scenario trace checks pass; otherwise it is `0.0`.43 44## Output Format45 46Write a compact asset review memo to `/workspace/output.md`. Include a source-boundary statement that this is a task-owned synthetic source pack. Preserve the object IDs above and state whether the baseline source pack passes the current docs-only checks.47 48Do not claim authority approval, accepted project evidence, software export validity, full standards compliance, executable real source-pack parsing, generated benchmark readiness, or benchmark readiness.49 50Include a fenced JSON block with exactly these numeric keys:51 52```json53{54 "future_stillwater_level_m": <numeric_value>,55 "future_design_level_m": <numeric_value>,56 "asset_freeboard_margin_m": <numeric_value>,57 "service_threshold_exceedance_m": <numeric_value>,58 "adaptation_raise_required_m": <numeric_value>,59 "adaptation_cost_margin_usd": <numeric_value>,60 "benefit_cost_ratio": <numeric_value>,61 "scenario_trace_score": <numeric_value>,62 "overall_pass_score": <numeric_value>63}64```65

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Ssc04 sea level rise case

ssc04_sea_level_rise_case

Sea-level-rise scenario and asset-level review case

Parameter ranges
present_high_tide_level_m
1.4
sea_level_rise_allowance_m
0.65
storm_surge_allowance_m
0.85
wave_allowance_m
0.35
asset_elevation_m
3.75
required_freeboard_m
0.3
service_threshold_m
2.7
adaptation_budget_usd
250000
selected_adaptation_cost_usd
180000
avoided_damage_usd
320000
traced_scenarios
4
required_scenarios
4

Example task

ssc04-sea-level-rise-case-preview — hard difficulty, all inputs given.

Sea-level-rise scenario and asset-level review case. Required outputs: future_stillwater_level_m, future_design_level_m, asset_freeboard_margin_m, service_threshold_exceedance_m, adaptation_raise_required_m, adaptation_cost_margin_usd

The model sees

Scenario context and visible inputs.

present_high_tide_level_m
1.4 to 1.4 m
sea_level_rise_allowance_m
0.65 to 0.65 m
storm_surge_allowance_m
0.85 to 0.85 m
wave_allowance_m
0.35 to 0.35 m
asset_elevation_m
3.75 to 3.75 m
required_freeboard_m
0.3 to 0.3 m
service_threshold_m
2.7 to 2.7 m
adaptation_budget_usd
250000 to 250000 USD
selected_adaptation_cost_usd
180000 to 180000 USD
avoided_damage_usd
320000 to 320000 USD
traced_scenarios
4 to 4
required_scenarios
4 to 4

Executable tool: sea-level-rise-asset-review-package_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "future_stillwater_level_m": <number>,
  "future_design_level_m": <number>,
  "asset_freeboard_margin_m": <number>,
  "service_threshold_exceedance_m": <number>,
  "adaptation_raise_required_m": <number>,
  "adaptation_cost_margin_usd": <number>,
  "benefit_cost_ratio": <number>,
  "scenario_trace_score": <number>,
  "overall_pass_score": <number>
}
  • future_stillwater_level_m · scored within ±3%
  • future_design_level_m · scored within ±3%
  • asset_freeboard_margin_m · scored within ±3%
  • service_threshold_exceedance_m · scored within ±3%
  • adaptation_raise_required_m · scored within ±3%
  • adaptation_cost_margin_usd · scored within ±3%
  • benefit_cost_ratio · scored within ±0.3%
  • scenario_trace_score · scored within ±0.3%
  • overall_pass_score · scored within ±0.1%