LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
civilboth

Wave Runup

Calculates the 2% exceedance wave runup height Ru2% on sloped coastal structures using the EurOtop (2018) TAW formula, which evaluates both breaking and surging runup expressions and takes the governing (minimum) value. Accounts for structure slope, surface roughness, and berm geometry to determine freeboard requirements for dikes, seawalls, and breakwaters.

both: The model must reason numerically unaided.

Standards

EurOtop (2018)TAW Guidelines

Tags

breakwatercoastaldikeovertoppingrunupwave

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

5 inputs

Always given

Included directly in every task prompt.

2

  • Wave height

    wave_height_m

    Significant spectral wave height H_m0

    0.3 – 6 m

  • Structure slope

    structure_slope

    Structure slope tan(alpha), e.g. 0.33 for 1:3 slope

    0.1 – 0.75

Derived from scenario

Sampled from the scenario and inferable from its description.

3

  • Wave period

    wave_period_s

    Spectral wave period T_m-1,0

    Derived from the archetype scenario. Hidden at hard difficulty.

    3 – 16 s

  • Roughness factor

    roughness_factor

    Roughness reduction factor gamma_f (1.0 = smooth, lower = rougher)

    Derived from the archetype scenario. Hidden at hard difficulty.

    0.35 – 1

  • Berm factor

    berm_factor

    Berm reduction factor gamma_b (1.0 = no berm, lower = larger berm)

    Derived from the archetype scenario. Hidden at hard difficulty.

    0.6 – 1

Scored outputs

3 outputs

Breaker parameter

breaker_parameter

Breaker parameter (Iribarren number) xi_m-1,0

Scores if within ±5% of the reference value.

Runup height

runup_height_m

2% exceedance wave runup height Ru2% (m)

Scores if within ±5% of the reference value.

Regime

regime

Wave regime: 1.0 = breaking/plunging, 2.0 = surging/non-breaking

Scores if within ±1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

easy

All inputs given

Moderate waves on smooth structure — all parameters given, straightforward calculation

medium

All inputs given

Larger waves on rough structures — all parameters given, more complex conditions

hard

Some inputs hidden

Roughness and berm factors hidden — agent must infer from site description

Hidden inputs

  • Roughness factorroughness_factor
  • Berm factorberm_factor
  • Wave period swave_period_s

Prompt replacement text

The structure is {{ archetype.description }} ({{ archetype.site_context }})

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a senior coastal engineer specializing in wave runup and overtopping analysis for coastal structures.2 3## Problem4 5Determine the 2% exceedance wave runup height (Ru2%) on a coastal structure given the incident wave conditions and structure properties. Calculate the breaker parameter, runup height, and classify the wave regime.6 7## Given8 9| Parameter | Value | Unit |10|-----------|-------|------|11| Significant wave height (H_m0) | {{ wave_height_m }} | m |12{% if wave_period_s is defined %}13| Spectral wave period (T_m-1,0) | {{ wave_period_s }} | s |14{% endif %}15| Structure slope tan(α) | {{ structure_slope }} | - |16{% if roughness_factor is defined %}17| Roughness factor (γ_f) | {{ roughness_factor }} | - |18{% endif %}19{% if berm_factor is defined %}20| Berm factor (γ_b) | {{ berm_factor }} | - |21{% endif %}22{% if archetype_description is defined %}23 24### Structure Conditions25 26{{ archetype_description }}27{% endif %}28 29{% if tool_available %}30## Available Tool31 32A wave runup calculation tool is available at `/workspace/{{ meta.name }}_calc.py`. Run it with:33 34```bash35python3 /workspace/{{ meta.name }}_calc.py --help36```37 38You may use this tool to verify your calculations or compute values directly.39{% endif %}40 41## Required42 43Calculate the following:44 451. Breaker parameter (Iribarren number) ξ_m-1,0462. 2% exceedance wave runup height Ru2% in metres473. Wave regime — report as a numeric code: 1.0 = breaking/plunging, 2.0 = surging/non-breaking48 49## Applicable Standards50 51- EurOtop (2018) Manual on Wave Overtopping52- TAW (Technical Advisory Committee on Water Defences) Guidelines53 54## Constraints55 56- No internet access is available. Work from engineering knowledge and the provided tool.57- Assume head-on wave attack (γ_β = 1.0).58- Use the following procedure:59 1. **Spectral wavelength**:60 - L_m-1,0 = g × T_m-1,0² / (2π)61 - where g = 9.81 m/s²62 2. **Breaker parameter** (Iribarren-type):63 - ξ_m-1,0 = tan(α) / √(H_m0 / L_m-1,0)64 3. **Runup — breaking (plunging) expression**:65 - Ru2% / H_m0 = 1.65 × γ_b × γ_f × γ_β × ξ_m-1,066 4. **Runup — maximum (surging) expression**:67 - Ru2% / H_m0 = γ_f × γ_β × (4.0 − 1.5 / √ξ_m-1,0)68 5. **Governing runup**: take the **minimum** of the two expressions above69 6. **Dimensional runup**: Ru2% = (Ru2% / H_m0) × H_m070 7. **Regime classification**:71 - If the breaking expression governs → 1.0 (breaking/plunging)72 - If the maximum expression governs → 2.0 (surging/non-breaking)73 74## Output Format75 76Show your step-by-step working in Markdown. At the end of your solution, include a JSON block with your final answers in exactly this format:77 78```json79{80 "breaker_parameter": <numeric_value>,81 "runup_height_m": <numeric_value>,82 "regime": <numeric_value>83}84```85 86Write your complete solution to `/workspace/output.md`.87

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Smooth dike

smooth_dike

Smooth concrete or asphalt dike with gentle seaward slope

dutch-north-sea-dikethames-estuary-embankmentbrisbane-river-levee
Parameter ranges
roughness_factor
0.95 – 1
berm_factor
0.9 – 1
wave_period_s
5 – 12

Rock armour revetment

rock_armour_revetment

Double-layer rock armour revetment on steep slope

gold-coast-revetmentnewcastle-foreshore-armourdarwin-seawall
Parameter ranges
roughness_factor
0.5 – 0.6
berm_factor
0.85 – 1
wave_period_s
6 – 14

Concrete seawall

concrete_seawall

Stepped or smooth concrete seawall with moderate roughness

sydney-harbour-seawalladelaide-glenelg-wallcairns-esplanade-wall
Parameter ranges
roughness_factor
0.85 – 0.95
berm_factor
0.8 – 1
wave_period_s
4 – 10

Rubble mound breakwater

rubble_mound_breakwater

Rubble mound breakwater with rough two-layer armor

fremantle-outer-breakwatertownsville-port-breakwaterportland-harbour-arm
Parameter ranges
roughness_factor
0.38 – 0.45
berm_factor
0.6 – 0.8
wave_period_s
8 – 16

Example task

dutch-north-sea-dike-smooth-dike-preview — hard difficulty, some inputs hidden.

Smooth concrete or asphalt dike with gentle seaward slope. dutch-north-sea-dike. Required outputs: breaker_parameter, runup_height_m, regime

The model sees

Scenario context and visible inputs.

wave_height_m
0.3 to 6 m
structure_slope
0.1 to 0.75 -

Executable tool: wave-runup_calc.py

The model must infer

Inputs withheld at this difficulty.

  • Wave period s

    wave_period_s

  • Berm factor

    berm_factor

  • Roughness factor

    roughness_factor

Stand-in text in the prompt

The structure is {{ archetype.description }} ({{ archetype.site_context }})

The model must produce

The scored JSON answer schema.

{
  "breaker_parameter": <number>,
  "runup_height_m": <number>,
  "regime": <number>
}
  • breaker_parameter · scored within ±5%
  • runup_height_m · scored within ±5%
  • regime · scored within ±1%