LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
mechanicalwith-tool

Sor Calculation

Calculates clarifier surface overflow rate from flow and plan area, then compares the result with an explicit maximum design criterion. The template reports hydraulic loading, utilisation, margin, and a numeric criterion flag.

with-tool: The model is given an executable Python calculator script.

Standards

Ten States StandardsWEF MOP 8

Tags

clarifierdeterministicmechanicalsurface-overflow-ratewastewater

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

3 inputs

Always given

Included directly in every task prompt.

3

  • Flow rate

    flow_rate_m3_d

    Flow rate to the clarifier

    1 – 1000000 m3/d

  • Clarifier surface area

    clarifier_surface_area_m2

    Clarifier plan surface area

    1 – 100000 m2

  • Maximum sor

    maximum_sor_m3_m2_d

    Maximum allowable surface overflow rate criterion

    1 – 100 m3/m2.d

Scored outputs

4 outputs

Surface overflow rate m3 m2 d

surface_overflow_rate_m3_m2_d

Calculated surface overflow rate

Scores if within ±3% of the reference value.

Utilisation ratio

utilisation_ratio

Ratio of calculated SOR to maximum criterion

Scores if within ±3% of the reference value.

Compliance margin m3 m2 d

compliance_margin_m3_m2_d

Positive margin below the maximum criterion

Scores if within ±3% of the reference value.

Criterion satisfied

criterion_satisfied

Numeric flag where 1 means the criterion is satisfied

Scores if within ±1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All parameters given for a secondary clarifier
medium:
All parameters given across wastewater and water clarifiers
hard:
All parameters given for larger water treatment clarifiers

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • sor-calculation_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a senior mechanical engineer specializing in water and wastewater treatment.2 3## Problem4 5Calculate surface overflow rate for a clarifier and compare it with an explicit maximum design criterion.6 7## Given8 9| Parameter | Value | Unit |10|-----------|-------|------|11| Flow rate | {{ flow_rate_m3_d }} | m3/d |12| Clarifier surface area | {{ clarifier_surface_area_m2 }} | m2 |13| Maximum surface overflow rate | {{ maximum_sor_m3_m2_d }} | m3/m2.d |14 15{% if archetype_description is defined %}16### Clarifier Context17 18{{ archetype_description }}19{% endif %}20 21{% if tool_available %}22## Available Tool23 24A surface overflow rate calculation tool is available at `/workspace/{{ meta.name }}_calc.py`. Run it with:25 26```bash27python3 /workspace/{{ meta.name }}_calc.py --help28```29 30You may use this tool to verify your calculations or compute values directly.31{% endif %}32 33## Required34 35Calculate the following:36 371. Surface overflow rate in m3/m2.d382. Utilisation ratio against the maximum criterion393. Compliance margin in m3/m2.d404. Numeric criterion flag, where 1 means satisfied and 0 means not satisfied41 42## Constraints43 44- No internet access is available. Work from engineering knowledge and the provided tool.45- Use surface overflow rate = flow rate / clarifier surface area.46- Use utilisation ratio = surface overflow rate / maximum surface overflow rate.47- Use compliance margin = maximum surface overflow rate - surface overflow rate.48 49## Output Format50 51Show your step-by-step working in Markdown. At the end of your solution, include a JSON block with your final answers in exactly this format:52 53```json54{55 "surface_overflow_rate_m3_m2_d": <numeric_value>,56 "utilisation_ratio": <numeric_value>,57 "compliance_margin_m3_m2_d": <numeric_value>,58 "criterion_satisfied": <numeric_value>59}60```61 62Write your complete solution to `/workspace/output.md`.63 64

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Secondary clarifier

secondary_clarifier

Secondary clarifier hydraulic loading check

municipal-wwtpsecondary-clarifier
Parameter ranges
flow_rate_m3_d
1000 – 80000
clarifier_surface_area_m2
100 – 4000
maximum_sor_m3_m2_d
20 – 45

Water treatment clarifier

water_treatment_clarifier

Water treatment clarifier hydraulic loading check

water-treatment-plantsolids-contact-clarifier
Parameter ranges
flow_rate_m3_d
5000 – 300000
clarifier_surface_area_m2
250 – 10000
maximum_sor_m3_m2_d
25 – 60

Example task

water-treatment-plant-water-treatment-clarifier-preview — hard difficulty, all inputs given.

Water treatment clarifier hydraulic loading check. water-treatment-plant. Required outputs: surface_overflow_rate_m3_m2_d, utilisation_ratio, compliance_margin_m3_m2_d, criterion_satisfied

The model sees

Scenario context and visible inputs.

flow_rate_m3_d
5000 to 300000 m3/d
clarifier_surface_area_m2
250 to 10000 m2
maximum_sor_m3_m2_d
25 to 60 m3/m2.d

Executable tool: sor-calculation_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "surface_overflow_rate_m3_m2_d": <number>,
  "utilisation_ratio": <number>,
  "compliance_margin_m3_m2_d": <number>,
  "criterion_satisfied": <number>
}
  • surface_overflow_rate_m3_m2_d · scored within ±3%
  • utilisation_ratio · scored within ±3%
  • compliance_margin_m3_m2_d · scored within ±3%
  • criterion_satisfied · scored within ±1%