LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
structuralwith-tool

Scm Substitution

Calculates cement content, SCM content, cement reduction, and water-binder ratio from total binder content, SCM replacement percentage, and water content. The template is a deterministic binder mass-balance calculation.

with-tool: The model is given an executable Python calculator script.

Standards

ACI 211.1AS 1379

Tags

binderconcretedeterministicscmstructural

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

3 inputs

Always given

Included directly in every task prompt.

3

  • Total binder

    total_binder_kg_m3

    Total binder content

    100 – 800 kg/m3

  • Scm replacement pct

    scm_replacement_pct

    Percentage of total binder replaced by SCM

    0 – 80 %

  • Water content

    water_content_kg_m3

    Mix water content

    0 – 400 kg/m3

Scored outputs

4 outputs

Cement content

cement_content_kg_m3

Cement content after SCM replacement

Scores if within ±3% of the reference value.

Scm content

scm_content_kg_m3

SCM content

Scores if within ±3% of the reference value.

Cement reduction

cement_reduction_kg_m3

Reduction in cement content relative to all-cement binder

Scores if within ±3% of the reference value.

Water binder ratio

water_binder_ratio

Water-binder ratio

Scores if within ±3% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All parameters given for a fly ash mix
medium:
All parameters given across SCM mixes
hard:
All parameters given for higher replacement slag mixes

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • scm-substitution_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a senior structural materials engineer specializing in concrete mix calculations.2 3## Problem4 5Calculate cement and supplementary cementitious material quantities for a binder replacement percentage.6 7## Given8 9| Parameter | Value | Unit |10|-----------|-------|------|11| Total binder content | {{ total_binder_kg_m3 }} | kg/m3 |12| SCM replacement | {{ scm_replacement_pct }} | % |13| Water content | {{ water_content_kg_m3 }} | kg/m3 |14 15{% if archetype_description is defined %}16### Concrete Context17 18{{ archetype_description }}19{% endif %}20 21{% if tool_available %}22## Available Tool23 24An SCM substitution calculation tool is available at `/workspace/{{ meta.name }}_calc.py`. Run it with:25 26```bash27python3 /workspace/{{ meta.name }}_calc.py --help28```29 30You may use this tool to verify your calculations or compute values directly.31{% endif %}32 33## Required34 35Calculate the following:36 371. Cement content382. SCM content393. Cement reduction404. Water-binder ratio41 42## Constraints43 44- No internet access is available. Work from engineering knowledge and the provided tool.45- Use SCM content = total binder x replacement percentage / 100.46- Use cement content = total binder - SCM content.47- Use water-binder ratio = water content / total binder.48 49## Output Format50 51Show your step-by-step working in Markdown. At the end of your solution, include a JSON block with your final answers in exactly this format:52 53```json54{55 "cement_content_kg_m3": <numeric_value>,56 "scm_content_kg_m3": <numeric_value>,57 "cement_reduction_kg_m3": <numeric_value>,58 "water_binder_ratio": <numeric_value>59}60```61 62Write your complete solution to `/workspace/output.md`.63 64

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Fly ash mix

fly_ash_mix

Concrete mix with fly ash binder replacement

building-concretefly-ash-mix
Parameter ranges
total_binder_kg_m3
280 – 500
scm_replacement_pct
10 – 40
water_content_kg_m3
120 – 220

Slag mix

slag_mix

Concrete mix with slag binder replacement

marine-concreteslag-mix
Parameter ranges
total_binder_kg_m3
300 – 650
scm_replacement_pct
30 – 70
water_content_kg_m3
120 – 240

Example task

marine-concrete-slag-mix-preview — hard difficulty, all inputs given.

Concrete mix with slag binder replacement. marine-concrete. Required outputs: cement_content_kg_m3, scm_content_kg_m3, cement_reduction_kg_m3, water_binder_ratio

The model sees

Scenario context and visible inputs.

total_binder_kg_m3
300 to 650 kg/m3
scm_replacement_pct
30 to 70 %
water_content_kg_m3
120 to 240 kg/m3

Executable tool: scm-substitution_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "cement_content_kg_m3": <number>,
  "scm_content_kg_m3": <number>,
  "cement_reduction_kg_m3": <number>,
  "water_binder_ratio": <number>
}
  • cement_content_kg_m3 · scored within ±3%
  • scm_content_kg_m3 · scored within ±3%
  • cement_reduction_kg_m3 · scored within ±3%
  • water_binder_ratio · scored within ±3%