LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
structuralwith-tool

Target Strength Calc

Calculates the required average compressive strength for concrete mix design from the specified strength, historical standard deviation, and an explicit reliability factor. The template uses fcr = fc + max(k s, minimum margin), keeping code selection assumptions visible through numeric inputs rather than hidden standard lookup.

with-tool: The model is given an executable Python calculator script.

Standards

ACI 301ACI 318AS 1379

Tags

concretedeterministicmix-designstructuraltarget-strength

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

4 inputs

Always given

Included directly in every task prompt.

4

  • Specified strength

    specified_strength_mpa

    Specified compressive strength f'c

    20 – 100 MPa

  • Standard deviation

    standard_deviation_mpa

    Historical standard deviation s

    0 – 15 MPa

  • K factor

    k_factor

    Reliability multiplier applied to the standard deviation

    1 – 2.5

  • Minimum margin

    minimum_margin_mpa

    Minimum margin above specified strength

    0 – 12 MPa

Scored outputs

4 outputs

Statistical margin mpa

statistical_margin_mpa

Statistical margin k times standard deviation

Scores if within ±3% of the reference value.

Governing margin mpa

governing_margin_mpa

Governing margin after minimum margin check

Scores if within ±3% of the reference value.

Target mean strength mpa

target_mean_strength_mpa

Required average compressive strength f'cr

Scores if within ±3% of the reference value.

Margin above specified mpa

margin_above_specified_mpa

Margin above specified compressive strength

Scores if within ±3% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All parameters given for normal-strength concrete with good records
medium:
All parameters given for normal-strength mixes with varied production records
hard:
All parameters given for high-strength or less certain production scenarios

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • target-strength-calc_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a senior structural engineer specializing in concrete mix design.2 3## Problem4 5Calculate the required target mean compressive strength for a concrete mix from the specified strength, production standard deviation, and reliability margin.6 7## Given8 9| Parameter | Value | Unit |10|-----------|-------|------|11| Specified compressive strength f'c | {{ specified_strength_mpa }} | MPa |12| Historical standard deviation s | {{ standard_deviation_mpa }} | MPa |13| Reliability multiplier k | {{ k_factor }} | - |14| Minimum margin | {{ minimum_margin_mpa }} | MPa |15 16{% if archetype_description is defined %}17### Concrete Production Context18 19{{ archetype_description }}20{% endif %}21 22{% if tool_available %}23## Available Tool24 25A target strength calculation tool is available at `/workspace/{{ meta.name }}_calc.py`. Run it with:26 27```bash28python3 /workspace/{{ meta.name }}_calc.py --help29```30 31You may use this tool to verify your calculations or compute values directly.32{% endif %}33 34## Required35 36Calculate the following:37 381. Statistical margin k x s (MPa)392. Governing margin after checking the minimum margin (MPa)403. Required average compressive strength f'cr (MPa)414. Margin above specified strength (MPa)42 43## Constraints44 45- No internet access is available. Work from engineering knowledge and the provided tool.46- Use statistical margin = k x standard deviation.47- Use governing margin = max(statistical margin, minimum margin).48- Use target mean strength f'cr = f'c + governing margin.49- Treat the k-factor and minimum margin as explicit project inputs; do not infer a different code formula.50 51## Output Format52 53Show your step-by-step working in Markdown. At the end of your solution, include a JSON block with your final answers in exactly this format:54 55```json56{57 "statistical_margin_mpa": <numeric_value>,58 "governing_margin_mpa": <numeric_value>,59 "target_mean_strength_mpa": <numeric_value>,60 "margin_above_specified_mpa": <numeric_value>61}62```63 64Write your complete solution to `/workspace/output.md`.65

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Normal strength good records

normal_strength_good_records

Normal-strength concrete with good historical production records

commercial-building-slabwater-retaining-structure
Parameter ranges
specified_strength_mpa
25 – 40
standard_deviation_mpa
2.5 – 5
k_factor
1.34 – 1.65
minimum_margin_mpa
3 – 5

Normal strength limited records

normal_strength_limited_records

Normal-strength concrete with limited or variable production records

regional-precast-yardremote-project-batch-plant
Parameter ranges
specified_strength_mpa
25 – 50
standard_deviation_mpa
5 – 9
k_factor
1.65 – 2
minimum_margin_mpa
5 – 8

High strength concrete

high_strength_concrete

High-strength concrete mix requiring a higher control margin

high-rise-corebridge-precast-girder
Parameter ranges
specified_strength_mpa
50 – 90
standard_deviation_mpa
4 – 10
k_factor
1.65 – 2.33
minimum_margin_mpa
6 – 12

Example task

regional-precast-yard-normal-strength-limited-records-preview — hard difficulty, all inputs given.

Normal-strength concrete with limited or variable production records. regional-precast-yard. Required outputs: statistical_margin_mpa, governing_margin_mpa, target_mean_strength_mpa, margin_above_specified_mpa

The model sees

Scenario context and visible inputs.

specified_strength_mpa
25 to 50 MPa
standard_deviation_mpa
5 to 9 MPa
k_factor
1.65 to 2
minimum_margin_mpa
5 to 8 MPa

Executable tool: target-strength-calc_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "statistical_margin_mpa": <number>,
  "governing_margin_mpa": <number>,
  "target_mean_strength_mpa": <number>,
  "margin_above_specified_mpa": <number>
}
  • statistical_margin_mpa · scored within ±3%
  • governing_margin_mpa · scored within ±3%
  • target_mean_strength_mpa · scored within ±3%
  • margin_above_specified_mpa · scored within ±3%