LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
groundwith-tool

Ground Improvement Foundation Recheck Package

Calculates source-bound ground improvement recheck metrics from a deterministic SSC-07 task-owned source pack. The template combines pre/post SPT improvement, bearing capacity, immediate settlement, consolidation settlement, certificate match, and overall acceptance checks.

with-tool: The model is given an executable Python calculator script.

Standards

SPT improvement screeningbearing recheckelastic settlement screening

Tags

certificatedeterministicfoundationgroundground-improvementsettlement

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

12 inputs

Always given

Included directly in every task prompt.

12
Show 12 inputs

  • Pre improvement n1 60

    pre_improvement_n1_60

    SPT-07-POST-01 baseline corrected N1,60

    9

  • Post improvement n1 60

    post_improvement_n1_60

    SPT-07-POST-01 post-improvement corrected N1,60

    22

  • Target n1 60

    target_n1_60

    GI-07-CERT-01 required post-improvement N1,60

    18

  • Applied bearing pressure

    applied_bearing_pressure_kpa

    FDN-07-RECHECK-01 applied service bearing pressure

    180 kPa

  • Bearing factor per blow

    bearing_factor_per_blow_kpa

    SETTLE-07-RECHECK-01 source-owned bearing factor per corrected SPT blow

    12 kPa

  • Footing width

    footing_width_m

    FDN-07-RECHECK-01 footing width

    2 m

  • Elastic modulus

    elastic_modulus_kpa

    SETTLE-07-RECHECK-01 post-improvement elastic modulus

    35000 kPa

  • Poisson ratio

    poisson_ratio

    SETTLE-07-RECHECK-01 Poisson ratio

    0.3

  • Primary settlement

    primary_settlement_mm

    SETTLE-07-RECHECK-01 primary settlement component

    12.5 mm

  • Allowable settlement

    allowable_settlement_mm

    MEMO-07-FOUND-01 allowable total settlement

    25 mm

  • Required certificate items

    required_certificate_items

    GI-07-CERT-01 required certificate fields

    5 count

  • Matching certificate items

    matching_certificate_items

    GI-07-CERT-01 matched certificate fields

    5 count

Scored outputs

11 outputs

Improvement ratio

improvement_ratio

Post-improvement N1,60 divided by pre-improvement N1,60

Scores if within ±3% of the reference value.

Post improvement n margin

post_improvement_n_margin

Post-improvement N1,60 minus target N1,60

Scores if within ±3% of the reference value.

Allowable bearing capacity

allowable_bearing_capacity_kpa

Source-owned bearing factor times post-improvement N1,60

Scores if within ±3% of the reference value.

Bearing utilization

bearing_utilization

Applied bearing pressure divided by allowable bearing capacity

Scores if within ±3% of the reference value.

Bearing margin

bearing_margin_kpa

Allowable bearing capacity minus applied bearing pressure

Scores if within ±3% of the reference value.

Immediate settlement

immediate_settlement_mm

Elastic immediate settlement estimate

Scores if within ±3% of the reference value.

Primary settlement

primary_settlement_mm

Primary settlement component from source worksheet

Scores if within ±3% of the reference value.

Total settlement

total_settlement_mm

Immediate plus primary settlement

Scores if within ±3% of the reference value.

Settlement margin

settlement_margin_mm

Allowable settlement minus total settlement

Scores if within ±3% of the reference value.

Certificate match

certificate_match_percent

Matched certificate fields divided by required certificate fields

Scores if within ±3% of the reference value.

Overall pass score

overall_pass_score

1.0 when improvement, bearing, settlement, and certificate checks pass

Scores if within ±3% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All source-pack values given for the SSC-07 ground improvement package
medium:
All source-pack values given for the SSC-07 ground improvement package
hard:
All source-pack values given for the SSC-07 ground improvement package

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • ground-improvement-foundation-recheck-package_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are checking a task-owned synthetic SSC-07 ground improvement acceptance and foundation recheck package for `SSC-07-LH-06`.2 3Use only the task-owned synthetic source pack values shown below for numeric grading.4 5## Source Pack6 7- Ground improvement certificate: `GI-07-CERT-01`8- Post-improvement SPT log: `SPT-07-POST-01`9- Foundation recheck plan: `FDN-07-RECHECK-01`10- Bearing and settlement worksheet: `SETTLE-07-RECHECK-01`11- Foundation review memo: `MEMO-07-FOUND-01`12 13## Source Values14 15| Item | Value |16|---|---:|17| Pre-improvement N1,60 | {{ pre_improvement_n1_60 }} |18| Post-improvement N1,60 | {{ post_improvement_n1_60 }} |19| Target N1,60 | {{ target_n1_60 }} |20| Applied bearing pressure | {{ applied_bearing_pressure_kpa }} kPa |21| Bearing factor per blow | {{ bearing_factor_per_blow_kpa }} kPa |22| Footing width | {{ footing_width_m }} m |23| Elastic modulus | {{ elastic_modulus_kpa }} kPa |24| Poisson ratio | {{ poisson_ratio }} |25| Primary settlement | {{ primary_settlement_mm }} mm |26| Allowable settlement | {{ allowable_settlement_mm }} mm |27| Required certificate items | {{ required_certificate_items }} |28| Matching certificate items | {{ matching_certificate_items }} |29 30Compute improvement ratio, post-improvement N margin, allowable bearing, bearing utilization and margin, immediate settlement, total settlement, settlement margin, certificate match percent, and overall pass score.31 32Write a compact source-bound foundation review memo to `/workspace/output.md`. Preserve the source IDs above. Include a source-boundary statement that this is a task-owned synthetic source pack.33 34Do not claim authority approval, accepted project evidence, executable real source-pack parsing, full standards compliance, generated benchmark readiness, or benchmark readiness.35 36Include a fenced JSON block with exactly these numeric keys:37 38```json39{40 "improvement_ratio": <numeric_value>,41 "post_improvement_n_margin": <numeric_value>,42 "allowable_bearing_capacity_kpa": <numeric_value>,43 "bearing_utilization": <numeric_value>,44 "bearing_margin_kpa": <numeric_value>,45 "immediate_settlement_mm": <numeric_value>,46 "primary_settlement_mm": <numeric_value>,47 "total_settlement_mm": <numeric_value>,48 "settlement_margin_mm": <numeric_value>,49 "certificate_match_percent": <numeric_value>,50 "overall_pass_score": <numeric_value>51}52```53

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Ssc07 ground improvement case

ssc07_ground_improvement_case

Ground investigation package for one improvement certificate and foundation recheck

ground-improvementfoundation-recheck
Parameter ranges
pre_improvement_n1_60
9
post_improvement_n1_60
22
target_n1_60
18
applied_bearing_pressure_kpa
180
bearing_factor_per_blow_kpa
12
footing_width_m
2
elastic_modulus_kpa
35000
poisson_ratio
0.3
primary_settlement_mm
12.5
allowable_settlement_mm
25
required_certificate_items
5
matching_certificate_items
5

Example task

ground-improvement-ssc07-ground-improvement-case-preview — hard difficulty, all inputs given.

Ground investigation package for one improvement certificate and foundation recheck. ground-improvement. Required outputs: improvement_ratio, post_improvement_n_margin, allowable_bearing_capacity_kpa, bearing_utilization, bearing_margin_kpa, immediate_settlement_mm

The model sees

Scenario context and visible inputs.

pre_improvement_n1_60
9 to 9
post_improvement_n1_60
22 to 22
target_n1_60
18 to 18
applied_bearing_pressure_kpa
180 to 180 kPa
bearing_factor_per_blow_kpa
12 to 12 kPa
footing_width_m
2 to 2 m
elastic_modulus_kpa
35000 to 35000 kPa
poisson_ratio
0.3 to 0.3
primary_settlement_mm
12.5 to 12.5 mm
allowable_settlement_mm
25 to 25 mm
required_certificate_items
5 to 5 count
matching_certificate_items
5 to 5 count

Executable tool: ground-improvement-foundation-recheck-package_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "improvement_ratio": <number>,
  "post_improvement_n_margin": <number>,
  "allowable_bearing_capacity_kpa": <number>,
  "bearing_utilization": <number>,
  "bearing_margin_kpa": <number>,
  "immediate_settlement_mm": <number>,
  "primary_settlement_mm": <number>,
  "total_settlement_mm": <number>,
  "settlement_margin_mm": <number>,
  "certificate_match_percent": <number>,
  "overall_pass_score": <number>
}
  • improvement_ratio · scored within ±3%
  • post_improvement_n_margin · scored within ±3%
  • allowable_bearing_capacity_kpa · scored within ±3%
  • bearing_utilization · scored within ±3%
  • bearing_margin_kpa · scored within ±3%
  • immediate_settlement_mm · scored within ±3%
  • primary_settlement_mm · scored within ±3%
  • total_settlement_mm · scored within ±3%
  • settlement_margin_mm · scored within ±3%
  • certificate_match_percent · scored within ±3%
  • overall_pass_score · scored within ±3%