LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
groundwith-tool

Ground Investigation Parameter Repair Package

Calculates source-bound ground investigation repair metrics from a deterministic SSC-07 task-owned source pack. The template combines CPT/lab parameter comparison, adopted repaired phi, affected bearing, wall, and grid checks, and comment closeout.

with-tool: The model is given an executable Python calculator script.

Standards

affected calculation recheckcomment closeoutgeotechnical parameter review

Tags

closeoutcptdeterministicgroundlab-testparameter-repairreview

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

13 inputs

Always given

Included directly in every task prompt.

13
Show 13 inputs

  • Cpt phi deg

    cpt_phi_deg

    CPT-07-REPAIR-01 CPT-derived friction angle

    34.5 degrees

  • Lab phi deg

    lab_phi_deg

    LAB-07-REPAIR-01 lab-derived friction angle

    31 degrees

  • Adopted phi deg

    adopted_phi_deg

    MEMO-07-REPAIR-01 adopted repaired friction angle

    31 degrees

  • Spt n1 60

    spt_n1_60

    GIR-07-REVIEW-01 reviewed corrected N1,60

    16.2

  • Minimum n1 60

    minimum_n1_60

    CALC-07-AFFECTED-01 minimum corrected N1,60

    15

  • Applied bearing pressure

    applied_bearing_pressure_kpa

    CALC-07-AFFECTED-01 applied bearing pressure

    185 kPa

  • Repaired allowable bearing

    repaired_allowable_bearing_kpa

    CALC-07-AFFECTED-01 repaired allowable bearing pressure

    210 kPa

  • Wall sliding fs

    wall_sliding_fs

    CALC-07-AFFECTED-01 repaired wall sliding factor of safety

    1.62

  • Minimum wall sliding fs

    minimum_wall_sliding_fs

    MEMO-07-REPAIR-01 minimum wall sliding factor of safety

    1.5

  • Repaired grid resistance

    repaired_grid_resistance_ohm

    CALC-07-AFFECTED-01 repaired grounding grid resistance

    1.9 ohm

  • Maximum grid resistance

    maximum_grid_resistance_ohm

    MEMO-07-REPAIR-01 maximum grid resistance

    2 ohm

  • Closed comments

    closed_comments

    GIR-07-REVIEW-01 closed parameter-review comments

    6 count

  • Total comments

    total_comments

    GIR-07-REVIEW-01 total parameter-review comments

    6 count

Scored outputs

9 outputs

Phi source delta deg

phi_source_delta_deg

Absolute difference between CPT and lab friction angle values

Scores if within ±3% of the reference value.

Adopted phi deg

adopted_phi_deg

Adopted repaired friction angle

Scores if within ±3% of the reference value.

Spt n1 60 margin

spt_n1_60_margin

Corrected N1,60 minus minimum N1,60

Scores if within ±3% of the reference value.

Bearing utilization

bearing_utilization

Applied bearing pressure divided by repaired allowable bearing

Scores if within ±3% of the reference value.

Bearing margin

bearing_margin_kpa

Repaired allowable bearing minus applied bearing pressure

Scores if within ±3% of the reference value.

Wall sliding fs margin

wall_sliding_fs_margin

Wall sliding factor of safety minus minimum sliding factor of safety

Scores if within ±3% of the reference value.

Grid resistance margin ohm

grid_resistance_margin_ohm

Maximum grid resistance minus repaired grid resistance

Scores if within ±3% of the reference value.

Comment closeout

comment_closeout_percent

Closed comments divided by total comments

Scores if within ±3% of the reference value.

Overall pass score

overall_pass_score

1.0 when source adoption, affected checks, and comments pass

Scores if within ±3% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All source-pack values given for the SSC-07 parameter repair package
medium:
All source-pack values given for the SSC-07 parameter repair package
hard:
All source-pack values given for the SSC-07 parameter repair package

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • ground-investigation-parameter-repair-package_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are checking a task-owned synthetic SSC-07 ground investigation review and parameter repair package for `SSC-07-LH-08`.2 3Use only the task-owned synthetic source pack values shown below for numeric grading.4 5## Source Pack6 7- Ground investigation review: `GIR-07-REVIEW-01`8- CPT repair source: `CPT-07-REPAIR-01`9- Lab/test repair source: `LAB-07-REPAIR-01`10- Affected calculation excerpts: `CALC-07-AFFECTED-01`11- Geotechnical review response: `MEMO-07-REPAIR-01`12 13## Source Values14 15| Item | Value |16|---|---:|17| CPT-derived phi | {{ cpt_phi_deg }} degrees |18| Lab-test phi | {{ lab_phi_deg }} degrees |19| Adopted repaired phi | {{ adopted_phi_deg }} degrees |20| SPT N1,60 | {{ spt_n1_60 }} |21| Minimum N1,60 | {{ minimum_n1_60 }} |22| Applied bearing pressure | {{ applied_bearing_pressure_kpa }} kPa |23| Repaired allowable bearing | {{ repaired_allowable_bearing_kpa }} kPa |24| Wall sliding FS | {{ wall_sliding_fs }} |25| Minimum wall sliding FS | {{ minimum_wall_sliding_fs }} |26| Repaired grid resistance | {{ repaired_grid_resistance_ohm }} ohm |27| Maximum grid resistance | {{ maximum_grid_resistance_ohm }} ohm |28| Closed comments | {{ closed_comments }} |29| Total comments | {{ total_comments }} |30 31Compute the phi source delta, adopted phi, SPT margin, bearing utilization and margin, wall sliding margin, grid resistance margin, comment closeout, and overall pass score.32 33Write a compact source-bound geotechnical review response to `/workspace/output.md`. Preserve the source IDs above. Include a source-boundary statement that this is a task-owned synthetic source pack.34 35Do not claim authority approval, accepted project evidence, executable real source-pack parsing, full standards compliance, generated benchmark readiness, or benchmark readiness.36 37Include a fenced JSON block with exactly these numeric keys:38 39```json40{41 "phi_source_delta_deg": <numeric_value>,42 "adopted_phi_deg": <numeric_value>,43 "spt_n1_60_margin": <numeric_value>,44 "bearing_utilization": <numeric_value>,45 "bearing_margin_kpa": <numeric_value>,46 "wall_sliding_fs_margin": <numeric_value>,47 "grid_resistance_margin_ohm": <numeric_value>,48 "comment_closeout_percent": <numeric_value>,49 "overall_pass_score": <numeric_value>50}51```52

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Ssc07 parameter repair case

ssc07_parameter_repair_case

Ground investigation package for one parameter repair and affected-design recheck

parameter-repairaffected-design-recheck
Parameter ranges
cpt_phi_deg
34.5
lab_phi_deg
31
adopted_phi_deg
31
spt_n1_60
16.2
minimum_n1_60
15
applied_bearing_pressure_kpa
185
repaired_allowable_bearing_kpa
210
wall_sliding_fs
1.62
minimum_wall_sliding_fs
1.5
repaired_grid_resistance_ohm
1.9
maximum_grid_resistance_ohm
2
closed_comments
6
total_comments
6

Example task

parameter-repair-ssc07-parameter-repair-case-preview — hard difficulty, all inputs given.

Ground investigation package for one parameter repair and affected-design recheck. parameter-repair. Required outputs: phi_source_delta_deg, adopted_phi_deg, spt_n1_60_margin, bearing_utilization, bearing_margin_kpa, wall_sliding_fs_margin

The model sees

Scenario context and visible inputs.

cpt_phi_deg
34.5 to 34.5 degrees
lab_phi_deg
31 to 31 degrees
adopted_phi_deg
31 to 31 degrees
spt_n1_60
16.2 to 16.2
minimum_n1_60
15 to 15
applied_bearing_pressure_kpa
185 to 185 kPa
repaired_allowable_bearing_kpa
210 to 210 kPa
wall_sliding_fs
1.62 to 1.62
minimum_wall_sliding_fs
1.5 to 1.5
repaired_grid_resistance_ohm
1.9 to 1.9 ohm
maximum_grid_resistance_ohm
2 to 2 ohm
closed_comments
6 to 6 count
total_comments
6 to 6 count

Executable tool: ground-investigation-parameter-repair-package_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "phi_source_delta_deg": <number>,
  "adopted_phi_deg": <number>,
  "spt_n1_60_margin": <number>,
  "bearing_utilization": <number>,
  "bearing_margin_kpa": <number>,
  "wall_sliding_fs_margin": <number>,
  "grid_resistance_margin_ohm": <number>,
  "comment_closeout_percent": <number>,
  "overall_pass_score": <number>
}
  • phi_source_delta_deg · scored within ±3%
  • adopted_phi_deg · scored within ±3%
  • spt_n1_60_margin · scored within ±3%
  • bearing_utilization · scored within ±3%
  • bearing_margin_kpa · scored within ±3%
  • wall_sliding_fs_margin · scored within ±3%
  • grid_resistance_margin_ohm · scored within ±3%
  • comment_closeout_percent · scored within ±3%
  • overall_pass_score · scored within ±3%