LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
mechanicalwith-tool

Equipment Datasheet Commissioning Review Package

Calculates source-bound equipment datasheet and commissioning review metrics from a deterministic SSC-06 task-owned source pack. The template combines flow/head capacity margins, POR/AOR position, NPSH and motor margins, evidence completeness, open commissioning items, critical review comments, and an overall synthetic pass score.

with-tool: The model is given an executable Python calculator script.

Standards

POR/AOR screeningcommissioning checklist workflowpump datasheet review workflow

Tags

aorcommissioningdatasheetdeterministicequipmentmechanicalporreview

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

16 inputs

Always given

Included directly in every task prompt.

16
Show 16 inputs

  • Scheduled flow

    scheduled_flow_l_s

    EQUIP-06-SCHED-08 scheduled duty flow

    78 L/s

  • Datasheet max flow

    datasheet_max_flow_l_s

    DATASHEET-06-MFR-08 datasheet maximum flow

    85 L/s

  • Scheduled head

    scheduled_head_m

    EQUIP-06-SCHED-08 scheduled duty head

    24.5 m

  • Datasheet max head

    datasheet_max_head_m

    DATASHEET-06-MFR-08 datasheet maximum head

    27.5 m

  • Bep flow

    bep_flow_l_s

    CURVE-06-EXPORT-08 best-efficiency-point flow

    82 L/s

  • Por lower pct

    por_lower_pct

    CURVE-06-EXPORT-08 POR lower bound as percent of BEP flow

    70 %

  • Por upper pct

    por_upper_pct

    CURVE-06-EXPORT-08 POR upper bound as percent of BEP flow

    110 %

  • Npsh available

    npsh_available_m

    COMM-06-CHECK-08 NPSH available

    10.6 m

  • Npsh required

    npsh_required_m

    CURVE-06-EXPORT-08 NPSH required

    7.8 m

  • Shaft power

    shaft_power_kw

    CURVE-06-EXPORT-08 shaft power

    26 kW

  • Selected motor

    selected_motor_kw

    EQUIP-06-SCHED-08 selected motor size

    30 kW

  • Motor service factor

    motor_service_factor

    DATASHEET-06-MFR-08 motor service factor

    1.15

  • Provided evidence count

    provided_evidence_count

    REVIEW-06-COMMENTS-08 evidence items provided

    7

  • Required evidence count

    required_evidence_count

    REVIEW-06-COMMENTS-08 evidence items required

    8

  • Open commissioning items

    open_commissioning_items

    COMM-06-CHECK-08 open commissioning items

    2

  • Critical review comments open

    critical_review_comments_open

    REVIEW-06-COMMENTS-08 critical review comments still open

    0

Scored outputs

10 outputs

Flow capacity margin pct

flow_capacity_margin_pct

Datasheet flow capacity margin

Scores if within ±3% of the reference value.

Head capacity margin pct

head_capacity_margin_pct

Datasheet head capacity margin

Scores if within ±3% of the reference value.

Por position pct

por_position_pct

Scheduled duty flow as a percent of BEP flow

Scores if within ±3% of the reference value.

Por margin pct

por_margin_pct

Nearest POR bound margin

Scores if within ±3% of the reference value.

Npsh margin

npsh_margin_m

NPSH available minus NPSH required

Scores if within ±3% of the reference value.

Motor service margin

motor_service_margin_kw

Selected motor size minus service-factor-adjusted shaft power

Scores if within ±3% of the reference value.

Evidence completeness score

evidence_completeness_score

Provided evidence count divided by required evidence count

Scores if within ±3% of the reference value.

Open commissioning items

open_commissioning_items

Open commissioning item count

Scores if within ±3% of the reference value.

Critical review comments open

critical_review_comments_open

Critical review comments still open

Scores if within ±3% of the reference value.

Overall pass score

overall_pass_score

1.0 when capacity, POR, NPSH, motor, evidence, and critical comment checks pass

Scores if within ±0.1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All source-pack values given for the SSC-06 datasheet commissioning review package
medium:
All source-pack values given for the SSC-06 datasheet commissioning review package
hard:
All source-pack values given for the SSC-06 datasheet commissioning review package

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • equipment-datasheet-commissioning-review-package_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are an equipment review engineer checking a task-owned synthetic SSC-06 equipment datasheet and commissioning review package.2 3Use only the task-owned synthetic source pack values shown below for numeric grading. Datasheet review, POR/AOR screening, commissioning, and review-comment workflows shape the context only; this instance does not run external software or parse a real source pack.4 5## Scene6 7- Product: `SSC-06-LH-08`8- Equipment schedule: `EQUIP-06-SCHED-08`9- Manufacturer datasheet: `DATASHEET-06-MFR-08`10- Curve/table export: `CURVE-06-EXPORT-08`11- Commissioning checklist: `COMM-06-CHECK-08`12- Review comments: `REVIEW-06-COMMENTS-08`13- Review response: `MEMO-06-REVIEW-08`14 15## Source Values16 17| Item | Value |18| --- | --- |19| Scheduled duty flow | {{ scheduled_flow_l_s }} L/s |20| Datasheet max flow | {{ datasheet_max_flow_l_s }} L/s |21| Scheduled duty head | {{ scheduled_head_m }} m |22| Datasheet max head | {{ datasheet_max_head_m }} m |23| BEP flow | {{ bep_flow_l_s }} L/s |24| POR lower bound | {{ por_lower_pct }} % of BEP |25| POR upper bound | {{ por_upper_pct }} % of BEP |26| NPSH available | {{ npsh_available_m }} m |27| NPSH required | {{ npsh_required_m }} m |28| Shaft power | {{ shaft_power_kw }} kW |29| Selected motor size | {{ selected_motor_kw }} kW |30| Motor service factor | {{ motor_service_factor }} |31| Provided evidence count | {{ provided_evidence_count }} |32| Required evidence count | {{ required_evidence_count }} |33| Open commissioning items | {{ open_commissioning_items }} |34| Critical review comments open | {{ critical_review_comments_open }} |35 36## Calculation Rules37 38- Flow capacity margin percent equals `(datasheet max flow - scheduled flow) / scheduled flow x 100`.39- Head capacity margin percent equals `(datasheet max head - scheduled head) / scheduled head x 100`.40- POR position percent equals scheduled flow divided by BEP flow times 100.41- POR margin percent equals the smaller margin to the lower and upper POR bounds.42- NPSH margin equals NPSH available minus NPSH required.43- Motor service margin equals selected motor size minus shaft power times motor service factor.44- Evidence completeness score equals provided evidence count divided by required evidence count.45- Overall pass score is `1.0` only when capacity, POR, NPSH, motor, evidence completeness, and critical-comment checks pass.46 47## Output Format48 49Write a compact memo to `/workspace/output.md`. Include a source-boundary statement that this is a task-owned synthetic source pack. Preserve the source IDs above and state whether the baseline source pack passes the current docs-only checks.50 51Do not claim authority approval, accepted project evidence, software export validity, full standards compliance, executable real source-pack parsing, generated modelling evidence, generated benchmark readiness, or benchmark readiness.52 53Include a fenced JSON block with exactly these numeric keys:54 55```json56{57 "flow_capacity_margin_pct": <numeric_value>,58 "head_capacity_margin_pct": <numeric_value>,59 "por_position_pct": <numeric_value>,60 "por_margin_pct": <numeric_value>,61 "npsh_margin_m": <numeric_value>,62 "motor_service_margin_kw": <numeric_value>,63 "evidence_completeness_score": <numeric_value>,64 "open_commissioning_items": <numeric_value>,65 "critical_review_comments_open": <numeric_value>,66 "overall_pass_score": <numeric_value>67}68```69

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Ssc06 equipment review case

ssc06_equipment_review_case

Equipment schedule, datasheet, curve export, commissioning checklist, and review response source pack

equipment-review-commissioningdatasheet-por-commissioning-check
Parameter ranges
scheduled_flow_l_s
78
datasheet_max_flow_l_s
85
scheduled_head_m
24.5
datasheet_max_head_m
27.5
bep_flow_l_s
82
por_lower_pct
70
por_upper_pct
110
npsh_available_m
10.6
npsh_required_m
7.8
shaft_power_kw
26
selected_motor_kw
30
motor_service_factor
1.15
provided_evidence_count
7
required_evidence_count
8
open_commissioning_items
2
critical_review_comments_open
0

Example task

equipment-review-commissioning-ssc06-equipment-review-case-preview — hard difficulty, all inputs given.

Equipment schedule, datasheet, curve export, commissioning checklist, and review response source pack. equipment-review-commissioning. Required outputs: flow_capacity_margin_pct, head_capacity_margin_pct, por_position_pct, por_margin_pct, npsh_margin_m, motor_service_margin_kw

The model sees

Scenario context and visible inputs.

scheduled_flow_l_s
78 to 78 L/s
datasheet_max_flow_l_s
85 to 85 L/s
scheduled_head_m
24.5 to 24.5 m
datasheet_max_head_m
27.5 to 27.5 m
bep_flow_l_s
82 to 82 L/s
por_lower_pct
70 to 70 %
por_upper_pct
110 to 110 %
npsh_available_m
10.6 to 10.6 m
npsh_required_m
7.8 to 7.8 m
shaft_power_kw
26 to 26 kW
selected_motor_kw
30 to 30 kW
motor_service_factor
1.15 to 1.15
provided_evidence_count
7 to 7
required_evidence_count
8 to 8
open_commissioning_items
2 to 2
critical_review_comments_open
0 to 0

Executable tool: equipment-datasheet-commissioning-review-package_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "flow_capacity_margin_pct": <number>,
  "head_capacity_margin_pct": <number>,
  "por_position_pct": <number>,
  "por_margin_pct": <number>,
  "npsh_margin_m": <number>,
  "motor_service_margin_kw": <number>,
  "evidence_completeness_score": <number>,
  "open_commissioning_items": <number>,
  "critical_review_comments_open": <number>,
  "overall_pass_score": <number>
}
  • flow_capacity_margin_pct · scored within ±3%
  • head_capacity_margin_pct · scored within ±3%
  • por_position_pct · scored within ±3%
  • por_margin_pct · scored within ±3%
  • npsh_margin_m · scored within ±3%
  • motor_service_margin_kw · scored within ±3%
  • evidence_completeness_score · scored within ±3%
  • open_commissioning_items · scored within ±3%
  • critical_review_comments_open · scored within ±3%
  • overall_pass_score · scored within ±0.1%