LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
mechanicalwith-tool

Por Aor Compliance

Checks pump operating flow against explicit preferred and allowable operating range ratios relative to best efficiency point flow. The template reports flow ratio, POR margins, and numeric POR/AOR flags.

with-tool: The model is given an executable Python calculator script.

Standards

HI 9.6.3

Tags

aordeterministicmechanicaloperating-rangeporpump

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

6 inputs

Always given

Included directly in every task prompt.

6

  • Operating flow

    operating_flow_l_s

    Pump operating flow

    0 – 100000 L/s

  • Best efficiency flow

    best_efficiency_flow_l_s

    Best efficiency point flow

    0.1 – 100000 L/s

  • Por min ratio

    por_min_ratio

    Minimum preferred operating range ratio

    0 – 2

  • Por max ratio

    por_max_ratio

    Maximum preferred operating range ratio

    0 – 3

  • Aor min ratio

    aor_min_ratio

    Minimum allowable operating range ratio

    0 – 2

  • Aor max ratio

    aor_max_ratio

    Maximum allowable operating range ratio

    0 – 3

Scored outputs

5 outputs

Flow ratio

flow_ratio

Operating flow divided by best efficiency point flow

Scores if within ±3% of the reference value.

Por margin low

por_margin_low

Margin above lower preferred operating range limit

Scores if within ±3% of the reference value.

Por margin high

por_margin_high

Margin below upper preferred operating range limit

Scores if within ±3% of the reference value.

Within por

within_por

Numeric flag where 1 means operating flow is inside POR

Scores if within ±1% of the reference value.

Within aor

within_aor

Numeric flag where 1 means operating flow is inside AOR

Scores if within ±1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All parameters given for a water pump
medium:
All parameters given across pump services
hard:
All parameters given for process pump range checks

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • por-aor-compliance_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a senior mechanical engineer specializing in pump operating range checks.2 3## Problem4 5Check whether a pump operating flow is inside explicit preferred and allowable operating ranges.6 7## Given8 9| Parameter | Value | Unit |10|-----------|-------|------|11| Operating flow | {{ operating_flow_l_s }} | L/s |12| Best efficiency point flow | {{ best_efficiency_flow_l_s }} | L/s |13| POR minimum ratio | {{ por_min_ratio }} | - |14| POR maximum ratio | {{ por_max_ratio }} | - |15| AOR minimum ratio | {{ aor_min_ratio }} | - |16| AOR maximum ratio | {{ aor_max_ratio }} | - |17 18{% if archetype_description is defined %}19### Pump Context20 21{{ archetype_description }}22{% endif %}23 24{% if tool_available %}25## Available Tool26 27A POR/AOR compliance tool is available at `/workspace/{{ meta.name }}_calc.py`. Run it with:28 29```bash30python3 /workspace/{{ meta.name }}_calc.py --help31```32 33You may use this tool to verify your calculations or compute values directly.34{% endif %}35 36## Required37 38Calculate the following:39 401. Operating flow ratio relative to best efficiency point412. Lower and upper margins against the preferred operating range423. Numeric preferred operating range flag434. Numeric allowable operating range flag44 45## Constraints46 47- No internet access is available. Work from engineering knowledge and the provided tool.48- Use only the explicit POR and AOR ratios provided.49- Use flow ratio = operating flow / best efficiency point flow.50 51## Output Format52 53Show your step-by-step working in Markdown. At the end of your solution, include a JSON block with your final answers in exactly this format:54 55```json56{57 "flow_ratio": <numeric_value>,58 "por_margin_low": <numeric_value>,59 "por_margin_high": <numeric_value>,60 "within_por": <numeric_value>,61 "within_aor": <numeric_value>62}63```64 65Write your complete solution to `/workspace/output.md`.66 67

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Water pump

water_pump

Water pump operating range check

water-pump-stationtransfer-pump
Parameter ranges
operating_flow_l_s
10 – 1000
best_efficiency_flow_l_s
10 – 1000
por_min_ratio
0.7 – 0.8
por_max_ratio
1.1 – 1.2
aor_min_ratio
0.4 – 0.6
aor_max_ratio
1.2 – 1.4

Process pump

process_pump

Process pump operating range check

process-plantchemical-transfer
Parameter ranges
operating_flow_l_s
1 – 500
best_efficiency_flow_l_s
1 – 500
por_min_ratio
0.6 – 0.8
por_max_ratio
1.1 – 1.3
aor_min_ratio
0.3 – 0.6
aor_max_ratio
1.3 – 1.6

Example task

process-plant-process-pump-preview — hard difficulty, all inputs given.

Process pump operating range check. process-plant. Required outputs: flow_ratio, por_margin_low, por_margin_high, within_por, within_aor

The model sees

Scenario context and visible inputs.

operating_flow_l_s
1 to 500 L/s
best_efficiency_flow_l_s
1 to 500 L/s
por_min_ratio
0.6 to 0.8 -
por_max_ratio
1.1 to 1.3 -
aor_min_ratio
0.3 to 0.6 -
aor_max_ratio
1.3 to 1.6 -

Executable tool: por-aor-compliance_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "flow_ratio": <number>,
  "por_margin_low": <number>,
  "por_margin_high": <number>,
  "within_por": <number>,
  "within_aor": <number>
}
  • flow_ratio · scored within ±3%
  • por_margin_low · scored within ±3%
  • por_margin_high · scored within ±3%
  • within_por · scored within ±1%
  • within_aor · scored within ±1%