LIVEdataset aec-bench@releasetasks 552models 18disciplines 5last submission … · built …

electricalwith-tool

Bess Sizing

Determines the beginning-of-life installed capacity for a battery energy storage system using E_bol = (P * t) / (DoD * eta_rt * (1 - degradation)), accounting for depth of discharge, round-trip efficiency, and end-of-life degradation. Supports grid-scale peaking, renewable firming, and microgrid applications per IEC 62933 methodology.

with-tool: The model is given an executable Python calculator script.

Standards

IEC 62933 IEEE 2030.2.1

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

01
Template
The reusable contract shown on this page.
02
Scenario
An archetype and site context are sampled.
03
Difficulty tier
Inputs may be hidden at harder tiers.
04
Task prompt
The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

5 inputs

Always given

Included directly in every task prompt.

Power requirement
power_requirement_mw
Required discharge power (peak demand to be served)
0.5 – 500 MW
Discharge duration hours
discharge_duration_hours
Required discharge duration at rated power
0.5 – 12 h
Degradation allowance pct
degradation_allowance_pct
End-of-life capacity degradation allowance
5 – 30 %

Derived from scenario

Sampled from the scenario and inferable from its description.

Depth of discharge pct
depth_of_discharge_pct
Allowable depth of discharge (usable SOC range)
Derived from the archetype scenario. Hidden at hard difficulty.
50 – 95 %
Round trip efficiency pct
round_trip_efficiency_pct
AC-to-AC round-trip efficiency of the BESS
Derived from the archetype scenario. Hidden at hard difficulty.
80 – 96 %

Scored outputs

4 outputs

Nominal power mw

nominal_power_mw

Nominal power rating of the BESS (MW)

Scores if within ±1% of the reference value.

Required energy mwh

required_energy_mwh

Required energy capacity (MWh)

Scores if within ±3% of the reference value.

Bol capacity mwh

bol_capacity_mwh

Beginning-of-life installed capacity (MWh)

Scores if within ±3% of the reference value.

Usable energy mwh

usable_energy_mwh

Usable energy at BOL after DoD and efficiency (MWh)

Scores if within ±3% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

easy

All inputs given

Commercial scale, all parameters given, moderate DoD and efficiency

medium

All inputs given

Any application scale, all parameters given, full parameter ranges

hard

Some inputs hidden

DoD and efficiency hidden, agent must infer from battery chemistry and application context

Hidden inputs

Depth of discharge pctdepth_of_discharge_pct
Round trip efficiency pctround_trip_efficiency_pct

Prompt replacement text

The project uses a {{ archetype.description | lower }} configuration at {{ archetype.site_context }}.

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

instruction.md
bess-sizing_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a senior electrical engineer specializing in battery energy storage system design.2 3## Problem4 5Size a battery energy storage system (BESS) by calculating the nominal power rating, required energy capacity, beginning-of-life (BOL) installed capacity, and usable energy per IEC 62933 and IEEE 2030.2.1.6 7## Given8 9| Parameter | Value | Unit |10|-----------|-------|------|11| Required discharge power | {{ power_requirement_mw }} | MW |12| Discharge duration | {{ discharge_duration_hours }} | h |13{% if depth_of_discharge_pct is defined %}14| Depth of discharge (DoD) | {{ depth_of_discharge_pct }} | % |15{% endif %}16{% if round_trip_efficiency_pct is defined %}17| Round-trip efficiency (η_rt) | {{ round_trip_efficiency_pct }} | % |18{% endif %}19| Degradation allowance | {{ degradation_allowance_pct }} | % |20{% if archetype_description is defined %}21 22### Application Context23 24{{ archetype_description }}25{% endif %}26 27{% if tool_available %}28## Available Tool29 30A BESS sizing calculation tool is available at `/workspace/bess-sizing_calc.py`. Run it with:31 32```bash33python3 /workspace/bess-sizing_calc.py --help34```35 36You may use this tool to verify your calculations or compute values directly.37{% endif %}38 39## Required40 41Calculate the following:42 431. Nominal power rating (MW) — the rated discharge power of the BESS442. Required energy capacity (MWh) — the energy that must be delivered during the discharge period453. Beginning-of-life installed capacity (MWh) — the total nameplate energy capacity accounting for DoD, round-trip efficiency, and degradation464. Usable energy at BOL (MWh) — the energy actually available after DoD and efficiency losses47 48## Applicable Standards49 50- IEC 62933 — Electrical energy storage (EES) systems51- IEEE 2030.2.1 — Guide for design, operation, and maintenance of battery energy storage systems52 53## Constraints54 55- No internet access is available. Work from engineering knowledge and the provided tool.56- Nominal power rating equals the required discharge power: P_nominal = P_required57- Required energy: E_required = P × t_discharge (MWh)58- Beginning-of-life capacity must account for depth of discharge, round-trip efficiency, and degradation:59  - E_bol = E_required / (DoD × η_rt × (1 − degradation))60  - Where DoD and η_rt are expressed as fractions (e.g., 90% → 0.90)61- Usable energy at BOL: E_usable = E_bol × DoD × η_rt62- All percentage inputs (DoD, efficiency, degradation) are given as percentages and must be converted to fractions for calculation63 64## Output Format65 66Show your step-by-step working in Markdown, including the energy requirement, BOL capacity derivation, and usable energy computation. At the end of your solution, include a JSON block with your final answers in exactly this format:67 68```json69{70  "nominal_power_mw": <numeric_value>,71  "required_energy_mwh": <numeric_value>,72  "bol_capacity_mwh": <numeric_value>,73  "usable_energy_mwh": <numeric_value>74}75```76 77Write your complete solution to `/workspace/output.md`.78

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Grid peaking

grid_peaking

Grid-scale peaking and load-shifting BESS

hunter-valley-gridlatrobe-valley-gridpilbara-grid

Parameter ranges

power_requirement_mw: 50 – 500
discharge_duration_hours: 2 – 4
depth_of_discharge_pct: 80 – 90
round_trip_efficiency_pct: 85 – 92
degradation_allowance_pct: 15 – 25

Renewable firming

renewable_firming

Renewable energy firming and smoothing BESS

north-queensland-solar-farmsouth-australia-wind-farmwestern-nsw-solar-farm

Parameter ranges

power_requirement_mw: 10 – 200
discharge_duration_hours: 2 – 6
depth_of_discharge_pct: 80 – 90
round_trip_efficiency_pct: 86 – 93
degradation_allowance_pct: 10 – 20

Commercial demand

commercial_demand

Commercial behind-the-meter demand management BESS

sydney-cbd-commercialmelbourne-cbd-commercialbrisbane-commercial

Parameter ranges

power_requirement_mw: 0.5 – 10
discharge_duration_hours: 1 – 4
depth_of_discharge_pct: 80 – 95
round_trip_efficiency_pct: 88 – 96
degradation_allowance_pct: 10 – 20

Microgrid island

microgrid_island

Remote microgrid or island BESS for energy autonomy

torres-strait-islandcoober-pedy-microgridking-island-microgrid

Parameter ranges

power_requirement_mw: 0.5 – 20
discharge_duration_hours: 4 – 12
depth_of_discharge_pct: 70 – 85
round_trip_efficiency_pct: 83 – 90
degradation_allowance_pct: 15 – 30

Example task

north-queensland-solar-farm-renewable-firming-preview — hard difficulty, some inputs hidden.

Renewable energy firming and smoothing BESS. north-queensland-solar-farm. Required outputs: nominal_power_mw, required_energy_mwh, bol_capacity_mwh, usable_energy_mwh

The model sees

Scenario context and visible inputs.

power_requirement_mw: 10 to 200 MW
discharge_duration_hours: 2 to 6 h
degradation_allowance_pct: 10 to 20 %

Executable tool: bess-sizing_calc.py

The model must infer

Inputs withheld at this difficulty.

Round trip efficiency pct
round_trip_efficiency_pct
Depth of discharge pct
depth_of_discharge_pct

Stand-in text in the prompt

The project uses a {{ archetype.description | lower }} configuration at {{ archetype.site_context }}.

The model must produce

The scored JSON answer schema.

{
  "nominal_power_mw": <number>,
  "required_energy_mwh": <number>,
  "bol_capacity_mwh": <number>,
  "usable_energy_mwh": <number>
}

nominal_power_mw · scored within ±1%
required_energy_mwh · scored within ±3%
bol_capacity_mwh · scored within ±3%
usable_energy_mwh · scored within ±3%

Bess Sizing

How this task is generated

Template

Scenario

Difficulty tier

Task prompt

Parameters

Inputs

Scored outputs

Nominal power mw

Required energy mwh

Bol capacity mwh

Usable energy mwh

Difficulty

easy

medium

hard

Task bundle

Scenario archetypes

Grid peaking

Renewable firming

Commercial demand

Microgrid island

Example task

The model sees

The model must infer

The model must produce