LIVEdataset aec-bench@releasetasks 552models 18disciplines 5last submission … · built …

electricalwith-tool

Dc Ac Ratio

Calculates the DC/AC ratio (inverter loading ratio) for solar PV systems and estimates annual energy yield accounting for system losses, inverter efficiency, and clipping losses from inverter overloading. Uses a quadratic clipping model to balance higher array utilisation against peak-hour energy curtailment, per IEC 62548 and AS/NZS 5033.

with-tool: The model is given an executable Python calculator script.

Standards

AS/NZS 5033 IEC 62548

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

01
Template
The reusable contract shown on this page.
02
Scenario
An archetype and site context are sampled.
03
Difficulty tier
Inputs may be hidden at harder tiers.
04
Task prompt
The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

4 inputs

Always given

Included directly in every task prompt.

Dc array capacity
dc_array_capacity_kwp
Total PV array DC power capacity at STC
5 – 10000 kWp
Inverter ac capacity
inverter_ac_capacity_kw
Total inverter AC power capacity (nameplate rating)
3 – 8000 kW
System losses pct
system_losses_pct
Total system losses excluding clipping (soiling, wiring, mismatch, temperature)
5 – 25 %

Derived from scenario

Sampled from the scenario and inferable from its description.

Annual psh
annual_psh
Annual peak sun hours for the site location
Derived from the archetype scenario. Hidden at hard difficulty.
800 – 2600 h

Scored outputs

4 outputs

Dc ac ratio

dc_ac_ratio

DC/AC ratio (Inverter Loading Ratio)

Scores if within ±1% of the reference value.

Estimated clipping loss pct

estimated_clipping_loss_pct

Estimated annual clipping loss (%)

Scores if within ±5% of the reference value.

Annual energy yield kwh

annual_energy_yield_kwh

Estimated annual energy yield (kWh)

Scores if within ±3% of the reference value.

Specific yield kwh per kwp

specific_yield_kwh_per_kwp

Specific yield (kWh per kWp installed)

Scores if within ±3% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

easy

All inputs given

Residential scale, all parameters given, moderate ILR

medium

All inputs given

Commercial or utility scale, all parameters given, wider ILR range

hard

Some inputs hidden

Peak sun hours hidden, agent must infer from site location context

Hidden inputs

Annual pshannual_psh

Prompt replacement text

The project site is located in {{ archetype.site_context }}, a {{ archetype.description | lower }} environment.

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

instruction.md
dc-ac-ratio_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a senior electrical engineer specializing in solar PV system design.2 3## Problem4 5Calculate the DC/AC ratio (inverter loading ratio) for a solar PV installation, estimate the annual clipping losses, and determine the expected annual energy yield per IEC 62548 and AS/NZS 5033.6 7## Given8 9| Parameter | Value | Unit |10|-----------|-------|------|11| DC array capacity | {{ dc_array_capacity_kwp }} | kWp |12| Inverter AC capacity | {{ inverter_ac_capacity_kw }} | kW |13{% if annual_psh is defined %}14| Annual peak sun hours | {{ annual_psh }} | h |15{% endif %}16| System losses (excl. clipping) | {{ system_losses_pct }} | % |17{% if archetype_description is defined %}18 19### Site Context20 21{{ archetype_description }}22{% endif %}23 24{% if tool_available %}25## Available Tool26 27A DC/AC ratio calculation tool is available at `/workspace/dc-ac-ratio_calc.py`. Run it with:28 29```bash30python3 /workspace/dc-ac-ratio_calc.py --help31```32 33You may use this tool to verify your calculations or compute values directly.34{% endif %}35 36## Required37 38Calculate the following:39 401. DC/AC ratio (Inverter Loading Ratio, ILR) — ratio of DC array capacity to inverter AC capacity412. Estimated annual clipping loss (%) — energy lost when DC output exceeds inverter capacity423. Annual energy yield (kWh) — total AC energy produced over one year434. Specific yield (kWh/kWp) — energy produced per kWp of installed DC capacity44 45## Applicable Standards46 47- IEC 62548 — Photovoltaic (PV) arrays — Design requirements48- AS/NZS 5033 — Installation and safety requirements for photovoltaic (PV) arrays49 50## Constraints51 52- No internet access is available. Work from engineering knowledge and the provided tool.53- DC/AC ratio: ILR = DC array capacity (kWp) / inverter AC capacity (kW)54- Clipping loss estimation (quadratic model for moderate-irradiance sites):55  - For ILR ≤ 1.0: clipping = 0%56  - For ILR > 1.0: clipping_pct = 10.0 × (ILR - 1)² + (-0.5) × (ILR - 1), minimum 0%57- Inverter efficiency: 96.5% (CEC weighted)58- Annual energy yield: E = P_dc × PSH × (1 - system_losses/100) × η_inv × (1 - clipping/100)59- Specific yield: E / P_dc (kWh per kWp)60 61## Output Format62 63Show your step-by-step working in Markdown, including the ILR calculation, clipping loss estimation, and energy yield computation. At the end of your solution, include a JSON block with your final answers in exactly this format:64 65```json66{67  "dc_ac_ratio": <numeric_value>,68  "estimated_clipping_loss_pct": <numeric_value>,69  "annual_energy_yield_kwh": <numeric_value>,70  "specific_yield_kwh_per_kwp": <numeric_value>71}72```73 74Write your complete solution to `/workspace/output.md`.75

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Residential rooftop

residential_rooftop

Residential rooftop solar installation

sydney-suburbanbrisbane-suburbanadelaide-suburban

Parameter ranges

dc_array_capacity_kwp: 5 – 15
inverter_ac_capacity_kw: 3 – 12
annual_psh: 1300 – 1800
system_losses_pct: 10 – 18

Commercial rooftop

commercial_rooftop

Commercial rooftop solar installation in Melbourne/Sydney (BOM avg 1400-1600 PSH)

melbourne-commercialperth-commercialsydney-commercial

Parameter ranges

dc_array_capacity_kwp: 30 – 200
inverter_ac_capacity_kw: 25 – 160
annual_psh: 1400 – 1600
system_losses_pct: 10 – 18

Utility scale

utility_scale

Utility-scale ground-mounted solar farm in North Queensland (BOM avg 1800-2100 PSH)

north-queensland-solar-farmwestern-nsw-solar-farmpilbara-solar-farm

Parameter ranges

dc_array_capacity_kwp: 500 – 10000
inverter_ac_capacity_kw: 400 – 8000
annual_psh: 1800 – 2100
system_losses_pct: 8 – 16

Arid high irradiance

arid_high_irradiance

Solar installation in arid high-irradiance region near Alice Springs/Broken Hill (BOM avg 2200-2500 PSH)

alice-springs-solarbroken-hill-solarlongreach-solar

Parameter ranges

dc_array_capacity_kwp: 100 – 5000
inverter_ac_capacity_kw: 80 – 4000
annual_psh: 2200 – 2500
system_losses_pct: 8 – 14

Example task

melbourne-commercial-commercial-rooftop-preview — hard difficulty, some inputs hidden.

Commercial rooftop solar installation in Melbourne/Sydney (BOM avg 1400-1600 PSH). melbourne-commercial. Required outputs: dc_ac_ratio, estimated_clipping_loss_pct, annual_energy_yield_kwh, specific_yield_kwh_per_kwp

The model sees

Scenario context and visible inputs.

dc_array_capacity_kwp: 30 to 200 kWp
inverter_ac_capacity_kw: 25 to 160 kW
system_losses_pct: 10 to 18 %

Executable tool: dc-ac-ratio_calc.py

The model must infer

Inputs withheld at this difficulty.

Annual psh
annual_psh

Stand-in text in the prompt

The project site is located in {{ archetype.site_context }}, a {{ archetype.description | lower }} environment.

The model must produce

The scored JSON answer schema.

{
  "dc_ac_ratio": <number>,
  "estimated_clipping_loss_pct": <number>,
  "annual_energy_yield_kwh": <number>,
  "specific_yield_kwh_per_kwp": <number>
}

dc_ac_ratio · scored within ±1%
estimated_clipping_loss_pct · scored within ±5%
annual_energy_yield_kwh · scored within ±3%
specific_yield_kwh_per_kwp · scored within ±3%

Dc Ac Ratio

How this task is generated

Template

Scenario

Difficulty tier

Task prompt

Parameters

Inputs

Scored outputs

Dc ac ratio

Estimated clipping loss pct

Annual energy yield kwh

Specific yield kwh per kwp

Difficulty

easy

medium

hard

Task bundle

Scenario archetypes

Residential rooftop

Commercial rooftop

Utility scale

Arid high irradiance

Example task

The model sees

The model must infer

The model must produce