LIVEdataset aec-bench@releasetasks 552models 18disciplines 5last submission … · built …

electricalwith-tool

Road Aeci Calculation

Calculates annual road lighting energy consumption and Annual Energy Consumption Index from system power, full-output hours, dimmed hours, dimming level, and illuminated area.

with-tool: The model is given an executable Python calculator script.

Standards

AS/NZS 1158.3.1 EN 13201-5

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

01
Template
The reusable contract shown on this page.
02
Scenario
An archetype and site context are sampled.
03
Difficulty tier
Inputs may be hidden at harder tiers.
04
Task prompt
The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

5 inputs

Always given

Included directly in every task prompt.

System power
system_power_w
Total road lighting system power at full output
100 – 200000 W
Full output hours per year
full_output_hours_per_year
Annual hours at full lighting output
0 – 8760 h/year
Dimming level pct
dimming_level_pct
Dimmed output level relative to full power
0 – 100 %
Illuminated area
illuminated_area_m2
Illuminated road or pathway area
100 – 100000 m2

Hidden at higher difficulty

Visible in easier tasks and withheld in one or more harder tiers.

Dimmed hours per year
dimmed_hours_per_year
Annual hours at dimmed lighting output
Hidden at hard difficulty.
0 – 8760 h/year

Scored outputs

2 outputs

Annual energy kwh

annual_energy_kwh

Annual lighting energy consumption

Scores if within ±3% of the reference value.

Aeci kwh per m2 year

aeci_kwh_per_m2_year

Annual Energy Consumption Index

Scores if within ±3% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

easy

All inputs given

Local road with all values visible

medium

All inputs given

Road lighting dimming scenario

hard

Some inputs hidden

Arterial road with dimmed hours embedded in context

Hidden inputs

Dimmed hours per yeardimmed_hours_per_year

Prompt replacement text

Use the annual dimmed operating hours implied by {{ archetype.description }}.

Dimmed hours per year restricted to: 2500

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

instruction.md
road-aeci-calculation_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1# ABOUTME: Prompt template for road lighting Annual Energy Consumption Index tasks.2# ABOUTME: Presents full-output, dimmed-hour, and area inputs for calculation.3 4You are a senior road lighting engineer checking annual energy performance.5 6## Given7 8| Parameter | Value | Unit |9|-----------|-------|------|10| System power | {{ system_power_w }} | W |11| Full-output operating hours | {{ full_output_hours_per_year }} | h/year |12| Dimmed operating hours | {{ dimmed_hours_per_year }} | h/year |13| Dimming level | {{ dimming_level_pct }} | % |14| Illuminated area | {{ illuminated_area_m2 }} | m2 |15 16## Constraints17 18- Annual energy equals full-output energy plus dimmed energy.19- Dimmed energy uses system power multiplied by the dimming level fraction.20- AECI equals annual energy divided by illuminated area.21 22## Output Format23 24Include a JSON block with exactly these keys:25 26```json27{28  "annual_energy_kwh": <numeric_value>,29  "aeci_kwh_per_m2_year": <numeric_value>30}31```32 33Write your complete solution to `/workspace/output.md`.34

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Local road night dimming

local_road_night_dimming

Local road with overnight dimming

local-roadnight-dimming

Parameter ranges

system_power_w: 500 – 6000
full_output_hours_per_year: 1800 – 3500
dimmed_hours_per_year: 1500 – 4500
dimming_level_pct: 30 – 70
illuminated_area_m2: 300 – 5000

Arterial road night dimming

arterial_road_night_dimming

Arterial road with adaptive lighting control

arterial-roadadaptive-lighting

Parameter ranges

system_power_w: 5000 – 70000
full_output_hours_per_year: 2000 – 4500
dimmed_hours_per_year: 1000 – 4000
dimming_level_pct: 40 – 80
illuminated_area_m2: 3000 – 50000

Example task

arterial-road-arterial-road-night-dimming-preview — hard difficulty, some inputs hidden.

Arterial road with adaptive lighting control. arterial-road. Required outputs: annual_energy_kwh, aeci_kwh_per_m2_year

The model sees

Scenario context and visible inputs.

system_power_w: 5000 to 70000 W
full_output_hours_per_year: 2000 to 4500 h/year
dimming_level_pct: 40 to 80 %
illuminated_area_m2: 3000 to 50000 m2

Executable tool: road-aeci-calculation_calc.py

The model must infer

Inputs withheld at this difficulty.

Dimmed hours per year
dimmed_hours_per_year

Stand-in text in the prompt