LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
electricalwith-tool

Lighting Energy Emergency Mode Package

Calculates source-bound lighting energy metrics from a deterministic SSC-13 task-owned source pack. The template combines lighting layout, controls, LENI/energy profile, emergency load schedule, and criteria checks.

with-tool: The model is given an executable Python calculator script.

Standards

LENI workflowbattery autonomy reviewemergency lighting workflowlighting energy review

Tags

batterydeterministicelectricalemergencyenergylenilighting

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

21 inputs

Always given

Included directly in every task prompt.

21
Show 21 inputs

  • Grid lux 01

    grid_lux_01

    LIGHT-13-LAYOUT-07 grid point 01

    175 lux

  • Grid lux 02

    grid_lux_02

    LIGHT-13-LAYOUT-07 grid point 02

    168 lux

  • Grid lux 03

    grid_lux_03

    LIGHT-13-LAYOUT-07 grid point 03

    182 lux

  • Grid lux 04

    grid_lux_04

    LIGHT-13-LAYOUT-07 grid point 04

    171 lux

  • Grid lux 05

    grid_lux_05

    LIGHT-13-LAYOUT-07 grid point 05

    176 lux

  • Grid lux 06

    grid_lux_06

    LIGHT-13-LAYOUT-07 grid point 06

    169 lux

  • Required illuminance

    required_illuminance_lux

    CRIT-13-TABLE-07 required normal illuminance

    150 lux

  • Emergency illuminance

    emergency_illuminance_lux

    EMERG-13-LOAD-07 emergency illuminance

    12 lux

  • Required emergency illuminance

    required_emergency_illuminance_lux

    CRIT-13-TABLE-07 required emergency illuminance

    10 lux

  • Luminaire

    luminaire_count

    LIGHT-13-LAYOUT-07 luminaire count

    18 count

  • Normal luminaire power

    normal_luminaire_power_w

    LENI-13-PROFILE-07 normal luminaire power

    42 W

  • Control factor

    control_factor

    CTRL-13-SCHED-07 control factor

    0.65

  • Annual operating hours

    annual_operating_hours

    LENI-13-PROFILE-07 annual operating hours

    3200 h/year

  • Area

    area_m2

    LENI-13-PROFILE-07 assessed area

    450 m2

  • Target leni

    target_leni_kwh_m2_year

    CRIT-13-TABLE-07 target LENI

    5 kWh/m2-year

  • Emergency luminaire power

    emergency_luminaire_power_w

    EMERG-13-LOAD-07 emergency luminaire power

    8 W

  • Exit sign

    exit_sign_count

    EMERG-13-LOAD-07 exit sign count

    12 count

  • Exit sign power

    exit_sign_power_w

    EMERG-13-LOAD-07 exit sign power

    4 W

  • Emergency autonomy

    emergency_autonomy_h

    EMERG-13-LOAD-07 emergency autonomy

    2 h

  • Battery efficiency

    battery_efficiency

    EMERG-13-LOAD-07 battery efficiency

    0.85

  • Battery capacity

    battery_capacity_kwh

    EMERG-13-LOAD-07 battery capacity

    0.8 kWh

Scored outputs

11 outputs

Average illuminance lux

average_illuminance_lux

Average normal-mode illuminance

Scores if within ±0.3% of the reference value.

Minimum illuminance lux

minimum_illuminance_lux

Minimum normal-mode illuminance

Scores if within ±0.3% of the reference value.

Uniformity ratio

uniformity_ratio

Minimum illuminance divided by average illuminance

Scores if within ±0.3% of the reference value.

Illuminance margin lux

illuminance_margin_lux

Average normal illuminance minus required illuminance

Scores if within ±0.3% of the reference value.

Emergency illuminance margin lux

emergency_illuminance_margin_lux

Emergency illuminance minus required emergency illuminance

Scores if within ±0.3% of the reference value.

Annual lighting energy kwh

annual_lighting_energy_kwh

Annual controlled lighting energy

Scores if within ±0.3% of the reference value.

Leni kwh m2 year

leni_kwh_m2_year

Lighting energy numeric indicator

Scores if within ±0.3% of the reference value.

Leni margin kwh m2 year

leni_margin_kwh_m2_year

Target LENI minus calculated LENI

Scores if within ±0.3% of the reference value.

Emergency battery required kwh

emergency_battery_required_kwh

Emergency battery capacity required

Scores if within ±0.3% of the reference value.

Emergency battery margin kwh

emergency_battery_margin_kwh

Installed battery capacity minus required capacity

Scores if within ±0.3% of the reference value.

Overall pass score

overall_pass_score

1.0 when lighting energy and emergency checks pass

Scores if within ±0.1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All source-pack values given for the SSC-13 lighting energy package
medium:
All source-pack values given for the SSC-13 lighting energy package
hard:
All source-pack values given for the SSC-13 lighting energy package

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • lighting-energy-emergency-mode-package_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a lighting and emergency-mode reviewer checking a task-owned synthetic SSC-13 lighting energy package.2 3Use only the task-owned synthetic source pack values shown below for numeric grading. External lighting, LENI, emergency-lighting, and backup-power tools shape the workflow context only; they are not extra data sources for this instance.4 5## Scene6 7- Product: `SSC-13-LH-07`8- Lighting layout: `LIGHT-13-LAYOUT-07`9- Control schedule: `CTRL-13-SCHED-07`10- LENI/energy profile: `LENI-13-PROFILE-07`11- Emergency load schedule: `EMERG-13-LOAD-07`12- Criteria table: `CRIT-13-TABLE-07`13- Lighting-energy memo: `MEMO-13-ENERGY-07`14 15All checks use the same lighting grid, controls, energy profile, emergency load schedule, and criteria table.16 17## Source Values18 19| Item | Value |20|------|-------|21| Lighting grid lux values | {{ grid_lux_01 }}, {{ grid_lux_02 }}, {{ grid_lux_03 }}, {{ grid_lux_04 }}, {{ grid_lux_05 }}, {{ grid_lux_06 }} |22| Required normal/emergency illuminance | {{ required_illuminance_lux }} lux / {{ required_emergency_illuminance_lux }} lux |23| Emergency illuminance | {{ emergency_illuminance_lux }} lux |24| Luminaire count and normal power | {{ luminaire_count }} at {{ normal_luminaire_power_w }} W |25| Control factor and annual hours | {{ control_factor }} / {{ annual_operating_hours }} h |26| Area and LENI target | {{ area_m2 }} m2 / {{ target_leni_kwh_m2_year }} kWh/m2-year |27| Emergency luminaire power | {{ emergency_luminaire_power_w }} W each |28| Exit sign count and power | {{ exit_sign_count }} at {{ exit_sign_power_w }} W |29| Emergency autonomy and battery efficiency | {{ emergency_autonomy_h }} h / {{ battery_efficiency }} |30| Battery capacity | {{ battery_capacity_kwh }} kWh |31 32## Output Format33 34Write a compact lighting-energy memo to `/workspace/output.md`. Include a source-boundary statement that this is a task-owned synthetic source pack. Do not claim authority approval, accepted project evidence, software export validity, full standards compliance, executable real source-pack parsing, generated benchmark readiness, or benchmark readiness.35 36Include a fenced JSON block with exactly these numeric keys:37 38```json39{40 "average_illuminance_lux": <numeric_value>,41 "minimum_illuminance_lux": <numeric_value>,42 "uniformity_ratio": <numeric_value>,43 "illuminance_margin_lux": <numeric_value>,44 "emergency_illuminance_margin_lux": <numeric_value>,45 "annual_lighting_energy_kwh": <numeric_value>,46 "leni_kwh_m2_year": <numeric_value>,47 "leni_margin_kwh_m2_year": <numeric_value>,48 "emergency_battery_required_kwh": <numeric_value>,49 "emergency_battery_margin_kwh": <numeric_value>,50 "overall_pass_score": <numeric_value>51}52```53

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Ssc13 lighting energy case

ssc13_lighting_energy_case

Lighting energy and emergency mode case

ssc13-lighting-energy
Parameter ranges

Example task

ssc13-lighting-energy-ssc13-lighting-energy-case-preview — hard difficulty, all inputs given.

Lighting energy and emergency mode case. ssc13-lighting-energy. Required outputs: average_illuminance_lux, minimum_illuminance_lux, uniformity_ratio, illuminance_margin_lux, emergency_illuminance_margin_lux, annual_lighting_energy_kwh

The model sees

Scenario context and visible inputs.

grid_lux_01
175 to 175 lux
grid_lux_02
168 to 168 lux
grid_lux_03
182 to 182 lux
grid_lux_04
171 to 171 lux
grid_lux_05
176 to 176 lux
grid_lux_06
169 to 169 lux
required_illuminance_lux
150 to 150 lux
emergency_illuminance_lux
12 to 12 lux
required_emergency_illuminance_lux
10 to 10 lux
luminaire_count
18 to 18 count
normal_luminaire_power_w
42 to 42 W
control_factor
0.65 to 0.65
annual_operating_hours
3200 to 3200 h/year
area_m2
450 to 450 m2
target_leni_kwh_m2_year
5 to 5 kWh/m2-year
emergency_luminaire_power_w
8 to 8 W
exit_sign_count
12 to 12 count
exit_sign_power_w
4 to 4 W
emergency_autonomy_h
2 to 2 h
battery_efficiency
0.85 to 0.85
battery_capacity_kwh
0.8 to 0.8 kWh

Executable tool: lighting-energy-emergency-mode-package_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "average_illuminance_lux": <number>,
  "minimum_illuminance_lux": <number>,
  "uniformity_ratio": <number>,
  "illuminance_margin_lux": <number>,
  "emergency_illuminance_margin_lux": <number>,
  "annual_lighting_energy_kwh": <number>,
  "leni_kwh_m2_year": <number>,
  "leni_margin_kwh_m2_year": <number>,
  "emergency_battery_required_kwh": <number>,
  "emergency_battery_margin_kwh": <number>,
  "overall_pass_score": <number>
}
  • average_illuminance_lux · scored within ±0.3%
  • minimum_illuminance_lux · scored within ±0.3%
  • uniformity_ratio · scored within ±0.3%
  • illuminance_margin_lux · scored within ±0.3%
  • emergency_illuminance_margin_lux · scored within ±0.3%
  • annual_lighting_energy_kwh · scored within ±0.3%
  • leni_kwh_m2_year · scored within ±0.3%
  • leni_margin_kwh_m2_year · scored within ±0.3%
  • emergency_battery_required_kwh · scored within ±0.3%
  • emergency_battery_margin_kwh · scored within ±0.3%
  • overall_pass_score · scored within ±0.1%