LIVEdataset aec-bench@releasetasks 552models 18last submission … · built …
mechanicalwith-tool

Occupancy Fire Product Class Compliance Package

Calculates source-bound occupancy/fire/product-class compliance metrics from a deterministic SSC-15 task-owned source pack. The template combines one occupancy schedule, product datasheet, fire/hazard class note, authority reference, calculation appendix, and compliance memo.

with-tool: The model is given an executable Python calculator script.

Standards

authority evidence reviewfire product class reviewoccupant-load review

Tags

authoritycompliancedeterministicfiremechanicaloccupancyproduct-class

How this task is generated

One template produces many comparable benchmark tasks while keeping the scoring contract fixed.

  1. 01

    Template

    The reusable contract shown on this page.

  2. 02

    Scenario

    An archetype and site context are sampled.

  3. 03

    Difficulty tier

    Inputs may be hidden at harder tiers.

  4. 04

    Task prompt

    The model responds with the declared outputs.

Parameters

Inputs the model receives, and the outputs it is scored on.

Inputs

16 inputs

Always given

Included directly in every task prompt.

16
Show 16 inputs

  • Floor area

    floor_area_m2

    OCC-15-SCHED-07 floor area for the occupancy context

    960 m2

  • Occupant area factor m2 per person

    occupant_area_factor_m2_per_person

    OCC-15-SCHED-07 occupant area factor

    10 m2/person

  • Product class capacity

    product_class_capacity_persons

    DAT-15-PRODUCT-07 product class occupancy capacity

    120 persons

  • Flame spread index

    flame_spread_index

    FIRE-15-CLASS-07 product flame spread index

    25

  • Flame spread limit

    flame_spread_limit

    AUTH-15-REF-07 flame spread limit

    75

  • Smoke developed index

    smoke_developed_index

    FIRE-15-CLASS-07 product smoke developed index

    80

  • Smoke developed limit

    smoke_developed_limit

    AUTH-15-REF-07 smoke developed limit

    450

  • Fire resistance rating

    fire_resistance_rating_min

    DAT-15-PRODUCT-07 fire resistance rating

    60 min

  • Required fire resistance

    required_fire_resistance_min

    AUTH-15-REF-07 required fire resistance

    45 min

  • Nac device

    nac_device_count

    CALC-15-APP-07 notification appliance count affected by the product class

    64 count

  • Nac current per device

    nac_current_per_device_a

    CALC-15-APP-07 current per notification appliance

    0.075 A

  • Nac supply capacity

    nac_supply_capacity_a

    CALC-15-APP-07 notification appliance circuit supply capacity

    8 A

  • Smoke exhaust

    smoke_exhaust_ach

    CALC-15-APP-07 smoke exhaust air-change rate

    6 ACH

  • Required smoke exhaust

    required_smoke_exhaust_ach

    AUTH-15-REF-07 required smoke exhaust air-change rate

    5 ACH

  • Authority evidence items

    authority_evidence_items

    MEMO-15-CODE-07 authority evidence items provided

    5 count

  • Required authority evidence items

    required_authority_evidence_items

    MEMO-15-CODE-07 required authority evidence items

    5 count

Scored outputs

9 outputs

Occupant load persons

occupant_load_persons

Floor area divided by occupant area factor

Scores if within ±3% of the reference value.

Product class capacity margin persons

product_class_capacity_margin_persons

Product class capacity minus occupant load

Scores if within ±3% of the reference value.

Flame spread margin

flame_spread_margin

Flame spread limit minus flame spread index

Scores if within ±3% of the reference value.

Smoke developed margin

smoke_developed_margin

Smoke developed limit minus smoke developed index

Scores if within ±3% of the reference value.

Fire resistance margin min

fire_resistance_margin_min

Fire resistance rating minus required fire resistance

Scores if within ±3% of the reference value.

Nac current margin

nac_current_margin_a

NAC supply capacity minus connected NAC current

Scores if within ±3% of the reference value.

Smoke exhaust ach margin

smoke_exhaust_ach_margin

Smoke exhaust ACH minus required ACH

Scores if within ±0.3% of the reference value.

Authority evidence fraction

authority_evidence_fraction

Authority evidence items divided by required evidence items

Scores if within ±0.3% of the reference value.

Overall pass score

overall_pass_score

1.0 when occupancy, fire class, NAC, smoke exhaust, and authority checks pass

Scores if within ±0.1% of the reference value.

Difficulty

Each template is sampled at three tiers. Harder tiers may hide inputs, forcing the model to infer them from the scenario description.

All inputs remain visible at every tier

For this template, difficulty scales through parameter and scenario ranges rather than hidden information.

easy:
All source-pack values given for the SSC-15 occupancy fire product-class package
medium:
All source-pack values given for the SSC-15 occupancy fire product-class package
hard:
All source-pack values given for the SSC-15 occupancy fire product-class package

Task bundle

The exact instruction and parameter contract used to generate this task, pinned to the published library source.

/workspace

  • instruction.md
  • occupancy-fire-product-class-compliance-package_calc.py

Teal lines show Jinja input conditions, not task visibility policy. A line renders only when that input or tool is visible.

1You are a code-compliance reviewer checking a task-owned synthetic SSC-15 occupancy/fire/product-class compliance note.2 3Use only the task-owned synthetic source pack values shown below for numeric grading. Listing directories, fire product classes, and authority routes shape the context only; they are not extra data sources for this instance.4 5## Scene6 7- Product: `SSC-15-LH-07`8- Occupancy schedule: `OCC-15-SCHED-07`9- Product datasheet: `DAT-15-PRODUCT-07`10- Fire/hazard class note: `FIRE-15-CLASS-07`11- Authority reference: `AUTH-15-REF-07`12- Calculation appendix: `CALC-15-APP-07`13- Compliance response memo: `MEMO-15-CODE-07`14 15All checks use the same occupancy context, product class, and authority reference. Do not change the occupancy schedule, product identity, fire class, or authority criterion unless you explicitly flag a source conflict.16 17## Source Values18 19| Item | Value |20|------|-------|21| Floor area | {{ floor_area_m2 }} m2 |22| Occupant area factor | {{ occupant_area_factor_m2_per_person }} m2/person |23| Product class capacity | {{ product_class_capacity_persons }} persons |24| Flame spread index | {{ flame_spread_index }} |25| Flame spread limit | {{ flame_spread_limit }} |26| Smoke developed index | {{ smoke_developed_index }} |27| Smoke developed limit | {{ smoke_developed_limit }} |28| Fire resistance rating | {{ fire_resistance_rating_min }} min |29| Required fire resistance | {{ required_fire_resistance_min }} min |30| NAC devices | {{ nac_device_count }} |31| NAC current per device | {{ nac_current_per_device_a }} A |32| NAC supply capacity | {{ nac_supply_capacity_a }} A |33| Smoke exhaust ACH | {{ smoke_exhaust_ach }} |34| Required smoke exhaust ACH | {{ required_smoke_exhaust_ach }} |35| Authority evidence items | {{ authority_evidence_items }} |36| Required authority evidence items | {{ required_authority_evidence_items }} |37 38Occupant load equals floor area divided by occupant area factor. NAC current margin equals supply capacity minus device count times current per device.39 40## Output Format41 42Write a compact compliance response memo to `/workspace/output.md`. Include a source-boundary statement that this is a task-owned synthetic source pack. Do not claim authority approval, accepted project evidence, software export validity, full standards compliance, executable real source-pack parsing, generated benchmark readiness, or benchmark readiness.43 44Include a fenced JSON block with exactly these numeric keys:45 46```json47{48 "occupant_load_persons": <numeric_value>,49 "product_class_capacity_margin_persons": <numeric_value>,50 "flame_spread_margin": <numeric_value>,51 "smoke_developed_margin": <numeric_value>,52 "fire_resistance_margin_min": <numeric_value>,53 "nac_current_margin_a": <numeric_value>,54 "smoke_exhaust_ach_margin": <numeric_value>,55 "authority_evidence_fraction": <numeric_value>,56 "overall_pass_score": <numeric_value>57}58```59

Scenario archetypes

Each generated task is drawn from one of these realistic scenario bands.

Site contexts ground each scenario in a real locale the model can use to infer hidden values.

Ssc15 occupancy fire class case

ssc15_occupancy_fire_class_case

Occupancy, fire, and product-class compliance case

ssc15-occupancy-fire-class
Parameter ranges

Example task

ssc15-occupancy-fire-class-ssc15-occupancy-fire-class-case-preview — hard difficulty, all inputs given.

Occupancy, fire, and product-class compliance case. ssc15-occupancy-fire-class. Required outputs: occupant_load_persons, product_class_capacity_margin_persons, flame_spread_margin, smoke_developed_margin, fire_resistance_margin_min, nac_current_margin_a

The model sees

Scenario context and visible inputs.

floor_area_m2
960 to 960 m2
occupant_area_factor_m2_per_person
10 to 10 m2/person
product_class_capacity_persons
120 to 120 persons
flame_spread_index
25 to 25
flame_spread_limit
75 to 75
smoke_developed_index
80 to 80
smoke_developed_limit
450 to 450
fire_resistance_rating_min
60 to 60 min
required_fire_resistance_min
45 to 45 min
nac_device_count
64 to 64 count
nac_current_per_device_a
0.075 to 0.075 A
nac_supply_capacity_a
8 to 8 A
smoke_exhaust_ach
6 to 6 ACH
required_smoke_exhaust_ach
5 to 5 ACH
authority_evidence_items
5 to 5 count
required_authority_evidence_items
5 to 5 count

Executable tool: occupancy-fire-product-class-compliance-package_calc.py

The model must infer

Inputs withheld at this difficulty.

Nothing. All inputs are supplied.

The model must produce

The scored JSON answer schema.

{
  "occupant_load_persons": <number>,
  "product_class_capacity_margin_persons": <number>,
  "flame_spread_margin": <number>,
  "smoke_developed_margin": <number>,
  "fire_resistance_margin_min": <number>,
  "nac_current_margin_a": <number>,
  "smoke_exhaust_ach_margin": <number>,
  "authority_evidence_fraction": <number>,
  "overall_pass_score": <number>
}
  • occupant_load_persons · scored within ±3%
  • product_class_capacity_margin_persons · scored within ±3%
  • flame_spread_margin · scored within ±3%
  • smoke_developed_margin · scored within ±3%
  • fire_resistance_margin_min · scored within ±3%
  • nac_current_margin_a · scored within ±3%
  • smoke_exhaust_ach_margin · scored within ±0.3%
  • authority_evidence_fraction · scored within ±0.3%
  • overall_pass_score · scored within ±0.1%