FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-94301

Supplement tolerance computed as fractional minutes · case 01

Contracts not divisible by ten produce fractional supplement minutes.

Shift rostering labor rules● Open access↗
FA-94302

Supplement tolerance computed as fractional minutes · case 02

Contracts not divisible by ten produce fractional supplement minutes.

Shift rostering labor rules◈ Members↗
FA-94303

Supplement tolerance computed as fractional minutes · case 03

Contracts not divisible by ten produce fractional supplement minutes.

Shift rostering labor rules◈ Members↗
FA-94304

Supplement tolerance computed as fractional minutes · case 04

Contracts not divisible by ten produce fractional supplement minutes.

Shift rostering labor rules◈ Members↗
FA-94305

Supplement tolerance computed as fractional minutes · case 05

Contracts not divisible by ten produce fractional supplement minutes.

Shift rostering labor rules◈ Members↗
FA-94306

Overtime minutes also counted as additional hours · case 01

Weeks over 40 hours count minutes in both additional and overtime bands.

Shift rostering labor rules● Open access↗
FA-94307

Overtime minutes also counted as additional hours · case 02

Weeks over 40 hours count minutes in both additional and overtime bands.

Shift rostering labor rules◈ Members↗
FA-94308

Overtime minutes also counted as additional hours · case 03

Weeks over 40 hours count minutes in both additional and overtime bands.

Shift rostering labor rules◈ Members↗
FA-94309

Overtime minutes also counted as additional hours · case 04

Weeks over 40 hours count minutes in both additional and overtime bands.

Shift rostering labor rules◈ Members↗
FA-94310

Overtime minutes also counted as additional hours · case 05

Weeks over 40 hours count minutes in both additional and overtime bands.

Shift rostering labor rules◈ Members↗
FA-94311

Supplement paid on additional minutes inside the tolerance · case 01

Every additional minute earns the supplement.

Shift rostering labor rules● Open access↗
FA-94312

Supplement paid on additional minutes inside the tolerance · case 02

Every additional minute earns the supplement.

Shift rostering labor rules◈ Members↗
FA-94313

Supplement paid on additional minutes inside the tolerance · case 03

Every additional minute earns the supplement.

Shift rostering labor rules◈ Members↗
FA-94314

Supplement paid on additional minutes inside the tolerance · case 04

Every additional minute earns the supplement.

Shift rostering labor rules◈ Members↗
FA-94315

Supplement paid on additional minutes inside the tolerance · case 05

Every additional minute earns the supplement.

Shift rostering labor rules◈ Members↗
FA-94316

Negative top-up recorded for weeks above contract · case 01

Busy weeks show negative guaranteed-hours top-ups that offset pay.

Shift rostering labor rules● Open access↗
FA-94317

Negative top-up recorded for weeks above contract · case 02

Busy weeks show negative guaranteed-hours top-ups that offset pay.

Shift rostering labor rules◈ Members↗
FA-94318

Negative top-up recorded for weeks above contract · case 03

Busy weeks show negative guaranteed-hours top-ups that offset pay.

Shift rostering labor rules◈ Members↗
FA-94319

Negative top-up recorded for weeks above contract · case 04

Busy weeks show negative guaranteed-hours top-ups that offset pay.

Shift rostering labor rules◈ Members↗
FA-94320

Negative top-up recorded for weeks above contract · case 05

Busy weeks show negative guaranteed-hours top-ups that offset pay.

Shift rostering labor rules◈ Members↗
FA-94321

Refused overtime offers not charged to the ledger · case 01

Workers who always refuse stay at the top of the offer list.

Shift rostering labor rules● Open access↗
FA-94322

Refused overtime offers not charged to the ledger · case 02

Workers who always refuse stay at the top of the offer list.

Shift rostering labor rules◈ Members↗
FA-94323

Refused overtime offers not charged to the ledger · case 03

Workers who always refuse stay at the top of the offer list.

Shift rostering labor rules◈ Members↗
FA-94324

Refused overtime offers not charged to the ledger · case 04

Workers who always refuse stay at the top of the offer list.

Shift rostering labor rules◈ Members↗
FA-94325

Refused overtime offers not charged to the ledger · case 05

Workers who always refuse stay at the top of the offer list.

Shift rostering labor rules◈ Members↗
FA-94326

Offer reaching exactly twelve hours treated as ineligible · case 01

Workers who would finish at exactly 12 hours are skipped.

Shift rostering labor rules● Open access↗
FA-94327

Offer reaching exactly twelve hours treated as ineligible · case 02

Workers who would finish at exactly 12 hours are skipped.

Shift rostering labor rules◈ Members↗
FA-94328

Offer reaching exactly twelve hours treated as ineligible · case 03

Workers who would finish at exactly 12 hours are skipped.

Shift rostering labor rules◈ Members↗
FA-94329

Offer reaching exactly twelve hours treated as ineligible · case 04

Workers who would finish at exactly 12 hours are skipped.

Shift rostering labor rules◈ Members↗
FA-94330

Offer reaching exactly twelve hours treated as ineligible · case 05

Workers who would finish at exactly 12 hours are skipped.

Shift rostering labor rules◈ Members↗
FA-94331

Equal-ledger ties offered to the most junior worker · case 01

Ties go to juniors in violation of seniority tie-breaking.

Shift rostering labor rules● Open access↗
FA-94332

Equal-ledger ties offered to the most junior worker · case 02

Ties go to juniors in violation of seniority tie-breaking.

Shift rostering labor rules◈ Members↗
FA-94333

Equal-ledger ties offered to the most junior worker · case 03

Ties go to juniors in violation of seniority tie-breaking.

Shift rostering labor rules◈ Members↗
FA-94334

Equal-ledger ties offered to the most junior worker · case 04

Ties go to juniors in violation of seniority tie-breaking.

Shift rostering labor rules◈ Members↗
FA-94335

Equal-ledger ties offered to the most junior worker · case 05

Ties go to juniors in violation of seniority tie-breaking.

Shift rostering labor rules◈ Members↗
FA-94336

Accepted overtime not added to the day's worked minutes · case 01

The same worker can take several offers beyond the 12-hour maximum.

Shift rostering labor rules● Open access↗
FA-94337

Accepted overtime not added to the day's worked minutes · case 02

The same worker can take several offers beyond the 12-hour maximum.

Shift rostering labor rules◈ Members↗
FA-94338

Accepted overtime not added to the day's worked minutes · case 03

The same worker can take several offers beyond the 12-hour maximum.

Shift rostering labor rules◈ Members↗
FA-94339

Accepted overtime not added to the day's worked minutes · case 04

The same worker can take several offers beyond the 12-hour maximum.

Shift rostering labor rules◈ Members↗
FA-94340

Accepted overtime not added to the day's worked minutes · case 05

The same worker can take several offers beyond the 12-hour maximum.

Shift rostering labor rules◈ Members↗
FA-94341

Repeated enrolment row reported as an exam clash · case 01

A student enrolled twice in the same exam appears to have two exams in one period.

Exam timetabling constraints● Open access↗
FA-94342

Repeated enrolment row reported as an exam clash · case 02

A student enrolled twice in the same exam appears to have two exams in one period.

Exam timetabling constraints◈ Members↗
FA-94343

Repeated enrolment row reported as an exam clash · case 03

A student enrolled twice in the same exam appears to have two exams in one period.

Exam timetabling constraints◈ Members↗
FA-94344

Repeated enrolment row reported as an exam clash · case 04

A student enrolled twice in the same exam appears to have two exams in one period.

Exam timetabling constraints◈ Members↗
FA-94345

Repeated enrolment row reported as an exam clash · case 05

A student enrolled twice in the same exam appears to have two exams in one period.

Exam timetabling constraints◈ Members↗
FA-94346

Cross-listed course codes treated as separate papers · case 01

Students in a cross-listed paper are shown clashing with themselves.

Exam timetabling constraints● Open access↗
FA-94347

Cross-listed course codes treated as separate papers · case 02

Students in a cross-listed paper are shown clashing with themselves.

Exam timetabling constraints◈ Members↗
FA-94348

Cross-listed course codes treated as separate papers · case 03

Students in a cross-listed paper are shown clashing with themselves.

Exam timetabling constraints◈ Members↗
FA-94349

Cross-listed course codes treated as separate papers · case 04

Students in a cross-listed paper are shown clashing with themselves.

Exam timetabling constraints◈ Members↗
FA-94350

Cross-listed course codes treated as separate papers · case 05

Students in a cross-listed paper are shown clashing with themselves.

Exam timetabling constraints◈ Members↗
FA-94351

Unscheduled exams placed in the first period for clash checks · case 01

Exams still awaiting a slot create clashes with period 0 exams.

Exam timetabling constraints● Open access↗
FA-94352

Unscheduled exams placed in the first period for clash checks · case 02

Exams still awaiting a slot create clashes with period 0 exams.

Exam timetabling constraints◈ Members↗
FA-94353

Unscheduled exams placed in the first period for clash checks · case 03

Exams still awaiting a slot create clashes with period 0 exams.

Exam timetabling constraints◈ Members↗
FA-94354

Unscheduled exams placed in the first period for clash checks · case 04

Exams still awaiting a slot create clashes with period 0 exams.

Exam timetabling constraints◈ Members↗
FA-94355

Unscheduled exams placed in the first period for clash checks · case 05

Exams still awaiting a slot create clashes with period 0 exams.

Exam timetabling constraints◈ Members↗
FA-94356

Single exam in a period reported as a clash · case 01

Every scheduled sitting is listed as a clash.

Exam timetabling constraints● Open access↗
FA-94357

Single exam in a period reported as a clash · case 02

Every scheduled sitting is listed as a clash.

Exam timetabling constraints◈ Members↗
FA-94358

Single exam in a period reported as a clash · case 03

Every scheduled sitting is listed as a clash.

Exam timetabling constraints◈ Members↗
FA-94359

Single exam in a period reported as a clash · case 04

Every scheduled sitting is listed as a clash.

Exam timetabling constraints◈ Members↗
FA-94360

Single exam in a period reported as a clash · case 05

Every scheduled sitting is listed as a clash.

Exam timetabling constraints◈ Members↗
FA-94361

Clash report ordered by period instead of student · case 01

Student letters list clashes in a different order than the contract.

Exam timetabling constraints● Open access↗
FA-94362

Clash report ordered by period instead of student · case 02

Student letters list clashes in a different order than the contract.

Exam timetabling constraints◈ Members↗
FA-94363

Clash report ordered by period instead of student · case 03

Student letters list clashes in a different order than the contract.

Exam timetabling constraints◈ Members↗
FA-94364

Clash report ordered by period instead of student · case 04

Student letters list clashes in a different order than the contract.

Exam timetabling constraints◈ Members↗
FA-94365

Clash report ordered by period instead of student · case 05

Student letters list clashes in a different order than the contract.

Exam timetabling constraints◈ Members↗
FA-94366

Same-day test compares slot numbers instead of days · case 01

Exams in the same slot on different days count as same-day pairs while real same-day pairs are missed.

Exam timetabling constraints● Open access↗
FA-94367

Same-day test compares slot numbers instead of days · case 02

Exams in the same slot on different days count as same-day pairs while real same-day pairs are missed.

Exam timetabling constraints◈ Members↗
FA-94368

Same-day test compares slot numbers instead of days · case 03

Exams in the same slot on different days count as same-day pairs while real same-day pairs are missed.

Exam timetabling constraints◈ Members↗
FA-94369

Same-day test compares slot numbers instead of days · case 04

Exams in the same slot on different days count as same-day pairs while real same-day pairs are missed.

Exam timetabling constraints◈ Members↗
FA-94370

Same-day test compares slot numbers instead of days · case 05

Exams in the same slot on different days count as same-day pairs while real same-day pairs are missed.

Exam timetabling constraints◈ Members↗
FA-94371

Same-period clash counted as period spread · case 01

Clashing exams add a spread penalty on top of the clash.

Exam timetabling constraints● Open access↗
FA-94372

Same-period clash counted as period spread · case 02

Clashing exams add a spread penalty on top of the clash.

Exam timetabling constraints◈ Members↗
FA-94373

Same-period clash counted as period spread · case 03

Clashing exams add a spread penalty on top of the clash.

Exam timetabling constraints◈ Members↗
FA-94374

Same-period clash counted as period spread · case 04

Clashing exams add a spread penalty on top of the clash.

Exam timetabling constraints◈ Members↗
FA-94375

Same-period clash counted as period spread · case 05

Clashing exams add a spread penalty on top of the clash.

Exam timetabling constraints◈ Members↗
FA-94376

Clashing pair counted as two-in-a-day · case 01

Same-period clashes inflate the two-in-a-day penalty.

Exam timetabling constraints● Open access↗
FA-94377

Clashing pair counted as two-in-a-day · case 02

Same-period clashes inflate the two-in-a-day penalty.

Exam timetabling constraints◈ Members↗
FA-94378

Clashing pair counted as two-in-a-day · case 03

Same-period clashes inflate the two-in-a-day penalty.

Exam timetabling constraints◈ Members↗
FA-94379

Clashing pair counted as two-in-a-day · case 04

Same-period clashes inflate the two-in-a-day penalty.

Exam timetabling constraints◈ Members↗
FA-94380

Clashing pair counted as two-in-a-day · case 05

Same-period clashes inflate the two-in-a-day penalty.

Exam timetabling constraints◈ Members↗
FA-94381

Student periods listed in exam-code order before differencing · case 01

Pairs with the later exam first produce negative distances and are ignored.

Exam timetabling constraints● Open access↗
FA-94382

Student periods listed in exam-code order before differencing · case 02

Pairs with the later exam first produce negative distances and are ignored.

Exam timetabling constraints◈ Members↗
FA-94383

Student periods listed in exam-code order before differencing · case 03

Pairs with the later exam first produce negative distances and are ignored.

Exam timetabling constraints◈ Members↗
FA-94384

Student periods listed in exam-code order before differencing · case 04

Pairs with the later exam first produce negative distances and are ignored.

Exam timetabling constraints◈ Members↗
FA-94385

Student periods listed in exam-code order before differencing · case 05

Pairs with the later exam first produce negative distances and are ignored.

Exam timetabling constraints◈ Members↗
FA-94386

Shorter exam shares a room with a longer exam · case 01

A 90-minute exam is seated in a room already running a 120-minute exam.

Exam timetabling constraints● Open access↗
FA-94387

Shorter exam shares a room with a longer exam · case 02

A 90-minute exam is seated in a room already running a 120-minute exam.

Exam timetabling constraints◈ Members↗
FA-94388

Shorter exam shares a room with a longer exam · case 03

A 90-minute exam is seated in a room already running a 120-minute exam.

Exam timetabling constraints◈ Members↗
FA-94389

Shorter exam shares a room with a longer exam · case 04

A 90-minute exam is seated in a room already running a 120-minute exam.

Exam timetabling constraints◈ Members↗
FA-94390

Shorter exam shares a room with a longer exam · case 05

A 90-minute exam is seated in a room already running a 120-minute exam.

Exam timetabling constraints◈ Members↗
FA-94391

Whole exam placed in the first sufficient room · case 01

Small exams occupy large halls and later large exams must split or go unplaced.

Exam timetabling constraints● Open access↗
FA-94392

Whole exam placed in the first sufficient room · case 02

Small exams occupy large halls and later large exams must split or go unplaced.

Exam timetabling constraints◈ Members↗
FA-94393

Whole exam placed in the first sufficient room · case 03

Small exams occupy large halls and later large exams must split or go unplaced.

Exam timetabling constraints◈ Members↗
FA-94394

Whole exam placed in the first sufficient room · case 04

Small exams occupy large halls and later large exams must split or go unplaced.

Exam timetabling constraints◈ Members↗
FA-94395

Whole exam placed in the first sufficient room · case 05

Small exams occupy large halls and later large exams must split or go unplaced.

Exam timetabling constraints◈ Members↗
FA-94396

Split feasibility counts seats in incompatible rooms · case 01

An exam is split into rooms that cannot hold all its candidates, leaving students without seats.

Exam timetabling constraints● Open access↗
FA-94397

Split feasibility counts seats in incompatible rooms · case 02

An exam is split into rooms that cannot hold all its candidates, leaving students without seats.

Exam timetabling constraints◈ Members↗
FA-94398

Split feasibility counts seats in incompatible rooms · case 03

An exam is split into rooms that cannot hold all its candidates, leaving students without seats.

Exam timetabling constraints◈ Members↗
FA-94399

Split feasibility counts seats in incompatible rooms · case 04

An exam is split into rooms that cannot hold all its candidates, leaving students without seats.

Exam timetabling constraints◈ Members↗
FA-94400

Split feasibility counts seats in incompatible rooms · case 05

An exam is split into rooms that cannot hold all its candidates, leaving students without seats.

Exam timetabling constraints◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗