Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Prerequisite manifest merge: New dependencies prepend in reverse order · case 01
New dependencies prepend in reverse order.
Prerequisite manifest merge: New dependencies prepend in reverse order · case 02
New dependencies prepend in reverse order.
Prerequisite manifest merge: New dependencies prepend in reverse order · case 03
New dependencies prepend in reverse order.
Prerequisite manifest merge: New dependencies prepend in reverse order · case 04
New dependencies prepend in reverse order.
Prerequisite manifest merge: New dependencies prepend in reverse order · case 05
New dependencies prepend in reverse order.
Build status reduction: Optional job failures block the build · case 01
Optional job failures block the build.
Build status reduction: Optional job failures block the build · case 02
Optional job failures block the build.
Build status reduction: Optional job failures block the build · case 03
Optional job failures block the build.
Build status reduction: Optional job failures block the build · case 04
Optional job failures block the build.
Build status reduction: Optional job failures block the build · case 05
Optional job failures block the build.
Build status reduction: Required failures report success · case 01
Required failures report success.
Build status reduction: Required failures report success · case 02
Required failures report success.
Build status reduction: Required failures report success · case 03
Required failures report success.
Build status reduction: Required failures report success · case 04
Required failures report success.
Build status reduction: Required failures report success · case 05
Required failures report success.
Build status reduction: Cancelled required jobs count as success · case 01
Cancelled required jobs count as success.
Build status reduction: Cancelled required jobs count as success · case 02
Cancelled required jobs count as success.
Build status reduction: Cancelled required jobs count as success · case 03
Cancelled required jobs count as success.
Build status reduction: Cancelled required jobs count as success · case 04
Cancelled required jobs count as success.
Build status reduction: Cancelled required jobs count as success · case 05
Cancelled required jobs count as success.
Build status reduction: Pending prerequisites report active execution · case 01
Pending prerequisites report active execution.
Build status reduction: Pending prerequisites report active execution · case 02
Pending prerequisites report active execution.
Build status reduction: Pending prerequisites report active execution · case 03
Pending prerequisites report active execution.
Build status reduction: Pending prerequisites report active execution · case 04
Pending prerequisites report active execution.
Build status reduction: Pending prerequisites report active execution · case 05
Pending prerequisites report active execution.
Build status reduction: An active build reports completion · case 01
An active build reports completion.
Build status reduction: An active build reports completion · case 02
An active build reports completion.
Build status reduction: An active build reports completion · case 03
An active build reports completion.
Build status reduction: An active build reports completion · case 04
An active build reports completion.
Build status reduction: An active build reports completion · case 05
An active build reports completion.
Artifact identity tuple: Underscores split equivalent project identities · case 01
Underscores split equivalent project identities.
Artifact identity tuple: Underscores split equivalent project identities · case 02
Underscores split equivalent project identities.
Artifact identity tuple: Underscores split equivalent project identities · case 03
Underscores split equivalent project identities.
Artifact identity tuple: Underscores split equivalent project identities · case 04
Underscores split equivalent project identities.
Artifact identity tuple: Underscores split equivalent project identities · case 05
Underscores split equivalent project identities.
Artifact identity tuple: Patch versions collide · case 01
Patch versions collide.
Artifact identity tuple: Patch versions collide · case 02
Patch versions collide.
Artifact identity tuple: Patch versions collide · case 03
Patch versions collide.
Artifact identity tuple: Patch versions collide · case 04
Patch versions collide.
Artifact identity tuple: Patch versions collide · case 05
Patch versions collide.
Artifact identity tuple: ABI-specific artifacts collide · case 01
ABI-specific artifacts collide.
Artifact identity tuple: ABI-specific artifacts collide · case 02
ABI-specific artifacts collide.
Artifact identity tuple: ABI-specific artifacts collide · case 03
ABI-specific artifacts collide.
Artifact identity tuple: ABI-specific artifacts collide · case 04
ABI-specific artifacts collide.
Artifact identity tuple: ABI-specific artifacts collide · case 05
ABI-specific artifacts collide.
Artifact identity tuple: Debug and release artifacts collide · case 01
Debug and release artifacts collide.
Artifact identity tuple: Debug and release artifacts collide · case 02
Debug and release artifacts collide.
Artifact identity tuple: Debug and release artifacts collide · case 03
Debug and release artifacts collide.
Artifact identity tuple: Debug and release artifacts collide · case 04
Debug and release artifacts collide.
Artifact identity tuple: Debug and release artifacts collide · case 05
Debug and release artifacts collide.
Artifact identity tuple: Unclassified artifacts collide with classified artifacts · case 01
Unclassified artifacts collide with classified artifacts.
Artifact identity tuple: Unclassified artifacts collide with classified artifacts · case 02
Unclassified artifacts collide with classified artifacts.
Artifact identity tuple: Unclassified artifacts collide with classified artifacts · case 03
Unclassified artifacts collide with classified artifacts.
Artifact identity tuple: Unclassified artifacts collide with classified artifacts · case 04
Unclassified artifacts collide with classified artifacts.
Artifact identity tuple: Unclassified artifacts collide with classified artifacts · case 05
Unclassified artifacts collide with classified artifacts.
Compiler option precedence: Defaults override requested optimization · case 01
Defaults override requested optimization.
Compiler option precedence: Defaults override requested optimization · case 02
Defaults override requested optimization.
Compiler option precedence: Defaults override requested optimization · case 03
Defaults override requested optimization.
Compiler option precedence: Defaults override requested optimization · case 04
Defaults override requested optimization.
Compiler option precedence: Defaults override requested optimization · case 05
Defaults override requested optimization.
Compiler option precedence: Optimization options survive twice · case 01
Optimization options survive twice.
Compiler option precedence: Optimization options survive twice · case 02
Optimization options survive twice.
Compiler option precedence: Optimization options survive twice · case 03
Optimization options survive twice.
Compiler option precedence: Optimization options survive twice · case 04
Optimization options survive twice.
Compiler option precedence: Optimization options survive twice · case 05
Optimization options survive twice.
Compiler option precedence: Disabled warnings remain active · case 01
Disabled warnings remain active.
Compiler option precedence: Disabled warnings remain active · case 02
Disabled warnings remain active.
Compiler option precedence: Disabled warnings remain active · case 03
Disabled warnings remain active.
Compiler option precedence: Disabled warnings remain active · case 04
Disabled warnings remain active.
Compiler option precedence: Disabled warnings remain active · case 05
Disabled warnings remain active.
Compiler option precedence: The earliest optimization wins · case 01
The earliest optimization wins.
Compiler option precedence: The earliest optimization wins · case 02
The earliest optimization wins.
Compiler option precedence: The earliest optimization wins · case 03
The earliest optimization wins.
Compiler option precedence: The earliest optimization wins · case 04
The earliest optimization wins.
Compiler option precedence: The earliest optimization wins · case 05
The earliest optimization wins.
Compiler option precedence: Mandatory flags are appended repeatedly · case 01
Mandatory flags are appended repeatedly.
Compiler option precedence: Mandatory flags are appended repeatedly · case 02
Mandatory flags are appended repeatedly.
Compiler option precedence: Mandatory flags are appended repeatedly · case 03
Mandatory flags are appended repeatedly.
Compiler option precedence: Mandatory flags are appended repeatedly · case 04
Mandatory flags are appended repeatedly.
Compiler option precedence: Mandatory flags are appended repeatedly · case 05
Mandatory flags are appended repeatedly.
Direct rebuild trigger selection: Phony targets are incorrectly cached · case 01
Phony targets are incorrectly cached.
Direct rebuild trigger selection: Phony targets are incorrectly cached · case 02
Phony targets are incorrectly cached.
Direct rebuild trigger selection: Phony targets are incorrectly cached · case 03
Phony targets are incorrectly cached.
Direct rebuild trigger selection: Phony targets are incorrectly cached · case 04
Phony targets are incorrectly cached.
Direct rebuild trigger selection: Phony targets are incorrectly cached · case 05
Phony targets are incorrectly cached.
Direct rebuild trigger selection: A missing output does not trigger its producer · case 01
A missing output does not trigger its producer.
Direct rebuild trigger selection: A missing output does not trigger its producer · case 02
A missing output does not trigger its producer.
Direct rebuild trigger selection: A missing output does not trigger its producer · case 03
A missing output does not trigger its producer.
Direct rebuild trigger selection: A missing output does not trigger its producer · case 04
A missing output does not trigger its producer.
Direct rebuild trigger selection: A missing output does not trigger its producer · case 05
A missing output does not trigger its producer.
Direct rebuild trigger selection: Order-only changes trigger content rebuilds · case 01
Order-only changes trigger content rebuilds.
Direct rebuild trigger selection: Order-only changes trigger content rebuilds · case 02
Order-only changes trigger content rebuilds.
Direct rebuild trigger selection: Order-only changes trigger content rebuilds · case 03
Order-only changes trigger content rebuilds.
Direct rebuild trigger selection: Order-only changes trigger content rebuilds · case 04
Order-only changes trigger content rebuilds.
Direct rebuild trigger selection: Order-only changes trigger content rebuilds · case 05
Order-only changes trigger content rebuilds.
Direct rebuild trigger selection: Unchanged prerequisites trigger rebuilds · case 01
Unchanged prerequisites trigger rebuilds.
Direct rebuild trigger selection: Unchanged prerequisites trigger rebuilds · case 02
Unchanged prerequisites trigger rebuilds.
Direct rebuild trigger selection: Unchanged prerequisites trigger rebuilds · case 03
Unchanged prerequisites trigger rebuilds.
Direct rebuild trigger selection: Unchanged prerequisites trigger rebuilds · case 04
Unchanged prerequisites trigger rebuilds.
Direct rebuild trigger selection: Unchanged prerequisites trigger rebuilds · case 05
Unchanged prerequisites trigger rebuilds.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗