FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-1601

Nullable predicate: Compares NULL with ordinary equality · case 01

The query violates its result contract: compares null with ordinary equality.

Relational algebra● Open access↗
FA-1602

Nullable predicate: Compares NULL with ordinary equality · case 02

The query violates its result contract: compares null with ordinary equality.

Relational algebra◈ Members↗
FA-1603

Nullable predicate: Compares NULL with ordinary equality · case 03

The query violates its result contract: compares null with ordinary equality.

Relational algebra◈ Members↗
FA-1604

Nullable predicate: Compares NULL with ordinary equality · case 04

The query violates its result contract: compares null with ordinary equality.

Relational algebra◈ Members↗
FA-1605

Nullable predicate: Compares NULL with ordinary equality · case 05

The query violates its result contract: compares null with ordinary equality.

Relational algebra◈ Members↗
FA-1606

Nullable predicate: Negates unknown equality expecting a Boolean · case 01

The query violates its result contract: negates unknown equality expecting a boolean.

Relational algebra● Open access↗
FA-1607

Nullable predicate: Negates unknown equality expecting a Boolean · case 02

The query violates its result contract: negates unknown equality expecting a boolean.

Relational algebra◈ Members↗
FA-1608

Nullable predicate: Negates unknown equality expecting a Boolean · case 03

The query violates its result contract: negates unknown equality expecting a boolean.

Relational algebra◈ Members↗
FA-1609

Nullable predicate: Negates unknown equality expecting a Boolean · case 04

The query violates its result contract: negates unknown equality expecting a boolean.

Relational algebra◈ Members↗
FA-1610

Nullable predicate: Negates unknown equality expecting a Boolean · case 05

The query violates its result contract: negates unknown equality expecting a boolean.

Relational algebra◈ Members↗
FA-1611

Nullable predicate: Treats a measured zero as missing · case 01

The query violates its result contract: treats a measured zero as missing.

Relational algebra● Open access↗
FA-1612

Nullable predicate: Treats a measured zero as missing · case 02

The query violates its result contract: treats a measured zero as missing.

Relational algebra◈ Members↗
FA-1613

Nullable predicate: Treats a measured zero as missing · case 03

The query violates its result contract: treats a measured zero as missing.

Relational algebra◈ Members↗
FA-1614

Nullable predicate: Treats a measured zero as missing · case 04

The query violates its result contract: treats a measured zero as missing.

Relational algebra◈ Members↗
FA-1615

Nullable predicate: Treats a measured zero as missing · case 05

The query violates its result contract: treats a measured zero as missing.

Relational algebra◈ Members↗
FA-1616

Nullable predicate: Uses the inverse NULL predicate · case 01

The query violates its result contract: uses the inverse null predicate.

Relational algebra● Open access↗
FA-1617

Nullable predicate: Uses the inverse NULL predicate · case 02

The query violates its result contract: uses the inverse null predicate.

Relational algebra◈ Members↗
FA-1618

Nullable predicate: Uses the inverse NULL predicate · case 03

The query violates its result contract: uses the inverse null predicate.

Relational algebra◈ Members↗
FA-1619

Nullable predicate: Uses the inverse NULL predicate · case 04

The query violates its result contract: uses the inverse null predicate.

Relational algebra◈ Members↗
FA-1620

Nullable predicate: Uses the inverse NULL predicate · case 05

The query violates its result contract: uses the inverse null predicate.

Relational algebra◈ Members↗
FA-1621

Nullable predicate: Tests the nullable flag instead of the measurement · case 01

The query violates its result contract: tests the nullable flag instead of the measurement.

Relational algebra● Open access↗
FA-1622

Nullable predicate: Tests the nullable flag instead of the measurement · case 02

The query violates its result contract: tests the nullable flag instead of the measurement.

Relational algebra◈ Members↗
FA-1623

Nullable predicate: Tests the nullable flag instead of the measurement · case 03

The query violates its result contract: tests the nullable flag instead of the measurement.

Relational algebra◈ Members↗
FA-1624

Nullable predicate: Tests the nullable flag instead of the measurement · case 04

The query violates its result contract: tests the nullable flag instead of the measurement.

Relational algebra◈ Members↗
FA-1625

Nullable predicate: Tests the nullable flag instead of the measurement · case 05

The query violates its result contract: tests the nullable flag instead of the measurement.

Relational algebra◈ Members↗
FA-1626

Truth selection: Restricts truth to the literal one · case 01

The query violates its result contract: restricts truth to the literal one.

Relational algebra● Open access↗
FA-1627

Truth selection: Restricts truth to the literal one · case 02

The query violates its result contract: restricts truth to the literal one.

Relational algebra◈ Members↗
FA-1628

Truth selection: Restricts truth to the literal one · case 03

The query violates its result contract: restricts truth to the literal one.

Relational algebra◈ Members↗
FA-1629

Truth selection: Restricts truth to the literal one · case 04

The query violates its result contract: restricts truth to the literal one.

Relational algebra◈ Members↗
FA-1630

Truth selection: Restricts truth to the literal one · case 05

The query violates its result contract: restricts truth to the literal one.

Relational algebra◈ Members↗
FA-1631

Truth selection: Confuses known false with true · case 01

The query violates its result contract: confuses known false with true.

Relational algebra● Open access↗
FA-1632

Truth selection: Confuses known false with true · case 02

The query violates its result contract: confuses known false with true.

Relational algebra◈ Members↗
FA-1633

Truth selection: Confuses known false with true · case 03

The query violates its result contract: confuses known false with true.

Relational algebra◈ Members↗
FA-1634

Truth selection: Confuses known false with true · case 04

The query violates its result contract: confuses known false with true.

Relational algebra◈ Members↗
FA-1635

Truth selection: Confuses known false with true · case 05

The query violates its result contract: confuses known false with true.

Relational algebra◈ Members↗
FA-1636

Truth selection: Defaults unknown flags to true · case 01

The query violates its result contract: defaults unknown flags to true.

Relational algebra● Open access↗
FA-1637

Truth selection: Defaults unknown flags to true · case 02

The query violates its result contract: defaults unknown flags to true.

Relational algebra◈ Members↗
FA-1638

Truth selection: Defaults unknown flags to true · case 03

The query violates its result contract: defaults unknown flags to true.

Relational algebra◈ Members↗
FA-1639

Truth selection: Defaults unknown flags to true · case 04

The query violates its result contract: defaults unknown flags to true.

Relational algebra◈ Members↗
FA-1640

Truth selection: Defaults unknown flags to true · case 05

The query violates its result contract: defaults unknown flags to true.

Relational algebra◈ Members↗
FA-1641

Truth selection: Selects false flags instead of true · case 01

The query violates its result contract: selects false flags instead of true.

Relational algebra● Open access↗
FA-1642

Truth selection: Selects false flags instead of true · case 02

The query violates its result contract: selects false flags instead of true.

Relational algebra◈ Members↗
FA-1643

Truth selection: Selects false flags instead of true · case 03

The query violates its result contract: selects false flags instead of true.

Relational algebra◈ Members↗
FA-1644

Truth selection: Selects false flags instead of true · case 04

The query violates its result contract: selects false flags instead of true.

Relational algebra◈ Members↗
FA-1645

Truth selection: Selects false flags instead of true · case 05

The query violates its result contract: selects false flags instead of true.

Relational algebra◈ Members↗
FA-1646

Truth selection: Rejects negative integers that SQL treats as true · case 01

The query violates its result contract: rejects negative integers that sql treats as true.

Relational algebra● Open access↗
FA-1647

Truth selection: Rejects negative integers that SQL treats as true · case 02

The query violates its result contract: rejects negative integers that sql treats as true.

Relational algebra◈ Members↗
FA-1648

Truth selection: Rejects negative integers that SQL treats as true · case 03

The query violates its result contract: rejects negative integers that sql treats as true.

Relational algebra◈ Members↗
FA-1649

Truth selection: Rejects negative integers that SQL treats as true · case 04

The query violates its result contract: rejects negative integers that sql treats as true.

Relational algebra◈ Members↗
FA-1650

Truth selection: Rejects negative integers that SQL treats as true · case 05

The query violates its result contract: rejects negative integers that sql treats as true.

Relational algebra◈ Members↗
FA-1651

Not true selection: Boolean NOT discards unknown flags · case 01

The query violates its result contract: boolean not discards unknown flags.

Relational algebra● Open access↗
FA-1652

Not true selection: Boolean NOT discards unknown flags · case 02

The query violates its result contract: boolean not discards unknown flags.

Relational algebra◈ Members↗
FA-1653

Not true selection: Boolean NOT discards unknown flags · case 03

The query violates its result contract: boolean not discards unknown flags.

Relational algebra◈ Members↗
FA-1654

Not true selection: Boolean NOT discards unknown flags · case 04

The query violates its result contract: boolean not discards unknown flags.

Relational algebra◈ Members↗
FA-1655

Not true selection: Boolean NOT discards unknown flags · case 05

The query violates its result contract: boolean not discards unknown flags.

Relational algebra◈ Members↗
FA-1656

Not true selection: Drops known false flags · case 01

The query violates its result contract: drops known false flags.

Relational algebra● Open access↗
FA-1657

Not true selection: Drops known false flags · case 02

The query violates its result contract: drops known false flags.

Relational algebra◈ Members↗
FA-1658

Not true selection: Drops known false flags · case 03

The query violates its result contract: drops known false flags.

Relational algebra◈ Members↗
FA-1659

Not true selection: Drops known false flags · case 04

The query violates its result contract: drops known false flags.

Relational algebra◈ Members↗
FA-1660

Not true selection: Drops known false flags · case 05

The query violates its result contract: drops known false flags.

Relational algebra◈ Members↗
FA-1661

Not true selection: Interprets true as the literal one · case 01

The query violates its result contract: interprets true as the literal one.

Relational algebra● Open access↗
FA-1662

Not true selection: Interprets true as the literal one · case 02

The query violates its result contract: interprets true as the literal one.

Relational algebra◈ Members↗
FA-1663

Not true selection: Interprets true as the literal one · case 03

The query violates its result contract: interprets true as the literal one.

Relational algebra◈ Members↗
FA-1664

Not true selection: Interprets true as the literal one · case 04

The query violates its result contract: interprets true as the literal one.

Relational algebra◈ Members↗
FA-1665

Not true selection: Interprets true as the literal one · case 05

The query violates its result contract: interprets true as the literal one.

Relational algebra◈ Members↗
FA-1666

Not true selection: Defaults unknown flags to true before inversion · case 01

The query violates its result contract: defaults unknown flags to true before inversion.

Relational algebra● Open access↗
FA-1667

Not true selection: Defaults unknown flags to true before inversion · case 02

The query violates its result contract: defaults unknown flags to true before inversion.

Relational algebra◈ Members↗
FA-1668

Not true selection: Defaults unknown flags to true before inversion · case 03

The query violates its result contract: defaults unknown flags to true before inversion.

Relational algebra◈ Members↗
FA-1669

Not true selection: Defaults unknown flags to true before inversion · case 04

The query violates its result contract: defaults unknown flags to true before inversion.

Relational algebra◈ Members↗
FA-1670

Not true selection: Defaults unknown flags to true before inversion · case 05

The query violates its result contract: defaults unknown flags to true before inversion.

Relational algebra◈ Members↗
FA-1671

Not true selection: Treats negative true flags as false · case 01

The query violates its result contract: treats negative true flags as false.

Relational algebra● Open access↗
FA-1672

Not true selection: Treats negative true flags as false · case 02

The query violates its result contract: treats negative true flags as false.

Relational algebra◈ Members↗
FA-1673

Not true selection: Treats negative true flags as false · case 03

The query violates its result contract: treats negative true flags as false.

Relational algebra◈ Members↗
FA-1674

Not true selection: Treats negative true flags as false · case 04

The query violates its result contract: treats negative true flags as false.

Relational algebra◈ Members↗
FA-1675

Not true selection: Treats negative true flags as false · case 05

The query violates its result contract: treats negative true flags as false.

Relational algebra◈ Members↗
FA-1676

Closed range: Excludes the inclusive lower bound · case 01

The query violates its result contract: excludes the inclusive lower bound.

Relational algebra● Open access↗
FA-1677

Closed range: Excludes the inclusive lower bound · case 02

The query violates its result contract: excludes the inclusive lower bound.

Relational algebra◈ Members↗
FA-1678

Closed range: Excludes the inclusive lower bound · case 03

The query violates its result contract: excludes the inclusive lower bound.

Relational algebra◈ Members↗
FA-1679

Closed range: Excludes the inclusive lower bound · case 04

The query violates its result contract: excludes the inclusive lower bound.

Relational algebra◈ Members↗
FA-1680

Closed range: Excludes the inclusive lower bound · case 05

The query violates its result contract: excludes the inclusive lower bound.

Relational algebra◈ Members↗
FA-1681

Closed range: Excludes the inclusive upper bound · case 01

The query violates its result contract: excludes the inclusive upper bound.

Relational algebra● Open access↗
FA-1682

Closed range: Excludes the inclusive upper bound · case 02

The query violates its result contract: excludes the inclusive upper bound.

Relational algebra◈ Members↗
FA-1683

Closed range: Excludes the inclusive upper bound · case 03

The query violates its result contract: excludes the inclusive upper bound.

Relational algebra◈ Members↗
FA-1684

Closed range: Excludes the inclusive upper bound · case 04

The query violates its result contract: excludes the inclusive upper bound.

Relational algebra◈ Members↗
FA-1685

Closed range: Excludes the inclusive upper bound · case 05

The query violates its result contract: excludes the inclusive upper bound.

Relational algebra◈ Members↗
FA-1686

Closed range: Uses OR between the two range constraints · case 01

The query violates its result contract: uses or between the two range constraints.

Relational algebra● Open access↗
FA-1687

Closed range: Uses OR between the two range constraints · case 02

The query violates its result contract: uses or between the two range constraints.

Relational algebra◈ Members↗
FA-1688

Closed range: Uses OR between the two range constraints · case 03

The query violates its result contract: uses or between the two range constraints.

Relational algebra◈ Members↗
FA-1689

Closed range: Uses OR between the two range constraints · case 04

The query violates its result contract: uses or between the two range constraints.

Relational algebra◈ Members↗
FA-1690

Closed range: Uses OR between the two range constraints · case 05

The query violates its result contract: uses or between the two range constraints.

Relational algebra◈ Members↗
FA-1691

Closed range: Supplies upper bound before lower bound · case 01

The query violates its result contract: supplies upper bound before lower bound.

Relational algebra● Open access↗
FA-1692

Closed range: Supplies upper bound before lower bound · case 02

The query violates its result contract: supplies upper bound before lower bound.

Relational algebra◈ Members↗
FA-1693

Closed range: Supplies upper bound before lower bound · case 03

The query violates its result contract: supplies upper bound before lower bound.

Relational algebra◈ Members↗
FA-1694

Closed range: Supplies upper bound before lower bound · case 04

The query violates its result contract: supplies upper bound before lower bound.

Relational algebra◈ Members↗
FA-1695

Closed range: Supplies upper bound before lower bound · case 05

The query violates its result contract: supplies upper bound before lower bound.

Relational algebra◈ Members↗
FA-1696

Closed range: Coalesces missing values into the range · case 01

The query violates its result contract: coalesces missing values into the range.

Relational algebra● Open access↗
FA-1697

Closed range: Coalesces missing values into the range · case 02

The query violates its result contract: coalesces missing values into the range.

Relational algebra◈ Members↗
FA-1698

Closed range: Coalesces missing values into the range · case 03

The query violates its result contract: coalesces missing values into the range.

Relational algebra◈ Members↗
FA-1699

Closed range: Coalesces missing values into the range · case 04

The query violates its result contract: coalesces missing values into the range.

Relational algebra◈ Members↗
FA-1700

Closed range: Coalesces missing values into the range · case 05

The query violates its result contract: coalesces missing values into the range.

Relational algebra◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗