FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-6001

Vector dot product · case 01

The product of sums introduces cross-coordinate products.

Linear algebra● Open access↗
FA-6002

Vector dot product · case 02

The product of sums introduces cross-coordinate products.

Linear algebra◈ Members↗
FA-6003

Vector dot product · case 03

The product of sums introduces cross-coordinate products.

Linear algebra◈ Members↗
FA-6004

Vector dot product · case 04

The product of sums introduces cross-coordinate products.

Linear algebra◈ Members↗
FA-6005

Vector dot product · case 05

The product of sums introduces cross-coordinate products.

Linear algebra◈ Members↗
FA-6006

Vector hadamard product · case 01

Elementwise addition replaces multiplication.

Linear algebra● Open access↗
FA-6007

Vector hadamard product · case 02

Elementwise addition replaces multiplication.

Linear algebra◈ Members↗
FA-6008

Vector hadamard product · case 03

Elementwise addition replaces multiplication.

Linear algebra◈ Members↗
FA-6009

Vector hadamard product · case 04

Elementwise addition replaces multiplication.

Linear algebra◈ Members↗
FA-6010

Vector hadamard product · case 05

Elementwise addition replaces multiplication.

Linear algebra◈ Members↗
FA-6011

Three dimensional cross product · case 01

Symmetric sums replace antisymmetric determinant terms.

Linear algebra● Open access↗
FA-6012

Three dimensional cross product · case 02

Symmetric sums replace antisymmetric determinant terms.

Linear algebra◈ Members↗
FA-6013

Three dimensional cross product · case 03

Symmetric sums replace antisymmetric determinant terms.

Linear algebra◈ Members↗
FA-6014

Three dimensional cross product · case 04

Symmetric sums replace antisymmetric determinant terms.

Linear algebra◈ Members↗
FA-6015

Three dimensional cross product · case 05

Symmetric sums replace antisymmetric determinant terms.

Linear algebra◈ Members↗
FA-6016

Matrix two determinant · case 01

The off-diagonal product is added instead of subtracted.

Linear algebra● Open access↗
FA-6017

Matrix two determinant · case 02

The off-diagonal product is added instead of subtracted.

Linear algebra◈ Members↗
FA-6018

Matrix two determinant · case 03

The off-diagonal product is added instead of subtracted.

Linear algebra◈ Members↗
FA-6019

Matrix two determinant · case 04

The off-diagonal product is added instead of subtracted.

Linear algebra◈ Members↗
FA-6020

Matrix two determinant · case 05

The off-diagonal product is added instead of subtracted.

Linear algebra◈ Members↗
FA-6021

Matrix trace · case 01

Every matrix entry is summed rather than only the diagonal.

Linear algebra● Open access↗
FA-6022

Matrix trace · case 02

Every matrix entry is summed rather than only the diagonal.

Linear algebra◈ Members↗
FA-6023

Matrix trace · case 03

Every matrix entry is summed rather than only the diagonal.

Linear algebra◈ Members↗
FA-6024

Matrix trace · case 04

Every matrix entry is summed rather than only the diagonal.

Linear algebra◈ Members↗
FA-6025

Matrix trace · case 05

Every matrix entry is summed rather than only the diagonal.

Linear algebra◈ Members↗
FA-6026

Matrix transpose rectangular · case 01

Copying rows leaves row and column axes unchanged.

Linear algebra● Open access↗
FA-6027

Matrix transpose rectangular · case 02

Copying rows leaves row and column axes unchanged.

Linear algebra◈ Members↗
FA-6028

Matrix transpose rectangular · case 03

Copying rows leaves row and column axes unchanged.

Linear algebra◈ Members↗
FA-6029

Matrix transpose rectangular · case 04

Copying rows leaves row and column axes unchanged.

Linear algebra◈ Members↗
FA-6030

Matrix transpose rectangular · case 05

Copying rows leaves row and column axes unchanged.

Linear algebra◈ Members↗
FA-6031

Matrix vector product · case 01

Products between nonmatching coordinates contaminate each row.

Linear algebra● Open access↗
FA-6032

Matrix vector product · case 02

Products between nonmatching coordinates contaminate each row.

Linear algebra◈ Members↗
FA-6033

Matrix vector product · case 03

Products between nonmatching coordinates contaminate each row.

Linear algebra◈ Members↗
FA-6034

Matrix vector product · case 04

Products between nonmatching coordinates contaminate each row.

Linear algebra◈ Members↗
FA-6035

Matrix vector product · case 05

Products between nonmatching coordinates contaminate each row.

Linear algebra◈ Members↗
FA-6036

Matrix multiply row column · case 01

Rows of the right operand are used where columns are required.

Linear algebra● Open access↗
FA-6037

Matrix multiply row column · case 02

Rows of the right operand are used where columns are required.

Linear algebra◈ Members↗
FA-6038

Matrix multiply row column · case 03

Rows of the right operand are used where columns are required.

Linear algebra◈ Members↗
FA-6039

Matrix multiply row column · case 04

Rows of the right operand are used where columns are required.

Linear algebra◈ Members↗
FA-6040

Matrix multiply row column · case 05

Rows of the right operand are used where columns are required.

Linear algebra◈ Members↗
FA-6041

Outer product shape · case 01

The outer product axes are reversed.

Linear algebra● Open access↗
FA-6042

Outer product shape · case 02

The outer product axes are reversed.

Linear algebra◈ Members↗
FA-6043

Outer product shape · case 03

The outer product axes are reversed.

Linear algebra◈ Members↗
FA-6044

Outer product shape · case 04

The outer product axes are reversed.

Linear algebra◈ Members↗
FA-6045

Outer product shape · case 05

The outer product axes are reversed.

Linear algebra◈ Members↗
FA-6046

Matrix frobenius norm squared · case 01

Squaring a total introduces cancellation and cross terms.

Linear algebra● Open access↗
FA-6047

Matrix frobenius norm squared · case 02

Squaring a total introduces cancellation and cross terms.

Linear algebra◈ Members↗
FA-6048

Matrix frobenius norm squared · case 03

Squaring a total introduces cancellation and cross terms.

Linear algebra◈ Members↗
FA-6049

Matrix frobenius norm squared · case 04

Squaring a total introduces cancellation and cross terms.

Linear algebra◈ Members↗
FA-6050

Matrix frobenius norm squared · case 05

Squaring a total introduces cancellation and cross terms.

Linear algebra◈ Members↗
FA-6051

Matrix one norm · case 01

Maximum row sum computes the infinity norm.

Linear algebra● Open access↗
FA-6052

Matrix one norm · case 02

Maximum row sum computes the infinity norm.

Linear algebra◈ Members↗
FA-6053

Matrix one norm · case 03

Maximum row sum computes the infinity norm.

Linear algebra◈ Members↗
FA-6054

Matrix one norm · case 04

Maximum row sum computes the infinity norm.

Linear algebra◈ Members↗
FA-6055

Matrix one norm · case 05

Maximum row sum computes the infinity norm.

Linear algebra◈ Members↗
FA-6056

Matrix infinity norm · case 01

Maximum column sum computes the one-norm.

Linear algebra● Open access↗
FA-6057

Matrix infinity norm · case 02

Maximum column sum computes the one-norm.

Linear algebra◈ Members↗
FA-6058

Matrix infinity norm · case 03

Maximum column sum computes the one-norm.

Linear algebra◈ Members↗
FA-6059

Matrix infinity norm · case 04

Maximum column sum computes the one-norm.

Linear algebra◈ Members↗
FA-6060

Matrix infinity norm · case 05

Maximum column sum computes the one-norm.

Linear algebra◈ Members↗
FA-6061

Two by two adjugate · case 01

Off-diagonal cofactors lack negative signs.

Linear algebra● Open access↗
FA-6062

Two by two adjugate · case 02

Off-diagonal cofactors lack negative signs.

Linear algebra◈ Members↗
FA-6063

Two by two adjugate · case 03

Off-diagonal cofactors lack negative signs.

Linear algebra◈ Members↗
FA-6064

Two by two adjugate · case 04

Off-diagonal cofactors lack negative signs.

Linear algebra◈ Members↗
FA-6065

Two by two adjugate · case 05

Off-diagonal cofactors lack negative signs.

Linear algebra◈ Members↗
FA-6066

Two by two inverse rational · case 01

The adjugate is not divided by the determinant.

Linear algebra● Open access↗
FA-6067

Two by two inverse rational · case 02

The adjugate is not divided by the determinant.

Linear algebra◈ Members↗
FA-6068

Two by two inverse rational · case 03

The adjugate is not divided by the determinant.

Linear algebra◈ Members↗
FA-6069

Two by two inverse rational · case 04

The adjugate is not divided by the determinant.

Linear algebra◈ Members↗
FA-6070

Two by two inverse rational · case 05

The adjugate is not divided by the determinant.

Linear algebra◈ Members↗
FA-6071

Matrix symmetry predicate · case 01

Diagonal positivity is unrelated to transpose symmetry.

Linear algebra● Open access↗
FA-6072

Matrix symmetry predicate · case 02

Diagonal positivity is unrelated to transpose symmetry.

Linear algebra◈ Members↗
FA-6073

Matrix symmetry predicate · case 03

Diagonal positivity is unrelated to transpose symmetry.

Linear algebra◈ Members↗
FA-6074

Matrix symmetry predicate · case 04

Diagonal positivity is unrelated to transpose symmetry.

Linear algebra◈ Members↗
FA-6075

Matrix symmetry predicate · case 05

Diagonal positivity is unrelated to transpose symmetry.

Linear algebra◈ Members↗
FA-6076

Matrix diagonal predicate · case 01

Nonzero diagonal entries do not constrain off-diagonal entries.

Linear algebra● Open access↗
FA-6077

Matrix diagonal predicate · case 02

Nonzero diagonal entries do not constrain off-diagonal entries.

Linear algebra◈ Members↗
FA-6078

Matrix diagonal predicate · case 03

Nonzero diagonal entries do not constrain off-diagonal entries.

Linear algebra◈ Members↗
FA-6079

Matrix diagonal predicate · case 04

Nonzero diagonal entries do not constrain off-diagonal entries.

Linear algebra◈ Members↗
FA-6080

Matrix diagonal predicate · case 05

Nonzero diagonal entries do not constrain off-diagonal entries.

Linear algebra◈ Members↗
FA-6081

Two by two characteristic coefficients · case 01

The trace coefficient has the wrong sign.

Linear algebra● Open access↗
FA-6082

Two by two characteristic coefficients · case 02

The trace coefficient has the wrong sign.

Linear algebra◈ Members↗
FA-6083

Two by two characteristic coefficients · case 03

The trace coefficient has the wrong sign.

Linear algebra◈ Members↗
FA-6084

Two by two characteristic coefficients · case 04

The trace coefficient has the wrong sign.

Linear algebra◈ Members↗
FA-6085

Two by two characteristic coefficients · case 05

The trace coefficient has the wrong sign.

Linear algebra◈ Members↗
FA-6086

Orthogonality zero dot · case 01

Zero coordinate sum is confused with zero mutual dot product.

Linear algebra● Open access↗
FA-6087

Orthogonality zero dot · case 02

Zero coordinate sum is confused with zero mutual dot product.

Linear algebra◈ Members↗
FA-6088

Orthogonality zero dot · case 03

Zero coordinate sum is confused with zero mutual dot product.

Linear algebra◈ Members↗
FA-6089

Orthogonality zero dot · case 04

Zero coordinate sum is confused with zero mutual dot product.

Linear algebra◈ Members↗
FA-6090

Orthogonality zero dot · case 05

Zero coordinate sum is confused with zero mutual dot product.

Linear algebra◈ Members↗
FA-6091

Two dimensional affine transform · case 01

The homogeneous translation column is omitted.

Linear algebra● Open access↗
FA-6092

Two dimensional affine transform · case 02

The homogeneous translation column is omitted.

Linear algebra◈ Members↗
FA-6093

Two dimensional affine transform · case 03

The homogeneous translation column is omitted.

Linear algebra◈ Members↗
FA-6094

Two dimensional affine transform · case 04

The homogeneous translation column is omitted.

Linear algebra◈ Members↗
FA-6095

Two dimensional affine transform · case 05

The homogeneous translation column is omitted.

Linear algebra◈ Members↗
FA-6096

Three dimensional scalar triple product · case 01

Coordinatewise triple multiplication omits determinant permutations.

Linear algebra● Open access↗
FA-6097

Three dimensional scalar triple product · case 02

Coordinatewise triple multiplication omits determinant permutations.

Linear algebra◈ Members↗
FA-6098

Three dimensional scalar triple product · case 03

Coordinatewise triple multiplication omits determinant permutations.

Linear algebra◈ Members↗
FA-6099

Three dimensional scalar triple product · case 04

Coordinatewise triple multiplication omits determinant permutations.

Linear algebra◈ Members↗
FA-6100

Three dimensional scalar triple product · case 05

Coordinatewise triple multiplication omits determinant permutations.

Linear algebra◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗