Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Aircraft exactly on a limit asked to carry ballast · case 01
A CG exactly on the forward or aft limit produces a nonzero ballast or an error.
Aircraft exactly on a limit asked to carry ballast · case 02
A CG exactly on the forward or aft limit produces a nonzero ballast or an error.
Aircraft exactly on a limit asked to carry ballast · case 03
A CG exactly on the forward or aft limit produces a nonzero ballast or an error.
Aircraft exactly on a limit asked to carry ballast · case 04
A CG exactly on the forward or aft limit produces a nonzero ballast or an error.
Aircraft exactly on a limit asked to carry ballast · case 05
A CG exactly on the forward or aft limit produces a nonzero ballast or an error.
Overweight check ignores the added ballast · case 01
Ballast that pushes the aircraft over maximum weight is approved.
Overweight check ignores the added ballast · case 02
Ballast that pushes the aircraft over maximum weight is approved.
Overweight check ignores the added ballast · case 03
Ballast that pushes the aircraft over maximum weight is approved.
Overweight check ignores the added ballast · case 04
Ballast that pushes the aircraft over maximum weight is approved.
Overweight check ignores the added ballast · case 05
Ballast that pushes the aircraft over maximum weight is approved.
Summer and winter standard weights transposed · case 01
Winter loadsheets are lighter than summer ones for the same passenger count.
Summer and winter standard weights transposed · case 02
Winter loadsheets are lighter than summer ones for the same passenger count.
Summer and winter standard weights transposed · case 03
Winter loadsheets are lighter than summer ones for the same passenger count.
Summer and winter standard weights transposed · case 04
Winter loadsheets are lighter than summer ones for the same passenger count.
Summer and winter standard weights transposed · case 05
Winter loadsheets are lighter than summer ones for the same passenger count.
Lap infants charged at the child standard weight · case 01
Rows with lap infants report extra weight that is already included in the adult standard.
Lap infants charged at the child standard weight · case 02
Rows with lap infants report extra weight that is already included in the adult standard.
Lap infants charged at the child standard weight · case 03
Rows with lap infants report extra weight that is already included in the adult standard.
Lap infants charged at the child standard weight · case 04
Rows with lap infants report extra weight that is already included in the adult standard.
Lap infants charged at the child standard weight · case 05
Rows with lap infants report extra weight that is already included in the adult standard.
Children counted as lap-infant carriers · case 01
A row with one adult, one child and two lap infants is accepted.
Children counted as lap-infant carriers · case 02
A row with one adult, one child and two lap infants is accepted.
Children counted as lap-infant carriers · case 03
A row with one adult, one child and two lap infants is accepted.
Children counted as lap-infant carriers · case 04
A row with one adult, one child and two lap infants is accepted.
Children counted as lap-infant carriers · case 05
A row with one adult, one child and two lap infants is accepted.
Lap infants consume seats in the capacity check · case 01
A full row of three adults each holding an infant is rejected for seat capacity.
Lap infants consume seats in the capacity check · case 02
A full row of three adults each holding an infant is rejected for seat capacity.
Lap infants consume seats in the capacity check · case 03
A full row of three adults each holding an infant is rejected for seat capacity.
Lap infants consume seats in the capacity check · case 04
A full row of three adults each holding an infant is rejected for seat capacity.
Lap infants consume seats in the capacity check · case 05
A full row of three adults each holding an infant is rejected for seat capacity.
Baggage moment computed from bag count · case 01
Bag weight appears in the total but the hold barely moves the moment.
Baggage moment computed from bag count · case 02
Bag weight appears in the total but the hold barely moves the moment.
Baggage moment computed from bag count · case 03
Bag weight appears in the total but the hold barely moves the moment.
Baggage moment computed from bag count · case 04
Bag weight appears in the total but the hold barely moves the moment.
Baggage moment computed from bag count · case 05
Bag weight appears in the total but the hold barely moves the moment.
Row errors reported with zero-based row numbers · case 01
The cabin crew are told to fix row 0, or the row in front of the actual problem row.
Row errors reported with zero-based row numbers · case 02
The cabin crew are told to fix row 0, or the row in front of the actual problem row.
Row errors reported with zero-based row numbers · case 03
The cabin crew are told to fix row 0, or the row in front of the actual problem row.
Row errors reported with zero-based row numbers · case 04
The cabin crew are told to fix row 0, or the row in front of the actual problem row.
Row errors reported with zero-based row numbers · case 05
The cabin crew are told to fix row 0, or the row in front of the actual problem row.
Burned fuel moment added instead of removed · case 01
Landing CG moves the wrong way as fuel is used and ends far aft.
Burned fuel moment added instead of removed · case 02
Landing CG moves the wrong way as fuel is used and ends far aft.
Burned fuel moment added instead of removed · case 03
Landing CG moves the wrong way as fuel is used and ends far aft.
Burned fuel moment added instead of removed · case 04
Landing CG moves the wrong way as fuel is used and ends far aft.
Burned fuel moment added instead of removed · case 05
Landing CG moves the wrong way as fuel is used and ends far aft.
Landing weight subtracts gallons from pounds · case 01
Landing weight is barely below takeoff weight and MLW exceedances are reported after long flights.
Landing weight subtracts gallons from pounds · case 02
Landing weight is barely below takeoff weight and MLW exceedances are reported after long flights.
Landing weight subtracts gallons from pounds · case 03
Landing weight is barely below takeoff weight and MLW exceedances are reported after long flights.
Landing weight subtracts gallons from pounds · case 04
Landing weight is barely below takeoff weight and MLW exceedances are reported after long flights.
Landing weight subtracts gallons from pounds · case 05
Landing weight is barely below takeoff weight and MLW exceedances are reported after long flights.
Landing moment divided by takeoff weight · case 01
Landing CG is systematically forward and grows worse with longer flights.
Landing moment divided by takeoff weight · case 02
Landing CG is systematically forward and grows worse with longer flights.
Landing moment divided by takeoff weight · case 03
Landing CG is systematically forward and grows worse with longer flights.
Landing moment divided by takeoff weight · case 04
Landing CG is systematically forward and grows worse with longer flights.
Landing moment divided by takeoff weight · case 05
Landing CG is systematically forward and grows worse with longer flights.
Landing exactly at MLW flagged as overweight · case 01
A flight planned to land at exactly the maximum landing weight is reported MLW.
Landing exactly at MLW flagged as overweight · case 02
A flight planned to land at exactly the maximum landing weight is reported MLW.
Landing exactly at MLW flagged as overweight · case 03
A flight planned to land at exactly the maximum landing weight is reported MLW.
Landing exactly at MLW flagged as overweight · case 04
A flight planned to land at exactly the maximum landing weight is reported MLW.
Landing exactly at MLW flagged as overweight · case 05
A flight planned to land at exactly the maximum landing weight is reported MLW.
Landing status tests the takeoff CG · case 01
A takeoff CG inside limits is reported OK even when the burn drives the landing CG out.
Landing status tests the takeoff CG · case 02
A takeoff CG inside limits is reported OK even when the burn drives the landing CG out.
Landing status tests the takeoff CG · case 03
A takeoff CG inside limits is reported OK even when the burn drives the landing CG out.
Landing status tests the takeoff CG · case 04
A takeoff CG inside limits is reported OK even when the burn drives the landing CG out.
Landing status tests the takeoff CG · case 05
A takeoff CG inside limits is reported OK even when the burn drives the landing CG out.
Last burn step removes more fuel than the tank holds · case 01
Tanks whose quantity is not a multiple of the step size end with negative fuel and a skewed final CG.
Last burn step removes more fuel than the tank holds · case 02
Tanks whose quantity is not a multiple of the step size end with negative fuel and a skewed final CG.
Last burn step removes more fuel than the tank holds · case 03
Tanks whose quantity is not a multiple of the step size end with negative fuel and a skewed final CG.
Last burn step removes more fuel than the tank holds · case 04
Tanks whose quantity is not a multiple of the step size end with negative fuel and a skewed final CG.
Last burn step removes more fuel than the tank holds · case 05
Tanks whose quantity is not a multiple of the step size end with negative fuel and a skewed final CG.
CG excursion ignores the takeoff condition · case 01
When the most aft CG occurs at takeoff, the reported maximum is the first in-flight sample instead.
CG excursion ignores the takeoff condition · case 02
When the most aft CG occurs at takeoff, the reported maximum is the first in-flight sample instead.
CG excursion ignores the takeoff condition · case 03
When the most aft CG occurs at takeoff, the reported maximum is the first in-flight sample instead.
CG excursion ignores the takeoff condition · case 04
When the most aft CG occurs at takeoff, the reported maximum is the first in-flight sample instead.
CG excursion ignores the takeoff condition · case 05
When the most aft CG occurs at takeoff, the reported maximum is the first in-flight sample instead.
Fuel in unlisted tanks dropped from the aircraft · case 01
A full tip tank that is not in the burn order disappears from the CG trajectory.
Fuel in unlisted tanks dropped from the aircraft · case 02
A full tip tank that is not in the burn order disappears from the CG trajectory.
Fuel in unlisted tanks dropped from the aircraft · case 03
A full tip tank that is not in the burn order disappears from the CG trajectory.
Fuel in unlisted tanks dropped from the aircraft · case 04
A full tip tank that is not in the burn order disappears from the CG trajectory.
Fuel in unlisted tanks dropped from the aircraft · case 05
A full tip tank that is not in the burn order disappears from the CG trajectory.
Per-step moment removal omits fuel density · case 01
The CG drifts steadily in one direction during burn regardless of tank location.
Per-step moment removal omits fuel density · case 02
The CG drifts steadily in one direction during burn regardless of tank location.
Per-step moment removal omits fuel density · case 03
The CG drifts steadily in one direction during burn regardless of tank location.
Per-step moment removal omits fuel density · case 04
The CG drifts steadily in one direction during burn regardless of tank location.
Per-step moment removal omits fuel density · case 05
The CG drifts steadily in one direction during burn regardless of tank location.
A tank repeated in the order is burned twice · case 01
Listing a tank again after it was emptied burns its original quantity a second time.
A tank repeated in the order is burned twice · case 02
Listing a tank again after it was emptied burns its original quantity a second time.
A tank repeated in the order is burned twice · case 03
Listing a tank again after it was emptied burns its original quantity a second time.
A tank repeated in the order is burned twice · case 04
Listing a tank again after it was emptied burns its original quantity a second time.
A tank repeated in the order is burned twice · case 05
Listing a tank again after it was emptied burns its original quantity a second time.
Millimetre arms converted as centimetres · case 01
Items documented in millimetres land ten times further aft than their real station.
Millimetre arms converted as centimetres · case 02
Items documented in millimetres land ten times further aft than their real station.
Millimetre arms converted as centimetres · case 03
Items documented in millimetres land ten times further aft than their real station.
Millimetre arms converted as centimetres · case 04
Items documented in millimetres land ten times further aft than their real station.
Millimetre arms converted as centimetres · case 05
Items documented in millimetres land ten times further aft than their real station.
Kilograms divided instead of multiplied by the pound factor · case 01
Metric-documented items weigh less than half their real value in pounds.
Kilograms divided instead of multiplied by the pound factor · case 02
Metric-documented items weigh less than half their real value in pounds.
Kilograms divided instead of multiplied by the pound factor · case 03
Metric-documented items weigh less than half their real value in pounds.
Kilograms divided instead of multiplied by the pound factor · case 04
Metric-documented items weigh less than half their real value in pounds.
Kilograms divided instead of multiplied by the pound factor · case 05
Metric-documented items weigh less than half their real value in pounds.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗