Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Shuffle preserves playing head · case 01
Shuffling replaces the playing entry with the first random candidate.
Shuffle preserves playing head · case 02
Shuffling replaces the playing entry with the first random candidate.
Shuffle preserves playing head · case 03
Shuffling replaces the playing entry with the first random candidate.
Shuffle preserves playing head · case 04
Shuffling replaces the playing entry with the first random candidate.
Shuffle preserves playing head · case 05
Shuffling replaces the playing entry with the first random candidate.
Manifest merge by sequence · case 01
Appending a refreshed manifest duplicates overlapping sequence numbers.
Manifest merge by sequence · case 02
Appending a refreshed manifest duplicates overlapping sequence numbers.
Manifest merge by sequence · case 03
Appending a refreshed manifest duplicates overlapping sequence numbers.
Manifest merge by sequence · case 04
Appending a refreshed manifest duplicates overlapping sequence numbers.
Manifest merge by sequence · case 05
Appending a refreshed manifest duplicates overlapping sequence numbers.
Live window prune absolute sequence · case 01
An absolute sequence number is applied as a local array slice offset.
Live window prune absolute sequence · case 02
An absolute sequence number is applied as a local array slice offset.
Live window prune absolute sequence · case 03
An absolute sequence number is applied as a local array slice offset.
Live window prune absolute sequence · case 04
An absolute sequence number is applied as a local array slice offset.
Live window prune absolute sequence · case 05
An absolute sequence number is applied as a local array slice offset.
Discontinuity base increments on prune · case 01
A sliding manifest window loses discontinuity history when old segments disappear.
Discontinuity base increments on prune · case 02
A sliding manifest window loses discontinuity history when old segments disappear.
Discontinuity base increments on prune · case 03
A sliding manifest window loses discontinuity history when old segments disappear.
Discontinuity base increments on prune · case 04
A sliding manifest window loses discontinuity history when old segments disappear.
Discontinuity base increments on prune · case 05
A sliding manifest window loses discontinuity history when old segments disappear.
Segment uri relative resolution · case 01
The manifest filename is incorrectly treated as a directory.
Segment uri relative resolution · case 02
The manifest filename is incorrectly treated as a directory.
Segment uri relative resolution · case 03
The manifest filename is incorrectly treated as a directory.
Segment uri relative resolution · case 04
The manifest filename is incorrectly treated as a directory.
Segment uri relative resolution · case 05
The manifest filename is incorrectly treated as a directory.
Segment byte range inclusive header · case 01
Adding full byte length fetches one byte from the following range.
Segment byte range inclusive header · case 02
Adding full byte length fetches one byte from the following range.
Segment byte range inclusive header · case 03
Adding full byte length fetches one byte from the following range.
Segment byte range inclusive header · case 04
Adding full byte length fetches one byte from the following range.
Segment byte range inclusive header · case 05
Adding full byte length fetches one byte from the following range.
Implicit range offset resource scope · case 01
An omitted range offset carries over from an unrelated resource URI.
Implicit range offset resource scope · case 02
An omitted range offset carries over from an unrelated resource URI.
Implicit range offset resource scope · case 03
An omitted range offset carries over from an unrelated resource URI.
Implicit range offset resource scope · case 04
An omitted range offset carries over from an unrelated resource URI.
Implicit range offset resource scope · case 05
An omitted range offset carries over from an unrelated resource URI.
Init segment before media · case 01
Media data is appended before its required decoder initialization data.
Init segment before media · case 02
Media data is appended before its required decoder initialization data.
Init segment before media · case 03
Media data is appended before its required decoder initialization data.
Init segment before media · case 04
Media data is appended before its required decoder initialization data.
Init segment before media · case 05
Media data is appended before its required decoder initialization data.
Segment cache key includes rendition · case 01
Two quality renditions share a sequence number and collide in the segment cache.
Segment cache key includes rendition · case 02
Two quality renditions share a sequence number and collide in the segment cache.
Segment cache key includes rendition · case 03
Two quality renditions share a sequence number and collide in the segment cache.
Segment cache key includes rendition · case 04
Two quality renditions share a sequence number and collide in the segment cache.
Segment cache key includes rendition · case 05
Two quality renditions share a sequence number and collide in the segment cache.
Download chunks offset assembly · case 01
Appending in download completion order corrupts segment byte order.
Download chunks offset assembly · case 02
Appending in download completion order corrupts segment byte order.
Download chunks offset assembly · case 03
Appending in download completion order corrupts segment byte order.
Download chunks offset assembly · case 04
Appending in download completion order corrupts segment byte order.
Download chunks offset assembly · case 05
Appending in download completion order corrupts segment byte order.
Partial segment replacement · case 01
A retried part is appended as a duplicate part rather than updating its stored payload.
Partial segment replacement · case 02
A retried part is appended as a duplicate part rather than updating its stored payload.
Partial segment replacement · case 03
A retried part is appended as a duplicate part rather than updating its stored payload.
Partial segment replacement · case 04
A retried part is appended as a duplicate part rather than updating its stored payload.
Partial segment replacement · case 05
A retried part is appended as a duplicate part rather than updating its stored payload.
Download failure restores pending · case 01
Removing a failed download from inflight without requeueing permanently loses that segment.
Download failure restores pending · case 02
Removing a failed download from inflight without requeueing permanently loses that segment.
Download failure restores pending · case 03
Removing a failed download from inflight without requeueing permanently loses that segment.
Download failure restores pending · case 04
Removing a failed download from inflight without requeueing permanently loses that segment.
Download failure restores pending · case 05
Removing a failed download from inflight without requeueing permanently loses that segment.
Segment eviction retains shared init · case 01
Evicting one media segment deletes initialization bytes needed by other segments.
Segment eviction retains shared init · case 02
Evicting one media segment deletes initialization bytes needed by other segments.
Segment eviction retains shared init · case 03
Evicting one media segment deletes initialization bytes needed by other segments.
Segment eviction retains shared init · case 04
Evicting one media segment deletes initialization bytes needed by other segments.
Segment eviction retains shared init · case 05
Evicting one media segment deletes initialization bytes needed by other segments.
Segment append must finish before next · case 01
A second append is started while the previous asynchronous append is still active.
Segment append must finish before next · case 02
A second append is started while the previous asynchronous append is still active.
Segment append must finish before next · case 03
A second append is started while the previous asynchronous append is still active.
Segment append must finish before next · case 04
A second append is started while the previous asynchronous append is still active.
Segment append must finish before next · case 05
A second append is started while the previous asynchronous append is still active.
Append failure keeps uncommitted segment · case 01
Append completion is treated as success even when the decoder rejected the segment.
Append failure keeps uncommitted segment · case 02
Append completion is treated as success even when the decoder rejected the segment.
Append failure keeps uncommitted segment · case 03
Append completion is treated as success even when the decoder rejected the segment.
Append failure keeps uncommitted segment · case 04
Append completion is treated as success even when the decoder rejected the segment.
Append failure keeps uncommitted segment · case 05
Append completion is treated as success even when the decoder rejected the segment.
End of stream waits for queued appends · case 01
The stream ends before all declared media segments have been appended.
End of stream waits for queued appends · case 02
The stream ends before all declared media segments have been appended.
End of stream waits for queued appends · case 03
The stream ends before all declared media segments have been appended.
End of stream waits for queued appends · case 04
The stream ends before all declared media segments have been appended.
End of stream waits for queued appends · case 05
The stream ends before all declared media segments have been appended.
Segment selection by time interval · case 01
Inclusive segment ends select the previous segment at a shared boundary.
Segment selection by time interval · case 02
Inclusive segment ends select the previous segment at a shared boundary.
Segment selection by time interval · case 03
Inclusive segment ends select the previous segment at a shared boundary.
Segment selection by time interval · case 04
Inclusive segment ends select the previous segment at a shared boundary.
Segment selection by time interval · case 05
Inclusive segment ends select the previous segment at a shared boundary.
Segment priority seek distance · case 01
Numeric download order fills old segments before the seek target.
Segment priority seek distance · case 02
Numeric download order fills old segments before the seek target.
Segment priority seek distance · case 03
Numeric download order fills old segments before the seek target.
Segment priority seek distance · case 04
Numeric download order fills old segments before the seek target.
Segment priority seek distance · case 05
Numeric download order fills old segments before the seek target.
Rendition switch discards old pending · case 01
Quality switching leaves obsolete old-rendition downloads queued.
Rendition switch discards old pending · case 02
Quality switching leaves obsolete old-rendition downloads queued.
Rendition switch discards old pending · case 03
Quality switching leaves obsolete old-rendition downloads queued.
Rendition switch discards old pending · case 04
Quality switching leaves obsolete old-rendition downloads queued.
Rendition switch discards old pending · case 05
Quality switching leaves obsolete old-rendition downloads queued.
Manifest refresh retains terminal flag · case 01
A failed refresh resets terminal state from incomplete metadata.
Manifest refresh retains terminal flag · case 02
A failed refresh resets terminal state from incomplete metadata.
Manifest refresh retains terminal flag · case 03
A failed refresh resets terminal state from incomplete metadata.
Manifest refresh retains terminal flag · case 04
A failed refresh resets terminal state from incomplete metadata.
Manifest refresh retains terminal flag · case 05
A failed refresh resets terminal state from incomplete metadata.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗