Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Segment explicit gap skips download · case 01
A declared missing segment is repeatedly downloaded instead of represented as a playback gap.
Segment explicit gap skips download · case 02
A declared missing segment is repeatedly downloaded instead of represented as a playback gap.
Segment explicit gap skips download · case 03
A declared missing segment is repeatedly downloaded instead of represented as a playback gap.
Segment explicit gap skips download · case 04
A declared missing segment is repeatedly downloaded instead of represented as a playback gap.
Segment explicit gap skips download · case 05
A declared missing segment is repeatedly downloaded instead of represented as a playback gap.
Presentation order distinct from decode · case 01
Decoded B-frames are displayed in decode order instead of presentation order.
Presentation order distinct from decode · case 02
Decoded B-frames are displayed in decode order instead of presentation order.
Presentation order distinct from decode · case 03
Decoded B-frames are displayed in decode order instead of presentation order.
Presentation order distinct from decode · case 04
Decoded B-frames are displayed in decode order instead of presentation order.
Presentation order distinct from decode · case 05
Decoded B-frames are displayed in decode order instead of presentation order.
Seek preceding keyframe · case 01
Nearest-keyframe seeking may start after the requested media time.
Seek preceding keyframe · case 02
Nearest-keyframe seeking may start after the requested media time.
Seek preceding keyframe · case 03
Nearest-keyframe seeking may start after the requested media time.
Seek preceding keyframe · case 04
Nearest-keyframe seeking may start after the requested media time.
Seek preceding keyframe · case 05
Nearest-keyframe seeking may start after the requested media time.
Seek discard preroll presentation · case 01
Decoded preroll frames before the seek target are shown to the viewer.
Seek discard preroll presentation · case 02
Decoded preroll frames before the seek target are shown to the viewer.
Seek discard preroll presentation · case 03
Decoded preroll frames before the seek target are shown to the viewer.
Seek discard preroll presentation · case 04
Decoded preroll frames before the seek target are shown to the viewer.
Seek discard preroll presentation · case 05
Decoded preroll frames before the seek target are shown to the viewer.
Track timestamp offset applied once · case 01
Local track timestamps are mixed with the shared presentation timeline.
Track timestamp offset applied once · case 02
Local track timestamps are mixed with the shared presentation timeline.
Track timestamp offset applied once · case 03
Local track timestamps are mixed with the shared presentation timeline.
Track timestamp offset applied once · case 04
Local track timestamps are mixed with the shared presentation timeline.
Track timestamp offset applied once · case 05
Local track timestamps are mixed with the shared presentation timeline.
Presentation time offset subtracted · case 01
Ignoring presentation-time offset misaligns a segment timeline.
Presentation time offset subtracted · case 02
Ignoring presentation-time offset misaligns a segment timeline.
Presentation time offset subtracted · case 03
Ignoring presentation-time offset misaligns a segment timeline.
Presentation time offset subtracted · case 04
Ignoring presentation-time offset misaligns a segment timeline.
Presentation time offset subtracted · case 05
Ignoring presentation-time offset misaligns a segment timeline.
Seek buffer gap next available · case 01
A seek is accepted inside an unbuffered gap.
Seek buffer gap next available · case 02
A seek is accepted inside an unbuffered gap.
Seek buffer gap next available · case 03
A seek is accepted inside an unbuffered gap.
Seek buffer gap next available · case 04
A seek is accepted inside an unbuffered gap.
Seek buffer gap next available · case 05
A seek is accepted inside an unbuffered gap.
Live edge minus holdback · case 01
Live playback starts at the unstable edge instead of behind the holdback.
Live edge minus holdback · case 02
Live playback starts at the unstable edge instead of behind the holdback.
Live edge minus holdback · case 03
Live playback starts at the unstable edge instead of behind the holdback.
Live edge minus holdback · case 04
Live playback starts at the unstable edge instead of behind the holdback.
Live edge minus holdback · case 05
Live playback starts at the unstable edge instead of behind the holdback.
Duration from timebase endpoint · case 01
Duration ends at the final frame start and omits its displayed duration.
Duration from timebase endpoint · case 02
Duration ends at the final frame start and omits its displayed duration.
Duration from timebase endpoint · case 03
Duration ends at the final frame start and omits its displayed duration.
Duration from timebase endpoint · case 04
Duration ends at the final frame start and omits its displayed duration.
Duration from timebase endpoint · case 05
Duration ends at the final frame start and omits its displayed duration.
Edit list empty span advances movie · case 01
Empty edit-list spans do not advance the movie clock and shift later media earlier.
Edit list empty span advances movie · case 02
Empty edit-list spans do not advance the movie clock and shift later media earlier.
Edit list empty span advances movie · case 03
Empty edit-list spans do not advance the movie clock and shift later media earlier.
Edit list empty span advances movie · case 04
Empty edit-list spans do not advance the movie clock and shift later media earlier.
Edit list empty span advances movie · case 05
Empty edit-list spans do not advance the movie clock and shift later media earlier.
Chapter selection latest start · case 01
The first matching chapter remains selected throughout later chapters.
Chapter selection latest start · case 02
The first matching chapter remains selected throughout later chapters.
Chapter selection latest start · case 03
The first matching chapter remains selected throughout later chapters.
Chapter selection latest start · case 04
The first matching chapter remains selected throughout later chapters.
Chapter selection latest start · case 05
The first matching chapter remains selected throughout later chapters.
Media trim rebases timestamps · case 01
Trimmed media retains source timestamps instead of beginning at the trim-relative timeline.
Media trim rebases timestamps · case 02
Trimmed media retains source timestamps instead of beginning at the trim-relative timeline.
Media trim rebases timestamps · case 03
Trimmed media retains source timestamps instead of beginning at the trim-relative timeline.
Media trim rebases timestamps · case 04
Trimmed media retains source timestamps instead of beginning at the trim-relative timeline.
Media trim rebases timestamps · case 05
Trimmed media retains source timestamps instead of beginning at the trim-relative timeline.
Playback rate wall to media delta · case 01
The media timeline advances at normal speed regardless of playback rate.
Playback rate wall to media delta · case 02
The media timeline advances at normal speed regardless of playback rate.
Playback rate wall to media delta · case 03
The media timeline advances at normal speed regardless of playback rate.
Playback rate wall to media delta · case 04
The media timeline advances at normal speed regardless of playback rate.
Playback rate wall to media delta · case 05
The media timeline advances at normal speed regardless of playback rate.
Timestamp wrap unroll nearest forward · case 01
A wrapped media counter is treated as an absolute time and jumps backward.
Timestamp wrap unroll nearest forward · case 02
A wrapped media counter is treated as an absolute time and jumps backward.
Timestamp wrap unroll nearest forward · case 03
A wrapped media counter is treated as an absolute time and jumps backward.
Timestamp wrap unroll nearest forward · case 04
A wrapped media counter is treated as an absolute time and jumps backward.
Timestamp wrap unroll nearest forward · case 05
A wrapped media counter is treated as an absolute time and jumps backward.
Clip concatenation offset by duration · case 01
Concatenated clips restart their timestamps at zero and overlap earlier clips.
Clip concatenation offset by duration · case 02
Concatenated clips restart their timestamps at zero and overlap earlier clips.
Clip concatenation offset by duration · case 03
Concatenated clips restart their timestamps at zero and overlap earlier clips.
Clip concatenation offset by duration · case 04
Concatenated clips restart their timestamps at zero and overlap earlier clips.
Clip concatenation offset by duration · case 05
Concatenated clips restart their timestamps at zero and overlap earlier clips.
Seek request generation result · case 01
Completion of an earlier seek overwrites the newer requested position.
Seek request generation result · case 02
Completion of an earlier seek overwrites the newer requested position.
Seek request generation result · case 03
Completion of an earlier seek overwrites the newer requested position.
Seek request generation result · case 04
Completion of an earlier seek overwrites the newer requested position.
Seek request generation result · case 05
Completion of an earlier seek overwrites the newer requested position.
Playlist natural advance: Repeats a current track that has been disabled · case 01
Repeats a current track that has been disabled and produces an incorrect media-control or presentation result.
Playlist natural advance: Repeats a current track that has been disabled · case 02
Repeats a current track that has been disabled and produces an incorrect media-control or presentation result.
Playlist natural advance: Repeats a current track that has been disabled · case 03
Repeats a current track that has been disabled and produces an incorrect media-control or presentation result.
Playlist natural advance: Repeats a current track that has been disabled · case 04
Repeats a current track that has been disabled and produces an incorrect media-control or presentation result.
Playlist natural advance: Repeats a current track that has been disabled · case 05
Repeats a current track that has been disabled and produces an incorrect media-control or presentation result.
Play next queue: Consumes play-next requests in reverse insertion order · case 01
Consumes play-next requests in reverse insertion order and produces an incorrect media-control or presentation result.
Play next queue: Consumes play-next requests in reverse insertion order · case 02
Consumes play-next requests in reverse insertion order and produces an incorrect media-control or presentation result.
Play next queue: Consumes play-next requests in reverse insertion order · case 03
Consumes play-next requests in reverse insertion order and produces an incorrect media-control or presentation result.
Play next queue: Consumes play-next requests in reverse insertion order · case 04
Consumes play-next requests in reverse insertion order and produces an incorrect media-control or presentation result.
Play next queue: Consumes play-next requests in reverse insertion order · case 05
Consumes play-next requests in reverse insertion order and produces an incorrect media-control or presentation result.
Play next queue: Returns a queued occurrence without removing it · case 01
Returns a queued occurrence without removing it and produces an incorrect media-control or presentation result.
Play next queue: Returns a queued occurrence without removing it · case 02
Returns a queued occurrence without removing it and produces an incorrect media-control or presentation result.
Play next queue: Returns a queued occurrence without removing it · case 03
Returns a queued occurrence without removing it and produces an incorrect media-control or presentation result.
Play next queue: Returns a queued occurrence without removing it · case 04
Returns a queued occurrence without removing it and produces an incorrect media-control or presentation result.
Play next queue: Returns a queued occurrence without removing it · case 05
Returns a queued occurrence without removing it and produces an incorrect media-control or presentation result.
Play next queue: Removes all equal queued requests after playing one occurrence · case 01
Removes all equal queued requests after playing one occurrence and produces an incorrect media-control or presentation result.
Play next queue: Removes all equal queued requests after playing one occurrence · case 02
Removes all equal queued requests after playing one occurrence and produces an incorrect media-control or presentation result.
Play next queue: Removes all equal queued requests after playing one occurrence · case 03
Removes all equal queued requests after playing one occurrence and produces an incorrect media-control or presentation result.
Play next queue: Removes all equal queued requests after playing one occurrence · case 04
Removes all equal queued requests after playing one occurrence and produces an incorrect media-control or presentation result.
Play next queue: Removes all equal queued requests after playing one occurrence · case 05
Removes all equal queued requests after playing one occurrence and produces an incorrect media-control or presentation result.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗