FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-35101

Time-limited notification content expiry: open-action from valid · case 01

The open-action event leaves a notification in completed instead of action-pending.

Notification interfaces● Open access↗
FA-35102

Time-limited notification content expiry: open-action from valid · case 02

The open-action event leaves a notification in completed instead of action-pending.

Notification interfaces◈ Members↗
FA-35103

Time-limited notification content expiry: open-action from valid · case 03

The open-action event leaves a notification in completed instead of action-pending.

Notification interfaces◈ Members↗
FA-35104

Time-limited notification content expiry: open-action from valid · case 04

The open-action event leaves a notification in completed instead of action-pending.

Notification interfaces◈ Members↗
FA-35105

Time-limited notification content expiry: open-action from valid · case 05

The open-action event leaves a notification in completed instead of action-pending.

Notification interfaces◈ Members↗
FA-35106

Time-limited notification content expiry: deadline-reached from action-pending · case 01

The deadline-reached event leaves a notification in expired instead of pending-at-expiry.

Notification interfaces● Open access↗
FA-35107

Time-limited notification content expiry: deadline-reached from action-pending · case 02

The deadline-reached event leaves a notification in expired instead of pending-at-expiry.

Notification interfaces◈ Members↗
FA-35108

Time-limited notification content expiry: deadline-reached from action-pending · case 03

The deadline-reached event leaves a notification in expired instead of pending-at-expiry.

Notification interfaces◈ Members↗
FA-35109

Time-limited notification content expiry: deadline-reached from action-pending · case 04

The deadline-reached event leaves a notification in expired instead of pending-at-expiry.

Notification interfaces◈ Members↗
FA-35110

Time-limited notification content expiry: deadline-reached from action-pending · case 05

The deadline-reached event leaves a notification in expired instead of pending-at-expiry.

Notification interfaces◈ Members↗
FA-35111

Time-limited notification content expiry: action-success from pending-at-expiry · case 01

The action-success event leaves a notification in expired instead of completed.

Notification interfaces● Open access↗
FA-35112

Time-limited notification content expiry: action-success from pending-at-expiry · case 02

The action-success event leaves a notification in expired instead of completed.

Notification interfaces◈ Members↗
FA-35113

Time-limited notification content expiry: action-success from pending-at-expiry · case 03

The action-success event leaves a notification in expired instead of completed.

Notification interfaces◈ Members↗
FA-35114

Time-limited notification content expiry: action-success from pending-at-expiry · case 04

The action-success event leaves a notification in expired instead of completed.

Notification interfaces◈ Members↗
FA-35115

Time-limited notification content expiry: action-success from pending-at-expiry · case 05

The action-success event leaves a notification in expired instead of completed.

Notification interfaces◈ Members↗
FA-35116

Time-limited notification content expiry: action-failure from pending-at-expiry · case 01

The action-failure event leaves a notification in expired instead of expired-action-error.

Notification interfaces● Open access↗
FA-35117

Time-limited notification content expiry: action-failure from pending-at-expiry · case 02

The action-failure event leaves a notification in expired instead of expired-action-error.

Notification interfaces◈ Members↗
FA-35118

Time-limited notification content expiry: action-failure from pending-at-expiry · case 03

The action-failure event leaves a notification in expired instead of expired-action-error.

Notification interfaces◈ Members↗
FA-35119

Time-limited notification content expiry: action-failure from pending-at-expiry · case 04

The action-failure event leaves a notification in expired instead of expired-action-error.

Notification interfaces◈ Members↗
FA-35120

Time-limited notification content expiry: action-failure from pending-at-expiry · case 05

The action-failure event leaves a notification in expired instead of expired-action-error.

Notification interfaces◈ Members↗
FA-35121

Time-limited notification content expiry: deadline-extension from expired · case 01

The deadline-extension event leaves a notification in valid instead of revalidation-pending.

Notification interfaces● Open access↗
FA-35122

Time-limited notification content expiry: deadline-extension from expired · case 02

The deadline-extension event leaves a notification in valid instead of revalidation-pending.

Notification interfaces◈ Members↗
FA-35123

Time-limited notification content expiry: deadline-extension from expired · case 03

The deadline-extension event leaves a notification in valid instead of revalidation-pending.

Notification interfaces◈ Members↗
FA-35124

Time-limited notification content expiry: deadline-extension from expired · case 04

The deadline-extension event leaves a notification in valid instead of revalidation-pending.

Notification interfaces◈ Members↗
FA-35125

Time-limited notification content expiry: deadline-extension from expired · case 05

The deadline-extension event leaves a notification in valid instead of revalidation-pending.

Notification interfaces◈ Members↗
FA-35126

Time-limited notification content expiry: extension-validated from revalidation-pending · case 01

The extension-validated event leaves a notification in expired instead of valid.

Notification interfaces● Open access↗
FA-35127

Time-limited notification content expiry: extension-validated from revalidation-pending · case 02

The extension-validated event leaves a notification in expired instead of valid.

Notification interfaces◈ Members↗
FA-35128

Time-limited notification content expiry: extension-validated from revalidation-pending · case 03

The extension-validated event leaves a notification in expired instead of valid.

Notification interfaces◈ Members↗
FA-35129

Time-limited notification content expiry: extension-validated from revalidation-pending · case 04

The extension-validated event leaves a notification in expired instead of valid.

Notification interfaces◈ Members↗
FA-35130

Time-limited notification content expiry: extension-validated from revalidation-pending · case 05

The extension-validated event leaves a notification in expired instead of valid.

Notification interfaces◈ Members↗
FA-35131

Time-limited notification content expiry: extension-rejected from revalidation-pending · case 01

The extension-rejected event leaves a notification in valid instead of expired.

Notification interfaces● Open access↗
FA-35132

Time-limited notification content expiry: extension-rejected from revalidation-pending · case 02

The extension-rejected event leaves a notification in valid instead of expired.

Notification interfaces◈ Members↗
FA-35133

Time-limited notification content expiry: extension-rejected from revalidation-pending · case 03

The extension-rejected event leaves a notification in valid instead of expired.

Notification interfaces◈ Members↗
FA-35134

Time-limited notification content expiry: extension-rejected from revalidation-pending · case 04

The extension-rejected event leaves a notification in valid instead of expired.

Notification interfaces◈ Members↗
FA-35135

Time-limited notification content expiry: extension-rejected from revalidation-pending · case 05

The extension-rejected event leaves a notification in valid instead of expired.

Notification interfaces◈ Members↗
FA-35136

Time-limited notification content expiry: late-expiry from completed · case 01

The late-expiry event leaves a notification in expired instead of completed.

Notification interfaces● Open access↗
FA-35137

Time-limited notification content expiry: late-expiry from completed · case 02

The late-expiry event leaves a notification in expired instead of completed.

Notification interfaces◈ Members↗
FA-35138

Time-limited notification content expiry: late-expiry from completed · case 03

The late-expiry event leaves a notification in expired instead of completed.

Notification interfaces◈ Members↗
FA-35139

Time-limited notification content expiry: late-expiry from completed · case 04

The late-expiry event leaves a notification in expired instead of completed.

Notification interfaces◈ Members↗
FA-35140

Time-limited notification content expiry: late-expiry from completed · case 05

The late-expiry event leaves a notification in expired instead of completed.

Notification interfaces◈ Members↗
FA-35141

Sensitive notification preview redaction: screen-locked from revealed · case 01

The screen-locked event leaves a notification in revealed instead of redacting.

Notification interfaces● Open access↗
FA-35142

Sensitive notification preview redaction: screen-locked from revealed · case 02

The screen-locked event leaves a notification in revealed instead of redacting.

Notification interfaces◈ Members↗
FA-35143

Sensitive notification preview redaction: screen-locked from revealed · case 03

The screen-locked event leaves a notification in revealed instead of redacting.

Notification interfaces◈ Members↗
FA-35144

Sensitive notification preview redaction: screen-locked from revealed · case 04

The screen-locked event leaves a notification in revealed instead of redacting.

Notification interfaces◈ Members↗
FA-35145

Sensitive notification preview redaction: screen-locked from revealed · case 05

The screen-locked event leaves a notification in revealed instead of redacting.

Notification interfaces◈ Members↗
FA-35146

Sensitive notification preview redaction: redaction-applied from redacting · case 01

The redaction-applied event leaves a notification in revealed instead of redacted.

Notification interfaces● Open access↗
FA-35147

Sensitive notification preview redaction: redaction-applied from redacting · case 02

The redaction-applied event leaves a notification in revealed instead of redacted.

Notification interfaces◈ Members↗
FA-35148

Sensitive notification preview redaction: redaction-applied from redacting · case 03

The redaction-applied event leaves a notification in revealed instead of redacted.

Notification interfaces◈ Members↗
FA-35149

Sensitive notification preview redaction: redaction-applied from redacting · case 04

The redaction-applied event leaves a notification in revealed instead of redacted.

Notification interfaces◈ Members↗
FA-35150

Sensitive notification preview redaction: redaction-applied from redacting · case 05

The redaction-applied event leaves a notification in revealed instead of redacted.

Notification interfaces◈ Members↗
FA-35151

Sensitive notification preview redaction: reveal-click from redacted · case 01

The reveal-click event leaves a notification in revealed instead of reveal-pending.

Notification interfaces● Open access↗
FA-35152

Sensitive notification preview redaction: reveal-click from redacted · case 02

The reveal-click event leaves a notification in revealed instead of reveal-pending.

Notification interfaces◈ Members↗
FA-35153

Sensitive notification preview redaction: reveal-click from redacted · case 03

The reveal-click event leaves a notification in revealed instead of reveal-pending.

Notification interfaces◈ Members↗
FA-35154

Sensitive notification preview redaction: reveal-click from redacted · case 04

The reveal-click event leaves a notification in revealed instead of reveal-pending.

Notification interfaces◈ Members↗
FA-35155

Sensitive notification preview redaction: reveal-click from redacted · case 05

The reveal-click event leaves a notification in revealed instead of reveal-pending.

Notification interfaces◈ Members↗
FA-35156

Sensitive notification preview redaction: confirmation-accepted from reveal-pending · case 01

The confirmation-accepted event leaves a notification in redacted instead of revealed.

Notification interfaces● Open access↗
FA-35157

Sensitive notification preview redaction: confirmation-accepted from reveal-pending · case 02

The confirmation-accepted event leaves a notification in redacted instead of revealed.

Notification interfaces◈ Members↗
FA-35158

Sensitive notification preview redaction: confirmation-accepted from reveal-pending · case 03

The confirmation-accepted event leaves a notification in redacted instead of revealed.

Notification interfaces◈ Members↗
FA-35159

Sensitive notification preview redaction: confirmation-accepted from reveal-pending · case 04

The confirmation-accepted event leaves a notification in redacted instead of revealed.

Notification interfaces◈ Members↗
FA-35160

Sensitive notification preview redaction: confirmation-accepted from reveal-pending · case 05

The confirmation-accepted event leaves a notification in redacted instead of revealed.

Notification interfaces◈ Members↗
FA-35161

Sensitive notification preview redaction: confirmation-denied from reveal-pending · case 01

The confirmation-denied event leaves a notification in revealed instead of redacted.

Notification interfaces● Open access↗
FA-35162

Sensitive notification preview redaction: confirmation-denied from reveal-pending · case 02

The confirmation-denied event leaves a notification in revealed instead of redacted.

Notification interfaces◈ Members↗
FA-35163

Sensitive notification preview redaction: confirmation-denied from reveal-pending · case 03

The confirmation-denied event leaves a notification in revealed instead of redacted.

Notification interfaces◈ Members↗
FA-35164

Sensitive notification preview redaction: confirmation-denied from reveal-pending · case 04

The confirmation-denied event leaves a notification in revealed instead of redacted.

Notification interfaces◈ Members↗
FA-35165

Sensitive notification preview redaction: confirmation-denied from reveal-pending · case 05

The confirmation-denied event leaves a notification in revealed instead of redacted.

Notification interfaces◈ Members↗
FA-35166

Sensitive notification preview redaction: sensitive-update from revealed · case 01

The sensitive-update event leaves a notification in revealed instead of redacting-update.

Notification interfaces● Open access↗
FA-35167

Sensitive notification preview redaction: sensitive-update from revealed · case 02

The sensitive-update event leaves a notification in revealed instead of redacting-update.

Notification interfaces◈ Members↗
FA-35168

Sensitive notification preview redaction: sensitive-update from revealed · case 03

The sensitive-update event leaves a notification in revealed instead of redacting-update.

Notification interfaces◈ Members↗
FA-35169

Sensitive notification preview redaction: sensitive-update from revealed · case 04

The sensitive-update event leaves a notification in revealed instead of redacting-update.

Notification interfaces◈ Members↗
FA-35170

Sensitive notification preview redaction: sensitive-update from revealed · case 05

The sensitive-update event leaves a notification in revealed instead of redacting-update.

Notification interfaces◈ Members↗
FA-35171

Sensitive notification preview redaction: redaction-applied from redacting-update · case 01

The redaction-applied event leaves a notification in redacted instead of redacted-updated.

Notification interfaces● Open access↗
FA-35172

Sensitive notification preview redaction: redaction-applied from redacting-update · case 02

The redaction-applied event leaves a notification in redacted instead of redacted-updated.

Notification interfaces◈ Members↗
FA-35173

Sensitive notification preview redaction: redaction-applied from redacting-update · case 03

The redaction-applied event leaves a notification in redacted instead of redacted-updated.

Notification interfaces◈ Members↗
FA-35174

Sensitive notification preview redaction: redaction-applied from redacting-update · case 04

The redaction-applied event leaves a notification in redacted instead of redacted-updated.

Notification interfaces◈ Members↗
FA-35175

Sensitive notification preview redaction: redaction-applied from redacting-update · case 05

The redaction-applied event leaves a notification in redacted instead of redacted-updated.

Notification interfaces◈ Members↗
FA-35176

Sensitive notification preview redaction: reveal-click from redacted-updated · case 01

The reveal-click event leaves a notification in revealed instead of updated-reveal-pending.

Notification interfaces● Open access↗
FA-35177

Sensitive notification preview redaction: reveal-click from redacted-updated · case 02

The reveal-click event leaves a notification in revealed instead of updated-reveal-pending.

Notification interfaces◈ Members↗
FA-35178

Sensitive notification preview redaction: reveal-click from redacted-updated · case 03

The reveal-click event leaves a notification in revealed instead of updated-reveal-pending.

Notification interfaces◈ Members↗
FA-35179

Sensitive notification preview redaction: reveal-click from redacted-updated · case 04

The reveal-click event leaves a notification in revealed instead of updated-reveal-pending.

Notification interfaces◈ Members↗
FA-35180

Sensitive notification preview redaction: reveal-click from redacted-updated · case 05

The reveal-click event leaves a notification in revealed instead of updated-reveal-pending.

Notification interfaces◈ Members↗
FA-35181

Sensitive notification preview redaction: confirmation-accepted from updated-reveal-pending · case 01

The confirmation-accepted event leaves a notification in revealed instead of revealed-updated.

Notification interfaces● Open access↗
FA-35182

Sensitive notification preview redaction: confirmation-accepted from updated-reveal-pending · case 02

The confirmation-accepted event leaves a notification in revealed instead of revealed-updated.

Notification interfaces◈ Members↗
FA-35183

Sensitive notification preview redaction: confirmation-accepted from updated-reveal-pending · case 03

The confirmation-accepted event leaves a notification in revealed instead of revealed-updated.

Notification interfaces◈ Members↗
FA-35184

Sensitive notification preview redaction: confirmation-accepted from updated-reveal-pending · case 04

The confirmation-accepted event leaves a notification in revealed instead of revealed-updated.

Notification interfaces◈ Members↗
FA-35185

Sensitive notification preview redaction: confirmation-accepted from updated-reveal-pending · case 05

The confirmation-accepted event leaves a notification in revealed instead of revealed-updated.

Notification interfaces◈ Members↗
FA-35186

Sensitive notification preview redaction: screen-locked from reveal-pending · case 01

The screen-locked event leaves a notification in revealed instead of redacted.

Notification interfaces● Open access↗
FA-35187

Sensitive notification preview redaction: screen-locked from reveal-pending · case 02

The screen-locked event leaves a notification in revealed instead of redacted.

Notification interfaces◈ Members↗
FA-35188

Sensitive notification preview redaction: screen-locked from reveal-pending · case 03

The screen-locked event leaves a notification in revealed instead of redacted.

Notification interfaces◈ Members↗
FA-35189

Sensitive notification preview redaction: screen-locked from reveal-pending · case 04

The screen-locked event leaves a notification in revealed instead of redacted.

Notification interfaces◈ Members↗
FA-35190

Sensitive notification preview redaction: screen-locked from reveal-pending · case 05

The screen-locked event leaves a notification in revealed instead of redacted.

Notification interfaces◈ Members↗
FA-35191

Notification burst summary interaction: burst-detected from individuals-visible · case 01

The burst-detected event leaves a notification in summary-visible instead of condensing.

Notification interfaces● Open access↗
FA-35192

Notification burst summary interaction: burst-detected from individuals-visible · case 02

The burst-detected event leaves a notification in summary-visible instead of condensing.

Notification interfaces◈ Members↗
FA-35193

Notification burst summary interaction: burst-detected from individuals-visible · case 03

The burst-detected event leaves a notification in summary-visible instead of condensing.

Notification interfaces◈ Members↗
FA-35194

Notification burst summary interaction: burst-detected from individuals-visible · case 04

The burst-detected event leaves a notification in summary-visible instead of condensing.

Notification interfaces◈ Members↗
FA-35195

Notification burst summary interaction: burst-detected from individuals-visible · case 05

The burst-detected event leaves a notification in summary-visible instead of condensing.

Notification interfaces◈ Members↗
FA-35196

Notification burst summary interaction: summary-mounted from condensing · case 01

The summary-mounted event leaves a notification in individuals-visible instead of summary-visible.

Notification interfaces● Open access↗
FA-35197

Notification burst summary interaction: summary-mounted from condensing · case 02

The summary-mounted event leaves a notification in individuals-visible instead of summary-visible.

Notification interfaces◈ Members↗
FA-35198

Notification burst summary interaction: summary-mounted from condensing · case 03

The summary-mounted event leaves a notification in individuals-visible instead of summary-visible.

Notification interfaces◈ Members↗
FA-35199

Notification burst summary interaction: summary-mounted from condensing · case 04

The summary-mounted event leaves a notification in individuals-visible instead of summary-visible.

Notification interfaces◈ Members↗
FA-35200

Notification burst summary interaction: summary-mounted from condensing · case 05

The summary-mounted event leaves a notification in individuals-visible instead of summary-visible.

Notification interfaces◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗