Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Explicit configuration overlay: Nested mappings keep removed subkeys · case 01
Nested mappings keep removed subkeys.
Explicit configuration overlay: Nested mappings keep removed subkeys · case 02
Nested mappings keep removed subkeys.
Explicit configuration overlay: Nested mappings keep removed subkeys · case 03
Nested mappings keep removed subkeys.
Explicit configuration overlay: Nested mappings keep removed subkeys · case 04
Nested mappings keep removed subkeys.
Explicit configuration overlay: Nested mappings keep removed subkeys · case 05
Nested mappings keep removed subkeys.
Configuration schema diagnostics: Unknown configuration keys are ignored · case 01
Unknown configuration keys are ignored.
Configuration schema diagnostics: Unknown configuration keys are ignored · case 02
Unknown configuration keys are ignored.
Configuration schema diagnostics: Unknown configuration keys are ignored · case 03
Unknown configuration keys are ignored.
Configuration schema diagnostics: Unknown configuration keys are ignored · case 04
Unknown configuration keys are ignored.
Configuration schema diagnostics: Unknown configuration keys are ignored · case 05
Unknown configuration keys are ignored.
Configuration schema diagnostics: Required keys may be omitted · case 01
Required keys may be omitted.
Configuration schema diagnostics: Required keys may be omitted · case 02
Required keys may be omitted.
Configuration schema diagnostics: Required keys may be omitted · case 03
Required keys may be omitted.
Configuration schema diagnostics: Required keys may be omitted · case 04
Required keys may be omitted.
Configuration schema diagnostics: Required keys may be omitted · case 05
Required keys may be omitted.
Configuration schema diagnostics: Boolean values pass integer validation · case 01
Boolean values pass integer validation.
Configuration schema diagnostics: Boolean values pass integer validation · case 02
Boolean values pass integer validation.
Configuration schema diagnostics: Boolean values pass integer validation · case 03
Boolean values pass integer validation.
Configuration schema diagnostics: Boolean values pass integer validation · case 04
Boolean values pass integer validation.
Configuration schema diagnostics: Boolean values pass integer validation · case 05
Boolean values pass integer validation.
Configuration schema diagnostics: Enumerated settings accept arbitrary values · case 01
Enumerated settings accept arbitrary values.
Configuration schema diagnostics: Enumerated settings accept arbitrary values · case 02
Enumerated settings accept arbitrary values.
Configuration schema diagnostics: Enumerated settings accept arbitrary values · case 03
Enumerated settings accept arbitrary values.
Configuration schema diagnostics: Enumerated settings accept arbitrary values · case 04
Enumerated settings accept arbitrary values.
Configuration schema diagnostics: Enumerated settings accept arbitrary values · case 05
Enumerated settings accept arbitrary values.
Configuration schema diagnostics: The configured minimum is rejected · case 01
The configured minimum is rejected.
Configuration schema diagnostics: The configured minimum is rejected · case 02
The configured minimum is rejected.
Configuration schema diagnostics: The configured minimum is rejected · case 03
The configured minimum is rejected.
Configuration schema diagnostics: The configured minimum is rejected · case 04
The configured minimum is rejected.
Configuration schema diagnostics: The configured minimum is rejected · case 05
The configured minimum is rejected.
Environment variable projection: Environment lookup ignores the namespace prefix · case 01
Environment lookup ignores the namespace prefix.
Environment variable projection: Environment lookup ignores the namespace prefix · case 02
Environment lookup ignores the namespace prefix.
Environment variable projection: Environment lookup ignores the namespace prefix · case 03
Environment lookup ignores the namespace prefix.
Environment variable projection: Environment lookup ignores the namespace prefix · case 04
Environment lookup ignores the namespace prefix.
Environment variable projection: Environment lookup ignores the namespace prefix · case 05
Environment lookup ignores the namespace prefix.
Environment variable projection: Empty environment values fall through to defaults · case 01
Empty environment values fall through to defaults.
Environment variable projection: Empty environment values fall through to defaults · case 02
Empty environment values fall through to defaults.
Environment variable projection: Empty environment values fall through to defaults · case 03
Empty environment values fall through to defaults.
Environment variable projection: Empty environment values fall through to defaults · case 04
Empty environment values fall through to defaults.
Environment variable projection: Empty environment values fall through to defaults · case 05
Empty environment values fall through to defaults.
Environment variable projection: Explicit empty defaults are ignored · case 01
Explicit empty defaults are ignored.
Environment variable projection: Explicit empty defaults are ignored · case 02
Explicit empty defaults are ignored.
Environment variable projection: Explicit empty defaults are ignored · case 03
Explicit empty defaults are ignored.
Environment variable projection: Explicit empty defaults are ignored · case 04
Explicit empty defaults are ignored.
Environment variable projection: Explicit empty defaults are ignored · case 05
Explicit empty defaults are ignored.
Environment variable projection: Required absent variables are silently omitted · case 01
Required absent variables are silently omitted.
Environment variable projection: Required absent variables are silently omitted · case 02
Required absent variables are silently omitted.
Environment variable projection: Required absent variables are silently omitted · case 03
Required absent variables are silently omitted.
Environment variable projection: Required absent variables are silently omitted · case 04
Required absent variables are silently omitted.
Environment variable projection: Required absent variables are silently omitted · case 05
Required absent variables are silently omitted.
Environment variable projection: Optional absent variables become missing errors · case 01
Optional absent variables become missing errors.
Environment variable projection: Optional absent variables become missing errors · case 02
Optional absent variables become missing errors.
Environment variable projection: Optional absent variables become missing errors · case 03
Optional absent variables become missing errors.
Environment variable projection: Optional absent variables become missing errors · case 04
Optional absent variables become missing errors.
Environment variable projection: Optional absent variables become missing errors · case 05
Optional absent variables become missing errors.
Profile inheritance expansion: Inheritance cycles are classified as successful emptiness · case 01
Inheritance cycles are classified as successful emptiness.
Profile inheritance expansion: Inheritance cycles are classified as successful emptiness · case 02
Inheritance cycles are classified as successful emptiness.
Profile inheritance expansion: Inheritance cycles are classified as successful emptiness · case 03
Inheritance cycles are classified as successful emptiness.
Profile inheritance expansion: Inheritance cycles are classified as successful emptiness · case 04
Inheritance cycles are classified as successful emptiness.
Profile inheritance expansion: Inheritance cycles are classified as successful emptiness · case 05
Inheritance cycles are classified as successful emptiness.
Profile inheritance expansion: Missing parents are treated as empty profiles · case 01
Missing parents are treated as empty profiles.
Profile inheritance expansion: Missing parents are treated as empty profiles · case 02
Missing parents are treated as empty profiles.
Profile inheritance expansion: Missing parents are treated as empty profiles · case 03
Missing parents are treated as empty profiles.
Profile inheritance expansion: Missing parents are treated as empty profiles · case 04
Missing parents are treated as empty profiles.
Profile inheritance expansion: Missing parents are treated as empty profiles · case 05
Missing parents are treated as empty profiles.
Profile inheritance expansion: Parent values override child configuration · case 01
Parent values override child configuration.
Profile inheritance expansion: Parent values override child configuration · case 02
Parent values override child configuration.
Profile inheritance expansion: Parent values override child configuration · case 03
Parent values override child configuration.
Profile inheritance expansion: Parent values override child configuration · case 04
Parent values override child configuration.
Profile inheritance expansion: Parent values override child configuration · case 05
Parent values override child configuration.
Profile inheritance expansion: The parent directive leaks into application settings · case 01
The parent directive leaks into application settings.
Profile inheritance expansion: The parent directive leaks into application settings · case 02
The parent directive leaks into application settings.
Profile inheritance expansion: The parent directive leaks into application settings · case 03
The parent directive leaks into application settings.
Profile inheritance expansion: The parent directive leaks into application settings · case 04
The parent directive leaks into application settings.
Profile inheritance expansion: The parent directive leaks into application settings · case 05
The parent directive leaks into application settings.
Profile inheritance expansion: False child values fail to override parents · case 01
False child values fail to override parents.
Profile inheritance expansion: False child values fail to override parents · case 02
False child values fail to override parents.
Profile inheritance expansion: False child values fail to override parents · case 03
False child values fail to override parents.
Profile inheritance expansion: False child values fail to override parents · case 04
False child values fail to override parents.
Profile inheritance expansion: False child values fail to override parents · case 05
False child values fail to override parents.
Configuration change plan: Added settings are mistaken for removals · case 01
Added settings are mistaken for removals.
Configuration change plan: Added settings are mistaken for removals · case 02
Added settings are mistaken for removals.
Configuration change plan: Added settings are mistaken for removals · case 03
Added settings are mistaken for removals.
Configuration change plan: Added settings are mistaken for removals · case 04
Added settings are mistaken for removals.
Configuration change plan: Added settings are mistaken for removals · case 05
Added settings are mistaken for removals.
Configuration change plan: Removed settings disappear from the plan · case 01
Removed settings disappear from the plan.
Configuration change plan: Removed settings disappear from the plan · case 02
Removed settings disappear from the plan.
Configuration change plan: Removed settings disappear from the plan · case 03
Removed settings disappear from the plan.
Configuration change plan: Removed settings disappear from the plan · case 04
Removed settings disappear from the plan.
Configuration change plan: Removed settings disappear from the plan · case 05
Removed settings disappear from the plan.
Configuration change plan: All common keys are reported changed · case 01
All common keys are reported changed.
Configuration change plan: All common keys are reported changed · case 02
All common keys are reported changed.
Configuration change plan: All common keys are reported changed · case 03
All common keys are reported changed.
Configuration change plan: All common keys are reported changed · case 04
All common keys are reported changed.
Configuration change plan: All common keys are reported changed · case 05
All common keys are reported changed.
Configuration change plan: Unchanged restart-sensitive keys trigger restart · case 01
Unchanged restart-sensitive keys trigger restart.
Configuration change plan: Unchanged restart-sensitive keys trigger restart · case 02
Unchanged restart-sensitive keys trigger restart.
Configuration change plan: Unchanged restart-sensitive keys trigger restart · case 03
Unchanged restart-sensitive keys trigger restart.
Configuration change plan: Unchanged restart-sensitive keys trigger restart · case 04
Unchanged restart-sensitive keys trigger restart.
Configuration change plan: Unchanged restart-sensitive keys trigger restart · case 05
Unchanged restart-sensitive keys trigger restart.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗