FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
97840Executable case variants
19568Distinct failure mechanisms
293520Executed implementations
19568Open-access cases

A RECORD OF WHAT WENT WRONG

Browse the archive / 97840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-301

A calendar year is paired with a week from the previous ISO year · case 01

Dates near New Year receive a week number from one ISO year and a year label from another.

Calendar arithmetic● Open access↗
FA-302

A calendar year is paired with a week from the previous ISO year · case 02

Dates near New Year receive a week number from one ISO year and a year label from another.

Calendar arithmetic◈ Members↗
FA-303

A calendar year is paired with a week from the previous ISO year · case 03

Dates near New Year receive a week number from one ISO year and a year label from another.

Calendar arithmetic◈ Members↗
FA-304

A calendar year is paired with a week from the previous ISO year · case 04

Dates near New Year receive a week number from one ISO year and a year label from another.

Calendar arithmetic◈ Members↗
FA-305

A calendar year is paired with a week from the previous ISO year · case 05

Dates near New Year receive a week number from one ISO year and a year label from another.

Calendar arithmetic◈ Members↗
FA-306

Sorting local timestamp text reverses the order of absolute instants · case 01

An event with a later wall-clock reading is placed after an event that actually occurred later in UTC.

Time representation● Open access↗
FA-307

Sorting local timestamp text reverses the order of absolute instants · case 02

An event with a later wall-clock reading is placed after an event that actually occurred later in UTC.

Time representation◈ Members↗
FA-308

Sorting local timestamp text reverses the order of absolute instants · case 03

An event with a later wall-clock reading is placed after an event that actually occurred later in UTC.

Time representation◈ Members↗
FA-309

Sorting local timestamp text reverses the order of absolute instants · case 04

An event with a later wall-clock reading is placed after an event that actually occurred later in UTC.

Time representation◈ Members↗
FA-310

Sorting local timestamp text reverses the order of absolute instants · case 05

An event with a later wall-clock reading is placed after an event that actually occurred later in UTC.

Time representation◈ Members↗
FA-311

Duration formatting wraps elapsed hours at midnight · case 01

A multi-day duration loses its day component, and a negative duration looks like a positive time of day.

Time representation● Open access↗
FA-312

Duration formatting wraps elapsed hours at midnight · case 02

A multi-day duration loses its day component, and a negative duration looks like a positive time of day.

Time representation◈ Members↗
FA-313

Duration formatting wraps elapsed hours at midnight · case 03

A multi-day duration loses its day component, and a negative duration looks like a positive time of day.

Time representation◈ Members↗
FA-314

Duration formatting wraps elapsed hours at midnight · case 04

A multi-day duration loses its day component, and a negative duration looks like a positive time of day.

Time representation◈ Members↗
FA-315

Duration formatting wraps elapsed hours at midnight · case 05

A multi-day duration loses its day component, and a negative duration looks like a positive time of day.

Time representation◈ Members↗
FA-316

A weighted total is divided by the number of records · case 01

Changing the scale of weights changes the result, or unequal-weight observations are treated as equally influential.

Numerical aggregation● Open access↗
FA-317

A weighted total is divided by the number of records · case 02

Changing the scale of weights changes the result, or unequal-weight observations are treated as equally influential.

Numerical aggregation◈ Members↗
FA-318

A weighted total is divided by the number of records · case 03

Changing the scale of weights changes the result, or unequal-weight observations are treated as equally influential.

Numerical aggregation◈ Members↗
FA-319

A weighted total is divided by the number of records · case 04

Changing the scale of weights changes the result, or unequal-weight observations are treated as equally influential.

Numerical aggregation◈ Members↗
FA-320

A weighted total is divided by the number of records · case 05

Changing the scale of weights changes the result, or unequal-weight observations are treated as equally influential.

Numerical aggregation◈ Members↗
FA-321

Large cancelling terms erase a small summand · case 01

A mathematically nonzero residual disappears when large positive and negative terms cancel.

Floating-point arithmetic● Open access↗
FA-322

Large cancelling terms erase a small summand · case 02

A mathematically nonzero residual disappears when large positive and negative terms cancel.

Floating-point arithmetic◈ Members↗
FA-323

Large cancelling terms erase a small summand · case 03

A mathematically nonzero residual disappears when large positive and negative terms cancel.

Floating-point arithmetic◈ Members↗
FA-324

Large cancelling terms erase a small summand · case 04

A mathematically nonzero residual disappears when large positive and negative terms cancel.

Floating-point arithmetic◈ Members↗
FA-325

Large cancelling terms erase a small summand · case 05

A mathematically nonzero residual disappears when large positive and negative terms cancel.

Floating-point arithmetic◈ Members↗
FA-326

Subtracting two large moments destroys a small variance · case 01

A nonconstant sample reports zero or an inaccurate variance after its mean is shifted far from zero.

Floating-point arithmetic● Open access↗
FA-327

Subtracting two large moments destroys a small variance · case 02

A nonconstant sample reports zero or an inaccurate variance after its mean is shifted far from zero.

Floating-point arithmetic◈ Members↗
FA-328

Subtracting two large moments destroys a small variance · case 03

A nonconstant sample reports zero or an inaccurate variance after its mean is shifted far from zero.

Floating-point arithmetic◈ Members↗
FA-329

Subtracting two large moments destroys a small variance · case 04

A nonconstant sample reports zero or an inaccurate variance after its mean is shifted far from zero.

Floating-point arithmetic◈ Members↗
FA-330

Subtracting two large moments destroys a small variance · case 05

A nonconstant sample reports zero or an inaccurate variance after its mean is shifted far from zero.

Floating-point arithmetic◈ Members↗
FA-331

Rescaling integer ticks loses precision in an intermediate step · case 01

Large counters change by several ticks after a float conversion, or fractional source units disappear before multiplication.

Integer arithmetic● Open access↗
FA-332

Rescaling integer ticks loses precision in an intermediate step · case 02

Large counters change by several ticks after a float conversion, or fractional source units disappear before multiplication.

Integer arithmetic◈ Members↗
FA-333

Rescaling integer ticks loses precision in an intermediate step · case 03

Large counters change by several ticks after a float conversion, or fractional source units disappear before multiplication.

Integer arithmetic◈ Members↗
FA-334

Rescaling integer ticks loses precision in an intermediate step · case 04

Large counters change by several ticks after a float conversion, or fractional source units disappear before multiplication.

Integer arithmetic◈ Members↗
FA-335

Rescaling integer ticks loses precision in an intermediate step · case 05

Large counters change by several ticks after a float conversion, or fractional source units disappear before multiplication.

Integer arithmetic◈ Members↗
FA-336

Percentile interpolation uses unsorted observation positions · case 01

A percentile depends on input order or jumps to a nearest-rank value instead of the specified interpolated value.

Statistics● Open access↗
FA-337

Percentile interpolation uses unsorted observation positions · case 02

A percentile depends on input order or jumps to a nearest-rank value instead of the specified interpolated value.

Statistics◈ Members↗
FA-338

Percentile interpolation uses unsorted observation positions · case 03

A percentile depends on input order or jumps to a nearest-rank value instead of the specified interpolated value.

Statistics◈ Members↗
FA-339

Percentile interpolation uses unsorted observation positions · case 04

A percentile depends on input order or jumps to a nearest-rank value instead of the specified interpolated value.

Statistics◈ Members↗
FA-340

Percentile interpolation uses unsorted observation positions · case 05

A percentile depends on input order or jumps to a nearest-rank value instead of the specified interpolated value.

Statistics◈ Members↗
FA-341

A positive-only tie rule rounds negative halves toward zero · case 01

Exact midpoint values receive even rounding or asymmetric rounding instead of the required away-from-zero result.

Integer arithmetic● Open access↗
FA-342

A positive-only tie rule rounds negative halves toward zero · case 02

Exact midpoint values receive even rounding or asymmetric rounding instead of the required away-from-zero result.

Integer arithmetic◈ Members↗
FA-343

A positive-only tie rule rounds negative halves toward zero · case 03

Exact midpoint values receive even rounding or asymmetric rounding instead of the required away-from-zero result.

Integer arithmetic◈ Members↗
FA-344

A positive-only tie rule rounds negative halves toward zero · case 04

Exact midpoint values receive even rounding or asymmetric rounding instead of the required away-from-zero result.

Integer arithmetic◈ Members↗
FA-345

A positive-only tie rule rounds negative halves toward zero · case 05

Exact midpoint values receive even rounding or asymmetric rounding instead of the required away-from-zero result.

Integer arithmetic◈ Members↗
FA-346

A geometric-mean product overflows although the result is finite · case 01

Multiplying observations produces infinity or zero even when their geometric mean is a representable positive number.

Floating-point arithmetic● Open access↗
FA-347

A geometric-mean product overflows although the result is finite · case 02

Multiplying observations produces infinity or zero even when their geometric mean is a representable positive number.

Floating-point arithmetic◈ Members↗
FA-348

A geometric-mean product overflows although the result is finite · case 03

Multiplying observations produces infinity or zero even when their geometric mean is a representable positive number.

Floating-point arithmetic◈ Members↗
FA-349

A geometric-mean product overflows although the result is finite · case 04

Multiplying observations produces infinity or zero even when their geometric mean is a representable positive number.

Floating-point arithmetic◈ Members↗
FA-350

A geometric-mean product overflows although the result is finite · case 05

Multiplying observations produces infinity or zero even when their geometric mean is a representable positive number.

Floating-point arithmetic◈ Members↗
FA-351

Activate a joint voting configuration: The old configuration has only a minority · case 01

The joint configuration operation is admitted even though the old configuration has only a minority.

Consensus● Open access↗
FA-352

Activate a joint voting configuration: The old configuration has only a minority · case 02

The joint configuration operation is admitted even though the old configuration has only a minority.

Consensus◈ Members↗
FA-353

Activate a joint voting configuration: The old configuration has only a minority · case 03

The joint configuration operation is admitted even though the old configuration has only a minority.

Consensus◈ Members↗
FA-354

Activate a joint voting configuration: The old configuration has only a minority · case 04

The joint configuration operation is admitted even though the old configuration has only a minority.

Consensus◈ Members↗
FA-355

Activate a joint voting configuration: The old configuration has only a minority · case 05

The joint configuration operation is admitted even though the old configuration has only a minority.

Consensus◈ Members↗
FA-356

Activate a joint voting configuration: The new configuration has only a minority · case 01

The joint configuration operation is admitted even though the new configuration has only a minority.

Consensus● Open access↗
FA-357

Activate a joint voting configuration: The new configuration has only a minority · case 02

The joint configuration operation is admitted even though the new configuration has only a minority.

Consensus◈ Members↗
FA-358

Activate a joint voting configuration: The new configuration has only a minority · case 03

The joint configuration operation is admitted even though the new configuration has only a minority.

Consensus◈ Members↗
FA-359

Activate a joint voting configuration: The new configuration has only a minority · case 04

The joint configuration operation is admitted even though the new configuration has only a minority.

Consensus◈ Members↗
FA-360

Activate a joint voting configuration: The new configuration has only a minority · case 05

The joint configuration operation is admitted even though the new configuration has only a minority.

Consensus◈ Members↗
FA-361

Activate a joint voting configuration: The configuration entry is beyond the committed prefix · case 01

The joint configuration operation is admitted even though the configuration entry is beyond the committed prefix.

Consensus● Open access↗
FA-362

Activate a joint voting configuration: The configuration entry is beyond the committed prefix · case 02

The joint configuration operation is admitted even though the configuration entry is beyond the committed prefix.

Consensus◈ Members↗
FA-363

Activate a joint voting configuration: The configuration entry is beyond the committed prefix · case 03

The joint configuration operation is admitted even though the configuration entry is beyond the committed prefix.

Consensus◈ Members↗
FA-364

Activate a joint voting configuration: The configuration entry is beyond the committed prefix · case 04

The joint configuration operation is admitted even though the configuration entry is beyond the committed prefix.

Consensus◈ Members↗
FA-365

Activate a joint voting configuration: The configuration entry is beyond the committed prefix · case 05

The joint configuration operation is admitted even though the configuration entry is beyond the committed prefix.

Consensus◈ Members↗
FA-366

Activate a joint voting configuration: A second membership change overlaps an unfinalized change · case 01

The joint configuration operation is admitted even though a second membership change overlaps an unfinalized change.

Consensus● Open access↗
FA-367

Activate a joint voting configuration: A second membership change overlaps an unfinalized change · case 02

The joint configuration operation is admitted even though a second membership change overlaps an unfinalized change.

Consensus◈ Members↗
FA-368

Activate a joint voting configuration: A second membership change overlaps an unfinalized change · case 03

The joint configuration operation is admitted even though a second membership change overlaps an unfinalized change.

Consensus◈ Members↗
FA-369

Activate a joint voting configuration: A second membership change overlaps an unfinalized change · case 04

The joint configuration operation is admitted even though a second membership change overlaps an unfinalized change.

Consensus◈ Members↗
FA-370

Activate a joint voting configuration: A second membership change overlaps an unfinalized change · case 05

The joint configuration operation is admitted even though a second membership change overlaps an unfinalized change.

Consensus◈ Members↗
FA-371

Activate a joint voting configuration: A promoted learner lacks the configuration entry · case 01

The joint configuration operation is admitted even though a promoted learner lacks the configuration entry.

Consensus● Open access↗
FA-372

Activate a joint voting configuration: A promoted learner lacks the configuration entry · case 02

The joint configuration operation is admitted even though a promoted learner lacks the configuration entry.

Consensus◈ Members↗
FA-373

Activate a joint voting configuration: A promoted learner lacks the configuration entry · case 03

The joint configuration operation is admitted even though a promoted learner lacks the configuration entry.

Consensus◈ Members↗
FA-374

Activate a joint voting configuration: A promoted learner lacks the configuration entry · case 04

The joint configuration operation is admitted even though a promoted learner lacks the configuration entry.

Consensus◈ Members↗
FA-375

Activate a joint voting configuration: A promoted learner lacks the configuration entry · case 05

The joint configuration operation is admitted even though a promoted learner lacks the configuration entry.

Consensus◈ Members↗
FA-376

Transfer leadership to a chosen voter: Leadership is handed to a learner · case 01

The leader transfer operation is admitted even though leadership is handed to a learner.

Consensus● Open access↗
FA-377

Transfer leadership to a chosen voter: Leadership is handed to a learner · case 02

The leader transfer operation is admitted even though leadership is handed to a learner.

Consensus◈ Members↗
FA-378

Transfer leadership to a chosen voter: Leadership is handed to a learner · case 03

The leader transfer operation is admitted even though leadership is handed to a learner.

Consensus◈ Members↗
FA-379

Transfer leadership to a chosen voter: Leadership is handed to a learner · case 04

The leader transfer operation is admitted even though leadership is handed to a learner.

Consensus◈ Members↗
FA-380

Transfer leadership to a chosen voter: Leadership is handed to a learner · case 05

The leader transfer operation is admitted even though leadership is handed to a learner.

Consensus◈ Members↗
FA-381

Transfer leadership to a chosen voter: The target lacks the leader final log entry · case 01

The leader transfer operation is admitted even though the target lacks the leader final log entry.

Consensus● Open access↗
FA-382

Transfer leadership to a chosen voter: The target lacks the leader final log entry · case 02

The leader transfer operation is admitted even though the target lacks the leader final log entry.

Consensus◈ Members↗
FA-383

Transfer leadership to a chosen voter: The target lacks the leader final log entry · case 03

The leader transfer operation is admitted even though the target lacks the leader final log entry.

Consensus◈ Members↗
FA-384

Transfer leadership to a chosen voter: The target lacks the leader final log entry · case 04

The leader transfer operation is admitted even though the target lacks the leader final log entry.

Consensus◈ Members↗
FA-385

Transfer leadership to a chosen voter: The target lacks the leader final log entry · case 05

The leader transfer operation is admitted even though the target lacks the leader final log entry.

Consensus◈ Members↗
FA-386

Transfer leadership to a chosen voter: A delayed handoff names an obsolete term · case 01

The leader transfer operation is admitted even though a delayed handoff names an obsolete term.

Consensus● Open access↗
FA-387

Transfer leadership to a chosen voter: A delayed handoff names an obsolete term · case 02

The leader transfer operation is admitted even though a delayed handoff names an obsolete term.

Consensus◈ Members↗
FA-388

Transfer leadership to a chosen voter: A delayed handoff names an obsolete term · case 03

The leader transfer operation is admitted even though a delayed handoff names an obsolete term.

Consensus◈ Members↗
FA-389

Transfer leadership to a chosen voter: A delayed handoff names an obsolete term · case 04

The leader transfer operation is admitted even though a delayed handoff names an obsolete term.

Consensus◈ Members↗
FA-390

Transfer leadership to a chosen voter: A delayed handoff names an obsolete term · case 05

The leader transfer operation is admitted even though a delayed handoff names an obsolete term.

Consensus◈ Members↗
FA-391

Transfer leadership to a chosen voter: The handoff arrives after its transfer deadline · case 01

The leader transfer operation is admitted even though the handoff arrives after its transfer deadline.

Consensus● Open access↗
FA-392

Transfer leadership to a chosen voter: The handoff arrives after its transfer deadline · case 02

The leader transfer operation is admitted even though the handoff arrives after its transfer deadline.

Consensus◈ Members↗
FA-393

Transfer leadership to a chosen voter: The handoff arrives after its transfer deadline · case 03

The leader transfer operation is admitted even though the handoff arrives after its transfer deadline.

Consensus◈ Members↗
FA-394

Transfer leadership to a chosen voter: The handoff arrives after its transfer deadline · case 04

The leader transfer operation is admitted even though the handoff arrives after its transfer deadline.

Consensus◈ Members↗
FA-395

Transfer leadership to a chosen voter: The handoff arrives after its transfer deadline · case 05

The leader transfer operation is admitted even though the handoff arrives after its transfer deadline.

Consensus◈ Members↗
FA-396

Transfer leadership to a chosen voter: A transfer races outstanding leader writes · case 01

The leader transfer operation is admitted even though a transfer races outstanding leader writes.

Consensus● Open access↗
FA-397

Transfer leadership to a chosen voter: A transfer races outstanding leader writes · case 02

The leader transfer operation is admitted even though a transfer races outstanding leader writes.

Consensus◈ Members↗
FA-398

Transfer leadership to a chosen voter: A transfer races outstanding leader writes · case 03

The leader transfer operation is admitted even though a transfer races outstanding leader writes.

Consensus◈ Members↗
FA-399

Transfer leadership to a chosen voter: A transfer races outstanding leader writes · case 04

The leader transfer operation is admitted even though a transfer races outstanding leader writes.

Consensus◈ Members↗
FA-400

Transfer leadership to a chosen voter: A transfer races outstanding leader writes · case 05

The leader transfer operation is admitted even though a transfer races outstanding leader writes.

Consensus◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗