FAILURE MAP
← Case archive

FA-73986 / Feature flag rollout bucketing / Open access

Scheduled rollout ramp: A step is not active at its own timestamp · case 01

The ramp stays at the old percentage for the whole second a new step is scheduled.

Verified by executionVariant 1 · 8 checks per implementationDownload source bundle ↓JSON ↗

ROOT CAUSE

Steps are skipped with at >= now, making activation strictly after the scheduled instant.

VERIFIED REPAIR

Stop only at steps whose time is strictly greater than now.

Unsuccessful approach: Exempting hold steps from the strict comparison leaves numeric steps late at their own instant.

Case contract

steps is a possibly unsorted list of [epoch second, percent or None]. Order steps by time, breaking ties by list position (later entries apply later). Every step with time <= now is active in that order; a None percent is a hold that keeps the previous value; numeric percents are clamped to [0, 100]. Before the first step the percentage is 0. Return [percent, original list index of the last active step or -1].

Why this case matters

Scheduled ramps move production traffic unattended, so the percentage at any instant must be exact.

1 / The failure

Exit 1
"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(steps, now):
    order = sorted(range(len(steps)), key=lambda i: (steps[i][0], i))
    current = 0
    active = -1
    for i in order:
        at, pct = steps[i]
        if at >= now:
            break
        active = i
        if pct is not None:
            current = min(max(pct, 0), 100)
    return [current, active]
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [[('step scheduled exactly now is active', [[[0, 5], [60, 25]], 60], [25, 1]),
  ('unsorted schedule is ordered by time', [[[60, 50], [0, 10], [30, 25]], 45], [25, 2]),
  ('later entry wins a timestamp tie', [[[0, 5], [30, 50], [30, 20]], 40], [20, 2]),
  ('hold step keeps previous percentage', [[[0, 25], [30, None]], 40], [25, 1]),
  ('explicit rollback to zero percent', [[[0, 25], [30, 0]], 40], [0, 1]),
  ('ramp schedule sample 1', [[[45, 0], [45, 5], [20, None], [45, 25], [60, -10], [45, None]], 45], [25, 5]),
  ('ramp schedule sample 2', [[[20, 0], [30, 50]], 10], [0, -1]),
  ('ramp schedule sample 3', [[[30, 0], [0, None], [60, 100]], 25], [0, 1])],
 [('step scheduled exactly now is active', [[[0, 5], [60, 25]], 60], [25, 1]),
  ('unsorted schedule is ordered by time', [[[60, 50], [0, 10], [30, 25]], 45], [25, 2]),
  ('later entry wins a timestamp tie', [[[0, 5], [30, 50], [30, 20]], 40], [20, 2]),
  ('hold step keeps previous percentage', [[[0, 25], [30, None]], 40], [25, 1]),
  ('explicit rollback to zero percent', [[[0, 25], [30, 0]], 40], [0, 1]),
  ('over-hundred percent is clamped', [[[0, 150]], 10], [100, 0]),
  ('ramp schedule sample 6', [[[60, 0], [30, 50], [60, 75]], 60], [75, 2]),
  ('ramp schedule sample 17', [[[45, 5], [20, 120], [20, 50], [10, 100], [45, 75]], 20], [50, 2])],
 [('later entry wins a timestamp tie', [[[0, 5], [30, 50], [30, 20]], 40], [20, 2]),
  ('hold step keeps previous percentage', [[[0, 25], [30, None]], 40], [25, 1]),
  ('explicit rollback to zero percent', [[[0, 25], [30, 0]], 40], [0, 1]),
  ('over-hundred percent is clamped', [[[0, 150]], 10], [100, 0]),
  ('negative percent is clamped to zero', [[[0, 10], [5, -20]], 10], [0, 1]),
  ('ramp schedule sample 11', [[[0, 5]], -5], [0, -1]),
  ('ramp schedule sample 33', [[[0, 50]], 0], [50, 0]),
  ('ramp schedule sample 36', [[[10, 50], [20, 25], [30, None], [45, 0], [30, 25], [10, 0]], 20], [25, 1])],
 [('hold step keeps previous percentage', [[[0, 25], [30, None]], 40], [25, 1]),
  ('explicit rollback to zero percent', [[[0, 25], [30, 0]], 40], [0, 1]),
  ('over-hundred percent is clamped', [[[0, 150]], 10], [100, 0]),
  ('negative percent is clamped to zero', [[[0, 10], [5, -20]], 10], [0, 1]),
  ('before first step is zero', [[[10, 50]], 5], [0, -1]),
  ('ramp schedule sample 16', [[[60, 120]], 60], [100, 0]),
  ('ramp schedule sample 46', [[[30, 100], [20, 25], [30, -10], [30, 50], [30, None]], 30], [50, 4]),
  ('ramp schedule sample 54', [[[60, 0], [20, 50], [20, -10]], 60], [0, 0])],
 [('explicit rollback to zero percent', [[[0, 25], [30, 0]], 40], [0, 1]),
  ('over-hundred percent is clamped', [[[0, 150]], 10], [100, 0]),
  ('negative percent is clamped to zero', [[[0, 10], [5, -20]], 10], [0, 1]),
  ('before first step is zero', [[[10, 50]], 5], [0, -1]),
  ('active index refers to original position', [[[20, 30], [10, 10]], 15], [10, 1]),
  ('ramp schedule sample 6', [[[60, 0], [30, 50], [60, 75]], 60], [75, 2]),
  ('ramp schedule sample 15', [[[30, 50], [20, 120], [10, -10], [20, 5]], 30], [50, 0]),
  ('ramp schedule sample 21', [[], 0], [0, -1])]]
for label, args, expected in fixtures[N - 1]:
    check(label, solve(*args), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
Boundary fixtureActualExpectedOutcome
step scheduled exactly now is active[5, 0][25, 1]Failed
unsorted schedule is ordered by time[25, 2][25, 2]Passed
later entry wins a timestamp tie[20, 2][20, 2]Passed
hold step keeps previous percentage[25, 1][25, 1]Passed
explicit rollback to zero percent[0, 1][0, 1]Passed
ramp schedule sample 1[0, 2][25, 5]Failed
ramp schedule sample 2[0, -1][0, -1]Passed
ramp schedule sample 3[0, 1][0, 1]Passed

SHA-256 / f0c814b176bdf7fed396f3e1af130e9af1d495837378f2e3a05be83c8e22e169

2 / The unsuccessful fix

Exit 1
"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(steps, now):
    order = sorted(range(len(steps)), key=lambda i: (steps[i][0], i))
    current = 0
    active = -1
    for i in order:
        at, pct = steps[i]
        if at >= now and pct is not None:
            break
        active = i
        if pct is not None:
            current = min(max(pct, 0), 100)
    return [current, active]
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [[('step scheduled exactly now is active', [[[0, 5], [60, 25]], 60], [25, 1]),
  ('unsorted schedule is ordered by time', [[[60, 50], [0, 10], [30, 25]], 45], [25, 2]),
  ('later entry wins a timestamp tie', [[[0, 5], [30, 50], [30, 20]], 40], [20, 2]),
  ('hold step keeps previous percentage', [[[0, 25], [30, None]], 40], [25, 1]),
  ('explicit rollback to zero percent', [[[0, 25], [30, 0]], 40], [0, 1]),
  ('ramp schedule sample 1', [[[45, 0], [45, 5], [20, None], [45, 25], [60, -10], [45, None]], 45], [25, 5]),
  ('ramp schedule sample 2', [[[20, 0], [30, 50]], 10], [0, -1]),
  ('ramp schedule sample 3', [[[30, 0], [0, None], [60, 100]], 25], [0, 1])],
 [('step scheduled exactly now is active', [[[0, 5], [60, 25]], 60], [25, 1]),
  ('unsorted schedule is ordered by time', [[[60, 50], [0, 10], [30, 25]], 45], [25, 2]),
  ('later entry wins a timestamp tie', [[[0, 5], [30, 50], [30, 20]], 40], [20, 2]),
  ('hold step keeps previous percentage', [[[0, 25], [30, None]], 40], [25, 1]),
  ('explicit rollback to zero percent', [[[0, 25], [30, 0]], 40], [0, 1]),
  ('over-hundred percent is clamped', [[[0, 150]], 10], [100, 0]),
  ('ramp schedule sample 6', [[[60, 0], [30, 50], [60, 75]], 60], [75, 2]),
  ('ramp schedule sample 17', [[[45, 5], [20, 120], [20, 50], [10, 100], [45, 75]], 20], [50, 2])],
 [('later entry wins a timestamp tie', [[[0, 5], [30, 50], [30, 20]], 40], [20, 2]),
  ('hold step keeps previous percentage', [[[0, 25], [30, None]], 40], [25, 1]),
  ('explicit rollback to zero percent', [[[0, 25], [30, 0]], 40], [0, 1]),
  ('over-hundred percent is clamped', [[[0, 150]], 10], [100, 0]),
  ('negative percent is clamped to zero', [[[0, 10], [5, -20]], 10], [0, 1]),
  ('ramp schedule sample 11', [[[0, 5]], -5], [0, -1]),
  ('ramp schedule sample 33', [[[0, 50]], 0], [50, 0]),
  ('ramp schedule sample 36', [[[10, 50], [20, 25], [30, None], [45, 0], [30, 25], [10, 0]], 20], [25, 1])],
 [('hold step keeps previous percentage', [[[0, 25], [30, None]], 40], [25, 1]),
  ('explicit rollback to zero percent', [[[0, 25], [30, 0]], 40], [0, 1]),
  ('over-hundred percent is clamped', [[[0, 150]], 10], [100, 0]),
  ('negative percent is clamped to zero', [[[0, 10], [5, -20]], 10], [0, 1]),
  ('before first step is zero', [[[10, 50]], 5], [0, -1]),
  ('ramp schedule sample 16', [[[60, 120]], 60], [100, 0]),
  ('ramp schedule sample 46', [[[30, 100], [20, 25], [30, -10], [30, 50], [30, None]], 30], [50, 4]),
  ('ramp schedule sample 54', [[[60, 0], [20, 50], [20, -10]], 60], [0, 0])],
 [('explicit rollback to zero percent', [[[0, 25], [30, 0]], 40], [0, 1]),
  ('over-hundred percent is clamped', [[[0, 150]], 10], [100, 0]),
  ('negative percent is clamped to zero', [[[0, 10], [5, -20]], 10], [0, 1]),
  ('before first step is zero', [[[10, 50]], 5], [0, -1]),
  ('active index refers to original position', [[[20, 30], [10, 10]], 15], [10, 1]),
  ('ramp schedule sample 6', [[[60, 0], [30, 50], [60, 75]], 60], [75, 2]),
  ('ramp schedule sample 15', [[[30, 50], [20, 120], [10, -10], [20, 5]], 30], [50, 0]),
  ('ramp schedule sample 21', [[], 0], [0, -1])]]
for label, args, expected in fixtures[N - 1]:
    check(label, solve(*args), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
Boundary fixtureActualExpectedOutcome
step scheduled exactly now is active[5, 0][25, 1]Failed
unsorted schedule is ordered by time[25, 2][25, 2]Passed
later entry wins a timestamp tie[20, 2][20, 2]Passed
hold step keeps previous percentage[25, 1][25, 1]Passed
explicit rollback to zero percent[0, 1][0, 1]Passed
ramp schedule sample 1[0, 2][25, 5]Failed
ramp schedule sample 2[0, -1][0, -1]Passed
ramp schedule sample 3[0, 1][0, 1]Passed

SHA-256 / f55e2bc20b32f72042156ad952e7a7964d471594a92b53322be5565e30ae1047

3 / The verified repair

Exit 0
"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(steps, now):
    order = sorted(range(len(steps)), key=lambda i: (steps[i][0], i))
    current = 0
    active = -1
    for i in order:
        at, pct = steps[i]
        if at > now:
            break
        active = i
        if pct is not None:
            current = min(max(pct, 0), 100)
    return [current, active]
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [[('step scheduled exactly now is active', [[[0, 5], [60, 25]], 60], [25, 1]),
  ('unsorted schedule is ordered by time', [[[60, 50], [0, 10], [30, 25]], 45], [25, 2]),
  ('later entry wins a timestamp tie', [[[0, 5], [30, 50], [30, 20]], 40], [20, 2]),
  ('hold step keeps previous percentage', [[[0, 25], [30, None]], 40], [25, 1]),
  ('explicit rollback to zero percent', [[[0, 25], [30, 0]], 40], [0, 1]),
  ('ramp schedule sample 1', [[[45, 0], [45, 5], [20, None], [45, 25], [60, -10], [45, None]], 45], [25, 5]),
  ('ramp schedule sample 2', [[[20, 0], [30, 50]], 10], [0, -1]),
  ('ramp schedule sample 3', [[[30, 0], [0, None], [60, 100]], 25], [0, 1])],
 [('step scheduled exactly now is active', [[[0, 5], [60, 25]], 60], [25, 1]),
  ('unsorted schedule is ordered by time', [[[60, 50], [0, 10], [30, 25]], 45], [25, 2]),
  ('later entry wins a timestamp tie', [[[0, 5], [30, 50], [30, 20]], 40], [20, 2]),
  ('hold step keeps previous percentage', [[[0, 25], [30, None]], 40], [25, 1]),
  ('explicit rollback to zero percent', [[[0, 25], [30, 0]], 40], [0, 1]),
  ('over-hundred percent is clamped', [[[0, 150]], 10], [100, 0]),
  ('ramp schedule sample 6', [[[60, 0], [30, 50], [60, 75]], 60], [75, 2]),
  ('ramp schedule sample 17', [[[45, 5], [20, 120], [20, 50], [10, 100], [45, 75]], 20], [50, 2])],
 [('later entry wins a timestamp tie', [[[0, 5], [30, 50], [30, 20]], 40], [20, 2]),
  ('hold step keeps previous percentage', [[[0, 25], [30, None]], 40], [25, 1]),
  ('explicit rollback to zero percent', [[[0, 25], [30, 0]], 40], [0, 1]),
  ('over-hundred percent is clamped', [[[0, 150]], 10], [100, 0]),
  ('negative percent is clamped to zero', [[[0, 10], [5, -20]], 10], [0, 1]),
  ('ramp schedule sample 11', [[[0, 5]], -5], [0, -1]),
  ('ramp schedule sample 33', [[[0, 50]], 0], [50, 0]),
  ('ramp schedule sample 36', [[[10, 50], [20, 25], [30, None], [45, 0], [30, 25], [10, 0]], 20], [25, 1])],
 [('hold step keeps previous percentage', [[[0, 25], [30, None]], 40], [25, 1]),
  ('explicit rollback to zero percent', [[[0, 25], [30, 0]], 40], [0, 1]),
  ('over-hundred percent is clamped', [[[0, 150]], 10], [100, 0]),
  ('negative percent is clamped to zero', [[[0, 10], [5, -20]], 10], [0, 1]),
  ('before first step is zero', [[[10, 50]], 5], [0, -1]),
  ('ramp schedule sample 16', [[[60, 120]], 60], [100, 0]),
  ('ramp schedule sample 46', [[[30, 100], [20, 25], [30, -10], [30, 50], [30, None]], 30], [50, 4]),
  ('ramp schedule sample 54', [[[60, 0], [20, 50], [20, -10]], 60], [0, 0])],
 [('explicit rollback to zero percent', [[[0, 25], [30, 0]], 40], [0, 1]),
  ('over-hundred percent is clamped', [[[0, 150]], 10], [100, 0]),
  ('negative percent is clamped to zero', [[[0, 10], [5, -20]], 10], [0, 1]),
  ('before first step is zero', [[[10, 50]], 5], [0, -1]),
  ('active index refers to original position', [[[20, 30], [10, 10]], 15], [10, 1]),
  ('ramp schedule sample 6', [[[60, 0], [30, 50], [60, 75]], 60], [75, 2]),
  ('ramp schedule sample 15', [[[30, 50], [20, 120], [10, -10], [20, 5]], 30], [50, 0]),
  ('ramp schedule sample 21', [[], 0], [0, -1])]]
for label, args, expected in fixtures[N - 1]:
    check(label, solve(*args), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
Boundary fixtureActualExpectedOutcome
step scheduled exactly now is active[25, 1][25, 1]Passed
unsorted schedule is ordered by time[25, 2][25, 2]Passed
later entry wins a timestamp tie[20, 2][20, 2]Passed
hold step keeps previous percentage[25, 1][25, 1]Passed
explicit rollback to zero percent[0, 1][0, 1]Passed
ramp schedule sample 1[25, 5][25, 5]Passed
ramp schedule sample 2[0, -1][0, -1]Passed
ramp schedule sample 3[0, 1][0, 1]Passed

SHA-256 / 0461f83a04af9206ef77c5ae012af16b76232e71e11e0fde74de134d0bac6636

Verification & scope

A deterministic toy flag-evaluation model with a stipulated contract; it does not reproduce any vendor SDK byte for byte. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.

Observations recorded using Python 3.12.14 at 2026-09-29T14:48:52.585250+00:00.

Case digest / dcb6142ab1db433ba179988233569ed2fc44d00c5df1b5cc5d160f51077d7bbd