FA-74111 / Feature flag rollout bucketing / Open access

Semantic version clause: Prereleases outrank their release · case 01

A "greater than 1.0.0-rc.1" rule excludes the final 1.0.0 release.

Verified by executionVariant 1 · 8 checks per implementationDownload source bundle ↓JSON ↗

ROOT CAUSE

When exactly one side has a prerelease, the sign of the comparison is inverted.

VERIFIED REPAIR

Rank the version without a prerelease above the one with a prerelease.

Unsuccessful approach: Declaring them equal hides the difference between a release candidate and the release.

Case contract

Versions are MAJOR[.MINOR[.PATCH]][-prerelease][+build]; missing components are 0, build metadata is ignored, anything else is invalid (return None). A release outranks its prereleases; prerelease identifiers compare numerically when all digits, lexically otherwise, numeric below alphanumeric, and a shorter identifier list ranks lower when it is a prefix. op is semVerLessThan, semVerEqual or semVerGreaterThan; unknown ops return None.

Why this case matters

Targeting by app version gates features to clients that can render them.

1 / The failure

Exit 1

"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(version, op, target):
    def parse(s):
        s = s.split('+', 1)[0]
        core, _, pre = s.partition('-')
        parts = core.split('.')
        if not 1 <= len(parts) <= 3 or not all(p.isdigit() for p in parts):
            return None
        nums = [int(p) for p in parts] + [0] * (3 - len(parts))
        ids = pre.split('.') if pre else []
        return nums, ids
    def key_id(i):
        return (0, int(i), '') if i.isdigit() else (1, 0, i)
    def cmp(a, b):
        if a[0] != b[0]:
            return -1 if a[0] < b[0] else 1
        x, y = a[1], b[1]
        if not x or not y:
            return (len(y) == 0) - (len(x) == 0) if (x or y) else 0
        for p, q in zip(x, y):
            kp, kq = key_id(p), key_id(q)
            if kp != kq:
                return -1 if kp < kq else 1
        return (len(x) > len(y)) - (len(x) < len(y))
    a, b = parse(version), parse(target)
    if a is None or b is None:
        return None
    c = cmp(a, b)
    return {'semVerLessThan': c < 0, 'semVerEqual': c == 0, 'semVerGreaterThan': c > 0}.get(op)
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [[('numeric prerelease identifiers compare as numbers',
   ['1.0.0-beta.11', 'semVerGreaterThan', '1.0.0-beta.2'],
   True),
  ('numeric identifier ranks below alphanumeric', ['1.0.0-1', 'semVerLessThan', '1.0.0-alpha'], True),
  ('release outranks its prerelease', ['1.0.0', 'semVerGreaterThan', '1.0.0-rc.1'], True),
  ('two-component version pads patch', ['2.1', 'semVerEqual', '2.1.0'], True),
  ('build metadata is ignored', ['1.0.0+build.5', 'semVerEqual', '1.0.0'], True),
  ('version pair sample 1', ['1.0.0-beta.11', 'semVerEqual', '1.0.0-alpha'], False),
  ('version pair sample 2', ['1.0.0-alpha', 'semVerEqual', '1.0.0'], False),
  ('version pair sample 3', ['1.0.0-alpha.10', 'semVerLessThan', '1.0.0+build.5'], True)],
 [('numeric identifier ranks below alphanumeric', ['1.0.0-1', 'semVerLessThan', '1.0.0-alpha'], True),
  ('release outranks its prerelease', ['1.0.0', 'semVerGreaterThan', '1.0.0-rc.1'], True),
  ('two-component version pads patch', ['2.1', 'semVerEqual', '2.1.0'], True),
  ('build metadata is ignored', ['1.0.0+build.5', 'semVerEqual', '1.0.0'], True),
  ('build metadata after prerelease is ignored', ['1.0.0-rc.1+b7', 'semVerEqual', '1.0.0-rc.1'], True),
  ('version pair sample 6', ['1.0.0.0', 'semVerEqual', '2.1'], None),
  ('version pair sample 27', ['1.0.0-10', 'semVerLessThan', '1.0.0+build.5'], True),
  ('version pair sample 46', ['1.0.0-10', 'semVerLessThan', '1.0.0'], True)],
 [('release outranks its prerelease', ['1.0.0', 'semVerGreaterThan', '1.0.0-rc.1'], True),
  ('two-component version pads patch', ['2.1', 'semVerEqual', '2.1.0'], True),
  ('build metadata is ignored', ['1.0.0+build.5', 'semVerEqual', '1.0.0'], True),
  ('build metadata after prerelease is ignored', ['1.0.0-rc.1+b7', 'semVerEqual', '1.0.0-rc.1'], True),
  ('longer prerelease list ranks higher', ['1.0.0-alpha.1', 'semVerGreaterThan', '1.0.0-alpha'], True),
  ('version pair sample 11', ['1.0.0+build.5', 'semVerLessThan', '1.0.0.0'], None),
  ('version pair sample 36', ['1.0.0-beta.11', 'semVerLessThan', '1.0.0+build.5'], True),
  ('version pair sample 58', ['1', 'semVerGreaterThan', '1.0.0-alpha.beta'], True)],
 [('two-component version pads patch', ['2.1', 'semVerEqual', '2.1.0'], True),
  ('build metadata is ignored', ['1.0.0+build.5', 'semVerEqual', '1.0.0'], True),
  ('build metadata after prerelease is ignored', ['1.0.0-rc.1+b7', 'semVerEqual', '1.0.0-rc.1'], True),
  ('longer prerelease list ranks higher', ['1.0.0-alpha.1', 'semVerGreaterThan', '1.0.0-alpha'], True),
  ('minor ten beats minor nine', ['2.10.0', 'semVerGreaterThan', '2.9.0'], True),
  ('version pair sample 3', ['1.0.0-alpha.10', 'semVerLessThan', '1.0.0+build.5'], True),
  ('version pair sample 16', ['1.0.0-alpha.10', 'semVerEqual', '1.0.0'], False),
  ('version pair sample 17', ['2.9.0', 'semVerEqual', '1.0.0-alpha.10'], False)],
 [('build metadata is ignored', ['1.0.0+build.5', 'semVerEqual', '1.0.0'], True),
  ('build metadata after prerelease is ignored', ['1.0.0-rc.1+b7', 'semVerEqual', '1.0.0-rc.1'], True),
  ('longer prerelease list ranks higher', ['1.0.0-alpha.1', 'semVerGreaterThan', '1.0.0-alpha'], True),
  ('minor ten beats minor nine', ['2.10.0', 'semVerGreaterThan', '2.9.0'], True),
  ('four components are invalid', ['1.0.0.0', 'semVerEqual', '1.0.0'], None),
  ('version pair sample 21', ['2.1.0', 'semVerGreaterThan', '2.1'], False),
  ('version pair sample 55', ['1.0', 'semVerEqual', '1.0.0-10'], False),
  ('version pair sample 58', ['1', 'semVerGreaterThan', '1.0.0-alpha.beta'], True)]]
for label, args, expected in fixtures[N - 1]:
    check(label, solve(*args), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)

Boundary fixture	Actual	Expected	Outcome
numeric prerelease identifiers compare as numbers	`True`	`True`	Passed
numeric identifier ranks below alphanumeric	`True`	`True`	Passed
release outranks its prerelease	`False`	`True`	Failed
two-component version pads patch	`True`	`True`	Passed
build metadata is ignored	`True`	`True`	Passed
version pair sample 1	`False`	`False`	Passed
version pair sample 2	`False`	`False`	Passed
version pair sample 3	`False`	`True`	Failed

SHA-256 / 07aa6dceedcf8a1784fda3e46d7b21fdd700a3fde5f741ce042caf46e450fe17

2 / The unsuccessful fix

Exit 1

"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(version, op, target):
    def parse(s):
        s = s.split('+', 1)[0]
        core, _, pre = s.partition('-')
        parts = core.split('.')
        if not 1 <= len(parts) <= 3 or not all(p.isdigit() for p in parts):
            return None
        nums = [int(p) for p in parts] + [0] * (3 - len(parts))
        ids = pre.split('.') if pre else []
        return nums, ids
    def key_id(i):
        return (0, int(i), '') if i.isdigit() else (1, 0, i)
    def cmp(a, b):
        if a[0] != b[0]:
            return -1 if a[0] < b[0] else 1
        x, y = a[1], b[1]
        if not x or not y:
            return 0
        for p, q in zip(x, y):
            kp, kq = key_id(p), key_id(q)
            if kp != kq:
                return -1 if kp < kq else 1
        return (len(x) > len(y)) - (len(x) < len(y))
    a, b = parse(version), parse(target)
    if a is None or b is None:
        return None
    c = cmp(a, b)
    return {'semVerLessThan': c < 0, 'semVerEqual': c == 0, 'semVerGreaterThan': c > 0}.get(op)
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [[('numeric prerelease identifiers compare as numbers',
   ['1.0.0-beta.11', 'semVerGreaterThan', '1.0.0-beta.2'],
   True),
  ('numeric identifier ranks below alphanumeric', ['1.0.0-1', 'semVerLessThan', '1.0.0-alpha'], True),
  ('release outranks its prerelease', ['1.0.0', 'semVerGreaterThan', '1.0.0-rc.1'], True),
  ('two-component version pads patch', ['2.1', 'semVerEqual', '2.1.0'], True),
  ('build metadata is ignored', ['1.0.0+build.5', 'semVerEqual', '1.0.0'], True),
  ('version pair sample 1', ['1.0.0-beta.11', 'semVerEqual', '1.0.0-alpha'], False),
  ('version pair sample 2', ['1.0.0-alpha', 'semVerEqual', '1.0.0'], False),
  ('version pair sample 3', ['1.0.0-alpha.10', 'semVerLessThan', '1.0.0+build.5'], True)],
 [('numeric identifier ranks below alphanumeric', ['1.0.0-1', 'semVerLessThan', '1.0.0-alpha'], True),
  ('release outranks its prerelease', ['1.0.0', 'semVerGreaterThan', '1.0.0-rc.1'], True),
  ('two-component version pads patch', ['2.1', 'semVerEqual', '2.1.0'], True),
  ('build metadata is ignored', ['1.0.0+build.5', 'semVerEqual', '1.0.0'], True),
  ('build metadata after prerelease is ignored', ['1.0.0-rc.1+b7', 'semVerEqual', '1.0.0-rc.1'], True),
  ('version pair sample 6', ['1.0.0.0', 'semVerEqual', '2.1'], None),
  ('version pair sample 27', ['1.0.0-10', 'semVerLessThan', '1.0.0+build.5'], True),
  ('version pair sample 46', ['1.0.0-10', 'semVerLessThan', '1.0.0'], True)],
 [('release outranks its prerelease', ['1.0.0', 'semVerGreaterThan', '1.0.0-rc.1'], True),
  ('two-component version pads patch', ['2.1', 'semVerEqual', '2.1.0'], True),
  ('build metadata is ignored', ['1.0.0+build.5', 'semVerEqual', '1.0.0'], True),
  ('build metadata after prerelease is ignored', ['1.0.0-rc.1+b7', 'semVerEqual', '1.0.0-rc.1'], True),
  ('longer prerelease list ranks higher', ['1.0.0-alpha.1', 'semVerGreaterThan', '1.0.0-alpha'], True),
  ('version pair sample 11', ['1.0.0+build.5', 'semVerLessThan', '1.0.0.0'], None),
  ('version pair sample 36', ['1.0.0-beta.11', 'semVerLessThan', '1.0.0+build.5'], True),
  ('version pair sample 58', ['1', 'semVerGreaterThan', '1.0.0-alpha.beta'], True)],
 [('two-component version pads patch', ['2.1', 'semVerEqual', '2.1.0'], True),
  ('build metadata is ignored', ['1.0.0+build.5', 'semVerEqual', '1.0.0'], True),
  ('build metadata after prerelease is ignored', ['1.0.0-rc.1+b7', 'semVerEqual', '1.0.0-rc.1'], True),
  ('longer prerelease list ranks higher', ['1.0.0-alpha.1', 'semVerGreaterThan', '1.0.0-alpha'], True),
  ('minor ten beats minor nine', ['2.10.0', 'semVerGreaterThan', '2.9.0'], True),
  ('version pair sample 3', ['1.0.0-alpha.10', 'semVerLessThan', '1.0.0+build.5'], True),
  ('version pair sample 16', ['1.0.0-alpha.10', 'semVerEqual', '1.0.0'], False),
  ('version pair sample 17', ['2.9.0', 'semVerEqual', '1.0.0-alpha.10'], False)],
 [('build metadata is ignored', ['1.0.0+build.5', 'semVerEqual', '1.0.0'], True),
  ('build metadata after prerelease is ignored', ['1.0.0-rc.1+b7', 'semVerEqual', '1.0.0-rc.1'], True),
  ('longer prerelease list ranks higher', ['1.0.0-alpha.1', 'semVerGreaterThan', '1.0.0-alpha'], True),
  ('minor ten beats minor nine', ['2.10.0', 'semVerGreaterThan', '2.9.0'], True),
  ('four components are invalid', ['1.0.0.0', 'semVerEqual', '1.0.0'], None),
  ('version pair sample 21', ['2.1.0', 'semVerGreaterThan', '2.1'], False),
  ('version pair sample 55', ['1.0', 'semVerEqual', '1.0.0-10'], False),
  ('version pair sample 58', ['1', 'semVerGreaterThan', '1.0.0-alpha.beta'], True)]]
for label, args, expected in fixtures[N - 1]:
    check(label, solve(*args), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)

Boundary fixture	Actual	Expected	Outcome
numeric prerelease identifiers compare as numbers	`True`	`True`	Passed
numeric identifier ranks below alphanumeric	`True`	`True`	Passed
release outranks its prerelease	`False`	`True`	Failed
two-component version pads patch	`True`	`True`	Passed
build metadata is ignored	`True`	`True`	Passed
version pair sample 1	`False`	`False`	Passed
version pair sample 2	`True`	`False`	Failed
version pair sample 3	`False`	`True`	Failed

SHA-256 / 16f3f4bc99b5e9af54bcfffb9ffb3168ba2a813ef02d9a4a1800b62f0611ca57

3 / The verified repair

Exit 0

"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(version, op, target):
    def parse(s):
        s = s.split('+', 1)[0]
        core, _, pre = s.partition('-')
        parts = core.split('.')
        if not 1 <= len(parts) <= 3 or not all(p.isdigit() for p in parts):
            return None
        nums = [int(p) for p in parts] + [0] * (3 - len(parts))
        ids = pre.split('.') if pre else []
        return nums, ids
    def key_id(i):
        return (0, int(i), '') if i.isdigit() else (1, 0, i)
    def cmp(a, b):
        if a[0] != b[0]:
            return -1 if a[0] < b[0] else 1
        x, y = a[1], b[1]
        if not x or not y:
            return (len(x) == 0) - (len(y) == 0) if (x or y) else 0
        for p, q in zip(x, y):
            kp, kq = key_id(p), key_id(q)
            if kp != kq:
                return -1 if kp < kq else 1
        return (len(x) > len(y)) - (len(x) < len(y))
    a, b = parse(version), parse(target)
    if a is None or b is None:
        return None
    c = cmp(a, b)
    return {'semVerLessThan': c < 0, 'semVerEqual': c == 0, 'semVerGreaterThan': c > 0}.get(op)
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [[('numeric prerelease identifiers compare as numbers',
   ['1.0.0-beta.11', 'semVerGreaterThan', '1.0.0-beta.2'],
   True),
  ('numeric identifier ranks below alphanumeric', ['1.0.0-1', 'semVerLessThan', '1.0.0-alpha'], True),
  ('release outranks its prerelease', ['1.0.0', 'semVerGreaterThan', '1.0.0-rc.1'], True),
  ('two-component version pads patch', ['2.1', 'semVerEqual', '2.1.0'], True),
  ('build metadata is ignored', ['1.0.0+build.5', 'semVerEqual', '1.0.0'], True),
  ('version pair sample 1', ['1.0.0-beta.11', 'semVerEqual', '1.0.0-alpha'], False),
  ('version pair sample 2', ['1.0.0-alpha', 'semVerEqual', '1.0.0'], False),
  ('version pair sample 3', ['1.0.0-alpha.10', 'semVerLessThan', '1.0.0+build.5'], True)],
 [('numeric identifier ranks below alphanumeric', ['1.0.0-1', 'semVerLessThan', '1.0.0-alpha'], True),
  ('release outranks its prerelease', ['1.0.0', 'semVerGreaterThan', '1.0.0-rc.1'], True),
  ('two-component version pads patch', ['2.1', 'semVerEqual', '2.1.0'], True),
  ('build metadata is ignored', ['1.0.0+build.5', 'semVerEqual', '1.0.0'], True),
  ('build metadata after prerelease is ignored', ['1.0.0-rc.1+b7', 'semVerEqual', '1.0.0-rc.1'], True),
  ('version pair sample 6', ['1.0.0.0', 'semVerEqual', '2.1'], None),
  ('version pair sample 27', ['1.0.0-10', 'semVerLessThan', '1.0.0+build.5'], True),
  ('version pair sample 46', ['1.0.0-10', 'semVerLessThan', '1.0.0'], True)],
 [('release outranks its prerelease', ['1.0.0', 'semVerGreaterThan', '1.0.0-rc.1'], True),
  ('two-component version pads patch', ['2.1', 'semVerEqual', '2.1.0'], True),
  ('build metadata is ignored', ['1.0.0+build.5', 'semVerEqual', '1.0.0'], True),
  ('build metadata after prerelease is ignored', ['1.0.0-rc.1+b7', 'semVerEqual', '1.0.0-rc.1'], True),
  ('longer prerelease list ranks higher', ['1.0.0-alpha.1', 'semVerGreaterThan', '1.0.0-alpha'], True),
  ('version pair sample 11', ['1.0.0+build.5', 'semVerLessThan', '1.0.0.0'], None),
  ('version pair sample 36', ['1.0.0-beta.11', 'semVerLessThan', '1.0.0+build.5'], True),
  ('version pair sample 58', ['1', 'semVerGreaterThan', '1.0.0-alpha.beta'], True)],
 [('two-component version pads patch', ['2.1', 'semVerEqual', '2.1.0'], True),
  ('build metadata is ignored', ['1.0.0+build.5', 'semVerEqual', '1.0.0'], True),
  ('build metadata after prerelease is ignored', ['1.0.0-rc.1+b7', 'semVerEqual', '1.0.0-rc.1'], True),
  ('longer prerelease list ranks higher', ['1.0.0-alpha.1', 'semVerGreaterThan', '1.0.0-alpha'], True),
  ('minor ten beats minor nine', ['2.10.0', 'semVerGreaterThan', '2.9.0'], True),
  ('version pair sample 3', ['1.0.0-alpha.10', 'semVerLessThan', '1.0.0+build.5'], True),
  ('version pair sample 16', ['1.0.0-alpha.10', 'semVerEqual', '1.0.0'], False),
  ('version pair sample 17', ['2.9.0', 'semVerEqual', '1.0.0-alpha.10'], False)],
 [('build metadata is ignored', ['1.0.0+build.5', 'semVerEqual', '1.0.0'], True),
  ('build metadata after prerelease is ignored', ['1.0.0-rc.1+b7', 'semVerEqual', '1.0.0-rc.1'], True),
  ('longer prerelease list ranks higher', ['1.0.0-alpha.1', 'semVerGreaterThan', '1.0.0-alpha'], True),
  ('minor ten beats minor nine', ['2.10.0', 'semVerGreaterThan', '2.9.0'], True),
  ('four components are invalid', ['1.0.0.0', 'semVerEqual', '1.0.0'], None),
  ('version pair sample 21', ['2.1.0', 'semVerGreaterThan', '2.1'], False),
  ('version pair sample 55', ['1.0', 'semVerEqual', '1.0.0-10'], False),
  ('version pair sample 58', ['1', 'semVerGreaterThan', '1.0.0-alpha.beta'], True)]]
for label, args, expected in fixtures[N - 1]:
    check(label, solve(*args), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)

Boundary fixture	Actual	Expected	Outcome
numeric prerelease identifiers compare as numbers	`True`	`True`	Passed
numeric identifier ranks below alphanumeric	`True`	`True`	Passed
release outranks its prerelease	`True`	`True`	Passed
two-component version pads patch	`True`	`True`	Passed
build metadata is ignored	`True`	`True`	Passed
version pair sample 1	`False`	`False`	Passed
version pair sample 2	`False`	`False`	Passed
version pair sample 3	`True`	`True`	Passed

SHA-256 / ad57c5d62b48214cb1ce6bb2066639c5de216b08e57c883fe6edf3de6c3667e0

Verification & scope

A deterministic toy flag-evaluation model with a stipulated contract; it does not reproduce any vendor SDK byte for byte. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.

Observations recorded using Python 3.12.14 at 2026-09-29T14:48:53.739555+00:00.

Case digest / b9a353e076a44fa59ddd73f9e12edc91beed3aba98242aeccf987703d01065f6