FA-100046 / Preference pair construction / Open access

Preference pairs: equal ratings produce an oriented pair · case 01

equal ratings produce an oriented pair.

Verified by executionVariant 1 · 6 checks per implementationDownload source bundle ↓JSON ↗

ROOT CAUSE

The constructor uses input order to invent a winner when annotators tie.

THE FAILURE

The constructor uses input order to invent a winner when annotators tie.

Unsuccessful approach: Choosing the right side on ties instead of the left still invents a winner for equal ratings.

Case contract

Each record is [left_text,right_text,left_rating,right_rating]. Return [chosen,rejected] only for strict wins; ties produce None.

Why this case matters

A small deterministic preference-data transform makes pair semantics inspectable without a training framework.

1 / The failure

Exit 1

"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(records):
    return [[r[0],r[1]] if r[2]>=r[3] else [r[1],r[0]] for r in records]
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
check('left wins',solve([['L','R',N+1,N]]),[['L','R']])
check('right wins',solve([['L','R',N,N+1]]),[['R','L']])
check('nonzero tie',solve([['L','R',N,N]]),[None])
check('empty',solve([]),[])
check('negative strict win',solve([['L','R',-N,-N-1]]),[['L','R']])
check('mixed rows',solve([['a','b',2,1],['c','d',3,3]]),[['a','b'],None])
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)

Boundary fixture	Actual	Expected	Outcome
left wins	`[['L', 'R']]`	`[['L', 'R']]`	Passed
right wins	`[['R', 'L']]`	`[['R', 'L']]`	Passed
nonzero tie	`[['L', 'R']]`	`[None]`	Failed
empty	`[]`	`[]`	Passed
negative strict win	`[['L', 'R']]`	`[['L', 'R']]`	Passed
mixed rows	`[['a', 'b'], ['c', 'd']]`	`[['a', 'b'], None]`	Failed

SHA-256 / 56ef1bd9b86358c55c7036541ca5e556e862893553c2646dd45a8f6151eee912

2 / The unsuccessful fix

Exit 1

"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(records):
    return [[r[0],r[1]] if r[2]>r[3] else ([r[1],r[0]] if r[3]>r[2] else [r[1],r[0]]) for r in records]
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
check('left wins',solve([['L','R',N+1,N]]),[['L','R']])
check('right wins',solve([['L','R',N,N+1]]),[['R','L']])
check('nonzero tie',solve([['L','R',N,N]]),[None])
check('empty',solve([]),[])
check('negative strict win',solve([['L','R',-N,-N-1]]),[['L','R']])
check('mixed rows',solve([['a','b',2,1],['c','d',3,3]]),[['a','b'],None])
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)

Boundary fixture	Actual	Expected	Outcome
left wins	`[['L', 'R']]`	`[['L', 'R']]`	Passed
right wins	`[['R', 'L']]`	`[['R', 'L']]`	Passed
nonzero tie	`[['R', 'L']]`	`[None]`	Failed
empty	`[]`	`[]`	Passed
negative strict win	`[['L', 'R']]`	`[['L', 'R']]`	Passed
mixed rows	`[['a', 'b'], ['d', 'c']]`	`[['a', 'b'], None]`	Failed

SHA-256 / 9be9f6cff25f07c4df5e49a6bc54ac784550ef1cb19c49b931b4d885fd562c3c

HELD IN THE MEMBER ARCHIVE

The verified repair and its recorded checks are member-only.

This mechanism has 6 recorded checks per implementation. The open-access tier publishes the failure and the unsuccessful fix; the repaired source that passes every check, and the observations that prove it, are available to members.

Every case sharing this mechanism uses the same contract and the same repair, so this one record is held back for all of them.

Member access is invitation-based. Sign in with your invited account to inspect the repair.

Verification & scope

These are explicit toy record contracts; they do not claim compatibility with a trainer or improved model behavior. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.

Observations recorded using Python 3.12.14 at 2026-09-30T16:48:31.262256+00:00.

Case digest / e4cf8b180af4039c2514210d6cb605371dc519c1ca5691aab70b18019cffba39