RLXF specialist results

Phase 6 — one GRPO LoRA adapter optimized per target profile (paper-aligned per-prompt optimization), 21 curated FEV/paper profiles × 3 FcGPT bases = 64 specialists, all trained to checkpoint-800. Reward = the Phase-4 fev-mcc-best verifier. Each adapter is scored against the verifier on its own target profile and compared to its base; "full-match" = fraction of generations the verifier calls correct on all specified receptors (100 samples/profile).

RLXF works. Across all three bases, target full-profile-match jumps from ~0.10–0.14 (base) to 0.89–0.94 (adapter), Δ agreement +0.3, while validity stays ~0.97–0.99. 40/64 specialists reach full-match ≥ 0.90. retraining_v2 yields the strongest specialists (0.94), consistent with it being the recommended base.

Per-base aggregate (target profile, adapter vs base)

basebase full-matchadapter full-match Δ full-matchΔ agreementadapter validn
paper_reproduction0.140.890.750.3199%21
retraining_v10.100.920.820.3496%21
retraining_v20.100.700.600.2994%21
unknown0.000.610.610.40100%1
Laggards (highlighted below). The sparse 2-receptor partial profiles -----10- / -----01- underperform on some bases (e.g. retraining_v2 -----10- → 0.41 full-match, validity 0.51): the adapter over-mutates (edit ~10) and loses length control — partial reward-hacking on under-constrained targets. The 17 fully-specified FEV-design targets are uniformly strong. Follow-up: strengthen the length/edit penalty (or raise KL) for sparse-target specialists.

Per-specialist (sorted by adapter full-match; amber = full-match or validity < 0.90)

baseprofilebase full-matchadapter full-match Δvalidedit→WT
paper_reproduction010000000.851.000.15100%5.8
paper_reproduction011111110.001.001.00100%6.6
paper_reproduction101111110.711.000.29100%4.7
paper_reproduction111110010.000.990.99100%5.5
paper_reproduction111111100.550.990.44100%5.8
paper_reproduction110000000.270.970.70100%5.9
paper_reproduction010000010.000.960.96100%7.5
paper_reproduction--10----0.000.950.95100%7.2
paper_reproduction010010000.000.950.95100%6.4
paper_reproduction110000010.000.950.95100%7.4
paper_reproduction--01----0.410.940.5396%4.3
paper_reproduction111100000.000.930.93100%7.1
paper_reproduction-----10-0.020.930.9199%5.4
paper_reproduction010001100.000.910.91100%6.0
paper_reproduction111101110.000.870.87100%6.9
paper_reproduction011100010.000.840.84100%7.5
paper_reproduction011100000.000.820.82100%8.3
paper_reproduction110011110.000.740.74100%7.1
paper_reproduction-----01-0.070.660.5980%6.6
paper_reproduction010001110.000.650.65100%8.9
paper_reproduction111100010.000.640.64100%6.2
retraining_v1010000000.801.000.20100%5.2
retraining_v1101111110.411.000.59100%6.4
retraining_v1111100000.001.001.00100%6.0
retraining_v1111111100.681.000.32100%5.0
retraining_v1110000000.050.990.94100%4.4
retraining_v1110011110.000.990.99100%6.6
retraining_v1010000010.000.980.98100%6.4
retraining_v1010010000.000.980.98100%6.1
retraining_v1011111110.000.980.98100%5.8
retraining_v1111101110.000.980.98100%7.3
retraining_v1111110010.000.980.98100%6.7
retraining_v1-----01-0.090.970.8868%5.8
retraining_v1110000010.000.930.93100%6.7
retraining_v1--10----0.030.920.8988%6.0
retraining_v1010001100.000.910.91100%7.3
retraining_v1010001110.000.910.91100%8.8
retraining_v1011100000.000.910.91100%7.5
retraining_v1111100010.000.910.91100%8.1
retraining_v1--01----0.080.750.6796%4.3
retraining_v1011100010.000.670.67100%7.4
retraining_v1-----10-0.020.560.5464%2.6
retraining_v2010000000.691.000.31100%6.0
retraining_v2101111110.331.000.67100%5.0
retraining_v2110000000.211.000.79100%4.1
retraining_v2111111100.670.990.32100%4.0
retraining_v2--01----0.080.980.9086%3.5
retraining_v2010000010.000.960.96100%3.9
retraining_v2011111110.030.960.93100%5.4
retraining_v2--10----0.000.900.9093%4.1
retraining_v2111100010.000.880.88100%7.0
retraining_v2111100000.000.870.87100%6.2
retraining_v2011100000.000.840.84100%6.4
retraining_v2111101110.000.830.83100%6.8
retraining_v2110000010.000.800.80100%4.6
retraining_v2111110010.000.650.65100%4.7
retraining_v2010010000.000.610.61100%4.3
retraining_v2011100010.000.450.45100%6.9
retraining_v2010001100.000.410.41100%4.8
retraining_v2-----10-0.000.370.3743%8.2
retraining_v2-----01-0.110.200.0950%5.8
retraining_v2110011110.000.060.06100%3.0
retraining_v2010001110.000.010.01100%4.8
unknown011100010.000.610.61100%5.6