Causal · Counterfactual · RLHF Research Console
Tenantconsolidated · 14 tenants
Window
live · refreshed 14s ago
Causal ROICounterfactualsSimulation LabLearning TimelineRec QualityPolicy EvolutionTreatment vs Control
Recommendation Quality Tracker
Acceptance × realized impact × override pressure
live · 28d window · n=18,420
Quality by confidence band
count · accept rate · realized impact (vs predicted)0.95-1.00
412
94%
1.06x
0.85-0.95
1,820
81%
0.92x
0.75-0.85
2,410
62%
0.74x
0.65-0.75
1,740
41%
0.58x
0.50-0.65
820
18%
0.31x
< 0.50
240
4%
0.10x
Conf band
Count
Accept
Realized
Quality score
composite · 7d MAComposite score
0.847
Calibration error
0.041
Acceptance lift (7d)
+3.2pp
Realized/predicted
0.94x
Override rate
11.8%
Recs / day
1,820
Override impact heatmap
day × hour · destructive override pressure0h
2h
4h
6h
8h
10h
12h
14h
16h
18h
20h
22h
Mon
Tue
Wed
Thu
Fri
Sat
Sun
lowhigh override pressure
Override reasons
Carrier preference
412
Customer constraint
318
Capacity unavailable
261
Risk too high
184
Conflicts with SLA
142
Other
88
Realized vs predicted (28d)
d-14
-13%
d-13
3%
d-12
-1%
d-11
-1%
d-10
4%
d-9
1%
d-8
-4%
d-7
-14%
d-6
-9%
d-5
-15%
d-4
-4%
d-3
4%
d-2
-5%
d-1
2%
predicted realized