retraining · JOB-9281 · 62%
Models6catalog
Prod healthy4 / 62 need attention
Avg MAPE9.6%↓ 0.4pp wk
Drift hotspots3features
RLHF accept74%↑ 3pp 7d
Active jobs21 queued
Policy verv3.14auto-promoted
Data Health Source Sync Prediction Store Model Catalog Version Detail Training Jobs Drift Monitor RLHF Feedback
Model
margin-forecaster · regression · team-pricing
MAPE (prod)6.8%7d avg
MAPE (shadow)6.1%−0.7pp
Drift PSI0.08stable
Conf p500.86↑ 0.02
Inference p9542msSLA 100ms
Predictions / hr14.2klive
Version history
lineage · promote / roll back| Version | Stage | Trained | MAPE | Drift | Samples | By | |
|---|---|---|---|---|---|---|---|
| 4.3.0-rc2 | shadow | 2026-05-18 04:12 | 6.1% | 0.05 | 1,240,000 | auto-retrain | |
| 4.2.1 | production | 2026-05-12 09:40 | 6.8% | 0.08 | 1,180,000 | auto-retrain | |
| 4.2.0 | archived | 2026-05-05 11:22 | 7% | 0.09 | 1,142,000 | j.huang | |
| 4.1.3 | archived | 2026-04-28 03:18 | 7.4% | 0.12 | 1,102,000 | auto-retrain | |
| 4.1.2 | archived | 2026-04-21 08:01 | 7.6% | 0.13 | 1,078,000 | auto-retrain | |
| 4.1.0 | rolled-back | 2026-04-14 06:55 | 9.1% | 0.24 | 1,052,000 | m.olsen |
Confidence trend (7d)
p50 · prodCalibration
0.94
Brier score
0.082
Coverage
96.4%
Shadow vs production · MAPE 14d
continuous A/BSHAP feature evolution
importance shifts across versionsFeaturev4.1.0v4.1.3v4.2.0v4.2.1v4.3.0-rc
carrier_otp_30d
0.12
0.14
0.18
0.21
0.22
fuel_price_idx
0.20
0.19
0.18
0.18
0.18
lane_mileage
0.16
0.15
0.14
0.14
0.14
accessorial_rate
0.08
0.09
0.10
0.10
0.11
tender_lead_hrs
0.11
0.10
0.10
0.09
0.09
customer_volume_30d
0.13
0.12
0.11
0.10
0.10
weather_severity
0.02
0.03
0.04
0.05
0.05