AI PM Ready

AI risk & quality

AI fails silently, gradually, and unpredictably. The PM who understands AI-specific risk signals seniority in every interview and every incident.

Unlike traditional software that fails loudly (exceptions, 500 errors), AI fails silently. A model can degrade for weeks while passing automated checks. These are the six risk categories every AI PM tracks — with likelihood, severity, and the PM-owned signal for each.

Model RiskLikelihood: Very HighSeverity: High

Hallucination (confident wrong outputs), distributional shift (production inputs differ from training), adversarial inputs (deliberate manipulation), and model drift (gradual degradation as the world changes). All are normal — the PM job is to design for detection and recovery, not prevention alone.

PM-Owned Signal

Correction rate rising, user overrides increasing

PM Mitigation

Golden test set weekly regression + correction rate dashboard from Day 1.

Real Example

GPT-4 Bing hallucinated legal citations; users filed complaints before monitoring flagged it. Normal behavior — the PM's job is to design detection, not assume prevention.

Was this page useful?