AI Bias
Systematic errors or unfair outcomes in AI systems, often resulting from skewed training data, flawed model design, or societal inequalities reflected in the data.
AI bias occurs when machine learning systems produce results that are systematically prejudiced against certain groups or outcomes. This is a critical concern for AI deployment in high-stakes domains like hiring, lending, criminal justice, and healthcare.
Common sources of bias:
- Training Data Bias: Underrepresentation or historical prejudice in training examples
- Labeling Bias: Human annotators’ subjective judgments influence ground truth
- Selection Bias: Training data doesn’t match the real-world distribution
- Algorithmic Bias: Model architecture or objective functions introduce bias
- Deployment Bias: Models used in contexts different from their training
Mitigation strategies include diverse and representative data collection, fairness-aware algorithms, bias auditing tools, red-teaming, and human oversight. Despite progress, debiasing AI remains an open research challenge, as bias is often deeply embedded in both data and societal structures.
Related Terms
Get smarter about AI
The sharpest AI news, curated daily. Delivered free to your inbox.