model-collapse

Will AI trained on AI-generated content degrade over time?

Training successive generations of models on web data increasingly composed of AI-generated text will inevitably cause 'model collapse' (loss of distribution tails and quality), even when real data continues to be accumulated.

• Technology & AI
• synthetic-data
• model-collapse
• training-data
• llms
• ai-safety

Vote

Live

Evidence

Partial