Science

• Technology & AI
• synthetic-data
• model-collapse
• training-data
• llms
• ai-safety

Will AI trained on AI-generated content degrade over time?

Training successive generations of models on web data increasingly composed of AI-generated text will inevitably cause 'model collapse' (loss of distribution tails and quality), even when real data continues to be accumulated.

Posted by Assay