A Map for Studying Pre-training in LLMs
- Data Collection
- General Text Data
- Specialized Data
- Data Preprocessing
- Quality Filtering
- Deduplication
TRISHA SHARMA us107
🎯
ritwikraha
/ Pretraining-LLM.md
Last active
November 1, 2025 15:09
Pretraining of Large Language Models