Pre-training - Graph View The initial phase of training a language model on large-scale text data to learn general language understanding before task-specific fine-tuning. View concept details Related ConceptsLarge Language Models (LLMs) Fine-Tuning Training Data Next-Token Prediction Transformer Model Parameters Transfer Learning ← Back to full graph