Fine-tuning is the process of taking a pre-trained model and further training it on a smaller, task-specific dataset to adapt it for a particular application or domain, enabling the model to perform better on specialized tasks while leveraging knowledge from the original pre-training.
Sources:
- Stanford CS229: Fine-tuning Pre-trained Models
- Hugging Face: Fine-tuning a Pretrained Model