
Supervised fine-tuning, often shortened to SFT or simply called fine-tuning, adapts a pre-trained large language model by running additional training on a smaller dataset. Unlike approaches that shape an LLM's behavior without modifying the model itself, SFT changes the model's weights so it fits specific tasks and the data characteristics of a particular domain. For the Professional Machine Learning Engineer exam, the main distinction is understanding what updating those weights accomplishes and when the added work is justified.
Supervised fine-tuning starts with a base LLM that is already pre-trained and usable on its own. Because the base model already knows how language works, SFT does not train a model from scratch. Instead, it adjusts weights that already carry broad general knowledge.
The SFT process pairs that base model with domain-specific data and produces an adapted version of the model:
Higher accuracy on domain-specific data is the main reason to use supervised fine-tuning. A generic base model answers medical coding or legal contract questions in a generic way because its pre-training data reflected general language on average. Fine-tuning that model on domain examples leads it to respond using the vocabulary, formats, and conventions that the domain actually uses.
The trade-off is that SFT requires labeled datasets and an additional training run, which adds both development time and resource requirements. Whether that cost is worth paying depends on the specific case. On the Professional Machine Learning Engineer exam, when a scenario requires consistent adherence to specialized domain vocabulary, formats, and conventions and labeled examples can be provided, we would lean toward SFT. When modifying the model itself is unnecessary for the task, shaping behavior without an additional training run avoids the extra development time and resource overhead.
Our Professional Machine Learning Engineer course covers supervised fine-tuning for LLMs alongside other ways to shape LLM behavior and broader generative AI workflows, with practice questions that drill these distinctions.