跳到主要内容Skip to main content

微调Fine-tuning

Fine-tuning

  • 模型能力Model capabilities
  • 第二站 · 上手Station 2 · Hands On
解决什么问题What problem it solves

拿一个已有的模型,用你自己的数据继续训练,让它更懂你的领域。Teach an existing model a specific task or style, rather than describing the task in the prompt.

这是什么What it is

在已有模型的权重基础上继续训练,通常用较少的数据和时间。

它和「提示词」是两种不同手段:提示词改行为,微调改能力倾向。

Further training of an already-trained model on task-specific data, changing its weights rather than its instructions.

为什么需要知道Why it matters

多数场景你不需要微调。先用提示词和 RAG,不够再考虑微调。两者成本差一个量级。It can beat prompting for a narrow task, but it costs more and is harder to maintain. Prompting first is usually the right order.

出处Sources
  • OpenAI 微调指南OpenAI model optimization / fine-tuning guide ↗
  • Azure OpenAI 微调Customize a model with fine-tuning – Azure OpenAI ↗