跳到主要内容Skip to main content

CLIPContrastive Language-Image Pre-training

Contrastive Language-Image Pre-training

  • 图像语音视频Image, speech & video
  • 第二站 · 上手Station 2 · Hands On
解决什么问题What problem it solves

让模型理解「文字描述」和「图片内容」的对应关系,是文生图的基础。Lets a model relate text descriptions to image content — the foundation of text-to-image generation.

这是什么What it is

把图片和文字映射到同一空间,让「一只猫」这句话能对应到猫的图像特征。

Maps images and text into the same space, so the phrase "a cat" lands near the visual features of cats.

为什么需要知道Why it matters

几乎所有文生图工具都内置它。它决定了模型对提示词的理解能力上限。Nearly every text-to-image tool ships it. It sets the ceiling on how well a model understands a prompt.

出处Sources
  • CLIP 原论文(OpenAI)CLIP: Learning Transferable Visual Models ↗