CLIPContrastive Language-Image Pre-training
Contrastive Language-Image Pre-training
解决什么问题What problem it solves
让模型理解「文字描述」和「图片内容」的对应关系,是文生图的基础。Lets a model relate text descriptions to image content — the foundation of text-to-image generation.
这是什么What it is
把图片和文字映射到同一空间,让「一只猫」这句话能对应到猫的图像特征。
Maps images and text into the same space, so the phrase "a cat" lands near the visual features of cats.
为什么需要知道Why it matters
几乎所有文生图工具都内置它。它决定了模型对提示词的理解能力上限。Nearly every text-to-image tool ships it. It sets the ceiling on how well a model understands a prompt.
现在能做什么What you can do now
去 Agent 图谱:看有哪些装得上的客户端、运行时与工具Agent atlas: which clients, runtimes and tools you can install ↗
回到名词地图看第2站的其他 35 个词 →Back to the map: the other 35 terms in station 2 →
出处Sources
- CLIP 原论文(OpenAI)CLIP: Learning Transferable Visual Models ↗