跳到主要内容Skip to main content

嵌入层Embedding Layer

Embedding Layer

  • 核心概念Core concepts
  • 第四站 · 看懂Station 4 · Under the Hood
解决什么问题What problem it solves

把词变成数字向量的第一步,模型内部只认数字。The first step of turning words into numeric vectors — models only work in numbers internally.

这是什么What it is

模型内部把每个 token 映射成高维向量的那一层,是向量检索技术的源头。

The layer mapping each token to a high-dimensional vector inside the model — the origin of vector retrieval.

为什么需要知道Why it matters

它连接「看懂站」和「用深站」。你理解的 embedding 概念,和这里的实现是同一个东西。It connects the conceptual layer to the applied one: the embedding you use in practice is this.

出处Sources
  • Word2Vec(论文)Word2Vec: Efficient Estimation of Word Representations ↗