位置编码Positional Encoding
Positional Encoding
解决什么问题What problem it solves
让模型知道每个词在句子里的先后顺序。Lets the model know the order of words in a sentence.
这是什么What it is
给每个位置附加一组数字，使模型能分辨「猫追狗」和「狗追猫」。
Attaching a set of numbers to each position so the model can tell "the cat chased the dog" from "the dog chased the cat".
为什么需要知道Why it matters
它解释了为什么上下文窗口超了之后，模型对长文的理解会明显退化。It explains why comprehension of long passages degrades noticeably once you exceed the context window.
现在能做什么What you can do now
回到名词地图看第4站的其他 35 个词 →Back to the map: the other 35 terms in station 4 →