SELENE lunar lab

Positional Encodings

Language AI Architecture · Beginner

Give an order-blind attention layer a sense of where each token sits.

Run in Colab

Part of this learner path:

  • Language models end to end

The notebook Open on its own page View source Download standalone .ipynb