Delving into LLMs to probe how they do what they do.
-
-
An overview of what tokens and embeddings mean in the context of LLMs - and related models. Please use the code along side for more grounding. Code links towards the end.