Sat 13 Apr 2024 LLMs: Understanding Tokens and Embeddings An overview of what tokens and embeddings mean in the context of LLMs - and related models. Please use the code along side for more grounding. Code links towards the end. machine learning neural networks tokens embeddings llm