The History of Attention

A comprehensive analysis tracing the evolution of attention mechanisms from bag-of-words models to FlashAttention, examining the mathematical foundations and …

Notes: LLM From Scratch

Notes and pointers during the exploration of the book LLM From Scratch by Sebastian Raschka. Comprehensive exploration of tokenization, embeddings, and building …

Quick Notes - Hardware-aware programming on MacOS

Short notes - pointers to programming for speed and efficiency, leveraging hardware-specific features available on ARM Apple Silicon. MacOS-focused at most …

Handy Hacks

Quick handy hacks for reference from anywhere.

GenAI Pointers (Primarily Text Domain)

summary = "GenAI Notes for Text - Mostly pointers, not details." Terms Worth Understanding Tokenization Encoding/Decoding This video by Andrej Karpathy …

The Fallacy of the Full-stackist

The distinction between being a full-stack developer and the perception of being one can be big.

Useful Clojure Asides - Logging and Exceptions

It's always useful to have some nice logging when writing code. Simple logging and exception handling samples to make it a bit easier for the developer.

Interesting Java in clojure.core

Some neat Java ideas from the Clojure core

Developing Chrome Extensions using Clojurescript

How you may set up your clojurescript project for developing chrome extensions - an example

On The 'Decay' Of Small Organizations into Large Organizations

Some observations on challenges in managing quality and talent in organizations of different sizes.