• Tracing the Transformer: How Self-Attention Actually Works

  Every large language model you’ve used — GPT, Claude, Llama, BERT before them — is built out of the same core mechanism, repeated dozens of times: the Transformer block. It’s easy to wave your hands and say “it’s attention,” but the actual mechanics are simple enough to trace end to end. This post does that: from a sequence of tokens to a single self-attention head, to a full block, to a stack of them.

• Hello World!

  Welcome! My education and work history are listed on the about page. Feel free to reach out to me using any of the links at the bottom.