Long-Context on MdJawadhttps://www.mdjawad.com/tags/long-context/Recent content in Long-Context on MdJawadHugo -- 0.148.2en-usSat, 23 May 2026 12:00:00 +0800Rotary Positional Encoding: Why Position Is a Rotationhttps://www.mdjawad.com/posts/rotary-positional-encoding/Sat, 23 May 2026 12:00:00 +0800https://www.mdjawad.com/posts/rotary-positional-encoding/An intuitive, visual guide to Rotary Positional Encoding. Why spinning the query and key vectors beats stamping a position number onto them, why a dot product only ever feels the angle between two vectors, and why that hands you relative position for free. The starting point for understanding how LLMs stretch to long context.