FFmpeg and VLC together form the invisible backbone of nearly every video you watch online. Lex Fridman sits down with Jean-Baptiste Kempf, VLC lead developer and VideoLAN president, and Kieran Kunhya, longtime FFmpeg contributor and the engineer behind FFmpeg's notorious X account, for a four-hour technical autopsy of how digital video actually works. The conversation covers codecs, containers, handwritten assembly optimization, the FFmpeg and Libav fork drama, and how VLC turned down millions to stay ad-free.
The most valuable parts are not the conclusions. The deep dives into reverse engineering proprietary codecs, the Google and FFmpeg political fallout, the mechanics of ultra-low latency streaming, and the specific tradeoffs in AV2 versus existing patent-encumbered formats give you a ground-level view of decisions that shaped the modern internet. The segment on handwritten assembly code and why it still outperforms compiler output in 2024 is worth the timestamp alone at 2:01:08.
The episode ends with the future of both projects, including where AV2 codec development is headed and how open source video infrastructure survives burnout and corporate pressure. If you work anywhere near video encoding, streaming, or open source infrastructure, this is primary source material, not a summary.
[WATCH ON YOUTUBE →]