Learning

Interactive transformer matrix page for learning attention

纳米AI built an interactive page with Claude to visualize how Q, K, and V matrices change through transformer attention, using a 3-word, 3×4 example where clicking any cell shows the step-by-step computation.

View on X
364likes
59reposts
293saves
16Kviews
Made with
Claude
Role
Backend Engineer
Posted
纳米AI@antiAIvo

学 Transformer,最容易忘的是矩阵运算
推导的时候能跟上,隔几周再回忆
Q、K、V 的形状怎么变
里面的一些细节就想不起来了

想了下,原因是脑子里没有一张全局的运算画面

尝试用claude做了一个交互页面:
3 个词,3×4 的小矩阵
从输入到注意力输出
逐格演算,点哪一格就看哪一格
这样就可以随时回看,加强记忆🤔

View on X
Still from the video

More in Learning