Wasda – Experience transformer attention as music
Wasda – Experience transformer attention as music
I built Wasda, a tiny experiment to turn transformer attention into a playable musical instrument. Each token in the sequence becomes a piano note, and you can see the attention arcs between tokens while you listen. Temperature controls the “improvisation” of the model, and you can solo individual attention heads — for example, I’ve found temp ~1.7 with one head selected gives surprisingly relaxing patterns.
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Incorrect prediction on native model
Similar products
Experience live music, even if you weren’t at the show.
Pytorch implementation of seq2seq model with attention and pointer
Cybersalience – Guiding user attention using transformer attention
FOMO – See what your community pays attention to
A cartoon intro to how the attention mechanism works
An Attack on Titan Experience Made with ThreeJS
Contactless dining experience.
Minimal Paged Attention
Hypehop, a video service that pays you for your attention
How much is your attention worth to advertisers?