An actually boring introduction to knowledge neurons in transformers
The author tries to explain knowledge neurons to himself. Not much to see here...
Deep learning
minGPT for dummies
Trying to understand how Andrej Karpathy’s minGPT works, step by step....
An image is worth 16x16 words is worth a lot more words
Figuring out how an image might be worth 16x16 words...
Transformer toolbox
stuff you need to understand before understanding how transformers work...
My own little guide to einops
Why do feel like I’ll have to come back to this post many times...
What on earth is attention
Teaching myself about the attention mechanism in vision models...
Eden
Building the building blocks for generative art...
Visualizing adversarial examples with caricatures
Breaking down adversarial examples with carictaures...
A Few Months With Feature Visualization
Learning to reverse engineer CNNs and other stuff...
Hello DevoLearn
Google Summer of Code | Coding period week 9...