Michał Chromiak's blog 🌀 MLP-Mixer: How image patches communicate without attention
A practical guide to "MLP-Mixer: An all-MLP Architecture for Vision"
MLP-Mixer classifies images without convolution or self-attention. This guide follows an image through patch projection, token mixing, channel mixing, and classification, then examines the paper's accuracy, throughput, scaling, and permutation experiments.
more ...