Research & Writing

Blog

Dispatches from the edge of chaos — on nonlinear dynamics, AI, emergence, and the mathematics of complex systems.

Transformer

Swin Transformer: Architecture & How It Works

The Swin Transformer introduces a hierarchical vision Transformer that computes attention within shifted windows, achieving linear computational complexity with respect to image size while building multi-scale

1 min read
Transformer

Vision Transformer (ViT): Architecture & How It Works

The Vision Transformer (ViT) applies the Transformer architecture directly to image recognition by treating an image as a sequence of patches, achieving state-of-the-art results on image

1 min read