Blog
Training an EBM with Contrastive Divergence
May 2025
Energy-Based Models
Interactive notebook providing a hands-on tutorial on training a simple EBM on synthetic datasets using the TorchEBM library. Covers energy functions, Langevin Dynamics for sampling, and Contrastive Divergence.
Hamiltonian Mechanics
March 2025
Research, Tutorials
Hamiltonian mechanics is a way to describe how physical systems, like planets or pendulums, move over time, focusing on energy rather than just forces. By reframing complex dynamics through energy lenses, this 19th-century physics framework now powers cutting-edge generative AI.
The Map Of Transformers
April 2023
Natural Language Processing
A broad overview of Transformers research covering the landscape of transformer architectures, their applications, and the evolution of attention mechanisms in deep learning.
Transformers in Action: Attention Is All You Need
September 2022
Deep Learning
A brief survey, illustration, and implementation guide to understanding the transformer architecture and attention mechanisms that revolutionized natural language processing.
Rethinking Thinking: How Do Attention Mechanisms Actually Work?
July 2022
Deep Learning, Neuroscience
The brain, the mathematics, and DL – research frontiers exploring the intersection of neuroscience and attention mechanisms in artificial intelligence.