Skip to content

Interactive Demos

Learn by doing with interactive visualizations that make abstract concepts concrete.

Available Demos

Neural Network Visualizer

Step through neural network training on the XOR problem

See every detail of how a neural network learns:

  • Forward pass computation with full mathematical notation
  • Backward propagation showing gradient flow
  • Weight updates in real-time
  • Loss evolution over training epochs

Why XOR? It's the simplest problem that requires a hidden layer, making it perfect for understanding how neural networks learn non-linear representations.

Launch the visualizer →

Coming Soon

Attention Mechanism Visualizer

Explore how transformer attention works:

  • Query, key, value transformations
  • Attention weight computation
  • Multi-head attention patterns
  • Position-aware attention

Status: Planned for next phase

Transformer Block Visualizer

See a complete transformer layer in action:

  • Residual stream flow
  • Layer normalization effects
  • MLP transformations
  • Complete forward and backward passes

Status: Designing architecture

Sparse Autoencoder Explorer

Discover interpretable features in neural networks:

  • Feature activation patterns
  • Neuron polysemanticity
  • Feature steering
  • Activation reconstruction

Status: Research phase

How These Demos Help Learning

Make Math Visual

Equations are abstract - watching computations happen step-by-step makes them concrete.

Example: Seeing z = wx + b as actual numbers flowing through a network is more intuitive than reading the formula.

Enable Experimentation

Interactive controls let you explore "what if?" questions:

  • What if I increase the learning rate 10x?
  • What if I add noise to the training data?
  • What if I reset just one weight?

Build Intuition

Repeated interaction with visualizations develops intuitive understanding that reading alone cannot provide.

Design Philosophy

All demos follow these principles:

1. Show Everything

No black boxes - every computation is visible and explained.

2. Interactive Controls

Users can experiment, not just watch. Play, pause, step forward/backward, adjust parameters.

3. Educational Focus

Designed for learning, not production use. Clarity over performance.

4. Self-Contained

Run entirely in browser - no backend, no installation, no setup.

5. Source Available

All demo code is open source - learn by reading the implementation too.

Technical Stack

Built with modern web technologies:

  • React 19 - UI components and state management
  • TypeScript - Type safety and documentation
  • Vite - Fast development and optimized builds
  • TailwindCSS - Styling and responsive design
  • KaTeX - Mathematical notation rendering
  • Vitest - Testing framework

Why web-based?

  • Shareable (just send a URL)
  • No installation required
  • Works on any device with a browser
  • Easy to iterate and update

Using the Demos

For Self-Study

  1. Start with the basics: Neural Network Visualizer
  2. Experiment actively: Change parameters, observe results
  3. Form hypotheses: Predict what will happen before clicking
  4. Verify understanding: Can you explain what you see?

For Teaching

  • Live demonstrations: Show training dynamics in real-time
  • Student exploration: Let learners experiment freely
  • Discussion prompts: "Why did the loss spike?" "What would happen if...?"

For Research

  • Prototyping visualizations: Fork and modify for your own use
  • Testing hypotheses: Quick experiments without writing code
  • Communicating ideas: Share URLs to show concepts

Contributing

Interested in building new demos or improving existing ones?

  1. Browse the source code
  2. Open an issue with demo ideas
  3. Submit a pull request with improvements

Feedback

Found a bug? Have a feature request? Confused by something?

Open an issue on GitHub - all feedback helps improve these learning tools!


New demos are added as the project evolves. Check back for updates!

A hands-on learning project exploring LLM internals