Back to Discover
JAJay Alammar

Jay Alammar

ATOM Healthy

jalammar.github.io · AI & ML · en

Visualizing machine learning, transformers, diffusion models, and NLP concepts.

Visit Website
Indexed Posts
10
Update Frequency
Monthly
Last Fetched
Just now
Feed URL
https://jalammar.github.io/feed.xml
Jay Alammar homepage preview
jalammar.github.io

Jay Alammar

Visualizing machine learning, transformers, diffusion models, and NLP concepts.

Loading snapshot...·

Recent Articles

Mar 26, 2025

Moving To Substack

I’m freezing this blog and starting to post on my Substack instead. The authoring experience is much more convenient for me there. Please follow me there, and check out The Illustrated DeepSeek R-1 if you haven’t yet. And check out our How Transformer LLMs Wo…

Generative AI and AI Product Moats
May 9, 2023

Generative AI and AI Product Moats

Here are eight observations I’ve shared recently on the Cohere blog and videos that go over them.: Article: What’s the big deal with Generative AI? Is it the future or the present? Article: AI is Eating The World

Remaking Old Computer Graphics With AI Image Generation
Jan 1, 2023

Remaking Old Computer Graphics With AI Image Generation

Can AI Image generation tools make re-imagined, higher-resolution versions of old video game graphics? Over the last few days, I used AI image generation to reproduce one of my childhood nightmares. I wrestled with Stable Diffusion, Dall-E and Midjourney to s…

The Illustrated Stable Diffusion
Oct 4, 2022

The Illustrated Stable Diffusion

Translations: Chinese, Vietnamese. (V2 Nov 2022: Updated images for more precise description of forward diffusion. A few more images in this version) AI image generation is the most recent AI capability blowing people’s minds (mine included). The ability to c…

Applying massive language models in the real world with Cohere
Mar 7, 2022

Applying massive language models in the real world with Cohere

A little less than a year ago, I joined the awesome Cohere team. The company trains massive language models (both GPT-like and BERT-like) and offers them as an API (which also supports finetuning). Its founders include Google Brain alums including co-authors…

The Illustrated Retrieval Transformer
Jan 3, 2022

The Illustrated Retrieval Transformer

Discussion: Discussion Thread for comments, corrections, or any feedback. Translations: Korean, Russian Summary: The latest batch of language models can be much smaller yet achieve GPT-3 like performance by being able to query a database or search the web for…

Explainable AI Cheat Sheet
May 4, 2021

Explainable AI Cheat Sheet

Introducing the Explainable AI Cheat Sheet, your high-level guide to the set of tools and methods that helps humans understand AI/ML models and their predictions. I introduce the cheat sheet in this brief video:

Interfaces for Explaining Transformer Language Models
Dec 17, 2020

Interfaces for Explaining Transformer Language Models

window.ecco = {}; let dataPath = '/data/'; let ecco_url = '/assets/'; let dataPath = '/data/'; let ecco_url = '/assets/'; import * as explainingApp from "/js/explaining-app.js"; function showRefreshWarning(){ var warning = document.getElementById("warning");…

How GPT3 Works - Visualizations and Animations
Jul 27, 2020

How GPT3 Works - Visualizations and Animations

Discussions: Hacker News (397 points, 97 comments), Reddit r/MachineLearning (247 points, 27 comments) Translations: German, Korean, Chinese (Simplified), Russian, Turkish The tech world is abuzz with GPT3 hype. Massive language models (like GPT3) are startin…