↓Skip to main content

The GPU Song (GPUs Are Fire) - Lyrics and Video

Table of Contents

We made a song!

The GPU Song (GPUs Are Fire) by “Weird A.I.” Yankochip

This is a companion to the post on H100 Supply and Demand.

This song and the H100 supply post are now public and the links are fine to share wherever.

It’s on Spotify, Apple Music and YouTube.

Music Video #

Key contributors and credits, in alphabetical order: Anon (“Weird A.I.”), Clay, David, Eche, Gaddi, Zack.

Details #

It’s a parody of “We Didn’t Start The Fire” by Billy Joel.

Label: Turing Test Records

Artist: “Weird A.I.” Yankochip

Real Name of Artist: It’s a secret. (They are human though!)

Lyrics #

Elon Musk, GCP, Sam Altman, AMD
Inflection, 4N, Alan Turing test
Oracle, Anthropic, Google Cloud, symbiotic
Nvidia, Microsoft, AWS

Hugging Face, DGX, Lambda Labs, AlexNet
AMD, InfiniBand, A100, LLMs
Twitter, Tesla, SpaceX, Tiny Corp, HGX
Call up TSMC, Emad and Stability

GPUs are fire
Everybody’s huntin‘ for some H100s
GPUs are fire
We can never find ‘em but we wanna buy ‘em

SXM, CUDA, Rosenblatt is Buddha
SK Hynix, PCIe
Satya from Microsoft, doesn’t care what the cost
Azure, OpenAI, gimme CoreWeave

Which AI is best, acing all the Turing tests
Bing, Bard, Claude 2, ChatGPT
Reid Hoffman, Suleyman, who’s into it? Everyone
Mellanox, Jensen, Lemme get a million

GPUs are fire
Everybody’s huntin‘ for some H100s
GPUs are fire
We can never find ‘em but we wanna buy ‘em

Get a Llama take a ride, try Vicuna it’s alright
Facebook, Meta, Google, and Alphabet
FluidStack, Runpod, @roon, Geohot
Nine, Ten, Eleven Labs, ain’t seen nothing yet

OpenAI GPT, 1, 2, and 3
4, chat, what’s that? Falcon-40B
Intel behind Amazon, I could go on and on
LSTM, long short-term memory

GPUs are fire
Everybody’s huntin‘ for some H100s
GPUs are fire
We can never find ‘em but we wanna buy ‘em

Metalloid, silicon, for computers, not your mom
GPGPU, Fermi architecture
New threads for Zuckerberg, Cage battle of the nerds
Chief Executive Officer

“Ex Machina”, “Chappie”, “Westworld” makes me happy
“Her”, “Space Odyssey”, “Terminator”, “Wall-E”

GPUs are fire
Everybody’s huntin‘ for some H100s
GPUs are fire
We can never find ‘em but we wanna buy ‘em

HBM3, images from Midjourney
Dartmouth Conference, throwing out names
Attention Is All You Need, Vaswani and colleagues
Deep Q-network, get in the game

Geoffrey Hinton, Deep Learning, algorithm fire burning
Andrej Karpathy, sayin’ something catchy
Buy a car, don’t drive, take a nap till you arrive
But I’m not that into you, unless you got GPUs

GPUs are fire
Everybody’s huntin‘ for some H100s
GPUs are fire
Oh but please Elon
Stop buying on and on and on and on and on and on and on…

GPUs are fire
Everybody’s huntin‘ for some H100s
GPUs are fire
We can never find ‘em but we wanna buy ‘em

GPUs are fire
Everybody’s huntin‘ for some H100s
GPUs are fire
We can never find ‘em but we wanna buy ‘em

GPUs are fire
Everybody’s huntin‘ for some H100s
GPUs are fire
We can never find ‘em but we wanna buy ‘em

Lyrics with explanations #

Verse 1

  1. Elon Musk, GCP (Google Cloud is often referred to as GCP), Sam Altman, AMD (Nvidia’s main competitor, though notably absent from most LLM training and inference)
  2. Inflection (AI company started by Reid Hoffman and Mustafa Suleyman), 4N (the TSMC node used to make H100 GPUs), Alan Turing test (famous test of whether a machine is intelligent)
  3. Oracle, Anthropic (they make Claude, and are a top OpenAI competitor), Google Cloud, symbiotic (Google Cloud and Anthropic did a weird investment deal where GCP invested $300mm but Anthropic needs to spend $ on GCP)
  4. Nvidia, Microsoft, AWS

Verse 2

  1. Hugging Face (a place to download and share machine learning models), DGX (a Nvidia product line), Lambda Labs (a top GPU cloud), AlexNet (a neural network that revolutionized deep learning - Ilya Sutskever was also involved - and Ilya later was one of the OpenAI cofounders)
  2. AMD, InfiniBand (networking hardware that’s helpful for large LLM training), A100 (a top GPU - the H100 is generally ‘best’ and the A100 is ‘second best’), LLMs (large language models - for example, GPT-4)
  3. Twitter, Tesla, SpaceX, Tiny Corp (Geohot’s AI company), HGX (a Nvidia product line produced by OEMs)
  4. Call up TSMC (they manufacture the H100 GPUs), Emad and Stability (Emad is CEO of Stability AI, they make Stable Diffusion)

Chorus

  1. GPUs are fire
  2. Everybody’s huntin‘ for some H100s
  3. GPUs are fire
  4. We can never find ‘em but we wanna buy ‘em

Verse 3

  1. SXM (a form factor of GPUs), CUDA (Nvidia’s software - people feel this is a key part of why they have a monopoly), Rosenblatt is Buddha (born in 1928, Rosenblatt is sometimes called the father of deep learning)
  2. SK Hynix (they make the HBM3 - fast memory used on H100 SXM GPUs), PCIe (another GPU form factor, as an alternative to SXM)
  3. Satya from Microsoft (Satya is the CEO of Microsoft), doesn’t care what the cost (he’s investing a ton of money into AI, through OpenAI, Azure, CoreWeave)
  4. Azure, OpenAI, gimme CoreWeave

Verse 4

  1. Which AI is best, acing all the Turing tests
  2. Bing, Bard, Claude 2, ChatGPT (these are all different LLMs)
  3. Reid Hoffman, Suleyman, who’s into it? Everyone (Hoffman and Suleyman founded Inflection AI)
  4. Mellanox (Mellanox is a company that Nvidia bought, they are a major manufacturer of InfiniBand), Jensen (CEO at Nvidia), Lemme get a million (people want a lot of GPUs and they need to get them from Jensen and Mellanox)

Chorus

  1. GPUs are fire
  2. Everybody’s huntin‘ for some H100s
  3. GPUs are fire
  4. We can never find ‘em but we wanna buy ‘em

Verse 5

  1. Get a Llama take a ride (Llama LLM from Meta), try Vicuna it’s alright (community modification of LLaMA from LMSYS, not as good as GPT-4 but still pretty good)
  2. Facebook, Meta, Google, and Alphabet (both companies have renamed their official companies)
  3. FluidStack (popular choice for sourcing H100s, along with CoreWeave and Lambda), Runpod (popular cloud for renting on-demand GPUs), @roon (popular twitter account in the AI community), Geohot (George Hotz, founder of the tiny corp)
  4. Nine, Ten, Eleven Labs (Eleven Labs makes good voice cloning and text to speech software), ain’t seen nothing yet (more stuff is coming and it’s going to be epic)

Verse 6

  1. OpenAI GPT, 1, 2, and 3
  2. 4, chat, what’s that? Falcon-40B (GPT, GPT-2, GPT-3, and GPT-4 are all LLMs, and Falcon-40B is an open source LLM)
  3. Intel behind Amazon (Amazon has AI chips being actively used for AI inference, to a greater degree than Intel, which is kinda surprising), I could go on and on (there’s other interesting things like the minimal AMD usage)
  4. LSTM, long short-term memory (a type of neural network, and also references ‘I could go on and on’ because he has a long memory)

Chorus

  1. GPUs are fire
  2. Everybody’s huntin‘ for some H100s
  3. GPUs are fire
  4. We can never find ‘em but we wanna buy ‘em

Verse 7

  1. Metalloid, silicon, for computers, not your mom (metalloids are used in the production of GPUs, as is silicon. Silicon is also used in breast enhancements)
  2. GPGPU (using GPUs for tasks normally done by the CPU), Fermi architecture (an old GPU architecture from Nvidia named after Enrico Fermi)
  3. New threads for Zuckerberg (Meta’s “Threads”), Cage battle of the nerds (Musk vs Zuck in UFC)
  4. Chief Executive Officer (Musk and Zuck)

Verse 8

  1. “Ex Machina”, “Chappie”, “Westworld” makes me happy
  2. “Her”, “Space Odyssey”, “Terminator”, “Wall-E”

Chorus

  1. GPUs are fire
  2. Everybody’s huntin‘ for some H100s
  3. GPUs are fire
  4. We can never find ‘em but we wanna buy ‘em

Verse 9

  1. HBM3 (the VRAM used on SXM H100 GPUs), images from Midjourney (an AI art tool)
  2. Dartmouth Conference (the Dartmouth workshop in 1956 is considered to be what started AI as a field), throwing out names
  3. Attention Is All You Need, Vaswani and colleagues
  4. Deep Q-network (a reinforcement learning algorithm), get in the game

Verse 10

  1. Geoffrey Hinton (famous neural network researcher), Deep Learning, algorithm fire burning
  2. Andrej Karpathy (previously led self-driving at Tesla, before that was a founding member at OpenAI, now he’s back at OpenAI), sayin’ something catchy (he’s good at catchy phrases)
  3. Buy a car, don’t drive, take a nap till you arrive (kindof a reference to Karpathy working on self-driving)
  4. But I’m not that into you, unless you got GPUs

Outro Chorus

  1. GPUs are fire
  2. Everybody’s huntin‘ for some H100s
  3. GPUs are fire
  4. Oh but please Elon
  5. Stop buying on and on and on and on and on and on and on… (Elon’s buying lots of GPUs for Twitter, Tesla, X.ai)

Chorus

  1. GPUs are fire
  2. Everybody’s huntin‘ for some H100s
  3. GPUs are fire
  4. We can never find ‘em but we wanna buy ‘em

Chorus

  1. GPUs are fire
  2. Everybody’s huntin‘ for some H100s
  3. GPUs are fire
  4. We can never find ‘em but we wanna buy ‘em

Chorus

  1. GPUs are fire
  2. Everybody’s huntin‘ for some H100s
  3. GPUs are fire
  4. We can never find ‘em but we wanna buy ‘em

Images #

The GPU Song (GPUs Are Fire) Album Cover
The GPU Song (GPUs Are Fire) Album Cover. Larger version

“Weird A.I.” Yankochip
"Weird A.I." Yankochip. Larger version

Info #

Title: The GPU Song (GPUs Are Fire)

Artist: “Weird A.I.” Yankochip

Album: Single

Release Date: 2023