PT
Pre Training
Indexing
Sifting through hundreds of thousands of hours of indexed videos
Pre Training
Sifting through hundreds of thousands of hours of indexed videos
Pre Training
Arcmira media summary
Explore podcasts, interviews & explainers on Pre-Training — 16 indexed from Dwarkesh Patel & AIM Network, updated Nov 2025.
A specific recipe or method for scaling neural networks: "pre-training was a thing to scale it was a particular scaling recipe."
A method of training AI models, central to the age of scaling.
The foundational process of training AI models on large datasets.
this is what I tell people about pre-training I'm like the fact that pre-training for deep mind is working so well in the Gemini models
Pre-training is scaling incredibly well still.
Arcmira tracks 16 indexed media appearances or mentions for Pre-Training, tied to source videos, channels, and transcript-derived context.
Arcmira uses indexed YouTube videos and transcripts. Representative source evidence on this page includes "The Era of Easy AI Progress Is Ending - Ilya Sutskever" with transcript-derived context and links when available.
Pre-Training is connected to AI, OpenAI, Google in Arcmira's media graph.
16
Mentions
2.0M
Views
The trendline is visible, but the dated evidence behind Pre-Training is in the premium layer.
“A specific recipe or method for scaling neural networks: "pre-training was a thing to scale it was a particular scaling recipe."”
“A method of training AI models, central to the age of scaling.”
“The foundational process of training AI models on large datasets.”
“this is what I tell people about pre-training I'm like the fact that pre-training for deep mind is working so well in the Gemini models”
“Pre-training is scaling incredibly well still.”