Mixture Of Experts Moe Designs
Sifting through hundreds of thousands of hours of indexed videos
Mixture Of Experts Moe Designs
Sifting through hundreds of thousands of hours of indexed videos
Mixture Of Experts Moe Designs
1
Mentions
31.8K
Views

“And what deep seeded is called mixture of experts or MOOC designs, where if you have a 100 billion parameter model, when you run the inference, you actually run it. You don't need to access all 100 bi...”
Arcmira media summary
Arcmira tracks where Mixture of Experts (MOE) designs is discussed across indexed YouTube videos, transcripts, channels, and related entities.
And what deep seeded is called mixture of experts or MOOC designs, where if you have a 100 billion parameter model, when you run the inference, you actually run it. You don't need to access all 100 billion parameters. They found a way of just accessing, say, 10 billion parameters or 60 billion parameters, which makes the cost of running it in the compute much more efficient.
Arcmira tracks 1 indexed media appearances or mentions for Mixture of Experts (MOE) designs, tied to source videos, channels, and transcript-derived context.
Arcmira uses indexed YouTube videos and transcripts. Representative source evidence on this page includes "Nvidia Buys $2B of Synopsys Stock, DeepSeek Debuts New AI Models" with transcript-derived context and links when available.
Mixture of Experts (MOE) designs is connected to Intel, OpenAI, SoftBank in Arcmira's media graph.