@sequoia
We help the daring build legendary companies from idea to IPO and beyond.
Today's AI models train once. We don't work that way. We learn continuously, forget what doesn't matter, and retain what does. That gap is what @dan_biderman and @realJessyLin are closing at @EngramLab. AI that never stops learning, with memory that lives inside the model instead of bolted on as an afterthought. In our latest Training Data episode we get into why memory is the next frontier: why the brain forgets on purpose, why RAG is a band-aid, and what becomes possible when a model is always training. 00:00 Introduction 00:59 Always Training Explained 01:51 Beyond Context Windows 03:29 Ngram Product Overview 04:34 Adapters And Training Signals 05:32 Internalize Vs Externalize 06:49 Compute And Token Savings 08:19 Teams First Then Individuals 08:51 Memorization Vs Understanding 12:47 Dreams And Offline Digestion 14:08 Training Beats Curation 15:19 Why Everyone Needs A Model 21:44 Bitter Lesson And Architecture 24:44 RAG Killer And KV Cache 31:38 Future Of Memory And Models
12 years ago a top scientist said AI would wipe out radiology. Computer vision spread through every scan – and radiology demand went UP. Hospitals hired more radiologists. @Nvidia’s Jensen Huang on why we keep confusing a job's tasks with its purpose. x.com/Konstantine/st…
Don't mistake task for purpose. @Nvidia's Jensen Huang in conversation with @Konstantine: "Typing is not the job of a software engineer. Coding is not their job. Solving problems is their job." Jensen says AI is creating more jobs, not destroying them. Why? AI lets us solve problems better than ever.
What does AI actually change for builders: It’s not just speed. It’s ambition. The old question was whether an idea was even possible. @GoogleDeepMind's @OfficialLoganK says he now catches himself wanting to push the same idea ten steps further. The hard part becomes resetting your own ceiling on ambition. What do you build when the only constraint left is how big you let yourself dream?
"So we could edit this set?" Done and done. New Training Data with @OfficialLoganK of @GoogleDeepMind and @sonyatweetybird shows some of what Gemini Omni can do.
Listen to the full episode: Spotify: seq.vc/abo Apple: seq.vc/2ls YouTube: seq.vc/32x
Listen to the full episode here on X, or wherever you get your podcasts: Spotify: seq.vc/b4u Apple: seq.vc/3xf YouTube: seq.vc/syf x.com/sonyatweetybir…
Meet @CameronLMcCord. He's done a lot of hard things: paid his way through MIT with ROTC while double-majoring in nuclear engineering and physics. Spent ~5 years on a nuclear submarine for the Navy. He once steered that submarine through a Nordic fjord in a blizzard, in the
View more from AI Ascent 2026 including talks with @karpathy, @demishassabis, @DrJimFan , @dmitri_dolgov, @matiii, @bcherny here: youtube.com/playlist?list=… x.com/sequoia/status…
@amspector100 @bfspector @flappyairplanes More content from AI Ascent 2026 is available here: seq.vc/goj
