Ways to reduce harm, set limits, test behavior, and govern how AI is used.
Trend this week
Gaining attention12%of conversation
7 of 7 published weeks met the cross-podcast threshold.
10quoted moments5episodes4podcasts discussing this topic
A closer read
What changed
Its share fell from 16.5% to 11.7%, with evidence across 11 podcasts.
Where it showed up
It appeared in episodes including “Thinking in Silico: Goodfire CTO Dan Balsam on Concept Manifolds & a $1000/Month ML Research Agent” and “Pick Your Poison: Zvi Mowshowitz on the Unipolar/Multipolar AGI Dilemma, OpenFace & Pacing the ...”.
How to read it
5 cited episodes from 4 podcasts are shown below. The topic appeared across 11 podcasts in the full analysis.
Podcast moments from the week
10 quoted moments · 5 episodes · 4 podcasts
The Cognitive Revolution
Thinking in Silico: Goodfire CTO Dan Balsam on Concept Manifolds & a $1000/Month ML Research Agent
“Do you have a best-case scenario for what safe superintelligence might be up to? Could you imagine anything that feels Both somewhat realistic and, wow, that would be amazing if they could come forward with something like what you have in mind.”
“We may be one turn away on frontier models models to where these researchers do no longer feel comfortable that they fully understand what the models are capable of and how to put guardrails in place to safely release them into the world.”
“Is that right? My understanding is it was using— it was testing Exploit Jam, which is a cybersecurity attack benchmark, and that's just starting to go wild.”
#228: More Rogue AI Agents, AI Lab Staff Ask Washington to Pace Development, Continuing Battle Over Open Weights & OpenAI Previews Astra
We may be one turn away on frontier models models to where these researchers do no longer feel comfortable that they fully understand what the models are capable of and how to put guardrails in place to safely release them into the world.
Its share rose from 29.1% last week to 32.4% this week, reversing the previous week's drop.
Share of this week’s podcast conversation
Recent weeks30.9%→This week32.4%
Came up more often than in recent weeks.
Podcast moments5 cited momentsViewClose
The Cognitive Revolution
Thinking in Silico: Goodfire CTO Dan Balsam on Concept Manifolds & a $1000/Month ML Research Agent
Obviously, one of the big kind of received wisdoms of AI product development over the last couple years has been try to build something that will really work for the— with the next generation of models, even if it doesn't quite work yet.
are we still in that regime? And if so, is there Are there things that you're like wanting Opus 5.1 to be able— I, I don't know if you're even able to use Fable, interestingly enough, but is there something where you're like, I want my Opus 5.1 wishlist, I, I really hope it cl...
Seedance 2.5 & The New Age of AI Video (w/ Theoretically Media)
You do not look as good as that. Yeah. And then the other side of that, if there's any kind of like product branding in there, or if it's seeing it as, as a real person, or if any one of those supermodel dudes have any—
At the top line, I don't. Um, I'm going to use the best product, um, that provides the best results. Like, there's no, uh, uh, as we, as we, as we said in the '90s, um, uh, information knows no, knows no borders. So, you know, um, no, I'm, you know, I'm gonna jack into the old...
Google’s AI Leadership Shakeup: Disaster or Exactly What It Needs?
unbelievably powerful self-evident use case that for a ton of small business entrepreneurs who now make their living from Shopify shows just how valuable this technology can be
Its share rose from 5% last week to 10.2% this week, reversing the previous week's drop.
Share of this week’s podcast conversation
Recent weeks6.9%→This week10.2%
Came up more often than in recent weeks.
Podcast moments5 cited momentsViewClose
No Priors
Chasing Trillion-Dollar Companies, Founder Ambition, Token Budgets, and Regulatory Capture with Sarah & Elad
I think I'm looking at more, uh, both a little further out and then I'd say like, I don't know that there are that many markets that are gonna get to $100 billion of revenue in the next couple years that aren't Like inference, right? Tell me what else, what else you think in t...
There's a price war going on here. Yeah, which is interesting. And, and, and in response, uh, OpenAI also lowered its— some of its prices. So I think we see a race toward the bottom here on pricing. I watched a video on TikTok today. I didn't put it in the rundown, um, from a ...
#253 - Opus 5, Gemini 3.6, Kimi K3, Hugging Face Hack
Let's now move on to Terminal Bench 2, Terminal Bench 3, and ultimately this. And there you go. So here we do know that this particular model, Opus 5, is outperforming all other models on a cost per task basis. And that's really where they're trying to differentiate it is cost...
the sort of craft that goes into imbuing the right types of tastes and the right types of decision-making capabilities into any agent goes a super long way.
Why People Are Paying 10x More for AI | Sid Sheth, d-Matrix
Do you see emerging companies, startups that are agent-first? The New York Times had a piece recently about a guy and his brother running a $1.6 billion sales company that's basically an agent-first company. Do you see that segment of the economy growing?
where the geometry components come in is that the features aren't like, sort of like naive, maybe like SAE build take on things is like, you could imagine that the model is encoding like a bunch of totally orthogonal concepts to each other
Why People Are Paying 10x More for AI | Sid Sheth, d-Matrix
The models have now understood that they have better capability. It's almost like a human being, right? Once you realize that you have acquired a new capability, you become more confident. And same thing with these models. They tend to have become more confident with disagreei...
Chasing Trillion-Dollar Companies, Founder Ambition, Token Budgets, and Regulatory Capture with Sarah & Elad
I think the idea that the models can improve their own training if the leading scientists working on this believe it, and it's an extension of what we are already seeing in code and math, of course you should believe it, right?
Its share grew from 0.7% last week to 3.8% this week.
Share of this week’s podcast conversation
Recent weeks3.7%→This week3.8%
Came up about as often as in recent weeks.
Podcast moments4 cited momentsViewClose
Eye on AI
Why People Are Paying 10x More for AI | Sid Sheth, d-Matrix
Wow. That's amazing. What about edge compute? It seems to me that this would apply the latency question. Are you moving at all into the edge where latency is so important?
We could. I mean, absolutely, we could. We are not currently. The platform, the way we have built it is a platform that is built with like a Lego block approach, right?
40 Trillion Tokens a Day (Yes, More Than OpenAI) | Lin Qiao, CEO of Fireworks
KLD is a metrics of of the precision. So what it means is we reach bitwise equivalent. So the result in running from the training side, the result from inference side is bitwise equivalent. And why that matters is after you train, you need to deploy, right? So you don't want t...
