“we've also just seen pre-training very clearly not having hit a wall”

ConceptResearch

“Where, I mean, we, we also launched a product called Tasks a couple months ago where we're, we're having people in the Dasher fleet help basically collect, uh, data points to help train some of these world models. And I think we're so early there, and I think there's so many d...”

ConceptResearch

“it's not that hard to get a cherry-picked demo of like one cool success on a task”

ConceptResearch

“The problem is getting it to work on any object or in any environment.”

ConceptResearch

“I mean, one of the things that I think is interesting is that lately I'm hearing a lot more conversations about not only looking for other sources of open weight models that are out there that are not specifically Chinese or specifically from the US. Obviously Europe is doing ...”

ConceptResearch

“improving functional capability of these models to route and report information”

ConceptResearch

“Yeah, I think one of the things in the paper that you're referencing that was pointed out was that Anthropic had noticed that models are creating what they're calling workspaces, where they're essentially— the notion of the workspace is fulfilling the same function as working ...”

ConceptResearch

“No, it's not at all. Actually, I don't think it's obvious how I got in this I owe getting into this space to Andrej Karpathy. In 2015, he wrote an article called The Unreasonable Effectiveness of Recurrent Neural Nets. And that article, I read it and I pivoted my startup at th...”

ConceptResearch

“that we're starting to actually predict letters. He has an example out here. There's a little Paul Graham generator, and you can kind of read it, and the text kind of makes sense, but it doesn't. And there's a little, there's an example of code a little bit further down. It sa...”

ConceptResearch

“And what we missed throughout that entire journey that we were on the right track, but we should have just kept scaling up. And today to all of us, the scaling laws and scaling up seems like the most obvious thing. But having spent 4 or 5 years of my life on working on languag...”

ConceptResearch

“Very strange model release. Leo at Synthwaved writes, Gemini 3.6 Flash benchmarks are out, and it's beaten by other models on code tasks and is only really consistently state-of-the-art on vision and context benchmarks. But hey, 3.1 Pro is now so old that 3.6 Flash outperforms...”

ConceptResearch

“the latest generation of frontier models quietly plowing through unsolved math problems”

ConceptResearch

“Math capabilities accelerated so quickly”

ConceptResearch

“If you are doing stuff in the API and you want a very smart, cheap model, this is pretty good.”

ConceptResearch

“One second. He said 3.5 Pro is testing with partners and will hopefully land soon. And this is also on top of another tweet that he put out today, uh, exactly when 3.6 Flash came out, where he said very specifically, we have started our most ambitious pre-training run yet for ...”

ConceptResearch

“maybe there are significant scientific discoveries coming down the pipe. So that is very exciting”

ConceptResearch