“Oh, really? Using adaptive fine-tuning? And structured inference.”

ConceptResearch

“It's like a star search or something where you kind of, um, you like, you prune your search tree as you go on, like, um, what seems most successful so far, like Exactly.”

ConceptResearch

“yeah, but did it get any of them actually right?”

ConceptResearch

“The analogy that I reach for here is something like a dimmer switch, where I think you can basically accommodate both the binary intuition and the sort of continuous intuition. You know, if you have a light with a dimmer switch, like, really, it is either on to some extent or ...”

ConceptResearch

“being able to just scale the crap out of it so that we can evaluate given any description of an architecture”

ConceptResearch

“Let me stop. Wait, wait, wait. That's not right. Starts like freaking out. It starts having a, like, I don't want to use anthropomorphizing language, but the very fact that I'm reaching for it, I think is the point. And sort of goes to, to what your question is. Confidence. We...”

ConceptResearch

“They're not controlling for the amount of test-time compute that is being used on that benchmark question.”

ConceptResearch

“5.5 and other models, can think for, if you scaffold them reasonably well, can think for weeks even before having performance plateau on some of these benchmarks.”

ConceptResearch

“And so the point at which they plateau is simply too far out to reasonably test.”

ConceptResearch

“And basically what they're doing is they're poking at the model, you know, testing it with different inputs, seeing what the output is. And as you said, distilling— trying to distill, take away the knowledge, the learning, the reasoning from the core model so they can make the...”

ConceptResearch

“In this case, it's asking the model questions, feeding it a certain input, and then analyzing the reasoning steps and the output that the model gives you, and then using that as guidance for your own model that you're training because we know there's pre-training where a lot o...”

ConceptResearch

“This includes every Chinese cloud giant alongside multiple electric vehicle companies, robotics labs, and chipmakers. The designation blocks these firms from doing business with the Pentagon and restricts lobbying activities. Many analysts also view the designation as a precur...”

ConceptResearch

“On Wednesday, Bloomberg reported that Jonas Adler and Alexander Pritzl were also leaving to join Anthropic. The report described Adler and Pritzl as senior researchers who were viewed as key contributors to Gemini. After scraping social media, ChrisGPT found 2 more Googlers pa...”

ConceptResearch

“And it's exactly the same as we were all saying earlier of like, that's always been good development practice. Like, there's nothing worse than as a developer, you run the tests and you just get like Assert true failed, and you're like, great. Error 1317.”

ConceptResearch