“I do not think that the hyperscalers who own the compute have a huge amount of power”

ConceptInfrastructure

“Essentially, this is an independent oversight and advisory board that sits on top of Anthropic's normal board of directors. Importantly, the Benefit Trust has the power to elect or remove one member of the corporate board, which escalates to 2 and then 3 according to time and ...”

ConceptInfrastructure

“Adding another gigawatt suggests Meta's plans are still ticking along at a rapid pace”

ConceptInfrastructure

“Now overall, the sentiment towards FiveSix SOL is extremely positive, and it feels to me like to some extent it's also being the beneficiary of the fact that heading into the Fable 5 ban, OpenAI kind of had all the momentum when it came to the most enfranchised AI users. Codex...”

ConceptInfrastructure

“Awesome. That's, I think, a great one to start with. And thank you for inviting me on the show. I appreciate the opportunity. So I co-founded ZenML. about 5 years ago. So this was really almost at a point where MLOps was really reaching fever pitch on, there was all sorts of c...”

ConceptInfrastructure

“So I think if anything, even if you throw away every other tool that we ever used in MLOps, the principles and the learnings that we took from productionalizing these applications at scale still translate and are being rediscovered even at the AIE Worlds where I sometimes hear...”

ConceptInfrastructure

“Yeah. So, so the first thing is you need to pick your harness or you need to give your teams the ability to create, you know, using an agentic framework, whatever, let's say you're using LangGraph or Pydantic AI or something like that. Then you need to deploy it onto some comp...”

ConceptInfrastructure

“There's a lot that we're learning from this paper in terms of the algorithmic improvements that make this thing tick. So you mentioned, you know, massive model, 1.6 trillion parameters, 48 billion activated per token. I mean, 48 billion. I remember when 48 billion parameters f...”

ConceptInfrastructure

“And break it up into different subproblems that you can farm out to different GPUs. And traditional version of this is like, you know, data parallelism, for example, you take all the prompts that are coming in, you give some prompts to some machines and other prompts to other ...”

ConceptInfrastructure

“And so you can't hold them all in memory on one machine. And so now it's like just every end of incremental GPU is holding such a small fraction of the problem. This thing really is starting to look like a hive. It only makes sense when you zoom out and kind of look at it at m...”

ConceptInfrastructure

“Yeah, that's the idea. And so I guess when you mentioned colocation, that's another interesting thing where one thing we've seen is people come to us when they want very specifically located CPUs or GPUs. Like they want—”

ConceptInfrastructure

“Like just an open socket. This is directly like mTLS.”

ConceptInfrastructure

“I actually first met Eric, who's the CEO, through an investor. And back then, Eric was already thinking about building a new kind of runtime. And he got there thinking through why are workflow orchestration products so hard to use? It's because you have to run them on Kubernet...”

ConceptInfrastructure

“how much is this translating into actual impact for people?”

ConceptInfrastructure