d-Matrix Raises $275 Million to Solve AI's Most Expensive Problem

The AI boom has a big secret. Training is cheap compared to deployment. Building a large language model costs millions. Running it at scale costs billions. As enterprises deploy AI models into production, inference has become the dominant expense in AI infrastructure.

Santa Clara startup d-Matrix has raised $275 million to solve this economic crisis with a fundamentally different chip architecture. The Series C funding, co-led by BullhoundCapital, Triatomic Capital, and Singapore's Temasek sovereign wealth fund, values the company at $2 billion and brings total capital raised to $450 million.​

The insight behind d-Matrix is simple. The problem isn't computing power, it's the distance data travels. Traditional graphics processing units, from Nvidia and others, separate processing from memory. Data must constantly move between these two components, creating a bottleneck that wastes power and latency. This "memory wall" is why inference is so expensive.​

d-Matrix's solution is called Digital In-Memory Compute, or DIMC. Instead of separating memory from processing, the company embeds processing components directly into memory itself. The result is Corsair, an inference accelerator that delivers what the company claims are 10 times faster performance, 3 times lower costs, and up to 5 times better energy efficiency compared to GPU-based systems.​