Enterprise AI, in production.
    Four desks, one beat.

    Groq’s $6 Billion Valuation Says More About Nvidia Than Groq Itself

    ManufacturingNews

    Groq’s $6 Billion Valuation Says More About Nvidia Than Groq Itself

    If you're building inference chips that still use external memory, you're basically copying GPUs and you won’t win by copying Nvidia’s playbook.

    Last updated

    Groq Inc. is raising approximately $600 million in new funding at a valuation of about $6 billion, according to people familiar with the discussions. The round is being led by venture capital firm Disruptive, which has committed more than $300 million. The fundraising, still in the final stages, brings Groq’s total capital raised to more than $2 billion.

    The latest round more than doubles the company’s valuation from last year, when it raised $640 million in a deal led by BlackRock funds. The increased investor interest underscores Groq’s growing relevance in the AI infrastructure market, particularly as companies look beyond Nvidia for scalable and cost-efficient inference solutions.

    Founded by Jonathan Ross, a former engineering leader at Google, Groq is focused entirely on inference, the process of executing trained AI models rather than training them. Its proprietary chips, called Language Processing Units (LPUs), are designed for ultra-low latency and high-throughput inference, avoiding many of the hardware bottlenecks that affect GPU-based systems.

    “Every time we launched a new AI product at Google, the compute required to run it in production was typically 10 to 20 times more than what was needed to train it,” Ross said in a recent podcast interview. “Inference at scale is a completely different challenge.”

    by AIM Media HouseFree · No paywall

    Keep reading. It's free.

    Create a free Deployed account to finish this story and every story on the site. Choose the briefings you want with it:

    or

    No credit card. One click to unsubscribe. Already a reader? Sign in

    About the author

    Anshika Mathews

    Anshika is the Global Media Lead for AIM Media House. She holds a keen interest in technology and related policy-making and its impact on society.

    Related stories