Groq (inference platform)
Also known as: GroqCloud, LPU, Language Processing Unit
Groq is a US provider of exceptionally fast LLM inference. Instead of graphics cards, the company uses custom-built chips: Language Processing Units (LPUs). They are designed for one job only: running language models, not training them.
Not to be confused with Grok, the AI model from xAI. Groq is an infrastructure platform, Grok is a language model.
What the platform offers
GroqCloud serves open models via API, including Llama from Meta, OpenAI’s GPT-OSS, plus Qwen and DeepSeek variants. Closed models such as ChatGPT or Claude are deliberately absent. In late 2025, Nvidia licensed the LPU technology for around 20 billion US dollars. GroqCloud continues to operate as an independent service.
What sets it apart: speed
LPUs deliver answers far faster than typical GPU inference. Llama 3.3 70B reaches roughly 300–400 tokens per second on GroqCloud. Smaller models hit up to 1,000. That equals several pages of text per second.
Typical use cases
Speed matters wherever people wait for answers: chatbots, voice assistants, and AI agents that execute many steps in sequence. The faster each individual response, the smoother the entire workflow.
We can work out the next step together in a free introductory call. Contact →
As of: June 2026
Claude Cheat Sheet
An overview of Claude's features and models, with tips from our daily work. It is available in German and English, and we keep it up to date.
Open the cheat sheetDigital Impact in your inbox
With one sign-up you get three newsletters: the AI Insights Newsletter with our new articles every week, plus the Digital Impact Longread and the Digital Impact Update once a month. Sign-up uses double opt-in, and you can unsubscribe at any time.
AI Operations as a podcast
In the Digital Impact Podcast, André Hellmann, Christina D'Ilio, Christian Sattel and Sarah Stock talk with guests from practice about AI Operations. The episodes are easy to listen to on the go.
How this article was produced
- Topic selection
- Source selection
- Fact-checking
- Approval
- Research
- Drafting
- Diagrams
- Publishing
This article was produced with AI support. Ideation, editorial planning, substantive review and approval rest with a human; copy-editing sits with the AI. Editorial responsibility is held by André Hellmann.