Core concept
SRAM-only architecture (no HBM/DDR). Model weights fit in SRAM across many chips.
Advertisement
How it works
Limited to LLM inference. Not for training. Requires specific model deployment.
Advertisement
Trade-offs + gotchas
Ultra-low-latency LLM inference. Groq Cloud offers Llama/Mixtral at low prices.