Theses›Datacentre & AI compute›Agentic compute silicon

Agentic compute silicon

The shift to fleets of autonomous agents moves the binding compute bottleneck off the GPU forward-pass and onto orchestration, tool-execution and retrieval silicon by 2026

  • Bear
  • Shut
  • $16B by 2035

The callCPUs and GPUs were not designed for agents; the question is whether a new processor class wins that work or the CPU makers redesign for it the way NVIDIA redesigned the GPU for matrix maths.

D1D2R1R2R3C1foragainst D1D2R1R2R3C1foragainst
Fig. 1The balance. Drivers and catalysts against restraints, each block sized by its weight; catalysts hang dashed because they have not happened yet, sized by their odds. It tips toward the restraints.
  1. D1The workload does not fit the chips: tool execution and retrieval are 65-89% of end-to-end agent latency while the GPU idles, and CPU-to-GPU ratios are moving from 1:4 toward 1:1, so the binding constraint has moved off the matrix maths.
  2. D2Every workload shift has produced its processor class (the CPU, the GPU, the DPU, the inference chip), and inference becomes about three-quarters of AI compute by 2030, most of it agentic.
  3. R1The CPU makers redesign for agents: Arm, AMD, Intel and NVIDIA's own CPUs see the workload first, and the control plane was absorbed inside ten weeks, the way NVIDIA re-optimised the GPU for matrix maths rather than ceding it to a new chip.
  4. R2Every measured result so far resolves the control-plane bottleneck in software and orchestration, not new silicon.
  5. R3First silicon for a datacentre part costs $100M or more, so the bet is expensive to be wrong on.
  6. C1XCENA's MX1 memory expander enters mass production, the first merchant agent-memory tier shipping with customer revenue in 2027, proving a merchant socket exists.end-2026
Rests onthe beliefs underneath
Threatened by · confidence
What would prove itdated tests, open and resolved
20272028202920302031today1234predictionswatch 20272028202920302031today1234predictionswatch
Fig. 2Each ring is a dated test: dashed while open, struck through when overdue, ticked or crossed once resolved.
  1. 1By GTC 2027 the agent control-plane / orchestration workload is served predominantly by CPU + DPU + software, with no merchant control-plane ASIC reaching design-win volume.Jun 2027 · open
  2. 2Arm, AMD and Intel server roadmaps: do the next generations add agent-specific concurrency and memory paths? If yes, the bear case wins.Dec 2027 · open
  3. 3Any merchant agent or control-plane processor reaches design-win volume; I expect not.Dec 2027 · open
  4. 4A net-new agent-execution silicon company reaches a $1B standalone outcome on the product.Dec 2030 · open
Expressionslisted, private, technologies
  • 000660.KSSK hynix
    • cheap
    Sells processing-in-memory DRAM (AiM, HBM-PIM) and CXL memory modules to datacentre and AI customers.
  • 005930.KSSamsung Electronics
    • cheap
    Sells HBM-PIM and LPDDR-PIM memory and CXL memory modules (CMM-D) to datacentre customers.
  • MUMicron Technology
    • cheap
    Sells CXL memory expansion modules to server makers and hyperscalers.
  • 688008.SSMontage Technology
    • not screened
    Sells CXL memory expander controllers (MXC) to memory module makers including Samsung and SK hynix.
  • MRVLMarvell Technology
    • cheap
    Sells Structera CXL memory expansion and compute controllers to hyperscalers.
  • MCHPMicrochip Technology
    • cheap
    Sells SMC 2000 CXL smart memory controllers to server and module makers.
Private · 13 private companies, 6 of them in the US; none in continental Europe.

Navona · PuppyGraph · NebulaGraph · Memgraph · FalkorDB · Groq · d-Matrix · Cerebras Systems · Callosum · Tenspresso · Syntiant · Panmnesia · XCENA

8 more private companies tracked, not shown

Who has already bet on itprivate rounds, from public sources

$1.5B raised by 5 companies, $1.1B of it in the last three years. Wave under way: Large rounds in the last three years; the category is funded and getting crowded.

Backed by a top-tier venture firm: d-Matrix. Backed by a strategic investor: d-Matrix, Syntiant.

What changedthe record, newest first
  • 6 Nov 2026Investors are now paying unicorn-track prices for months-old teams building chips around memory for long context, before any product exists. That says memory is the bottleneck people believe in; it does not yet say who gets paid for it.
  • 15 Oct 2026The memory tier for AI agents is now named on an earnings call, and the companies naming it are selling commodity DRAM and SSDs into it. The demand is real; the question is whether anything but software ever gets to sell into it.
  • 8 Sep 2026A fund still asking you to defend the thesis is a fund that has not adopted it. The edge dies on the day they start explaining it back to you.
7 earlier
  • 28 Jul 2026A pre-product clean-sheet CPU company just quadrupled in price in five weeks, oversubscribed, with a top-tier US lead — and as far as public evidence goes, nothing technical changed in between. Capital is repricing exotic compute as if the proof existed; the proof is still a benchmark nobody has published. When price runs ahead of evidence this fast, the interesting question is no longer "is the technology real" but "who is underwriting what, on what".
  • 22 Jun 2026Capital for clean-sheet computing is suddenly abundant again. Tier-1 funds that had left chips are back, underwriting pre-product CPU bets, and AI coding models really do lower the cost of porting software to exotic hardware. But neither is the thing that was actually binding. Cheaper porting helps the incumbents too, and is weakest on a brand-new instruction set with no code to learn from. The real gates (the capital to tape out, a measured win on a real workload, a senior chip architect) are untouched by an easier round. An easier-to-fund bet is not a more-likely-to-work bet.
  • 21 Jun 2026A useful distinction when sizing up exotic-compute bets: the AI-chip profit pool consolidating toward custom silicon and the packaging/memory chokepoints does not automatically threaten a memory-retrieval or new-CPU startup, since those sit off the accelerator axis. The sharper risk to a memory-tier startup is that the giant cloud buyers build that tier themselves, not that a chip vendor out-competes it.
  • 9 Jun 2026When a sceptic asks why agent memory can't just run on Redis, a graph database, or pooled commodity memory, the honest answer is that today it can, because the working set is small and cacheable. The bet is that swarms of agents make the working set large, novel and concurrent, and caching then breaks. One published study already shows retrieval crossing 75% of latency once the corpus hits 200GB. Whether production gets there, and how fast, is the real uncertainty.
  • 5 Jun 2026An agentic-memory hardware startup turns out to be a rack-scale systems company, not a chip: it sells trays that sit in the data-centre memory rack, designs the chips and orchestrates the build. The bet is a throughput / utilisation one (keep GPUs busy across many concurrent agents), and the first real proof point is a benchmarked design partner, not the chip.
  • 4 Jun 2026Two independent reviews of an agentic-retrieval accelerator converged on the real question: a single query spends most of its time in inference, not retrieval, so the hardware case rests on multi-user throughput (keeping expensive GPUs busy across many concurrent agents), not single-query speed. And the benefit is handling context better, not using fewer tokens.
  • 1 Jun 2026Agents really do change the compute profile (tool calls and retrieval, not the model forward-pass, now dominate latency), but the winners look like CPUs and memory/retrieval silicon, not a brand-new 'agent chip'. When three incumbents ship a CPU answer to your category in ten weeks, the empty startup lane beside them is more often a signal than an opening.
Reading
Show the reading