Anthropic Message Threads: ~35% faster long Claude Code sessions — same token bill
SummaryPublic beta on the Messages API (Nov 2, 2026). Send the full chat once with thread create; later turns send only what's new. Anthropic's figure: median TTFT ~35% lower on Claude Code requests with 500k–1M tokens. Billing unchanged. Catch: 5-minute idle expiry; not ZDR or HIPAA eligible.
· MODEL Editors · 1 min read
Some links may be affiliate links. Disclosure

Anthropic shipped Message Threads as a public beta on the Messages API (release notes: Nov 2, 2026). Long agent loops no longer have to re-upload the whole conversation on every turn — which cuts time to first token on big sessions. Your token bill does not move.
How it works. First request: send the full conversation (plus system / tools) with thread: {"type": "create"}. Later turns: send only new messages plus thread: {"type": "continue", "previous_message_id": "<prior response id>"}. Required beta header on every request: message-threads-2026-08-12.
The number Anthropic published. With threads on by default for most Claude Code users, requests with 500k–1M tokens see median TTFT drop by about 35%. That figure is in Anthropic's product article — not restated as a separate number in the API docs. MODEL has not measured TTFT.
Billing / tokens unchanged. Threads make each HTTP request smaller. Claude still reads the full conversation every turn, so input tokens and pricing stay the same. Docs: "Threads do not change pricing or rate limits." Pair with prompt caching if you want cost wins; threads alone are a latency feature.
Where it runs. Claude API, Claude Platform on AWS, Claude in Microsoft Foundry, and Claude Models on Google Cloud (Anthropic managed).
Retention / compliance catches. Thread held in memory, encrypted, not written to disk. Expires 5 minutes after the last request; deleted no more than 1 hour after last use. Not ZDR eligible. Not HIPAA eligible. Different from Managed Agents session threads.
Builder caveats. Idle >5 minutes → continue returns 404 (thread_not_found); client must replay the full conversation in a new create. Keep your own copy of the chat — the API is best-effort storage, not your source of truth. Append-only; branch or edit earlier turns by starting a new thread.
Verdict. Real latency win for long coding / computer-use / multimodal agent loops, with an honest trade: same tokens, short memory window, no ZDR/HIPAA. Not tested by MODEL (API call — no key on box). Not investment advice.
MODEL Editors
Sources
- Make long-running agents faster with message threads
Anthropic / Claude
- Message threads
Claude Docs
- Claude Platform release notes — November 2, 2026
Claude Docs
FREE · EVERY WEEK
The top AI tools this week, tested.
Every week MODEL's editors pick the AI tools worth your time, try them hands-on, and tell you what's good, what's not, and who it's for. Free, in your inbox.
Free. Unsubscribe anytime. Our picks are editorial and can't be bought.
Continue

Builder Tip
Revolut self-hosts GLM 5.3 for ~2,000 engineers on 56 B200s
David Abitbol's AI Engineer NYC talk (Oct 13, 2026): after Claude Code bills hit $1k–$10k/month for some engineers, Revolut made self-hosted GLM 5.3 the default for coding — ~$0.30/M tokens, ~1/10 prior Anthropic+OpenAI invoice, TTFT cut ~88%. Caveat: the 60%/70% coding/lead-time chart does not isolate the model change.
· MODEL Editors

Tool Update
OpenAI built Pando, a Git backend for agent-scale monorepos
OpenAI's engineering post: Pando is a new Git-compatible backend for its monorepo. Codex multiplied parallel branches and pushes; Pando cut median push latency by nearly 80% and now serves nearly a petabyte of Git data a day. Internal only — exploring ways to share, not a product you can install.
· MODEL Editors

AI News
Google's Gemini 4 Carbon is #1 on the big intelligence board. You still can't use it.
Carbon (high) scores 59 on Artificial Analysis Intelligence Index v5 — ahead of Opus 5.5 max and GPT-6 Astra max. Access is Fairwind / cyber-defender only for now. Not tested by MODEL.
· MODEL Editors