Notes on AI cost engineering.

For teams that have made Claude Code the center of their engineering workflow, Anthropic's daily quota limit is not an inconvenience. It's a production incident. When the quota ...

For two years the trimio product talked about itself in borrowed vocabulary: routing rules, LCR configuration, least cost logic. The territory was ours. The language was everyon...

A new empirical study running 30 agentic software development tasks through a multi-agent framework on GPT-5 found something that should change how every engineering-led organiz...

On August 18, 2026, Claude Code's THRIFTY_SONIC flag was discovered in production — a hidden harness mechanism silently switching models and effort levels on developer requests ...

"Don't Paste the AI, Please" hit HN #1 with 491 points and 238 comments. The site is a community resource arguing against thoughtlessly copying and deploying AI-generated output...

On June 10, 2026, Anthropic sent a letter to the U.S. Senate Banking Committee alleging that operators affiliated with Alibaba and its Qwen AI research division ran the largest ...

On August 13, DeepSeek announced something no other LLM provider has done at scale: time-based pricing tiers. Peak and off-peak rates, with off-peak at 50% of peak cost. The new...

Your AI agents are reasoning before they act. They're weighing options, evaluating tool calls, forming plans — and then executing against your production systems. When something...

Moonshot AI pulled new Kimi K3 sign-ups Sunday evening after GPU capacity collapsed under demand for the open-weight frontier model. The story ran on HN at 274 points and 109 co...

DeepSeek shipped a developer preview of their own coding agent harness on August 14. MIT licensed. HN #9 with 680 points and 279 comments. A DeepSeek team member confirmed in th...

Wafer.ai published an inference benchmark on Friday that quietly redrew the frontier-model cost map. GLM-5.2 — quantized to MXFP4 via AMD Quark and served on MI355X — runs at 2,...

The defining enterprise-AI behavior of the last two years ended last week. Tokenmaxxing — the practice of equating token volume with engineering progress — collapsed under the b...

Apple spent approximately $1 billion per year to build an LLM routing layer. That's what WWDC 2026's AI architecture reveal actually is — a smart orchestrator that decides which...

An essay by Sean Goedecke hit Hacker News this morning with 1,034 points and 438 comments. The thesis: LLMs don't democratize expertise — they amplify it.

Microsoft's Experiences + Devices team (Windows, M365, Outlook, Teams, Surface) is winding down Claude Code licenses by June 30. The stated reason: convergence on GitHub Copilot...

Simon Willison compiled the full incident timeline last week from OpenAI's Black Hat presentation. It deserves a careful read — not because rogue AI agents are a novel concern, ...

Turn 9 of a 20-turn agent session. Claude Sonnet, routed via least-cost routing to Fireworks/Qwen3 for the cheaper turns. Everything working as expected — until the model says:

If you only have one statistic to put in your next board deck about AI risk, this is the one:

On May 7, 2026, a cooling system failure in AWS us-east-1 availability zone use1-az4 triggered a thermal event that took down EC2, SageMaker, and a cascade of dependent services...

In April 2026, a GCP service account key was accidentally committed to a git repo. A routine push, a credentials file that should have been gitignored. By May 9 — 41 days later ...

On July 31, 2026, Y Combinator open-sourced qm — the multiplayer agent harness it uses internally across accounting, legal, events, and engineering. By Saturday morning it sat a...

Oracle shed roughly 21,000 roles in its most recent fiscal year — about 13% of a workforce that had grown to 162,000. The trigger was explicit. The $1.8 billion in severance was...

Cloudflare cut 20% of its workforce in early 2026. GitLab eliminated three management layers. The pattern across enterprise tech in 2026 is consistent: companies are replacing h...

Every AI gateway claims to route on cost. A few claim to route on quality. Almost none can answer the question a CFO will ask: "How do you know this score is real?"

Semgrep ran their production IDOR vulnerability benchmark against open-weight models this week using the same dataset and prompt they use to evaluate frontier coding agents inte...

A widely-discussed essay landed on HN last week (746 points, 443 comments): the argument that domain expertise — not software engineering skill — is the binding constraint on AI...

Until early 2026, the routing argument for AI gateways had a footnote attached to it: "…assuming you're willing to use the open-weight models." The footnote was doing a lot of w...

If you treat "GPT-5.5" as a single product with a single price, you are leaving money on the table. Possibly a lot of it.

Databricks published a blog post this week that reads like the enterprise AI cost management case study the industry has been waiting for. It names names — Stripe, Coinbase, Ube...

Two facts every finance leader should hold in the same hand:

When you send all your AI API calls to a single provider, you've made a data residency decision — whether you intended to or not. That provider's terms of service, data retentio...

The debate about whether MCP (Model Context Protocol) is dying hit HN last week with 266 points and 243 comments. The argument: direct CLI access to Claude Code, raw API calls, ...

Saturday evening, Stephen Bochinski published "The Kimi K3 Moment" on his blog. It hit Hacker News #1 at 455 points and 458 comments — and the most-commented AI piece on the HN ...

On June 26, 2026, OpenAI did something it has never done before: it launched a model family, not a model. Three tiers — Sol, Terra, Luna — all priced differently, all on the sam...

On July 30, 2026, OpenAI updated the GPT-5.6 pricing page. No blog post. No press release. Just a price change on a model that launched 34 days earlier:

Monday morning, an essay by Fabian Gruhn hit the top of Hacker News with 797 points and 345 comments. The title: "Don't be a meat proxy."

Every AI agent your engineering team runs is a collection of tools. Cursor calls a GitHub tool. Claude Code calls a file system tool. Your SDR agent calls a HubSpot CRM tool. Th...

Anthropic launched Claude Sonnet 5 on Wednesday. By Wednesday afternoon it was HN #5 at 1,158 points and 686 comments. The numbers from Anthropic's announcement are unambiguous:...

On Friday, Epoch AI published the security industry's most consequential data point of 2026: high- and critical-severity CVE disclosures jumped 3.5x in June 2026 versus the pre-...

Three days after its $75B IPO, SpaceX announced the acquisition of Anysphere — the company behind Cursor — for $60 billion. The deal closes in Q3 2026.

PrismML shipped Bonsai 27B this morning — the first 27B-class model that runs end-to-end on a phone. The HN thread hit #3 on the front page at 626 points and 219 comments in und...

A reverse-engineer published a post on Tuesday night titled "Claude Code Is Steganographically Marking Requests." By Wednesday morning it was HN #2 at 2,151 points and 619 comme...

In the seven days between May 29 and June 1, four new open-source AI gateway projects shipped publicly: 9Router, RTK (Rust Token Killer), TokenPak, and OmniRoute. Together with ...

Every LLM routing tool on the market advertises one thing: route to the cheapest model. It sounds like a win. It usually isn't. Cheapest-only routing treats models as interchang...

Enterprise cost attribution tools — Apptio, Cloudability, Flexera — cost $200K–$800K per year and take quarters to deploy. They tag cloud resources after the fact, reconcile aga...

On Monday morning, July 6, 2026, OpenAI confirmed GPT-5.6 Sol Ultra is shipping to enterprise Codex accounts. The Hacker News thread hit #2 within hours — 320 points and 269 com...

Short answer: yes. Most prompt compression rewrites your prompt per request, which changes the cached prefix and turns every call into a cache miss. Here's the math, and how cach...

Cerebras announced the CS-4, their fourth-generation wafer-scale inference system. The numbers are straightforward: 1,000+ tokens per second on models exceeding 10 trillion para...

Anthropic published "Maximizing the Value of Your Claude Code Sessions" — a first-party guide covering /compact, /clear, /handoff, context window management, and session continu...

Google shipped Gemini 3.7 Flash on August 13. Three weeks after 3.6 Flash. Half the introductory price. Better on every benchmark that matters for coding and agentic workloads. ...

CloudSEK published a threat intelligence report on August 11 that maps the full blast radius of the March 2026 LiteLLM PyPI supply chain compromise. The numbers: approximately 2...

Gravitee 4.10 ships an LLM proxy, and the distribution advantage is real. But proxying a model call and optimizing what it costs are different problems — here is where the wedge actually is.

Neon and Castform published a detailed case study this week that landed at #13 on HN with 336 points. The finding:

This morning, Jeff Dean — Google's Chief Scientist for 27 years, architect of TensorFlow, TPUs, and Google Brain, co-author of MapReduce and GFS with Sanjay Ghemawat — announced...

An essay published this week at earendil.com hit #7 on HN with 415 points. The headline finding:

On July 31, 2026, an essay titled "The Session You Cannot Take With You" hit #1 on Hacker News with 467 points and 118 comments. The argument is simple and correct: AI agent ses...

Two stories this week put Kimi K3's autonomous security capabilities in sharp focus. Together, they create the most concrete enterprise AI security control question of 2026.

"If coding has been solved, why does software keep getting worse?" hit HN at 440 points with 364 comments — one of the most engaged threads of the week. The thesis: the AI codin...

Thinking Machines Lab released Inkling this morning — a 975B total-parameter mixture-of-experts model with 41B active parameters, a one-million-token context window, and open we...

The HN front page carried a 274-point story this weekend that earned the discussion it got: Mesh LLM (274 pts, 63 comments). Mesh LLM describes itself plainly: "Pool the GPUs an...

Cost savings don't matter if quality drops. When GLM-5.2 hit a pricing floor that wasn't matched by capability, hedge routing wasn't a nice-to-have — it was the whole game.

On July 7, 2026, Martin Alderson published a 1,800-word post arguing that the AI inference business is structurally built on sand. His candidate for the first grain that cracks ...

On Monday morning, July 6, 2026, OpenAI confirmed GPT-5.6 Sol Ultra is shipping to enterprise Codex accounts. The Hacker News thread hit #2 within hours — 320 points and 269 com...

On Monday, July 6, 2026, a controlled academic study crossed the Hacker News front page at #16 with 149 points and 78 comments: "Does Code Cleanliness Affect Coding Agents?" The...

Meituan released LongCat-2.0 today: 1.6 trillion total parameters, ~48B active per token (MoE), trained on 50,000+ domestic Chinese AI accelerators over 35+ trillion tokens, MIT...

On June 30, 2026, the U.S. Department of Commerce lifted export controls on Claude Fable 5 and Claude Mythos 5. Anthropic confirmed global restoration beginning July 1. The 18-d...

Two months ago, FinOps X in San Diego hosted a Linux Foundation announcement that has been quietly compounding in the background: the Tokenomics Foundation, modeled on the FinOp...

After the Fable 5 killswitch incident, every CIO is asking one question: who actually owns AI governance when the provider can pull access unilaterally?

This morning OpenRouter shipped Fusion — a new model that fans your prompt to 3–5 frontier LLMs simultaneously, then uses a judge model to synthesize the "best" answer. The HN t...

June 15, 2026. If your team uses Anthropic's API under a Pro, Max 5×, or Max 20× plan, your billing model changed this morning. Not a policy update. Not an email warning. The ch...

Anthropic changed how it bills Claude API calls. The change is small in copy but sizable in cost impact for high-context workflows. Here is what moved.

Hacker News top story today: an engineer describing being outpaced by AI-native colleagues, unable to slow hiring decisions that favor AI velocity, and uncertain what to do abou...

Between Friday evening and Monday morning, 30+ pull requests merged across two repositories. The result: Trimio's architecture went from a single-tenant LLM proxy to a fully iso...

Here's the problem with every LLM cost model in production today: it treats a complex multi-step reasoning request the same as a simple one-line classification, as long as they'...

GitHub Copilot switched to token-based billing on June 1. A developer who was paying $29/month on the flat subscription is now looking at $750–$3,000/month depending on how they...

A post on Hacker News today is making the rounds in engineering circles: a practitioner's guide to running Claude Code as a production agentic system — layered .claude/ configur...

LLM vendors are running the same playbook credit-card companies ran in 2014: frictionless to start, frictionless to fail. A $10K day is not a bug — it's the design.

When the measure becomes the target, it ceases to be a good measure. AI budgets hit Goodhart's Law when teams optimize cost-per-call instead of cost-per-outcome.

Two questions determine whether AI agents survive a CFO's budget review. The first: did the agent run successfully? Most teams can answer this. The second: did running it create...

The EU GDPR enforcement actions of 2025 included over €1.6 billion in total fines, a record year. AI data processing is now explicitly in scope: any AI system processing persona...

CVE-2026-42208 and CVE-2026-42912 — and what they say about the AI gateway architecture layer: defaults matter, and language choice is a security posture.

The difference between a soft limit and a hard limit isn't a policy choice — it's a billing-event choice. How to design AI budgets that don't surprise you.

When Cursor, Copilot, and Claude Code write 60% of your PRs, the ROI math changes. The bottleneck is no longer developer throughput — it's the API bill.

Uber's 2026 retrospective is the clearest field report on what happens when an engineering org goes fully AI-native — and what the budget caught first.

Enterprise cost attribution tools — Apptio, Cloudability, Flexera — cost $200K–$800K per year and take quarters to deploy. They tag cloud resources after the fact, reconcile aga...

GPT-5.0 shipped in late 2025. GPT-5.4 arrived six weeks later. GPT-5.5 and GPT-5.5 Pro followed in the same quarter. Each release brought capability improvements, pricing change...

If you're evaluating AI gateways in 2026, Portkey comes up early. It's well-documented, has a clean developer experience, and covers the core use cases — multi-provider routing,...

Most engineering and FinOps teams model generative AI costs the same way they model a REST API:

On May 9, 2026, a developer gave an AI agent a task: join the DN42 hobbyist network, register their presence, and scan the network to build an index. The agent was told to regis...

Most production AI teams know the cost of one model call. Many know the cost of one user interaction. Very few have a clear-eyed picture of what their workflow is going to cost ...

On April 30, 2026, Palo Alto Networks announced its intent to acquire Portkey — folding the AI gateway and LLMOps platform into Prisma AIRS (AI Runtime Security). The deal is ex...

A finance leader walks into an AI gateway evaluation expecting it to be like picking an API gateway. They expect a feature matrix, three vendors with overlapping checkboxes, and...

The AI gateway category has split into three lanes: security-first, performance-first, and economics-first. What the acquisition says about where the money is.

Prompt caching is one of the most-marketed cost-saving features in the LLM market. Anthropic's published claim — up to 90% cost reduction on cached prompts — is real. The proble...