AI Hot Topics
- DeepSeek open-sources its in-house inference framework DeepInfer (the one behind V4.1 Flash’s online service); the official post has 35k likes and 13k bookmarks. The accompanying technical report on Zhihu discloses Prefill/Decode hardware choices, KVCache targets and more, plus single-cluster numbers: 155 trillion tokens/day throughput and $38 revenue per card-hour at off-peak prices. At a $5–10 cost per GPU-hour, swyx roughly estimates about 80% serving gross margin (his estimate). Worth reading if you deploy inference. X @deepseek_ai | GitHub deepseek-ai/DeepInfer | X @shao__meng | X @swyx
- WSJ has seen Anthropic’s draft IPO prospectus: first-half revenue of $16.3B, nearly $9B spent on compute and infrastructure in the half, about $450B in committed compute contracts mostly non-cancellable, and two unnamed customers contributing about 20% of revenue. Cross-checked against the WSJ report republished on Investing.com. Separately, Dario personally answered Encode counsel Nathan Calvin’s challenge on “safety or racing to superintelligence”: he admitted three communication mistakes (a letter to Congress, a statement, and a bill draft) but said the “race to the top” strategy stays. X @rohanpaul_ai | investing.com/news/stock-market-new… | X @dotey
- The OpenAI API now supports 12-hour prompt caching, suited to always-on agents that reuse the same context all day. Codex lead Tibo added that cache is kept permanently for logged-in Codex and Work users, so returning to an old conversation hours later is guaranteed a cache hit. In another post Tibo admitted that about 40,000 accounts had usage limits inconsistent with their plan over the weekend; fixed, with credit to be added. X @OpenAIDevs | X @thsottiaux | X @thsottiaux
- OpenAI acquires Orchestra Bio (a platform that coordinates drug-discovery workflows) and folds it into the Rosalind life-science models and tools line. X @OpenAI
- Logan Kilpatrick: Gemini 4 Argon processed about 25 trillion tokens in its first 72 hours. Meanwhile Google Research open-sourced Harness², which lets an agent iteratively rewrite its own prompts, tools, memory and workflow during a task without touching the underlying model. X @OfficialLoganK | X /i/trending/2112543196727357508
- Meta releases the open-weights Muse Glimmer 30B (Apache 2.0), which runs on a single-GPU Mac/PC, aimed at always-on local agents and tool calling. X /i/trending/2112284686995136549
Tips & Hands-on
- Have the agent draw a state diagram and then formally verify (lauren/poteto, 1.7k likes, 1.8k bookmarks): first have the agent draw the feature’s user flow as a statechart, then use the /create-formal-verification-skill generated by pstack to find bugs with tools like TLA+. It helps you understand the code and user flows, and fix problems before users hit them. X @poteto
Uber uses agents to delete code safely (meng shao’s write-up): AutoClean has removed 16,000+ stale feature flags and over a million lines of code. Condition simplification goes to a deterministic engine (called via MCP) and the agent only decides propagation; when fixing CI the test fixer may only edit test files, preventing it from changing production code to make tests pass; finally several specialized review agents check in parallel that the change is “delete-only, semantics unchanged, in scope, no agent traces”, and any failure discards the diff.
Databricks MemCurrent’s agent memory design (meng shao’s write-up): raw session traces are append-only; distilled experience is stored as layered files with an auto-generated memory.md index at the top, injected at session start and retrieved from as needed. Ablations show most of the gain comes from “derived memory plus index” (no memory 22.3%, derived memory plus index 66.1%, both combined 68.4%).
- Supabase releases a skill for coding agents: the agent can query project logs directly, and the skill tells it to focus on error spikes, security issues, slow queries and usage growth, with you deciding when it runs. X @supabase