Microsoft Turned Database Grading Into RL Rewards—And It Worked
Microsoft's ThinkingBox converted database correctness checks into RL rewards, tripling repeatable success for agent tasks—but sharpening came at a cost.
11 posts
Microsoft's ThinkingBox converted database correctness checks into RL rewards, tripling repeatable success for agent tasks—but sharpening came at a cost.
Hugging Face turned its dataset hub into a universal RL environment registry. No new infra, no sign-ups—just tags. Harbor, Verifiers, OpenEnv, and NeMo Gym environments all land in one filter.
HuggingFace shows how to split RL training and inference across separate Jobs with no shared NCCL—just a rank-1 adapter, a FUSE-mounted bucket, and smart routing. Training time drops from 3h27m to 53m.
IBM just dropped Granite 4.2—3B, 8B, and 30B reasoning models trained from scratch on 15T tokens, with thinking/non-thinking modes and a staged RL pipeline that teaches agents to code, search, and use terminals.
Liquid AI's new 2.6B model beats competitors 4x its size on tool use and instruction following, runs at 220 tok/s on a laptop, and was trained inside real agent harnesses with RL.
NVIDIA, DeepMind, and Disney just open-sourced Newton—a GPU-accelerated physics engine that treats simulation as infrastructure. If you're building physical AI, your bottleneck just shifted.
LeRobot's biggest release yet ships world-model policies that imagine before acting, reward models that know when robots succeed, and a unified eval suite across six simulation benchmarks.
Cohere just released a 30B MoE model trained specifically for agentic software engineering. It's Apache 2.0, beats models 4× its size, and actually works across multiple agent harnesses.
Hugging Face, Meta PyTorch, Nvidia, and a dozen others just formed a committee to govern OpenEnv—the protocol layer trying to make agentic RL training actually interoperable.
ServiceNow AI's deep dive into vLLM's V1 upgrade reveals why getting base correctness right matters more than chasing incremental RL gains—a lesson in engineering priorities.
Hugging Face just dropped Ecom-RLVE, a reinforcement learning framework that trains e-commerce agents in realistic but controllable environments. This is how we move from chatbots to actually useful shopping assistants.