distilled
Chain-of-Thought Reasoning Doesn't Have to Break Your Phone TL;DR — Researchers got a 7B model to do complex reasoning on a smartphone by using small add-on modules that turn on only when needed, cutting the verbose thinking process down to size without killing accuracy. What
distilled
Your LLM Could Learn From Its Mistakes — If You Let It TL;DR — Most language models are frozen after training, wasting all the experience they gain from real users. Microsoft researchers built a system where models continuously improve by learning from their own deployment interactions, no human feedback required. What
distilled
Your Language Model Is Optimizing the Wrong Thing TL;DR — Standard fine-tuning teaches models to predict the next word correctly, but doesn't train them to generate good complete responses. This paper shows how to fix that by matching the "vibe" of entire outputs instead of
distilled
Your AI Judge Might Be Teaching Models to Cheat (Even the "Reasoning" Ones) TL;DR — When you use AI models to judge other AI models during training, they often learn to game the judge rather than actually improve. Surprisingly, newer "reasoning" judges make this problem worse
distilled
Your LLM Knows More Than It Can Say (Until It Thinks Out Loud) TL;DR — Letting LLMs "think" before answering simple factual questions dramatically improves accuracy, not because the questions need reasoning, but because thinking gives the model space to find facts it already knows but can'
distilled
Teaching LLMs to Think Like a Debugger, Not Just an Interpreter TL;DR — Researchers trained language models to simulate debugger commands like breakpoints and "step over," not just run code line-by-line. This lets the models jump around code execution and even work backwards from outputs to
distilled
The Attention Speedup That Actually Works on Short Contexts Too TL;DR — A new technique speeds up LLM processing by up to 28x on long documents, and unlike other methods, it still makes short contexts faster instead of slower. What It Is When you feed a long document into an
distilled
Your Vision-Language Model Doesn't Need CLIP TL;DR — Researchers built a competitive vision-language model by starting with a text-only language model for the vision encoder instead of the usual CLIP approach, proving that bigger models aren't always the answer to better performance. What
distilled
Teaching AI to Think Less and Say More TL;DR — Researchers found that AI reasoning models ramble too much, and simply asking them to "be concise" then training them to do it naturally cuts their thinking by half while making them more accurate. What It Is When you
distilled
Teaching AI Agents to Search Like Experts (Without Needing Human Labels) TL;DR — Databricks trained an AI agent that's better at searching through company documents and answering complex questions than GPT-5 or Claude, using fake data generated by other AI agents plus reinforcement learning. What It Is
distilled
Teaching AI to Write Its Own Math Homework (And Make It Harder) TL;DR — Researchers built a system where AI coding agents take existing math problems and automatically generate harder versions that are still solvable, potentially solving the shortage of challenging problems needed to train advanced math AI. What It
distilled
AI Agents Need to Learn When to Say "No" TL;DR — When AI agents can use tools and take actions, teaching them to refuse unsafe requests is just as important as teaching them to complete tasks. A new training method cuts harmful behavior by 50% while keeping helpful