LLM Reasoning Papers
Papers to improve reasoning capabilities of LLMs
Paper • 2408.07199 • Published • 22Note Summary: https://x.com/_philschmid/status/1828324252853862658
Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking
Paper • 2403.09629 • Published • 79Note Summary: https://x.com/_philschmid/status/1834864015928950984
Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning
Paper • 2406.12050 • Published • 19Note Summary: https://x.com/_philschmid/status/1835567839102591214
Let's Verify Step by Step
Paper • 2305.20050 • Published • 11Note Summary: https://x.com/_philschmid/status/1836296075084234908
V-STaR: Training Verifiers for Self-Taught Reasoners
Paper • 2402.06457 • Published • 9Note Summary: https://x.com/_philschmid/status/1835936839057740043
Training Language Models to Self-Correct via Reinforcement Learning
Paper • 2409.12917 • Published • 140Note Summary: https://x.com/_philschmid/status/1837121100196594084
Improve Mathematical Reasoning in Language Models by Automated Process Supervision
Paper • 2406.06592 • Published • 29Note Summary: https://x.com/_philschmid/status/1838865177116045533
Stream of Search (SoS): Learning to Search in Language
Paper • 2404.03683 • Published • 30Note Summary: https://x.com/_philschmid/status/1847565606964646077
Training Large Language Models to Reason in a Continuous Latent Space
Paper • 2412.06769 • Published • 94Note Summary: https://x.com/_philschmid/status/1871117240176894247
rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking
Paper • 2501.04519 • Published • 290Note Summary: https://x.com/_philschmid/status/1877269872473776616
-
Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters
Paper • 2408.03314 • Published • 63 -
Self-Reflection in LLM Agents: Effects on Problem-Solving Performance
Paper • 2405.06682 • Published • 3 -
Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers
Paper • 2408.06195 • Published • 73 -
Chain-of-Thought Reasoning Without Prompting
Paper • 2402.10200 • Published • 109 -
Think Before You Speak: Cultivating Communication Skills of Large Language Models via Inner Monologue
Paper • 2311.07445 • Published -
Self-Contrast: Better Reflection Through Inconsistent Solving Perspectives
Paper • 2401.02009 • Published • 1 -
LLaMA-Berry: Pairwise Optimization for O1-like Olympiad-Level Mathematical Reasoning
Paper • 2410.02884 • Published • 54 -
Towards System 2 Reasoning in LLMs: Learning How to Think With Meta Chain-of-Though
Paper • 2501.04682 • Published • 99 -
The Lessons of Developing Process Reward Models in Mathematical Reasoning
Paper • 2501.07301 • Published • 100 -
Search-o1: Agentic Search-Enhanced Large Reasoning Models
Paper • 2501.05366 • Published • 104