Model Sparsity · 11 Sep 2026
Sparse Mixture-of-Experts models overfit faster to repeated data, study warns
As human-written text supply exhausts, researchers find MoEs begin to degrade at half the repetition rate of dense models.
Topic
arXiv
Mentioned in 6 stories, most recently on Friday, 11 September 2026. Newest first.
Efficiency Science · 10 Sep 2026
Researchers propose Riemannian language modeling to eliminate output projection costs
A paper introducing RiLM shows that geodesic decoding bypasses massive matrix calculations to enable highly compact edge deployment.
Theoretical AI · 4 Sep 2026
A Non-Formulable Theorem proves fundamental limits of AI systems
The mathematical metatheorem proves that no finite syntactic system can autonomously produce every theorem it is capable of expressing.
Attention mechanisms · 3 Sep 2026
Declarative Attention protocol lets language models control their own context search
By allowing LLMs to restrict their attention to global, focused, or local regions, the framework reduces attended tokens during decoding by up to 52%.
Reinforcement learning · 2 Sep 2026
Researchers outline the rise of Verbal Reinforcement Learning to replace scalar rewards
A new unified framework formalizes how natural language feedback can act as task grounding, test-time deliberation, and parameter-tuning signals for AI agents.
Agent evaluation · 2 Sep 2026
CordisBench tests how language models reason about software lifecycles inside agents
The 1,200-question benchmark reveals that frontier models struggle to anticipate how plugin changes and component teardowns propagate through complex software environments.