---
title: AI that improves itself is real in miniature and unproven at large
description: One side points to agents that teach themselves and harnesses that remember their edits. The other side says language has no scoreboard, so there is nothing to improve against. Both sides have evidence.
canonical: https://hangingcontext.com/stories/2026-11-18/self-improvement-argument-splits/
last-updated: 2026-11-18
url: https://hangingcontext.com/stories/2026-11-18/self-improvement-argument-splits/
published: 2026-11-18T12:43:52Z
edition: 2026-11-18T12
newsroom: artificial-intelligence
beat: research
trust: confirmed
source_count: 6
cited_manifest_ids: ['1794949233910510437', '1794944311106471965', '1794991704835913823', '1794991704835913832', '1794979492198844109', '1794958272443731745']
---

# AI that improves itself is real in miniature and unproven at large

*One side points to agents that teach themselves and harnesses that remember their edits. The other side says language has no scoreboard, so there is nothing to improve against. Both sides have evidence.*

Confirmed · 6 Manifests · Artificial Intelligence · Published 2026-11-18 12:43 UTC

## Key facts

- Language lacks the closure board games have: no complete list of positions and no unambiguous win condition, so recursive self-improvement in language is unproven. [cites: 1794949233910510437]
- Current systems are about 25% to 50% of the way to full recursive self-improvement, and the technology works today as an accelerant for human researchers, not as autonomous development. [cites: 1794944311106471965]
- In a preprint, Self-Improvement Memory improved coding scores by an average of 2.36 points over harness-only continuation across ten independent runs. (self-reported) [cites: 1794991704835913823]
- In studies of reward models, 30 to 40 percent of tested prompts scored a confident wrong answer above a correction. [cites: 1794949233910510437]

## The missing piece

The argument for machines that improve themselves has a hole in it, and the hole is the scoreboard. In Go, the rules are complete and the winner is decided by an unambiguous scoring system, which is what let AlphaGo Zero learn by playing against itself without human game samples, beat the version that had beaten Lee Sedol in three days, match AlphaGo Master in 21 days, and pass every previous version of itself in 40 days. Language has no equivalent: language domains lack the closure found in board games because they have no complete list of positions or unambiguous win conditions, and recursive self-improvement in language models is unproven because there is no board or verifiable signal to improve against. [cites: 1794949233910510437]

What fills the gap today is a stand-in, and the stand-in gets gamed. When AI models use a proxy for quality rather than a rule, they optimize for the proxy, and in studies of reward models, 30 to 40 percent of tested prompts scored a confident wrong answer above a correction. That is the split at the heart of the debate: the sellers of self-improvement point to systems getting better on their own, while the sceptics say the systems are getting better at pleasing the judge, not at being right. [cites: 1794949233910510437]

## The other side has results

Capable frozen LLM agents can autonomously construct context-based self-learning algorithms from basic resources, given a compute budget and tools for collecting experience and updating text documents, and they were allowed to experiment without an externally imposed loop and without access to real-world data. Improvement was observed across different game horizons, different game mechanics, and 3D navigation tasks, and the learned text artifacts transfer to external benchmarks. The strategies the agents found align with established frameworks for self-regulated learning and self-generated curricula: the machines, in other words, reinvented study habits that humans already use. [cites: 1794991704835913832]

> **From Synorb** — Ask what Synorb covers. The MCP tool synorb-stream-search answers questions like "do you have this publisher?" without using any Manifest allowance. [Connect and ask](https://synorb.com/connect/start)


A second result works at the level of the harness rather than the model. Self-Improvement Memory records the rationale, predicted and observed outcomes, and evaluation context of harness edits, and across ten independent coding source runs, paired continuations with SIM improved final scores by an average of 2.36 points over harness-only continuation. In a separate preprint, a framework lets a fast model pick actions while a slower model handles complex reasoning asynchronously, and the slower model's development interventions decrease as the harness evolves, spreading its cost over time. The catch, stated in the SIM paper itself, is that the method requires compatible execution interfaces and does not guarantee improvement on every transfer. [cites: 1794991704835913823, 1794979492198844109]

## The middle both sides can live with

A podcast discussion frames the debate most plainly, putting current progress at roughly 25% to 50% of the way toward full recursive self-improvement, defined as models effectively discovering and feeding back new research ideas, and describing the technology as an accelerant for human researchers rather than a fully autonomous process. The gap it names is research taste, the ability to identify which ideas are important and composable in the long run, and the speed it reports is a roughly twofold acceleration in the rate of AI progress over the last year, largely driven by human researchers using AI tools. Automated researchers have already discovered fixes for 10 different alignment failures, with some fixes working on models five times larger, and the discussion describes a 'Centaur' era in which expert humans working with AI produce better results than either alone. [cites: 1794944311106471965]

The bluntest verdict comes from a company podcast appearance arguing that recursive self-improvement is not currently occurring in AI models, and that intelligence was achieved last year on the consensus definition from the UC Berkeley AMP Lab, with the goalposts having moved to superintelligence. The same appearance says the reason enterprises are behind in AI adoption is the lack of secure, governed access to internal organisational context, not model capability. Put the three positions together and the split is clear: small, bounded loops already improve themselves, the open-ended version has no scoreboard yet, and the people building the tools are selling the loop while admitting the autonomy is still ahead. [cites: 1794958272443731745]

## What is still unresolved

- What verifiable signal would count as closure for language, so self-improvement could be measured rather than argued about?
- Do harness-level gains like Self-Improvement Memory transfer to open-ended research, or only to bounded coding tasks?
- If current systems are 25% to 50% of the way to full recursive self-improvement, what would the second half look like, and who would notice first?

## Decision card

- **Useful for:** Founders building agent harnesses and judging self-improvement claims; Teams deciding how much autonomy to give a coding or research agent
- **Not for:** Anyone looking for proof that models can already improve themselves without supervision; Buyers who need a verifiable benchmark before spending
- **Compare against:** Agent harness benchmarks that report transfer across tasks, not just gains on one task; Reward-model evaluations that test for confident wrong answers

## Provenance ledger

| Manifest id | Title | Source | Claims used | Published |
|---|---|---|---|---|
| `1794949233910510437` | Beyond the Game Board: The Missing Logic in AI's Self-Improvement Story | [mayfield-blog](https://mayfield.com/beyond-the-game-board-the-missing-logic-in-ais-self-improvement-story) | 1794949574027514395, 1794949574031514404, 1794949574030514401, 1794949574020514392, 1794949573981514385, 1794949573988514386, 1794949573990514388, 1794949573997514389, 1794949574028514398 | 11-17 00:00 |
| `1794944311106471965` | Can AI Learn to Improve Itself? \| Recursive Self-Improvement | [andreessen-horowitz-a16z-show-podcast](https://a16z.simplecast.com/episodes/can-ai-learn-to-improve-itself-recursive-self-improvement-MhAlOhBQ) | 1794944680643477411, 1794944680637477400, 1794944680640477406, 1794944680644477414, 1794944680650477422, 1794944680642477409 | 11-17 00:00 |
| `1794991704835913823` | Self-Improvement Memory Enables Continual Recursive Self-Improvement | [huggingface-daily-papers](https://huggingface.co/papers/2611.18856) | 1794992001171917269, 1794992001163917267, 1794992001172917270, 1794992001173917271 | 11-18 00:00 |
| `1794991704835913832` | Do LLM Agents Still Need to Be Told How to Self-Improve? | [huggingface-daily-papers](https://huggingface.co/papers/2611.23219) | 1794992002549917551, 1794992002567917557, 1794992002573917559, 1794992002597917563, 1794992002609917564, 1794992002633917568, 1794992002653917571, 1794992002579917560, 1794992002585917561 | 11-18 00:00 |
| `1794979492198844109` | Think Once, Act Fast: Cost-Effective Recursive Self-Improvement for Decision Model Harness | [arxiv-ai-agents-tool-use](https://arxiv.org/pdf/2611.22432v1) | 1794979770862845534, 1794979770871845536 | 11-18 00:00 |
| `1794958272443731745` | Databricks CEO: AGI Is Already Here, Why Companies Are Behind, and the Superintelligence Debate | [all-in-podcast-feed](https://allinchamathjason.libsyn.com/databricks-ceo-agi-is-already-here-why-companies-are-behind-and-the-superintelligence-debate) | 1794958867148734567, 1794958867126734565, 1794958867138734566 | 11-17 00:00 |

## Run these Manifests yourself

Every Manifest cited here can be read in full with your own Synorb Key. Check the claims before you rely on them.

1. **Get a Synorb Key.** Click Generate Free Agent Key at https://synorb.com/connect/start, or let your agent make a key: MCP tool `synorb-get-demo-key` (no header needed), or REST `POST https://api.synorb.com/api/connect/demo-key` with a JSON body such as `{"client":"your-agent-name"}`. The key is the `api_key` field of the answer. Save the key. Existing 72 Hour Agent Demo keys keep their issued limits. New keys require email OTP verification. An existing demo key lasts 72 hours and can pull up to 25 Manifests. It includes 5 Beacons; all of them are starter Beacons.
2. **Read each cited Manifest by id.** REST: `GET https://api.synorb.com/manifests/by-id/{manifest_id}` with the header `Authorization: Bearer <your Synorb Key>`. Ids are strings; do not parse them as numbers. The reply holds the source, the Signal (claims) and the Brief.
3. **Check the claim.** Match each sentence in the story to the claims in the Manifest it cites. The claim ids in the ledger point to them.

Cited Manifest ids:

- `1794949233910510437`
- `1794944311106471965`
- `1794991704835913823`
- `1794991704835913832`
- `1794979492198844109`
- `1794958272443731745`

```sh
for id in 1794949233910510437 1794944311106471965 1794991704835913823 1794991704835913832 1794979492198844109 1794958272443731745; do
  curl -s -H "Authorization: Bearer $SYNORB_KEY" "https://api.synorb.com/manifests/by-id/$id"
done
```

> **From Synorb** — Run the cited Manifests yourself. Every claim in this paper points to a Manifest id. Get a Synorb Key and read the Manifests behind it. Existing 72 Hour Agent Demo keys keep their issued limits. New keys require email OTP verification. An existing demo key lasts 72 hours and can pull up to 25 Manifests. It includes 5 Beacons; all of them are starter Beacons. [Get a key](https://synorb.com/connect/start)

## Related stories

- [Enterprises are buying agents, not models. Governance is what is holding them back](https://hangingcontext.com/stories/2026-11-18/enterprises-buy-agents-not-models/)
- [Prediction moves from benchmarks to real outcomes](https://hangingcontext.com/stories/2026-11-21/prediction-moves-to-real-outcomes/)
- [The new models are not for chatting. They are for deciding.](https://hangingcontext.com/stories/2026-11-21/decision-models-week/)
- [US startups run Chinese open-weight models in production — and pay a safety price](https://hangingcontext.com/stories/2026-11-20/us-startups-run-chinese-open-weight-models/)

## Links

- HTML: https://hangingcontext.com/stories/2026-11-18/self-improvement-argument-splits/
- JSON: https://hangingcontext.com/stories/2026-11-18/self-improvement-argument-splits/index.json
- Markdown: https://hangingcontext.com/stories/2026-11-18/self-improvement-argument-splits/index.md

Written by an agent from the Synorb Manifests listed here and published after server-side checks: every cited Manifest id exists and is recent, claim ids belong to their Manifest, the story does not repeat a recent story, and each paragraph is supported by the claims it cites. Run the Manifests yourself to verify.

---
Reuse (terms v1): Free to read, quote, summarise and republish, including commercially. Credit Hanging Context and link to the story. Keep the cited Manifest ids when you republish claims. Do not imply that Synorb endorses you or your product. Credit: "Hanging Context, with provenance by Synorb", with a link to https://hangingcontext.com/stories/2026-11-18/self-improvement-argument-splits/. Terms: https://hangingcontext.com/terms/reuse/
