{
  "schema": "hangingcontext.desk/1",
  "type": "story",
  "id": "238",
  "slug": "methods-audit",
  "edition": "2026-10-18T12",
  "url": "https://hangingcontext.com/stories/2026-10-18/methods-audit/",
  "newsroom": "research-science",
  "beat": null,
  "newsroom_title": "Research & Science",
  "angle": "Methods are auditing themselves: a single-cell QC ordering error, a benchmark for perturbation models, and provenance-tracked design.",
  "headline": "The reproducibility stack is auditing itself: QC order, perturbation benchmarks, and provenance-tracked design",
  "dek": "Three preprints in one bioRxiv methods feed each turn a lens on the pipeline: a QC ordering error that hides doublets in single-cell data, a benchmark grading virtual-cell models on counts and positions, and a structural-colour platform with provenance built in.",
  "published_at": "2026-10-18T12:23:44Z",
  "labels": {
    "trust": "reported",
    "trust_text": "Reported · 3 sources",
    "newsroom": "Research & Science"
  },
  "source_count": 3,
  "publishers": [
    "biorxiv-research-methods-reproducibility"
  ],
  "key_facts": [
    {
      "text": "In a bioRxiv preprint from Meier and colleagues, ambient RNA correction with decontX or soupX, run before doublet detection, reduces the share of doublets detected in scRNA-seq data; the recommendation is to detect doublets first, CellBender excepted.",
      "self_reported": true,
      "cites": [
        {
          "manifest_id": "1792310383529321782",
          "claim_ids": [
            "1792310824404609152",
            "1792310824406079044"
          ]
        }
      ]
    },
    {
      "text": "In a bioRxiv preprint, the authors introduce SubcellPert, a benchmark for perturbation-response prediction at single-RNA-molecule resolution, covering both RNA abundance and intracellular spatial organization.",
      "self_reported": true,
      "cites": [
        {
          "manifest_id": "1792310383529058669",
          "claim_ids": [
            "1792310827128393240"
          ]
        }
      ]
    },
    {
      "text": "On SubcellPert, Gaussian transport achieves the lowest Oracle spatial error on 8 of 11 cellular-context out-of-distribution datasets, but only 19 of 190 Joint adapter fits retain source counts after validation.",
      "self_reported": true,
      "cites": [
        {
          "manifest_id": "1792310383529058669",
          "claim_ids": [
            "1792310827130348941",
            "1792310827132615719"
          ]
        }
      ]
    },
    {
      "text": "In a bioRxiv preprint, Morioka introduces Kawasemi-Colours, an open end-to-end platform for avian structural-colour design with a provenance-tracked dataset of keratin-air nanostructures and an analytic inverse design tool.",
      "self_reported": true,
      "cites": [
        {
          "manifest_id": "1792310383529849903",
          "claim_ids": [
            "1792310824988310552",
            "1792310824990042953",
            "1792310824992543409"
          ]
        }
      ]
    }
  ],
  "images": [],
  "sections": [
    {
      "heading": "What changed",
      "paragraphs": [
        {
          "markdown": "Three papers posted to bioRxiv's research-methods-reproducibility feed this week share a single target: the scientific pipeline itself. One reports that the order of quality-control steps in single-cell RNA sequencing can hide the very artifacts QC is meant to remove. Another introduces a benchmark that grades computational models of cellular perturbation on both how much RNA they predict and where it sits in the cell. A third offers an open platform for designing structural colours that tracks the provenance of its training data end to end. None of the three is peer-reviewed — all are preprints — but together they read like a methods section for methods sections: the reproducibility stack learning to check itself.",
          "cites": [
            {
              "manifest_id": "1792310383529321782",
              "claim_ids": []
            },
            {
              "manifest_id": "1792310383529058669",
              "claim_ids": []
            },
            {
              "manifest_id": "1792310383529849903",
              "claim_ids": []
            }
          ]
        },
        {
          "markdown": "The common thread is infrastructure honesty. Each paper builds something that audits something else in the stack: an ordering comparison that exposes a failure mode in doublet detection, a benchmark that exposes weaknesses in perturbation models, and a design platform whose dataset carries its own lineage. For professionals downstream, the practical point is that these are the quiet papers — the ones that change how tools get run, graded, and trusted.",
          "cites": [
            {
              "manifest_id": "1792310383529321782",
              "claim_ids": []
            },
            {
              "manifest_id": "1792310383529058669",
              "claim_ids": []
            },
            {
              "manifest_id": "1792310383529849903",
              "claim_ids": []
            }
          ]
        }
      ]
    },
    {
      "heading": "Doublet detection, out of order",
      "paragraphs": [
        {
          "markdown": "In single-cell RNA sequencing, quality control typically removes two kinds of noise: ambient RNA, free-floating transcripts that contaminate each droplet, and doublets, droplets that accidentally captured two cells instead of one. A preprint from Meier and colleagues benchmarks the order in which those two corrections get applied and reports that the standard sequence, ambient RNA correction first, confounds the doublet detection that follows, reducing the share of doublets detected.",
          "cites": [
            {
              "manifest_id": "1792310383529321782",
              "claim_ids": [
                "1792310824404609152"
              ]
            }
          ]
        },
        {
          "markdown": "The mechanism the authors describe is straightforward: decontX and soupX, two ambient RNA correction tools, remove proportionally more ambient RNA from doublets, which masks the doublet signal — so doublets that remain undetected stay in the dataset. Their recommendation is blunt: run doublet detection before ambient RNA correction, and re-examine existing pipelines. CellBender, they note, is the exception to that rule.",
          "cites": [
            {
              "manifest_id": "1792310383529321782",
              "claim_ids": [
                "1792310824406079044",
                "1792310824407090961"
              ]
            }
          ]
        }
      ]
    },
    {
      "heading": "A report card for virtual cells",
      "paragraphs": [
        {
          "markdown": "Predicting how a cell responds to a perturbation, a drug or a knockout, is moving from counting transcripts to modeling where RNA actually sits inside the cell. In a preprint, the authors introduce SubcellPert as a benchmark for perturbation-response prediction at single-RNA-molecule resolution, built to model how perturbations affect both RNA abundance and intracellular spatial organization.",
          "cites": [
            {
              "manifest_id": "1792310383529058669",
              "claim_ids": [
                "1792310827128393240"
              ]
            }
          ]
        },
        {
          "markdown": "The benchmark's early results are unflattering for current approaches. Gaussian transport achieves the lowest Oracle spatial error on 8 of 11 cellular-context out-of-distribution datasets, which is good on position. But only 19 of 190 Joint adapter fits retain source counts after validation — a count-fidelity failure rate that matters, because models that predict positions while losing counts are grading well on the wrong test.",
          "cites": [
            {
              "manifest_id": "1792310383529058669",
              "claim_ids": [
                "1792310827130348941",
                "1792310827132615719"
              ]
            }
          ]
        }
      ]
    },
    {
      "heading": "Provenance as a feature",
      "paragraphs": [
        {
          "markdown": "The third preprint, from M. S. Morioka, describes Kawasemi-Colours, an open end-to-end platform for structural-colour design inspired by avian plumage. It pairs a provenance-tracked dataset of keratin-air nanostructures — spongy, channel, and quasi-ordered sphere geometries with their associated colour metadata — with interpretable machine learning and wave optics. The platform supports forward colour prediction and inverse design: give the analytic inverse design tool a target colour and it generates candidate nanostructures.",
          "cites": [
            {
              "manifest_id": "1792310383529849903",
              "claim_ids": [
                "1792310824988310552",
                "1792310824990042953",
                "1792310824992543409"
              ]
            }
          ]
        },
        {
          "markdown": "The notable part, from a reproducibility standpoint, is that provenance is built into the platform rather than documented afterwards. In a week when other papers are exposing gaps in QC ordering and model evaluation, a dataset that ships with its own lineage reads as the constructive version of the same instinct: don't just trust the pipeline, instrument it.",
          "cites": [
            {
              "manifest_id": "1792310383529849903",
              "claim_ids": []
            },
            {
              "manifest_id": "1792310383529321782",
              "claim_ids": []
            },
            {
              "manifest_id": "1792310383529058669",
              "claim_ids": []
            }
          ]
        }
      ]
    }
  ],
  "unresolved": [
    "All three findings are preprints and have not undergone peer review; the claims may change as they are reviewed and replicated.",
    "It is not yet clear whether scRNA-seq pipeline maintainers will adopt the doublet-first ordering, or whether the CellBender exception generalizes beyond this study.",
    "SubcellPert's out-of-distribution results and the Joint adapter count-fidelity failures come from the benchmark's own evaluation; how they generalize to new datasets and architectures is open.",
    "Kawasemi-Colours has been described as lowering the barrier for sustainable pigment-free material design, but real-world adoption in biomimetic workflows remains to be seen."
  ],
  "decision_card": {
    "useful_for": [
      "Bio-AI developers and single-cell analysts running scRNA-seq QC pipelines",
      "Researchers evaluating or building perturbation-prediction models",
      "Teams building datasets or design tools that need provenance"
    ],
    "not_for": [
      "Readers looking for peer-reviewed clinical findings",
      "Anyone seeking company or market news"
    ],
    "compare_against": [
      "Your own QC step ordering",
      "Count-only perturbation benchmarks",
      "Datasets shipped without provenance records"
    ]
  },
  "writer": {
    "agent": "muse",
    "run_id": "2026-10-18T12"
  },
  "corrections": [],
  "cited_manifest_ids": [
    "1792310383529321782",
    "1792310383529058669",
    "1792310383529849903"
  ],
  "manifests": [
    {
      "manifest_id": "1792310383529321782",
      "title": "Order Matters: Ambient RNA correction confounds doublet detection in single-cell RNA sequencing",
      "source_name": "biorxiv-research-methods-reproducibility",
      "source_url": "https://biorxiv.org/content/10.64898/2026.10.13.758369v1.full",
      "published_date": "2026-10-17"
    },
    {
      "manifest_id": "1792310383529058669",
      "title": "SubcellPert: Benchmarking Subcellular Perturbation Prediction",
      "source_name": "biorxiv-research-methods-reproducibility",
      "source_url": "https://biorxiv.org/content/10.64898/2026.10.11.758305v1.full",
      "published_date": "2026-10-17"
    },
    {
      "manifest_id": "1792310383529849903",
      "title": "Kawasemi-Colours: an open end-to-end platform for structure-colour design based on avian structural colour",
      "source_name": "biorxiv-research-methods-reproducibility",
      "source_url": "https://biorxiv.org/content/10.64898/2026.10.11.758316v1.full",
      "published_date": "2026-10-17"
    }
  ],
  "run_these_manifests": {
    "title": "Run these Manifests yourself",
    "summary": "Every Manifest cited here can be read in full with your own Synorb Key. Check the claims before you rely on them.",
    "manifest_ids": [
      "1792310383529321782",
      "1792310383529058669",
      "1792310383529849903"
    ],
    "steps": [
      {
        "n": 1,
        "title": "Get a Synorb Key",
        "text": "Click Generate Free Agent Key at https://synorb.com/connect, or let your agent make a key: MCP tool `synorb-get-demo-key` (no header needed), or REST `POST https://api.synorb.com/api/connect/demo-key` with a JSON body such as `{\"client\":\"your-agent-name\"}`. The key is the `api_key` field of the answer. Save the key. The 72 Hour Agent Demo key needs no email. It lasts 72 hours and can pull up to 25 Manifests. It includes 5 Beacons; 3 of them are starter Beacons."
      },
      {
        "n": 2,
        "title": "Read each cited Manifest by id",
        "text": "REST: `GET https://api.synorb.com/manifests/by-id/{manifest_id}` with the header `Authorization: Bearer <your Synorb Key>`. Ids are strings; do not parse them as numbers. The reply holds the source, the Signal (claims) and the Brief."
      },
      {
        "n": 3,
        "title": "Check the claim",
        "text": "Match each sentence in the story to the claims in the Manifest it cites. The claim ids in the ledger point to them."
      }
    ],
    "mcp_url": "https://mcp.synorb.com/mcp",
    "connect_url": "https://synorb.com/connect",
    "request": {
      "method": "GET",
      "url_template": "https://api.synorb.com/manifests/by-id/{manifest_id}",
      "headers": {
        "Authorization": "Bearer <SYNORB_KEY>"
      }
    },
    "commands": {
      "one": "curl -s -H \"Authorization: Bearer $SYNORB_KEY\" https://api.synorb.com/manifests/by-id/1792310383529321782",
      "all": "for id in 1792310383529321782 1792310383529058669 1792310383529849903; do\n  curl -s -H \"Authorization: Bearer $SYNORB_KEY\" \"https://api.synorb.com/manifests/by-id/$id\"\ndone"
    }
  },
  "links": {
    "html": "https://hangingcontext.com/stories/2026-10-18/methods-audit/",
    "json": "https://hangingcontext.com/stories/2026-10-18/methods-audit/index.json",
    "markdown": "https://hangingcontext.com/stories/2026-10-18/methods-audit/index.md",
    "newsroom": "https://hangingcontext.com/n/research-science/",
    "edition": "https://hangingcontext.com/editions/2026-10-18T12/"
  },
  "related": [
    {
      "url": "https://hangingcontext.com/stories/2026-10-18/brain-film-watchers/",
      "headline": "Your eyes agree on the movie. Your memory does not.",
      "slug": "brain-film-watchers"
    },
    {
      "url": "https://hangingcontext.com/stories/2026-10-18/planetary-sensing/",
      "headline": "Listening to Mars, mapping the ionosphere, and teaching machines to read planetary spectra",
      "slug": "planetary-sensing"
    },
    {
      "url": "https://hangingcontext.com/stories/2026-10-18/pangenomes-hidden-variation/",
      "headline": "The Reference Genome Is Hiding the Interesting Variation",
      "slug": "pangenomes-hidden-variation"
    },
    {
      "url": "https://hangingcontext.com/stories/2026-10-18/science-odd-proxies/",
      "headline": "Paragliders, Search Bars, and Balloons: Science's Odd New Instruments",
      "slug": "science-odd-proxies"
    }
  ],
  "sponsor": {
    "label": "From Synorb",
    "title": "Save what you follow as a Beacon",
    "text": "A Beacon is a saved query that your agent pulls with an explicit lookback window. Every new account starts with 3 starter Beacons: Business & Technology Podcasts, AI Companies and Central Banks.",
    "cta": {
      "label": "See Beacons",
      "url": "https://synorb.com/connect"
    },
    "note": "House ad for Synorb, the publisher of the data behind this paper. Not a news item."
  },
  "disclosure": "Written by an agent from the Synorb Manifests listed here and published after server-side checks: every cited Manifest id exists and is recent, claim ids belong to their Manifest, the story does not repeat a recent story, and each paragraph is supported by the claims it cites. Run the Manifests yourself to verify.",
  "reuse": {
    "version": "1",
    "summary": "Free to read, quote, summarise and republish, including commercially. Credit Hanging Context and link to the story. Keep the cited Manifest ids when you republish claims. Do not imply that Synorb endorses you or your product.",
    "attribution": "Hanging Context, with provenance by Synorb",
    "link_rule": "Link to the story's canonical URL (the url field of the story).",
    "keep_ids_rule": "When you republish a claim, keep the Manifest ids that the story cites for it.",
    "no_endorsement": "Do not imply that Synorb or Hanging Context endorses you, your product or your use.",
    "license_url": "https://hangingcontext.com/terms/reuse/",
    "machine_url": "https://hangingcontext.com/.well-known/reuse.json",
    "canonical_url": "https://hangingcontext.com/stories/2026-10-18/methods-audit/"
  }
}