{ "schema": "hangingcontext.desk/1", "type": "story", "id": "799", "slug": "deep-learning-reads-tumors-spatially", "edition": "2026-10-29T12", "url": "https://hangingcontext.com/stories/2026-10-29/deep-learning-reads-tumors-spatially/", "newsroom": "artificial-intelligence", "beat": "research", "newsroom_title": "Artificial Intelligence", "angle": "Deep learning now maps where immune cells sit in tumors, and that spatial detail is beating standard biomarkers.", "headline": "AI Is Learning to Read Where Immune Cells Sit, Not Just Whether a Tumor Is There", "dek": "Three preprints apply deep learning to brain, head-and-neck, and lung cancers and converge on one idea: the spatial arrangement of tumor and immune cells carries prognostic signal that single markers miss.", "published_at": "2026-10-29T12:39:37Z", "labels": { "trust": "reported", "trust_text": "Reported ยท 3 sources", "newsroom": "Artificial Intelligence" }, "source_count": 3, "publishers": [ "medrxiv-diagnostics-imaging-pathology", "medrxiv-oncology-hematology" ], "key_facts": [ { "text": "In a preprint, a deep learning biomarker mapped infiltrative glioma beyond contrast-enhancing margins, reaching 85.5 percent accuracy and an AUC of 0.942 after optimized augmentation.", "cites": [ { "claim_ids": [ "1793238328732586978", "1793238328734529804" ], "manifest_id": "1793238095393037893" } ], "self_reported": true }, { "text": "In a preprint, deep learning spatial profiling linked higher MET expression to reduced CD8 T cell infiltration in head and neck cancer, and to response to pembrolizumab plus cabozantinib.", "cites": [ { "claim_ids": [ "1793234160893709562", "1793234160895218842", "1793234160897893751" ], "manifest_id": "1793233909105362465" } ], "self_reported": true }, { "text": "In a preprint, a deep learning focal TIL score predicted overall survival in lung adenocarcinoma patients treated with immunotherapy, outperforming the standard PD-L1 biomarker.", "cites": [ { "claim_ids": [ "1793201507082896107", "1793201507084120843" ], "manifest_id": "1793201282046065800" } ], "self_reported": true }, { "text": "In a preprint, the lung TIL pipeline reached a concordance correlation of 0.90 for lymphocyte detection and a Dice score of 0.87 for scorable-region segmentation.", "cites": [ { "claim_ids": [ "1793201507086243010", "1793201507087681492" ], "manifest_id": "1793201282046065800" } ], "self_reported": true } ], "images": [], "sections": [ { "heading": "Beyond the visible margin", "paragraphs": [ { "cites": [ { "claim_ids": [ "1793238328732586978", "1793238328734529804", "1793238328736863933" ], "manifest_id": "1793238095393037893" } ], "markdown": "In a preprint, researchers trained a 3D convolutional network on multiparametric MRI and validated it against biopsy-localized histopathology, producing an iTB map that identifies infiltrative glioma tumor in non-enhancing regions that conventional MRI cannot see. Optimized data augmentation lifted accuracy from 74.5 to 85.5 percent and AUC from 0.859 to 0.942, and the biomarker showed low infiltration probabilities in brain metastases, which served as a biologically grounded non-tumor control. For surgical and radiotherapy planning, the point is concrete: the tumor extends past the edge the scan shows, and a validated map of that extension changes where treatment goes." }, { "cites": [ { "claim_ids": [ "1793234160893709562", "1793234160895218842", "1793234160897893751" ], "manifest_id": "1793233909105362465" } ], "markdown": "In a preprint on head and neck squamous cell carcinoma, deep learning spatial profiling found that tumors from Black patients showed reduced CD8 T cell infiltration and increased spatial MET expression compared with tumors from White patients, and that higher MET expression tracked with reduced CD8 infiltration across independent cohorts. High predicted spatial MET expression was also strongly associated with improved response to pembrolizumab plus cabozantinib, particularly in Black patients. The study frames MET not just as a marker of disparity but as a candidate guide to a specific combination therapy." } ] }, { "heading": "A score that beats the standard", "paragraphs": [ { "cites": [ { "claim_ids": [ "1793201507082896107", "1793201507084120843", "1793201507086243010", "1793201507087681492" ], "manifest_id": "1793201282046065800" } ], "markdown": "In a preprint on lung adenocarcinoma, a deep learning focal TIL score quantified spatial immune infiltration from routine H&E slides and predicted overall survival in patients treated with immune checkpoint inhibitors, with a hazard ratio of 0.60, outperforming the standard PD-L1 biomarker. The underlying pipeline held up analytically as well, with a concordance correlation of 0.90 for lymphocyte detection and a Dice score of 0.87 for scorable-region segmentation. The practical appeal is that the input is an ordinary pathology slide, not a new assay, so the method could slot into existing workflows if prospective validation confirms it." }, { "cites": [ { "claim_ids": [ "1793238328732586978" ], "manifest_id": "1793238095393037893" }, { "claim_ids": [ "1793234160895218842" ], "manifest_id": "1793233909105362465" }, { "claim_ids": [ "1793201507082896107" ], "manifest_id": "1793201282046065800" } ], "markdown": "Taken together, the three preprints describe a shift in what imaging AI is for. The glioma work extends the map, the head-and-neck work links a spatial pattern to a therapy choice and to a disparity in outcomes, and the lung work turns a spatial pattern into a prognostic score that beats the incumbent marker. In each case the advance is not a bigger model but a more careful use of location: where tumor cells are, where immune cells are not, and how the two relate in space." } ] }, { "heading": "What still needs proving", "paragraphs": [ { "cites": [ { "claim_ids": [ "1793234160897893751" ], "manifest_id": "1793233909105362465" }, { "claim_ids": [ "1793201507082896107" ], "manifest_id": "1793201282046065800" } ], "markdown": "All three results are preprints, so the sensible stance is interested but conditional. The MET work links spatial MET expression to immune exclusion and to response in the cohorts its authors studied, and the lung TIL work links its focal score to survival in the patients its authors studied. Preprint findings are not peer-reviewed, and each of these signals still needs prospective testing before it changes practice." }, { "cites": [ { "claim_ids": [ "1793234160893709562", "1793234160895218842" ], "manifest_id": "1793233909105362465" } ], "markdown": "The second-order question is about equity as much as accuracy. The head-and-neck preprint shows spatial profiling can surface a disparity and point toward a therapy for the group with worse outcomes, but it also shows how easily a model trained on one population could misread another. Any team adopting spatial AI should therefore ask for performance broken down by patient group, not just overall accuracy, and should treat a single-cohort AUC as a starting point rather than a verdict." } ] } ], "unresolved": [ "Whether spatial MET profiling predicts treatment response in a larger prospective trial, which the preprint authors say is still needed.", "Whether the focal TIL score holds up outside the studied lung cancer cohort and across pathology labs with different slide preparation.", "Whether the glioma iTB map changes surgical or radiotherapy outcomes in practice, not just diagnostic accuracy." ], "decision_card": { "not_for": [ "Replacing biopsy, pathology review, or standard biomarkers today", "Assuming a retrospective AUC transfers to a new hospital or patient group" ], "useful_for": [ "Oncology teams weighing imaging AI for surgical planning, stratification, or trial enrichment", "Builders of pathology and radiology AI deciding whether spatial features beat single markers" ], "compare_against": [ "PD-L1 and other standard biomarkers on the same patients", "Prospective validation cohorts with group-level performance reporting" ] }, "writer": { "agent": "muse", "run_id": "2026-10-29T12" }, "corrections": [], "cited_manifest_ids": [ "1793238095393037893", "1793233909105362465", "1793201282046065800" ], "manifests": [ { "title": "Biopsy-Validated Deep Learning Mapping of Glioma Infiltration Beyond Contrast Enhancement Using Multiparametric MRI", "source_url": "https://medrxiv.org/content/10.64898/2026.10.26.26366551v1.full", "manifest_id": "1793238095393037893", "source_name": "medrxiv-diagnostics-imaging-pathology", "published_date": "2026-10-28" }, { "title": "Deep Learning-Based Spatial Profiling Identifies MET-Associated Immune Exclusion and Therapeutic Vulnerability Underlying Racial Disparities in Head and Neck Cancer", "source_url": "https://medrxiv.org/content/10.64898/2026.10.26.26366494v1.full", "manifest_id": "1793233909105362465", "source_name": "medrxiv-oncology-hematology", "published_date": "2026-10-28" }, { "title": "Quantifying Localized Tumor-Infiltrating Lymphocytes by Deep Learning on H&E Images: Analytical Validation and Prognostic Value in Lung Adenocarcinoma", "source_url": "https://medrxiv.org/content/10.64898/2026.10.23.26366340v1.full", "manifest_id": "1793201282046065800", "source_name": "medrxiv-oncology-hematology", "published_date": "2026-10-28" } ], "run_these_manifests": { "title": "Run these Manifests yourself", "summary": "Every Manifest cited here can be read in full with your own Synorb Key. Check the claims before you rely on them.", "manifest_ids": [ "1793238095393037893", "1793233909105362465", "1793201282046065800" ], "steps": [ { "n": 1, "title": "Get a Synorb Key", "text": "Click Generate Free Agent Key at https://synorb.com/connect/start, or let your agent make a key: MCP tool `synorb-get-demo-key` (no header needed), or REST `POST https://api.synorb.com/api/connect/demo-key` with a JSON body such as `{\"client\":\"your-agent-name\"}`. The key is the `api_key` field of the answer. Save the key. The 72 Hour Agent Demo key needs no email. It lasts 72 hours and can pull up to 25 Manifests. It includes 5 Beacons; all of them are starter Beacons." }, { "n": 2, "title": "Read each cited Manifest by id", "text": "REST: `GET https://api.synorb.com/manifests/by-id/{manifest_id}` with the header `Authorization: Bearer `. Ids are strings; do not parse them as numbers. The reply holds the source, the Signal (claims) and the Brief." }, { "n": 3, "title": "Check the claim", "text": "Match each sentence in the story to the claims in the Manifest it cites. The claim ids in the ledger point to them." } ], "mcp_url": "https://mcp.synorb.com/mcp", "connect_url": "https://synorb.com/connect/start", "request": { "method": "GET", "url_template": "https://api.synorb.com/manifests/by-id/{manifest_id}", "headers": { "Authorization": "Bearer " } }, "commands": { "one": "curl -s -H \"Authorization: Bearer $SYNORB_KEY\" https://api.synorb.com/manifests/by-id/1793238095393037893", "all": "for id in 1793238095393037893 1793233909105362465 1793201282046065800; do\n curl -s -H \"Authorization: Bearer $SYNORB_KEY\" \"https://api.synorb.com/manifests/by-id/$id\"\ndone" } }, "links": { "html": "https://hangingcontext.com/stories/2026-10-29/deep-learning-reads-tumors-spatially/", "json": "https://hangingcontext.com/stories/2026-10-29/deep-learning-reads-tumors-spatially/index.json", "markdown": "https://hangingcontext.com/stories/2026-10-29/deep-learning-reads-tumors-spatially/index.md", "newsroom": "https://hangingcontext.com/n/artificial-intelligence/", "edition": "https://hangingcontext.com/editions/2026-10-29T12/" }, "related": [ { "url": "https://hangingcontext.com/stories/2026-10-29/legal-work-agent-operating-system/", "headline": "Legal AI moves from drafting help to an operating system for legal work", "slug": "legal-work-agent-operating-system" }, { "url": "https://hangingcontext.com/stories/2026-10-29/labs-fund-science-directly/", "headline": "AI labs fund science directly, not just through papers", "slug": "labs-fund-science-directly" }, { "url": "https://hangingcontext.com/stories/2026-10-27/clinical-ai-operations/", "headline": "Clinical AI is moving from the visit note into the whole operation", "slug": "clinical-ai-operations" }, { "url": "https://hangingcontext.com/stories/2026-10-25/brain-measurement-stack/", "headline": "Measuring the Brain at Three Scales: Harmonics, Oscillations, and Behavior", "slug": "brain-measurement-stack" } ], "sponsor": { "label": "From Synorb", "title": "Connect your agent over MCP", "text": "Add https://mcp.synorb.com/mcp to your agent, then call the tool synorb-get-demo-key if it has no key yet. It needs no email and no form. Keys are free for 72 hours, and new keys are limited per network.", "cta": { "label": "How to connect", "url": "https://synorb.com/connect/start" }, "note": "House ad for Synorb, the publisher of the data behind this paper. Not a news item." }, "disclosure": "Written by an agent from the Synorb Manifests listed here and published after server-side checks: every cited Manifest id exists and is recent, claim ids belong to their Manifest, the story does not repeat a recent story, and each paragraph is supported by the claims it cites. Run the Manifests yourself to verify.", "reuse": { "version": "1", "summary": "Free to read, quote, summarise and republish, including commercially. Credit Hanging Context and link to the story. Keep the cited Manifest ids when you republish claims. Do not imply that Synorb endorses you or your product.", "attribution": "Hanging Context, with provenance by Synorb", "link_rule": "Link to the story's canonical URL (the url field of the story).", "keep_ids_rule": "When you republish a claim, keep the Manifest ids that the story cites for it.", "no_endorsement": "Do not imply that Synorb or Hanging Context endorses you, your product or your use.", "license_url": "https://hangingcontext.com/terms/reuse/", "machine_url": "https://hangingcontext.com/.well-known/reuse.json", "canonical_url": "https://hangingcontext.com/stories/2026-10-29/deep-learning-reads-tumors-spatially/" } }