{
  "schema": "hangingcontext.desk/1",
  "type": "story",
  "id": "1483",
  "slug": "measuring-ai-return-nebuly",
  "edition": "2026-11-12T12",
  "url": "https://hangingcontext.com/stories/2026-11-12/measuring-ai-return-nebuly/",
  "newsroom": "artificial-intelligence",
  "beat": "funding-deals",
  "newsroom_title": "Artificial Intelligence",
  "angle": "A $21M Series A for measuring AI ROI lands as enterprises stop asking what AI can do and start asking what it returned.",
  "headline": "Nebuly Raises $21M to Answer AI's Hardest Question: What Did It Return?",
  "dek": "Enterprises are spending faster than they can measure. Nebuly's Series A, Broadcom's baseline discipline, and Toloka's small-model proof point to a new buying question.",
  "published_at": "2026-11-12T12:46:00Z",
  "labels": {
    "trust": "confirmed",
    "trust_text": "Confirmed · 3 Manifests",
    "newsroom": "Artificial Intelligence"
  },
  "source_count": 3,
  "publishers": [
    "broadcom-blog",
    "nebuly-blog",
    "toloka-blog"
  ],
  "sources": [
    "broadcom-blog",
    "nebuly-blog",
    "toloka-blog"
  ],
  "distinct_source_count": 3,
  "key_facts": [
    {
      "text": "Nebuly raised $21 million in Series A funding, led by Planven.",
      "cites": [
        {
          "claim_ids": [
            "1794471050159636094",
            "1794471050161636095"
          ],
          "manifest_id": "1794470686135635134"
        }
      ],
      "self_reported": true
    },
    {
      "text": "A Gartner survey finds 85% of functional leaders plan to increase AI spending this year, while only 22% of organizations have scaled AI across multiple business units.",
      "cites": [
        {
          "claim_ids": [
            "1794471050169636100",
            "1794471050170636101"
          ],
          "manifest_id": "1794470686135635134"
        }
      ],
      "self_reported": false
    },
    {
      "text": "Forrester's 2026 Total Economic Impact study of VMware Cloud Foundation 9 projected a three-year ROI of 31% to 137% for a composite organization, with a medium-impact scenario of 73%.",
      "cites": [
        {
          "claim_ids": [
            "1794453152791571825",
            "1794453152794571826"
          ],
          "manifest_id": "1794452898295570383"
        }
      ],
      "self_reported": false
    },
    {
      "text": "Toloka's post-trained 4B model achieved 93.8% accuracy on unseen synthetic conversations for bank support.",
      "cites": [
        {
          "claim_ids": [
            "1794414579982365874"
          ],
          "manifest_id": "1794414223355365282"
        }
      ],
      "self_reported": true
    },
    {
      "text": "Toloka's post-trained 4B model cost one fifty-eighth of the serving cost of Gemini 3.8 Flash.",
      "cites": [
        {
          "claim_ids": [
            "1794414579987365877"
          ],
          "manifest_id": "1794414223355365282"
        }
      ],
      "self_reported": true
    }
  ],
  "images": [],
  "sections": [
    {
      "heading": "A $21 million bet on the receipt",
      "paragraphs": [
        {
          "cites": [
            {
              "claim_ids": [
                "1794471050159636094",
                "1794471050161636095",
                "1794471050163636096",
                "1794471050164636097",
                "1794471050175636104",
                "1794471050178636106",
                "1794471050166636098",
                "1794471050167636099"
              ],
              "manifest_id": "1794470686135635134"
            }
          ],
          "markdown": "Nebuly says it has raised $21 million in Series A funding to help enterprises measure the return on their AI initiatives. The round was led by Planven, the company says, with participation from Exor Ventures, Tenacity Capital, TGVG Capital, and Fastweb+Vodafone, and support from CDP Venture Capital SGR through its Artificial Intelligence Fund and Digital Transition Fund. Nebuly says it measures the return enterprises get from their AI agents, and that its platform connects to agents including Claude, ChatGPT, and Microsoft Copilot. The company says it has secured multiple six-figure contracts with large enterprises in telecommunications, automotive, industrial manufacturing, luxury, healthcare, and technology, and names Oura, Iveco Group, Fastweb+Vodafone, CNH, and Zeiss as customers."
        },
        {
          "cites": [
            {
              "claim_ids": [
                "1794471050169636100",
                "1794471050170636101",
                "1794471050172636102",
                "1794471050173636103"
              ],
              "manifest_id": "1794470686135635134"
            }
          ],
          "markdown": "The funding lands as spending outruns measurement. Nebuly cites a Gartner survey finding that 85 percent of functional leaders plan to increase their AI spending this year, while only 22 percent of organizations have successfully scaled AI across multiple business units. The company also says Uber hit its annual AI budget four months into 2026, and that an Amazon project ran 860 percent over budget due to unfinished agent tasks. Those are Nebuly's examples, not independently verified figures, but they describe the gap Nebuly is selling into: money going out faster than anyone can say what it returned."
        }
      ]
    },
    {
      "heading": "Return needs a baseline, not a benchmark",
      "paragraphs": [
        {
          "cites": [
            {
              "claim_ids": [
                "1794453152791571825",
                "1794453152794571826",
                "1794453152795571827",
                "1794453152796571828",
                "1794453152798571829",
                "1794453152800571831",
                "1794453152801571832"
              ],
              "manifest_id": "1794452898295570383"
            }
          ],
          "markdown": "Broadcom makes a parallel point from infrastructure. In a post on VCF migration outcomes, Broadcom's Justin Kaplan argues that completing a migration does not by itself prove value, and that leaders should validate performance against pre-migration baselines. The post cites Forrester's 2026 Total Economic Impact study of VMware Cloud Foundation 9, which projected a three-year ROI of 31 percent to 137 percent for a composite organization, with a medium-impact scenario of 73 percent. Kaplan's framework, which he calls VCF Migration Assurance, connects evidence across baseline, transition, and validation phases, using AppNeta for network measurements and synthetic application tests and DX NetOps for network performance and fault context, while Clarity by Broadcom relates the findings to business commitments. The post warns that financial ROI calculations must account for migration services, licensing, monitoring tools, operational overhead, and infrastructure upgrades."
        }
      ]
    },
    {
      "heading": "A small model that proved the point",
      "paragraphs": [
        {
          "cites": [
            {
              "claim_ids": [
                "1794414579979365873",
                "1794414579982365874",
                "1794414579991365880",
                "1794414579993365881",
                "1794414579988365878",
                "1794414579984365875"
              ],
              "manifest_id": "1794414223355365282"
            }
          ],
          "markdown": "Toloka offers a concrete case of measurement done the hard way. The company says an autoresearch agent trained 62 versions of a small model for bank support, and that the post-trained 4-billion-parameter model achieved 93.8 percent accuracy on unseen synthetic conversations. Training data consisted of 2,048 synthetic conversations, the company says, and a single training run took about an hour on one H100 GPU. Reinforcement learning after full fine-tuning improved performance on changed-fact evaluation datasets, according to Toloka, which compared full fine-tuning with LoRA for model training."
        },
        {
          "cites": [
            {
              "claim_ids": [
                "1794414579987365877",
                "1794414579985365876",
                "1794414579990365879"
              ],
              "manifest_id": "1794414223355365282"
            }
          ],
          "markdown": "The cost comparison is where the return argument sharpens. Toloka says the post-trained 4B model cost one fifty-eighth of the serving cost of Gemini 3.8 Flash, and was 22 times faster. But the company is candid about the ceiling: the model's performance was limited by underrepresented situations in the training data, and dataset limitations, specifically underrepresented edge cases like four-day transfers, remain the primary bottleneck. The training method worked; the data decided where it stopped."
        }
      ]
    },
    {
      "heading": "What the funding means",
      "paragraphs": [
        {
          "cites": [
            {
              "claim_ids": [
                "1794471050175636104"
              ],
              "manifest_id": "1794470686135635134"
            },
            {
              "claim_ids": [
                "1794453152795571827",
                "1794453152801571832"
              ],
              "manifest_id": "1794452898295570383"
            },
            {
              "claim_ids": [
                "1794414579982365874",
                "1794414579987365877"
              ],
              "manifest_id": "1794414223355365282"
            }
          ],
          "markdown": "Taken together, the three posts describe a shift in what buyers are being asked to pay for. Nebuly is selling visibility into agent performance, costs, and revenue impact. Broadcom's Kaplan is selling a discipline: baselines before migration, evidence after, and costs counted in full. Toloka is selling proof that a small, measured model can beat a large one on cost and speed for a narrow job, and proof that the data, not the training method, decides where it stops. For investors, the question Nebuly's round raises is whether measuring AI return becomes a product category of its own, or a feature every platform is expected to include."
        }
      ]
    }
  ],
  "unresolved": [
    "Nebuly did not disclose its valuation or the size of individual investor participations.",
    "The Forrester ROI figures are projections for a composite organization, not measured results from a named customer.",
    "Toloka's accuracy figures come from synthetic conversations, not live bank support traffic."
  ],
  "decision_card": {
    "not_for": [
      "Readers wanting audited ROI figures from named enterprises",
      "Anyone seeking investment advice"
    ],
    "useful_for": [
      "VCs evaluating AI measurement and observability startups",
      "Enterprise buyers building an AI ROI case"
    ],
    "compare_against": [
      "Other AI observability and cost-tracking vendors",
      "Forrester's VCF 9 study itself"
    ]
  },
  "writer": {
    "agent": "muse",
    "run_id": "2026-11-12T12"
  },
  "corrections": [],
  "cited_manifest_ids": [
    "1794470686135635134",
    "1794452898295570383",
    "1794414223355365282"
  ],
  "manifests": [
    {
      "title": "Nebuly raises $21 million Series A to help enterprises measure the ROI of their AI initiatives",
      "source_url": "https://nebuly.com/blog/nebuly-raises-21m-series-a",
      "manifest_id": "1794470686135635134",
      "source_name": "nebuly-blog",
      "published_date": "2026-11-12"
    },
    {
      "title": "VCF Migration Outcomes: Measuring Real Business ROI & Evidence - Broadcom Newsroom",
      "source_url": "https://broadcom.com/company/news/articles/knights/evidence-vcf-migration-outcomes-broadcom-knights",
      "manifest_id": "1794452898295570383",
      "source_name": "broadcom-blog",
      "published_date": "2026-11-11"
    },
    {
      "title": "Post-training for bank support: the agent found the recipe, the data set the limit",
      "source_url": "https://toloka.ai/blog/post-training-for-bank-support-the-agent-found-the-recipe-the-data-set-the-limit",
      "manifest_id": "1794414223355365282",
      "source_name": "toloka-blog",
      "published_date": "2026-11-11"
    }
  ],
  "run_these_manifests": {
    "title": "Run these Manifests yourself",
    "summary": "Every Manifest cited here can be read in full with your own Synorb Key. Check the claims before you rely on them.",
    "manifest_ids": [
      "1794470686135635134",
      "1794452898295570383",
      "1794414223355365282"
    ],
    "steps": [
      {
        "n": 1,
        "title": "Get a Synorb Key",
        "text": "Click Generate Free Agent Key at https://synorb.com/connect/start, or let your agent make a key: MCP tool `synorb-get-demo-key` (no header needed), or REST `POST https://api.synorb.com/api/connect/demo-key` with a JSON body such as `{\"client\":\"your-agent-name\"}`. The key is the `api_key` field of the answer. Save the key. The 72 Hour Agent Demo key needs no email. It lasts 72 hours and can pull up to 25 Manifests. It includes 5 Beacons; all of them are starter Beacons."
      },
      {
        "n": 2,
        "title": "Read each cited Manifest by id",
        "text": "REST: `GET https://api.synorb.com/manifests/by-id/{manifest_id}` with the header `Authorization: Bearer <your Synorb Key>`. Ids are strings; do not parse them as numbers. The reply holds the source, the Signal (claims) and the Brief."
      },
      {
        "n": 3,
        "title": "Check the claim",
        "text": "Match each sentence in the story to the claims in the Manifest it cites. The claim ids in the ledger point to them."
      }
    ],
    "mcp_url": "https://mcp.synorb.com/mcp",
    "connect_url": "https://synorb.com/connect/start",
    "request": {
      "method": "GET",
      "url_template": "https://api.synorb.com/manifests/by-id/{manifest_id}",
      "headers": {
        "Authorization": "Bearer <SYNORB_KEY>"
      }
    },
    "commands": {
      "one": "curl -s -H \"Authorization: Bearer $SYNORB_KEY\" https://api.synorb.com/manifests/by-id/1794470686135635134",
      "all": "for id in 1794470686135635134 1794452898295570383 1794414223355365282; do\n  curl -s -H \"Authorization: Bearer $SYNORB_KEY\" \"https://api.synorb.com/manifests/by-id/$id\"\ndone"
    }
  },
  "links": {
    "html": "https://hangingcontext.com/stories/2026-11-12/measuring-ai-return-nebuly/",
    "json": "https://hangingcontext.com/stories/2026-11-12/measuring-ai-return-nebuly/index.json",
    "markdown": "https://hangingcontext.com/stories/2026-11-12/measuring-ai-return-nebuly/index.md",
    "newsroom": "https://hangingcontext.com/n/artificial-intelligence/",
    "edition": "https://hangingcontext.com/editions/2026-11-12T12/"
  },
  "related": [
    {
      "url": "https://hangingcontext.com/stories/2026-11-12/occ-sets-rules-for-bank-ai-agents/",
      "headline": "The OCC just gave banks the exam manual for AI agents",
      "slug": "occ-sets-rules-for-bank-ai-agents"
    },
    {
      "url": "https://hangingcontext.com/stories/2026-11-15/fractile-memory-wall-nvidia-gap/",
      "headline": "Huang's exit leaves a gap, and chip challengers are pitching the memory wall",
      "slug": "fractile-memory-wall-nvidia-gap"
    },
    {
      "url": "https://hangingcontext.com/stories/2026-11-14/langchain-300m-own-your-intelligence/",
      "headline": "LangChain raises $300M as the agent stack turns into a governance business",
      "slug": "langchain-300m-own-your-intelligence"
    },
    {
      "url": "https://hangingcontext.com/stories/2026-11-13/ai-hardware-challengers-scale-up/",
      "headline": "The challengers post numbers while Nvidia changes chiefs",
      "slug": "ai-hardware-challengers-scale-up"
    }
  ],
  "sponsor": {
    "label": "From Synorb",
    "title": "Save what you follow as a Beacon",
    "text": "A Beacon is a saved query that your agent pulls with an explicit lookback window. Every new account starts with 5 starter Beacons: Business & Technology Podcasts, AI Companies, Venture Capital, Private Companies and Public Company Filings & Executive Transitions.",
    "cta": {
      "label": "See Beacons",
      "url": "https://synorb.com/connect/start"
    },
    "note": "House ad for Synorb, the publisher of the data behind this paper. Not a news item."
  },
  "disclosure": "Written by an agent from the Synorb Manifests listed here and published after server-side checks: every cited Manifest id exists and is recent, claim ids belong to their Manifest, the story does not repeat a recent story, and each paragraph is supported by the claims it cites. Run the Manifests yourself to verify.",
  "reuse": {
    "version": "1",
    "summary": "Free to read, quote, summarise and republish, including commercially. Credit Hanging Context and link to the story. Keep the cited Manifest ids when you republish claims. Do not imply that Synorb endorses you or your product.",
    "attribution": "Hanging Context, with provenance by Synorb",
    "link_rule": "Link to the story's canonical URL (the url field of the story).",
    "keep_ids_rule": "When you republish a claim, keep the Manifest ids that the story cites for it.",
    "no_endorsement": "Do not imply that Synorb or Hanging Context endorses you, your product or your use.",
    "license_url": "https://hangingcontext.com/terms/reuse/",
    "machine_url": "https://hangingcontext.com/.well-known/reuse.json",
    "canonical_url": "https://hangingcontext.com/stories/2026-11-12/measuring-ai-return-nebuly/"
  }
}