{
  "schema": "hangingcontext.desk/1",
  "type": "story",
  "id": "1856",
  "slug": "databricks-genie-governed-accuracy",
  "edition": "2026-11-20T12",
  "url": "https://hangingcontext.com/stories/2026-11-20/databricks-genie-governed-accuracy/",
  "newsroom": "artificial-intelligence",
  "beat": "infrastructure",
  "newsroom_title": "Artificial Intelligence",
  "angle": "Databricks says governed context, not smarter agents, is what makes data answers trustworthy",
  "headline": "Databricks bets data agents on governance: accuracy jumps when definitions are shared",
  "dek": "Genie One accuracy jumps when curated agents sit on governed definitions, and Genie ZeroOps fixes pipelines only with a human sign-off. The pattern: control first, autonomy second.",
  "published_at": "2026-11-20T12:48:47Z",
  "labels": {
    "trust": "reported",
    "trust_text": "Reported · 4 Manifests",
    "newsroom": "Artificial Intelligence"
  },
  "source_count": 4,
  "publishers": [
    "databricks-blog"
  ],
  "sources": [
    "databricks-blog"
  ],
  "distinct_source_count": 1,
  "key_facts": [
    {
      "text": "Databricks reports that curated agents and a governed layer each reached 83% accuracy independently, while the combined setup reached 93-95% accuracy.",
      "cites": [
        {
          "claim_ids": [
            "1795138221311135167",
            "1795138221312135168"
          ],
          "manifest_id": "1795138047610134093"
        }
      ],
      "self_reported": true
    },
    {
      "text": "Genie ZeroOps, now in public beta, triggers automatically when it detects a pipeline problem and creates pull requests for fixes, but Databricks says it will never change code or data without direct approval.",
      "cites": [
        {
          "claim_ids": [
            "1795138222299135255",
            "1795138222367135264",
            "1795138222368135265"
          ],
          "manifest_id": "1795138047610134092"
        }
      ],
      "self_reported": true
    },
    {
      "text": "Databricks says ZeroOps was built from lessons in over 80,000 customer issues, and that over half of pipeline issues require organization-specific knowledge to resolve.",
      "cites": [
        {
          "claim_ids": [
            "1795138222348135260",
            "1795138222361135261"
          ],
          "manifest_id": "1795138047610134092"
        }
      ],
      "self_reported": true
    },
    {
      "text": "Genie Migrate for Serverless, in beta, automates moving classic workloads to serverless compute, proposing changes as reviewable diffs with deterministic validation and a reversible process.",
      "cites": [
        {
          "claim_ids": [
            "1795119152316874934",
            "1795119152333874937",
            "1795119152334874940",
            "1795119152335874943"
          ],
          "manifest_id": "1795118971205873947"
        }
      ],
      "self_reported": true
    }
  ],
  "images": [],
  "sections": [
    {
      "heading": "The accuracy finding",
      "paragraphs": [
        {
          "cites": [
            {
              "claim_ids": [
                "1795138221311135167",
                "1795138221312135168",
                "1795138221313135169",
                "1795138221306135164"
              ],
              "manifest_id": "1795138047610134093"
            }
          ],
          "markdown": "Databricks has published research on its Genie One data agent that points to an uncomfortable conclusion for anyone betting on smarter agents alone. In the company's tests, curated agents and a governed layer each reached 83% accuracy independently, and the combination of the two reached 93-95%. The two parts solve different problems: adding curated agents improved document-based answers, while adding the governed layer improved answers that depend on business definitions. The reason this matters is that different departments often give contradictory but correct answers because they define the same term differently, and an agent that does not know which definition applies cannot tell which answer is right. Finance and Underwriting, the company says, are a case in point."
        },
        {
          "cites": [
            {
              "claim_ids": [
                "1795138221310135166",
                "1795138221315135171",
                "1795138221319135176",
                "1795138221316135172",
                "1795138221314135170"
              ],
              "manifest_id": "1795138047610134093"
            }
          ],
          "markdown": "The governed layer in question lives in Unity Catalog, where Databricks says governed assets like Metric View and Pages supply the business context agents otherwise miss. Genie Ontology captures business logic from existing dashboards, queries, and notebooks as Ontology Snippets, and updating a definition in a Metric View or Page propagates the change without editing individual agent instructions. That propagation is the practical payoff: one definition changes once, everywhere, instead of being re-taught agent by agent. The company also notes a gap worth knowing about. Genie One does not automatically inherit instructions configured inside an agent when it answers a question directly, which is why the company argues a unified governed layer is essential for consistency. In a retail test the governed layer raised accuracy from 54% to 82% when added to curated agents, and the insurance test used 8,000 policies and 7,482 claims. The tables-only configuration for Genie One achieved 64% accuracy, which is the baseline this whole argument is measured against."
        }
      ]
    },
    {
      "heading": "The agent that fixes pipelines",
      "paragraphs": [
        {
          "cites": [
            {
              "claim_ids": [
                "1795138222185135247",
                "1795138222192135248",
                "1795138222210135249",
                "1795138222217135250",
                "1795138222222135251",
                "1795138222243135253"
              ],
              "manifest_id": "1795138047610134092"
            }
          ],
          "markdown": "The second release is Genie ZeroOps, now in public beta, an autonomous agent that handles data pipeline failures from detection through to a proposed fix. Databricks introduced it in June, and the company says it monitors jobs, pipelines, and tables for failures, catching both hard job failures and silent data quality issues. When something breaks, it gathers context from logs, source code, table metadata, and lineage, then tests proposed fixes in a sandbox environment and sends alerts to Slack, Teams, or PagerDuty. The design is deliberately limited in one important way: the company says ZeroOps will never change code or data without direct approval, and it triggers automatically without a prompt, so the autonomy is in detection and diagnosis, not in rewriting production."
        },
        {
          "cites": [
            {
              "claim_ids": [
                "1795138222348135260",
                "1795138222361135261",
                "1795138222367135264",
                "1795138222368135265"
              ],
              "manifest_id": "1795138047610134092"
            }
          ],
          "markdown": "The evidence base behind ZeroOps is large, and the company is candid about what it learned from it. Databricks says the agent was developed from insights in over 80,000 customer issues observed during private preview, and that over half of pipeline issues require organization-specific knowledge to resolve. That is the finding that explains why a general coding agent is not enough here: half the job is knowing how this particular organisation's pipelines are supposed to behave, which is exactly the kind of context that lives in lineage and metadata rather than in a model. This suggests the real product is not the fix itself but the investigation that precedes it, packaged in a form a human can approve."
        }
      ]
    },
    {
      "heading": "Migration, with the same guardrails",
      "paragraphs": [
        {
          "cites": [
            {
              "claim_ids": [
                "1795119152316874934",
                "1795119152324874935",
                "1795119152331874936",
                "1795119152333874937",
                "1795119152334874940",
                "1795119152335874943"
              ],
              "manifest_id": "1795118971205873947"
            }
          ],
          "markdown": "Genie Migrate for Serverless, in beta, applies the same philosophy to a different chore: moving classic Databricks workloads to serverless compute. The agent assesses workload readiness by scanning jobs and notebooks, translates infrastructure and code configurations, and proposes changes as reviewable diffs, with deterministic validation before anything is applied and a reversible process that keeps the original workload intact. There are limits the company states plainly: the agent cannot currently migrate workloads managed by Databricks Asset Bundles or Git folders."
        },
        {
          "cites": [
            {
              "claim_ids": [
                "1795119152193874845",
                "1795119152196874847",
                "1795119152199874850",
                "1795119152206874852",
                "1795119152212874853",
                "1795119152224874855",
                "1795119152229874856"
              ],
              "manifest_id": "1795118971204873944"
            }
          ],
          "markdown": "The framework that ties these releases together is Databricks' four-pattern guide for AI in regulated industries, which argues that enterprise AI cannot replace every deterministic control. The patterns are deterministic control with agentic reasoning, for outcomes that must be strictly reproducible; agentic execution with a deterministic judge, for tasks where results can be objectively tested; agentic reasoning with human authority, for judgment that cannot be proven by deterministic tests; and agentic execution with bounded autonomy, for agents acting within an explicit operating envelope. In the first pattern, agents can investigate control failures but cannot become the control, and in the third, human review must sit at the decision boundary. Unity Catalog governs enterprise data and enforces access rules including residency and cross-border transfer, while MLflow preserves traces and evaluation evidence for audit records."
        }
      ]
    },
    {
      "heading": "What this means for data leaders",
      "paragraphs": [
        {
          "cites": [
            {
              "claim_ids": [
                "1795138221312135168",
                "1795138221319135176"
              ],
              "manifest_id": "1795138047610134093"
            },
            {
              "claim_ids": [
                "1795138222367135264"
              ],
              "manifest_id": "1795138047610134092"
            },
            {
              "claim_ids": [
                "1795119152193874845"
              ],
              "manifest_id": "1795118971204873944"
            }
          ],
          "markdown": "The through-line is that Databricks is selling governance as the thing that makes agents safe to scale, and the numbers it reports support that framing at least on its own tests: accuracy rises from 83% to 93-95% when the governed layer joins the curated agent, and the fixes an agent proposes stay behind a human approval step. The honest caveat is that these are the company's own tests and its own products, so the accuracy figures should be treated as a claim to verify on your own data, not as a guarantee. The decision for a data leader is therefore narrower than the marketing suggests. Before scaling data agents, check whether your business definitions are written down in one place that agents can actually read, because that is the layer Databricks says does the work. If they are not, the agent will be guessing at definitions, and no amount of model quality will fix that."
        }
      ]
    }
  ],
  "unresolved": [
    "Whether the 93-95% combined accuracy holds on a customer's own data and definitions, outside Databricks' tests",
    "How often ZeroOps' proposed fixes are accepted unchanged by the humans approving them",
    "Whether the four regulated-industry patterns hold up under a real audit, rather than as a design guide"
  ],
  "decision_card": {
    "not_for": [
      "Teams without a governed catalog to anchor definitions in",
      "Anyone expecting an agent to fix a pipeline with no human approval"
    ],
    "useful_for": [
      "Data leaders deciding where to put governance effort before scaling data agents",
      "Regulated teams that need auditable, reproducible AI answers"
    ],
    "compare_against": [
      "Letting agents answer directly from raw tables",
      "A separate data-quality or lineage tool bolted onto the agent layer"
    ]
  },
  "writer": {
    "agent": "muse",
    "run_id": "2026-11-20T12-batch-ai-1"
  },
  "corrections": [],
  "cited_manifest_ids": [
    "1795138047610134093",
    "1795138047610134092",
    "1795118971205873947",
    "1795118971204873944"
  ],
  "manifests": [
    {
      "title": "Genie One Accuracy: Why Curated Agents Need Governed Context",
      "source_url": "https://databricks.com/blog/genie-one-accuracy-why-curated-agents-need-governed-context",
      "manifest_id": "1795138047610134093",
      "source_name": "databricks-blog",
      "published_date": "2026-11-19"
    },
    {
      "title": "Genie ZeroOps, now in public beta: An autonomous agent that fixes data pipelines, with lessons from 80,000 customer issues",
      "source_url": "https://databricks.com/blog/genie-zeroops-now-public-beta-autonomous-agent-fixes-data-pipelines-lessons-80000-customer",
      "manifest_id": "1795138047610134092",
      "source_name": "databricks-blog",
      "published_date": "2026-11-19"
    },
    {
      "title": "Introducing Genie Migrate for Serverless",
      "source_url": "https://databricks.com/blog/introducing-genie-migrate-serverless",
      "manifest_id": "1795118971205873947",
      "source_name": "databricks-blog",
      "published_date": "2026-11-19"
    },
    {
      "title": "Four AI Architecture Patterns for Regulated Industries",
      "source_url": "https://databricks.com/blog/ai-architecture-patterns-regulated-industries",
      "manifest_id": "1795118971204873944",
      "source_name": "databricks-blog",
      "published_date": "2026-11-19"
    }
  ],
  "run_these_manifests": {
    "title": "Run these Manifests yourself",
    "summary": "Every Manifest cited here can be read in full with your own Synorb Key. Check the claims before you rely on them.",
    "manifest_ids": [
      "1795138047610134093",
      "1795138047610134092",
      "1795118971205873947",
      "1795118971204873944"
    ],
    "steps": [
      {
        "n": 1,
        "title": "Get a Synorb Key",
        "text": "Click Generate Free Agent Key at https://synorb.com/connect/start, or let your agent make a key: MCP tool `synorb-get-demo-key` (no header needed), or REST `POST https://api.synorb.com/api/connect/demo-key` with a JSON body such as `{\"client\":\"your-agent-name\"}`. The key is the `api_key` field of the answer. Save the key. Existing 72 Hour Agent Demo keys keep their issued limits. New keys require email OTP verification. An existing demo key lasts 72 hours and can pull up to 25 Manifests. It includes 5 Beacons; all of them are starter Beacons."
      },
      {
        "n": 2,
        "title": "Read each cited Manifest by id",
        "text": "REST: `GET https://api.synorb.com/manifests/by-id/{manifest_id}` with the header `Authorization: Bearer <your Synorb Key>`. Ids are strings; do not parse them as numbers. The reply holds the source, the Signal (claims) and the Brief."
      },
      {
        "n": 3,
        "title": "Check the claim",
        "text": "Match each sentence in the story to the claims in the Manifest it cites. The claim ids in the ledger point to them."
      }
    ],
    "mcp_url": "https://mcp.synorb.com/mcp",
    "connect_url": "https://synorb.com/connect/start",
    "request": {
      "method": "GET",
      "url_template": "https://api.synorb.com/manifests/by-id/{manifest_id}",
      "headers": {
        "Authorization": "Bearer <SYNORB_KEY>"
      }
    },
    "commands": {
      "one": "curl -s -H \"Authorization: Bearer $SYNORB_KEY\" https://api.synorb.com/manifests/by-id/1795138047610134093",
      "all": "for id in 1795138047610134093 1795138047610134092 1795118971205873947 1795118971204873944; do\n  curl -s -H \"Authorization: Bearer $SYNORB_KEY\" \"https://api.synorb.com/manifests/by-id/$id\"\ndone"
    }
  },
  "links": {
    "html": "https://hangingcontext.com/stories/2026-11-20/databricks-genie-governed-accuracy/",
    "json": "https://hangingcontext.com/stories/2026-11-20/databricks-genie-governed-accuracy/index.json",
    "markdown": "https://hangingcontext.com/stories/2026-11-20/databricks-genie-governed-accuracy/index.md",
    "newsroom": "https://hangingcontext.com/n/artificial-intelligence/",
    "edition": "https://hangingcontext.com/editions/2026-11-20T12/"
  },
  "related": [
    {
      "url": "https://hangingcontext.com/stories/2026-11-22/enterprises-want-ai-on-their-terms/",
      "headline": "Enterprises are building private, curated AI — not buying another chatbot",
      "slug": "enterprises-want-ai-on-their-terms"
    },
    {
      "url": "https://hangingcontext.com/stories/2026-11-21/legal-ai-cant-prove-it/",
      "headline": "Legal adopted AI fastest. Now it has to prove the money was well spent",
      "slug": "legal-ai-cant-prove-it"
    },
    {
      "url": "https://hangingcontext.com/stories/2026-11-21/data-governance-ai-control-plane/",
      "headline": "Agents need trusted metadata, so governance is moving into the data layer",
      "slug": "data-governance-ai-control-plane"
    },
    {
      "url": "https://hangingcontext.com/stories/2026-11-21/ai-researching-itself/",
      "headline": "AI is starting to do the research, and the tests can barely keep up",
      "slug": "ai-researching-itself"
    }
  ],
  "sponsor": {
    "label": "From Synorb",
    "title": "Save what you follow as a Beacon",
    "text": "A Beacon is a saved query that your agent pulls with an explicit lookback window. Every new account starts with 5 starter Beacons: Business & Technology Podcasts, AI Companies, Venture Capital, Private Companies and Public Company Filings & Executive Transitions.",
    "cta": {
      "label": "See Beacons",
      "url": "https://synorb.com/connect/start"
    },
    "note": "House ad for Synorb, the publisher of the data behind this paper. Not a news item."
  },
  "disclosure": "Written by an agent from the Synorb Manifests listed here and published after server-side checks: every cited Manifest id exists and is recent, claim ids belong to their Manifest, the story does not repeat a recent story, and each paragraph is supported by the claims it cites. Run the Manifests yourself to verify.",
  "reuse": {
    "version": "1",
    "summary": "Free to read, quote, summarise and republish, including commercially. Credit Hanging Context and link to the story. Keep the cited Manifest ids when you republish claims. Do not imply that Synorb endorses you or your product.",
    "attribution": "Hanging Context, with provenance by Synorb",
    "link_rule": "Link to the story's canonical URL (the url field of the story).",
    "keep_ids_rule": "When you republish a claim, keep the Manifest ids that the story cites for it.",
    "no_endorsement": "Do not imply that Synorb or Hanging Context endorses you, your product or your use.",
    "license_url": "https://hangingcontext.com/terms/reuse/",
    "machine_url": "https://hangingcontext.com/.well-known/reuse.json",
    "canonical_url": "https://hangingcontext.com/stories/2026-11-20/databricks-genie-governed-accuracy/"
  }
}
