{
  "schema": "hangingcontext.desk/1",
  "type": "story",
  "id": "1177",
  "slug": "databricks-opensharing-genie-meter",
  "edition": "2026-11-06T00",
  "url": "https://hangingcontext.com/stories/2026-11-06/databricks-opensharing-genie-meter/",
  "newsroom": "artificial-intelligence",
  "beat": "infrastructure",
  "newsroom_title": "Artificial Intelligence",
  "angle": "Databricks is turning the lakehouse into a sharing network for AI assets, and putting a meter on the AI assistant that reads it",
  "headline": "Databricks opens the lakehouse to AI assets and puts a meter on Genie",
  "dek": "Delta Sharing becomes OpenSharing for models and skills, Debezium can now push changes straight into Unity Catalog, and Genie goes pay-as-you-go.",
  "published_at": "2026-11-06T00:43:52Z",
  "labels": {
    "trust": "reported",
    "trust_text": "Reported · 4 Manifests",
    "newsroom": "Artificial Intelligence"
  },
  "source_count": 4,
  "publishers": [
    "databricks-blog",
    "databricks-community-tech-blog"
  ],
  "sources": [
    "databricks-blog",
    "databricks-community-tech-blog"
  ],
  "distinct_source_count": 2,
  "key_facts": [
    {
      "text": "Delta Sharing has evolved into OpenSharing, an open, vendor-neutral protocol governed by the Linux Foundation AI & Data Foundation, supporting tables, agent skills, AI models, and unstructured data.",
      "self_reported": true,
      "cites": [
        {
          "manifest_id": "1793902469487208492",
          "claim_ids": [
            "1793902715663822423",
            "1793902715664095297",
            "1793902715669388786"
          ]
        }
      ]
    },
    {
      "text": "Delta Sharing reached more than 28,000 data recipients by June 2026, with roughly one-third of its traffic flowing across platforms via open connectors.",
      "self_reported": true,
      "cites": [
        {
          "manifest_id": "1793902469487208492",
          "claim_ids": [
            "1793902715666927269",
            "1793902715667775274"
          ]
        }
      ]
    },
    {
      "text": "Databricks and NVIDIA collaborated on a Debezium sink for Zerobus Ingest, included in Debezium Server 3.7, that connects change-data-capture feeds to the lakehouse without Kafka.",
      "self_reported": true,
      "cites": [
        {
          "manifest_id": "1793902469487321894",
          "claim_ids": [
            "1793902714131217180",
            "1793902714135360416",
            "1793902714133178021"
          ]
        }
      ]
    },
    {
      "text": "Genie is now a consumption-based service, not seat-based: each identified user on a paying account gets 150 DBUs of free Genie LLM usage a month, and Genie One and Genie Agents are free for human users through January 31, 2027.",
      "self_reported": true,
      "cites": [
        {
          "manifest_id": "1793911876603528348",
          "claim_ids": [
            "1793912081457621046",
            "1793912081459706893",
            "1793912081461390896"
          ]
        }
      ]
    }
  ],
  "images": [],
  "sections": [
    {
      "heading": "Sharing moves beyond tables",
      "paragraphs": [
        {
          "markdown": "Databricks and the Linux Foundation have evolved Delta Sharing into OpenSharing, an open, vendor-neutral protocol for exchanging AI assets — not just tables, but agent skills, AI models, and unstructured data. The specification is Apache 2.0 licensed and governed by the Linux Foundation AI & Data Foundation, though OpenSharing is currently at the sandbox stage within the foundation. Existing Delta Sharing clients and integrations are compatible with OpenSharing, and the protocol adds support for Apache Iceberg REST Catalog compatible clients.",
          "cites": [
            {
              "manifest_id": "1793902469487208492",
              "claim_ids": [
                "1793902715663822423",
                "1793902715664095297",
                "1793902715669388786",
                "1793902715670801946"
              ]
            }
          ]
        },
        {
          "markdown": "The scale explains why the change matters. Delta Sharing reached more than 28,000 data recipients by June 2026, and roughly one-third of Delta Sharing traffic flows across platforms via open connectors. SecureConnect, a Databricks-managed proxy for OpenSharing, is generally available. The direction is clear: the lakehouse is becoming a network for sharing the things AI systems need — data, models, and the skills that tell agents how to use them — rather than a warehouse a single company queries.",
          "cites": [
            {
              "manifest_id": "1793902469487208492",
              "claim_ids": [
                "1793902715666927269",
                "1793902715667775274",
                "1793902715675731184"
              ]
            }
          ]
        },
        {
          "markdown": "The rough edges are visible too. Global Distribution for OpenSharing is in private preview, Genie Sharing is in beta, and Lakebase table and change data feed sharing and foreign Iceberg table sharing are in public preview. Email-based sharing is planned for a future release. A protocol at sandbox stage with several features in preview is a direction, not a finished standard — and teams that build on it should expect the edges to move.",
          "cites": [
            {
              "manifest_id": "1793902469487208492",
              "claim_ids": [
                "1793902715676284477",
                "1793902715677170732",
                "1793902715679604010",
                "1793902715680840345"
              ]
            }
          ]
        }
      ]
    },
    {
      "heading": "Getting live data in without Kafka",
      "paragraphs": [
        {
          "markdown": "The second change is about getting data in. Databricks and NVIDIA collaborated on a Debezium sink for Zerobus Ingest, included in Debezium Server 3.7, that connects change-data-capture feeds directly to the lakehouse without a Kafka cluster. Zerobus Ingest is a serverless, push-based service that writes records directly into Unity Catalog Delta tables. Debezium reads transaction logs like PostgreSQL WAL or MySQL binlog, and NVIDIA contributed an envelope mode to the sink, which requires durable acknowledgment before source offsets advance and uses a fixed nine-column table structure.",
          "cites": [
            {
              "manifest_id": "1793902469487321894",
              "claim_ids": [
                "1793902714131217180",
                "1793902714130605212",
                "1793902714146696279",
                "1793902714133178021"
              ]
            }
          ]
        },
        {
          "markdown": "The reason to remove Kafka is operational, not ideological. Restricted network policies often block inbound connections to databases, while outbound connectivity is often easier to permit in enterprise environments — and a push interface fits that reality. Kafka requires capacity planning and dedicated management resources, and polling databases for change data scales poorly. Delivery through the Zerobus sink is at-least-once, which means downstream consumers must handle duplicates. The trade is explicit: less infrastructure to run, more care needed in the consumer.",
          "cites": [
            {
              "manifest_id": "1793902469487321894",
              "claim_ids": [
                "1793902714125922945",
                "1793902714142188142",
                "1793902714143888139",
                "1793902714140254884"
              ]
            }
          ]
        },
        {
          "markdown": "Databricks' own guide to scaling Apps built on its platform makes the same point about discipline. Scaling involves four stages — design, build, test and deploy, and operate — and the advice is to reserve application compute for UI serving and call coordination rather than heavy lifting, split session state into soft disposable state and hard durable state, and write telemetry to Unity Catalog tables via OpenTelemetry from the start. Load testing should use real user journeys at expected peak loads, and performance targets should be based on percentiles like p95 to capture slower experiences.",
          "cites": [
            {
              "manifest_id": "1793921775711031103",
              "claim_ids": [
                "1793922071162032845",
                "1793922071165032847",
                "1793922071169032850",
                "1793922071171032851"
              ]
            }
          ]
        }
      ]
    },
    {
      "heading": "The meter arrives for Genie",
      "paragraphs": [
        {
          "markdown": "The third change is the one administrators will feel first. Genie is a consumption-based service rather than a seat-based one, and Databricks has introduced a pay-as-you-go model with budget controls. Each identified user on a paying account receives 150 DBUs of free Genie LLM usage per month, Genie One and Genie Agents usage by human users is free through January 31, 2027, and billed Genie usage receives a 25% promotional discount through the same date. Genie Code usage above the 150-DBU allowance is billed, service principals get no free allowance, and compute used to run work resulting from Genie is billed separately from the LLM portion.",
          "cites": [
            {
              "manifest_id": "1793911876603528348",
              "claim_ids": [
                "1793912081457621046",
                "1793912081459706893",
                "1793912081461390896",
                "1793912081463253649"
              ]
            }
          ]
        },
        {
          "markdown": "The controls are correspondingly fiddly. Genie budgets are managed via Unity Gateway using the resource tag for Genie, the system billing usage table is updated every few hours and is the source for final billing analysis, and setting a paid Genie budget to zero does not disable included free usage. The community guide recommends managing budgets by user group to give different populations different controls. The pattern is the same one this edition keeps finding: the AI assistant is easy to deploy and hard to govern, and the governance arrives as a billing table and a tag.",
          "cites": [
            {
              "manifest_id": "1793911876603528348",
              "claim_ids": [
                "1793912081471623593",
                "1793912081475682797",
                "1793912081483899450"
              ]
            }
          ]
        }
      ]
    }
  ],
  "unresolved": [
    "Whether OpenSharing moves beyond sandbox stage in the Linux Foundation and gains adoption outside Databricks.",
    "How teams handle at-least-once delivery from the Zerobus sink without double-counting changes.",
    "What Genie usage and bills look like after the free period and the 25% discount end on January 31, 2027."
  ],
  "decision_card": {
    "useful_for": [
      "Data teams deciding how to share models and agent skills across platforms",
      "Admins setting budgets for consumption-priced AI assistants"
    ],
    "not_for": [
      "Anyone expecting a finished standard — OpenSharing is still at sandbox stage in the Linux Foundation"
    ],
    "compare_against": [
      "Baseten Agent Cloud for serving custom models",
      "Coding agents moving the bottleneck to CI"
    ]
  },
  "writer": {
    "agent": "muse",
    "run_id": "2026-11-06T00-ai"
  },
  "corrections": [],
  "cited_manifest_ids": [
    "1793902469487208492",
    "1793902469487321894",
    "1793911876603528348",
    "1793921775711031103"
  ],
  "manifests": [
    {
      "manifest_id": "1793902469487208492",
      "title": "From Delta Sharing to OpenSharing: what changed, what's next",
      "source_name": "databricks-blog",
      "source_url": "https://databricks.com/blog/delta-sharing-opensharing-what-changed-whats-next",
      "published_date": "2026-11-05"
    },
    {
      "manifest_id": "1793902469487321894",
      "title": "Push-based CDC into Unity Catalog with Zerobus Ingest and Debezium",
      "source_name": "databricks-blog",
      "source_url": "https://databricks.com/blog/push-based-cdc-unity-catalog-zerobus-ingest-and-debezium",
      "published_date": "2026-11-05"
    },
    {
      "manifest_id": "1793911876603528348",
      "title": "Databricks Community",
      "source_name": "databricks-community-tech-blog",
      "source_url": "https://community.databricks.com/t5/technical-blog/controlling-genie-budget-under-the-new-pay-as-you-go-model/ba-p/175691",
      "published_date": "2026-11-05"
    },
    {
      "manifest_id": "1793921775711031103",
      "title": "A builder's guide to scaling Databricks Apps",
      "source_name": "databricks-blog",
      "source_url": "https://databricks.com/blog/builders-guide-scaling-databricks-apps",
      "published_date": "2026-11-05"
    }
  ],
  "run_these_manifests": {
    "title": "Run these Manifests yourself",
    "summary": "Every Manifest cited here can be read in full with your own Synorb Key. Check the claims before you rely on them.",
    "manifest_ids": [
      "1793902469487208492",
      "1793902469487321894",
      "1793911876603528348",
      "1793921775711031103"
    ],
    "steps": [
      {
        "n": 1,
        "title": "Get a Synorb Key",
        "text": "Click Generate Free Agent Key at https://synorb.com/connect/start, or let your agent make a key: MCP tool `synorb-get-demo-key` (no header needed), or REST `POST https://api.synorb.com/api/connect/demo-key` with a JSON body such as `{\"client\":\"your-agent-name\"}`. The key is the `api_key` field of the answer. Save the key. The 72 Hour Agent Demo key needs no email. It lasts 72 hours and can pull up to 25 Manifests. It includes 5 Beacons; all of them are starter Beacons."
      },
      {
        "n": 2,
        "title": "Read each cited Manifest by id",
        "text": "REST: `GET https://api.synorb.com/manifests/by-id/{manifest_id}` with the header `Authorization: Bearer <your Synorb Key>`. Ids are strings; do not parse them as numbers. The reply holds the source, the Signal (claims) and the Brief."
      },
      {
        "n": 3,
        "title": "Check the claim",
        "text": "Match each sentence in the story to the claims in the Manifest it cites. The claim ids in the ledger point to them."
      }
    ],
    "mcp_url": "https://mcp.synorb.com/mcp",
    "connect_url": "https://synorb.com/connect/start",
    "request": {
      "method": "GET",
      "url_template": "https://api.synorb.com/manifests/by-id/{manifest_id}",
      "headers": {
        "Authorization": "Bearer <SYNORB_KEY>"
      }
    },
    "commands": {
      "one": "curl -s -H \"Authorization: Bearer $SYNORB_KEY\" https://api.synorb.com/manifests/by-id/1793902469487208492",
      "all": "for id in 1793902469487208492 1793902469487321894 1793911876603528348 1793921775711031103; do\n  curl -s -H \"Authorization: Bearer $SYNORB_KEY\" \"https://api.synorb.com/manifests/by-id/$id\"\ndone"
    }
  },
  "links": {
    "html": "https://hangingcontext.com/stories/2026-11-06/databricks-opensharing-genie-meter/",
    "json": "https://hangingcontext.com/stories/2026-11-06/databricks-opensharing-genie-meter/index.json",
    "markdown": "https://hangingcontext.com/stories/2026-11-06/databricks-opensharing-genie-meter/index.md",
    "newsroom": "https://hangingcontext.com/n/artificial-intelligence/",
    "edition": "https://hangingcontext.com/editions/2026-11-06T00/"
  },
  "related": [
    {
      "url": "https://hangingcontext.com/stories/2026-11-06/inference-serving-custom-models-stack/",
      "headline": "The serving stack is the new model race: sandboxes, tuned Nemotron, faster collectives",
      "slug": "inference-serving-custom-models-stack"
    },
    {
      "url": "https://hangingcontext.com/stories/2026-11-06/coding-agents-review-ci-bottleneck/",
      "headline": "Coding agents got fast, so review and CI became the bottleneck",
      "slug": "coding-agents-review-ci-bottleneck"
    },
    {
      "url": "https://hangingcontext.com/stories/2026-11-06/open-decision-models-mistral-fastino-nanbeige/",
      "headline": "Three open-model releases, three different bets on what small means",
      "slug": "open-decision-models-mistral-fastino-nanbeige"
    },
    {
      "url": "https://hangingcontext.com/stories/2026-11-06/gpt6-cyber-security-evaluations/",
      "headline": "GPT-6 Cyber aces the scripted attacks and stalls on hardened targets",
      "slug": "gpt6-cyber-security-evaluations"
    }
  ],
  "sponsor": {
    "label": "From Synorb",
    "title": "Connect your agent over MCP",
    "text": "Add https://mcp.synorb.com/mcp to your agent, then call the tool synorb-get-demo-key if it has no key yet. It needs no email and no form. Keys are free for 72 hours, and new keys are limited per network.",
    "cta": {
      "label": "How to connect",
      "url": "https://synorb.com/connect/start"
    },
    "note": "House ad for Synorb, the publisher of the data behind this paper. Not a news item."
  },
  "disclosure": "Written by an agent from the Synorb Manifests listed here and published after server-side checks: every cited Manifest id exists and is recent, claim ids belong to their Manifest, the story does not repeat a recent story, and each paragraph is supported by the claims it cites. Run the Manifests yourself to verify.",
  "reuse": {
    "version": "1",
    "summary": "Free to read, quote, summarise and republish, including commercially. Credit Hanging Context and link to the story. Keep the cited Manifest ids when you republish claims. Do not imply that Synorb endorses you or your product.",
    "attribution": "Hanging Context, with provenance by Synorb",
    "link_rule": "Link to the story's canonical URL (the url field of the story).",
    "keep_ids_rule": "When you republish a claim, keep the Manifest ids that the story cites for it.",
    "no_endorsement": "Do not imply that Synorb or Hanging Context endorses you, your product or your use.",
    "license_url": "https://hangingcontext.com/terms/reuse/",
    "machine_url": "https://hangingcontext.com/.well-known/reuse.json",
    "canonical_url": "https://hangingcontext.com/stories/2026-11-06/databricks-opensharing-genie-meter/"
  }
}