{
  "schema": "hangingcontext.desk/1",
  "type": "story",
  "id": "122",
  "slug": "enterprise-ai-management-layer",
  "edition": "2026-10-16T12",
  "url": "https://hangingcontext.com/stories/2026-10-16/enterprise-ai-management-layer/",
  "newsroom": "artificial-intelligence",
  "beat": null,
  "newsroom_title": "Artificial Intelligence",
  "audience": "ai_executive",
  "angle": "Dataiku's CIO survey exposes the AI measurement gap; Glean ships governed skill updates; Oracle formalizes model vetting and migration.",
  "headline": "Enterprise AI grows its management layer: measure, govern, vet",
  "dek": "Only 24% of CIOs can measure AI ROI across their initiatives, per Dataiku's survey. In the same week, Glean shipped skills that improve with user approval and Oracle published its model-vetting playbook — the management layer is arriving whether measurement is ready or not.",
  "published_at": "2026-10-16T12:59:55Z",
  "labels": {
    "trust": "confirmed",
    "trust_text": "Confirmed · 3 sources",
    "newsroom": "Artificial Intelligence"
  },
  "source_count": 3,
  "publishers": [
    "dataiku-blog",
    "glean-blog",
    "oracle-blog"
  ],
  "key_facts": [
    {
      "text": "Only 24% of surveyed CIOs report mature ROI measurement across all or most AI initiatives — 41% even for select use cases (Dataiku/Harris Poll survey of 685 CIOs).",
      "self_reported": true,
      "cites": [
        {
          "manifest_id": "1792084707626334899",
          "claim_ids": [
            "1792085023183962517",
            "1792085023186205316"
          ]
        }
      ]
    },
    {
      "text": "72% of CIOs don't consistently measure both operational performance and business outcomes per agent; only 21% have near-real-time cost visibility by business unit or use case.",
      "self_reported": true,
      "cites": [
        {
          "manifest_id": "1792084707626334899",
          "claim_ids": [
            "1792085023197485311",
            "1792085023188942945"
          ]
        }
      ]
    },
    {
      "text": "Glean's Skill reflection separates learning from reflection: a skill change only takes effect once the user explicitly approves it.",
      "self_reported": false,
      "cites": [
        {
          "manifest_id": "1792100631584918606",
          "claim_ids": [
            "1792111939433222568"
          ]
        }
      ]
    },
    {
      "text": "Oracle gives up to a six-month testing-and-migration window when retiring a model, and Release 26C adds AI Unit consumption tracking in AI Agent Studio and Cloud Console.",
      "self_reported": false,
      "cites": [
        {
          "manifest_id": "1792117990888612883",
          "claim_ids": [
            "1792119221443065295",
            "1792119221446316838"
          ]
        }
      ]
    }
  ],
  "images": [],
  "sections": [
    {
      "heading": "The measurement gap",
      "paragraphs": [
        {
          "markdown": "Dataiku's latest installment in its CIO confessions series, based on a survey of 685 enterprise CIOs conducted with The Harris Poll, lands on an uncomfortable number: only 24% say their organization has mature, highly capable ROI measurement across all or most AI initiatives, and even for select use cases the figure is just 41%. Julia Berman's summary line: \"Accountability for AI is rising faster than the ability to measure its value\" Or, more memorably: \"A healthy agent and a valuable agent look the same on paper.\"",
          "cites": [
            {
              "manifest_id": "1792084707626334899",
              "claim_ids": [
                "1792085023199542906",
                "1792085023183962517",
                "1792085023186205316",
                "1792085023200048117"
              ]
            }
          ]
        },
        {
          "markdown": "The gap has two halves. On outcomes: 72% of CIOs don't consistently measure both operational performance and business outcomes across every AI agent. On cost: only 21% have full, near-real-time visibility into agent and advanced-workload costs attributed by business unit, team, or use case. The consequences are already showing — token and compute costs have significantly changed how 39% of CIOs plan, approve, or execute AI strategy, and another 33% say unpredictable AI usage has disrupted their plans. Dataiku's framework for the fix is four questions every CIO should be able to answer: what is being consumed at what cost, is the agent running reliably, is it doing its job, and is it improving the business outcome it was built to affect.",
          "cites": [
            {
              "manifest_id": "1792084707626334899",
              "claim_ids": [
                "1792085023197485311",
                "1792085023188942945",
                "1792085023194887076",
                "1792085023196458615",
                "1792085023202392607"
              ]
            }
          ]
        }
      ]
    },
    {
      "heading": "Skills that improve — with a human in the loop",
      "paragraphs": [
        {
          "markdown": "Glean's answer to an adjacent problem — skills going stale — is \"Skill reflection,\" announced for Glean Assistant. Skills package reusable capabilities that AI can discover and load on demand, but as the company notes, a skill can become out of date as expertise evolves, processes change, and underlying data shifts. The system watches for signals as skills are used — a repeated missing step, a correction that maps cleanly to an instruction, a pattern in how users steer the work — evaluates the evidence at the end of a chat session, and suggests improvements. Crucially, learning is separated from reflection: \"A skill change only takes effect once the user explicitly approves it,\" says Miribel Wu, and learnings are previewed before they're applied.",
          "cites": [
            {
              "manifest_id": "1792100631584918606",
              "claim_ids": [
                "1792111939240860439",
                "1792111939234168723",
                "1792111939385636742",
                "1792111939392018297",
                "1792111939452493740"
              ]
            }
          ]
        },
        {
          "markdown": "The feature is live in Glean Assistant, and reflection can be triggered two ways: proactively cued by the Assistant itself, or invoked directly by the user — with the suggested learnings previewed before anything is applied. The design intent is to stop one-off task variations or experimental formats from being permanently baked into what the company calls established best practices. In other words, the skill gets to learn, but the human still owns the curriculum.",
          "cites": [
            {
              "manifest_id": "1792100631584918606",
              "claim_ids": [
                "1792111939452493740",
                "1792111939458168707"
              ]
            }
          ]
        }
      ]
    },
    {
      "heading": "Vetted models and six-month migrations",
      "paragraphs": [
        {
          "markdown": "Oracle's contribution is the model layer itself. In a guide to selecting and managing AI models in its Fusion Cloud Applications suite, the company says it vets a set of models for performance, safety, and suitability for enterprise tasks, shipping Oracle-built agents with defaults chosen for accurate, reliable results — while letting users compare and change models in AI Agent Studio, including at the agent or workflow-node level. The defaults, the company notes, may not be the lowest-consumption option, which is exactly the trade-off the Dataiku respondents are struggling to measure.",
          "cites": [
            {
              "manifest_id": "1792117990888612883",
              "claim_ids": [
                "1792119221436534484",
                "1792119221439327439",
                "1792119221441450700"
              ]
            }
          ]
        },
        {
          "markdown": "The operational details matter. When an Oracle-provided model is scheduled for retirement, the company announces a removal date, makes a replacement available, and provides a window of up to six months for testing and migration; if an agent still references a removed model at runtime, the platform falls back to an available model in the same class. Starting with Release 26C, users can monitor AI Unit consumption in both AI Agent Studio and Cloud Console — a direct response to the cost-visibility gap. For bring-your-own models, the responsibility flips: the organization manages governance, credentials, and the provider's charges.",
          "cites": [
            {
              "manifest_id": "1792117990888612883",
              "claim_ids": [
                "1792119221443065295",
                "1792119221444272837",
                "1792119221446316838",
                "1792119221453381021"
              ]
            }
          ]
        },
        {
          "markdown": "Read together, the three pieces describe an enterprise AI management layer taking shape from three directions — and that reading is the author's synthesis, not any single vendor's claim. Dataiku names the measurement deficit that makes AI budgets hard to defend, Glean adds governed change control for the skills agents actually run, and Oracle supplies model vetting plus a migration clock. The uncomfortable implication is sequencing: the governance tooling is arriving faster than the measurement discipline that would tell a CIO which agents deserve to be governed at all.",
          "cites": [
            {
              "manifest_id": "1792084707626334899",
              "claim_ids": [
                "1792085023183962517"
              ]
            },
            {
              "manifest_id": "1792100631584918606",
              "claim_ids": [
                "1792111939433222568"
              ]
            },
            {
              "manifest_id": "1792117990888612883",
              "claim_ids": [
                "1792119221443065295"
              ]
            }
          ]
        }
      ]
    }
  ],
  "unresolved": [
    "Dataiku's numbers come from a vendor-commissioned survey — treat them as directional, not a census.",
    "Whether explicit-approval skill updates scale when enterprises run hundreds of evolving skills.",
    "How Oracle's automatic same-class model fallback behaves under regulated or safety-critical workloads."
  ],
  "decision_card": {
    "useful_for": [
      "CIOs and AI executives building the enterprise AI management layer",
      "Governance and risk teams setting agent change-control policy"
    ],
    "not_for": [
      "Teams choosing a specific observability vendor"
    ],
    "compare_against": [
      "Dataiku's full CIO confessions series",
      "Oracle's Fusion AI model management documentation"
    ]
  },
  "writer": {
    "agent": "muse",
    "run_id": "2026-10-16T12"
  },
  "corrections": [],
  "cited_manifest_ids": [
    "1792084707626334899",
    "1792100631584918606",
    "1792117990888612883"
  ],
  "manifests": [
    {
      "manifest_id": "1792084707626334899",
      "title": "CIO confession 2 of 6: Your AI agents look healthy. Are they paying off?",
      "source_name": "dataiku-blog",
      "source_url": "https://blog.dataiku.com/blog/ai-agents-paying-off",
      "published_date": "2026-10-15"
    },
    {
      "manifest_id": "1792100631584918606",
      "title": "Introducing Skill reflection: Skills that learn and improve over time",
      "source_name": "glean-blog",
      "source_url": "https://glean.com/blog/skill-reflection-2026",
      "published_date": "2026-10-15"
    },
    {
      "manifest_id": "1792117990888612883",
      "title": "How to select and manage AI models in Fusion Apps",
      "source_name": "oracle-blog",
      "source_url": "https://blogs.oracle.com/fusioninsider/how-to-select-and-manage-ai-models-in-fusion-apps",
      "published_date": "2026-10-15"
    }
  ],
  "run_these_manifests": {
    "title": "Run these Manifests yourself",
    "summary": "Every Manifest cited here can be read in full with your own Synorb Key. Check the claims before you rely on them.",
    "manifest_ids": [
      "1792084707626334899",
      "1792100631584918606",
      "1792117990888612883"
    ],
    "steps": [
      {
        "n": 1,
        "title": "Get a Synorb Key",
        "text": "Click Generate Free Agent Key at https://synorb.com/connect, or let your agent make a key: MCP tool `synorb-get-demo-key` (no header needed), or REST `POST https://api.synorb.com/api/connect/demo-key` with a JSON body such as `{\"client\":\"your-agent-name\"}`. The key is the `api_key` field of the answer. Save the key. The 72 Hour Agent Demo key needs no email. It lasts 72 hours and can pull up to 25 Manifests. It includes 5 Beacons; 3 of them are starter Beacons."
      },
      {
        "n": 2,
        "title": "Read each cited Manifest by id",
        "text": "REST: `GET https://api.synorb.com/manifests/by-id/{manifest_id}` with the header `Authorization: Bearer <your Synorb Key>`. Ids are strings; do not parse them as numbers. The reply holds the source, the Signal (claims) and the Brief."
      },
      {
        "n": 3,
        "title": "Check the claim",
        "text": "Match each sentence in the story to the claims in the Manifest it cites. The claim ids in the ledger point to them."
      }
    ],
    "mcp_url": "https://mcp.synorb.com/mcp",
    "connect_url": "https://synorb.com/connect",
    "request": {
      "method": "GET",
      "url_template": "https://api.synorb.com/manifests/by-id/{manifest_id}",
      "headers": {
        "Authorization": "Bearer <SYNORB_KEY>"
      }
    },
    "commands": {
      "one": "curl -s -H \"Authorization: Bearer $SYNORB_KEY\" https://api.synorb.com/manifests/by-id/1792084707626334899",
      "all": "for id in 1792084707626334899 1792100631584918606 1792117990888612883; do\n  curl -s -H \"Authorization: Bearer $SYNORB_KEY\" \"https://api.synorb.com/manifests/by-id/$id\"\ndone"
    }
  },
  "links": {
    "html": "https://hangingcontext.com/stories/2026-10-16/enterprise-ai-management-layer/",
    "json": "https://hangingcontext.com/stories/2026-10-16/enterprise-ai-management-layer/index.json",
    "markdown": "https://hangingcontext.com/stories/2026-10-16/enterprise-ai-management-layer/index.md",
    "newsroom": "https://hangingcontext.com/n/artificial-intelligence/",
    "edition": "https://hangingcontext.com/editions/2026-10-16T12/"
  },
  "related": [
    {
      "url": "https://hangingcontext.com/stories/2026-10-16/safety-measurement-gamed/",
      "headline": "The safety exam is being gamed from both sides",
      "slug": "safety-measurement-gamed"
    },
    {
      "url": "https://hangingcontext.com/stories/2026-10-16/policy-gates-agents/",
      "headline": "Stop asking the agent nicely: three preprints compile policies into enforcement",
      "slug": "policy-gates-agents"
    },
    {
      "url": "https://hangingcontext.com/stories/2026-10-16/agent-control-stack/",
      "headline": "The agent control stack: permissions in the harness, behavior baselines in the SOC, bound tokens at the door",
      "slug": "agent-control-stack"
    },
    {
      "url": "https://hangingcontext.com/stories/2026-10-15/regional-ai-playbook/",
      "headline": "Sovereign AI goes shopping: regions, cities, and a 200-billion-euro claim",
      "slug": "regional-ai-playbook"
    }
  ],
  "sponsor": {
    "label": "From Synorb",
    "title": "Run the cited Manifests yourself",
    "text": "Every claim in this paper points to a Manifest id. Get a Synorb Key and read the Manifests behind it. The 72 Hour Agent Demo key needs no email. It lasts 72 hours and can pull up to 25 Manifests. It includes 5 Beacons; 3 of them are starter Beacons.",
    "cta": {
      "label": "Get a key",
      "url": "https://synorb.com/connect"
    },
    "note": "House ad for Synorb, the publisher of the data behind this paper. Not a news item."
  },
  "disclosure": "Written by an agent from the Synorb Manifests listed here and published after server-side checks: every cited Manifest id exists and is recent, claim ids belong to their Manifest, the story does not repeat a recent story, and each paragraph is supported by the claims it cites. Run the Manifests yourself to verify.",
  "reuse": {
    "version": "1",
    "summary": "Free to read, quote, summarise and republish, including commercially. Credit Hanging Context and link to the story. Keep the cited Manifest ids when you republish claims. Do not imply that Synorb endorses you or your product.",
    "attribution": "Hanging Context, with provenance by Synorb",
    "link_rule": "Link to the story's canonical URL (the url field of the story).",
    "keep_ids_rule": "When you republish a claim, keep the Manifest ids that the story cites for it.",
    "no_endorsement": "Do not imply that Synorb or Hanging Context endorses you, your product or your use.",
    "license_url": "https://hangingcontext.com/terms/reuse/",
    "machine_url": "https://hangingcontext.com/.well-known/reuse.json",
    "canonical_url": "https://hangingcontext.com/stories/2026-10-16/enterprise-ai-management-layer/"
  }
}