AI 8 min read

Data Fragmentation Is the Agent Bottleneck

Data fragmentation is not just a warehouse problem. It is whether an agent can find the right record, use the right source, respect permissions, and write back safely.

Chris Fitkin
Chris Fitkin
Partner & Co-Founder

Data fragmentation becomes painful when an agent has to act.

Dashboards can survive a surprising amount of fragmentation. A human can notice when a metric looks wrong, ask someone in Slack, open the contract folder, check the CRM note, and reconcile the answer manually.

Agents do not get that same informal safety net. If the renewal amount is stale in CRM, the contract is in SharePoint, the escalation history is in tickets, the policy exception lives in someone’s email, and the account owner changed last week, the agent either misses context or blends it without knowing which source should win.

IBM’s data governance guidance frames the foundation clearly: data governance is about availability, quality, security, ownership, access rights, and responsibilities. IBM also notes that getting access permissions right is even more important when an AI agent, rather than a human employee, is accessing data.

That is the practical standard for agent readiness. The question is not “Do we have the data?” The question is “Can this workflow use the data correctly, safely, and repeatedly?”

Fragmentation is workflow-specific

A company can have fragmented enterprise data and still be ready for one agent workflow. The review should start with the records, documents, permissions, and write-backs behind that workflow.

The Warehouse Is Not Enough

Most companies already invested in analytics infrastructure. That matters, but agents need operational context, not only reporting data.

A revenue dashboard may summarize pipeline by segment. A deal-risk agent needs the specific account, the current opportunity, the latest buyer email, support incidents, old pricing exceptions, product usage changes, and the rule for whether it can update the forecast note.

A finance dashboard may show AP aging. An invoice-exception agent needs the invoice, PO, receiving record, vendor terms, approval threshold, policy exception, prior dispute history, and evidence that the controller can inspect.

That kind of context cuts across structured and unstructured systems. It also changes quickly.

McKinsey’s 2025 State of AI survey reports that AI use is now widespread, but most organizations have not embedded AI deeply enough into workflows and processes to realize material enterprise-level benefits. Data fragmentation is one reason. AI may be available everywhere, while the context needed to change work remains scattered.

The same point shows up in enterprise architecture commentary. A TechRadar Pro analysis on enterprise AI integration argues that model aggregation does not solve the harder problem of grounding answers in live CRM data, support history, product telemetry, financial records, and compliance policies while respecting permissions and triggering actions inside governed workflows. That is a concise description of the bottleneck: enterprise AI needs integration with the work, not just more places to query.

The Five Fragmentation Tests

Run these tests before building the agent:

Can the agent identify the right object? The workflow may involve an account, contract, invoice, ticket, project, employee, vendor, claim, or asset. If systems disagree on identifiers, the agent will join the wrong context.

Can the agent know which source wins? CRM may have the account tier. The contract may have the legal terms. The support system may have the current escalation state. The policy document may have the rule. Each field needs a source-of-truth decision.

Can the agent respect permissions? UI-level permissions are not enough if retrieval and tool access bypass them. IBM points to role-based access control as a common mechanism for providing access after governance policies are defined.

Can the agent expose evidence? Reviewers need to see which records, documents, and fields shaped the output. Without provenance, review turns into rework.

Can the workflow complete the loop? If a human approves the output but still copies it into CRM, ERP, ticketing, or a document system, the workflow remains fragmented at the final step.

AI data fragmentation test

Use this as a workflow-level data readiness review. Do not score the whole enterprise when one workflow is the unit of value.

Test: Identity

Evidence to inspect
Stable IDs across CRM, ERP, docs, tickets, email, projects, or warehouse records.
Risk if weak
The agent assembles context for the wrong customer, invoice, vendor, or project.

Test: Source of truth

Evidence to inspect
Field-level rules for which system owns amount, status, owner, policy, date, and exception facts.
Risk if weak
The output mixes stale and current facts without knowing which should win.

Test: Permissions

Evidence to inspect
Role-based access paths for both retrieval and tool actions.
Risk if weak
The agent sees or changes information the reviewer should not access.

Test: Provenance

Evidence to inspect
Citations, record links, document versions, and evidence shown beside the recommendation.
Risk if weak
Reviewers redo the research because they cannot trust the output.

Test: Write-back

Evidence to inspect
Approved destinations, state checks, audit events, and rollback paths.
Risk if weak
The workflow produces a useful draft but leaves manual copy-paste in place.

A Context Layer Map

The context layer is the operational bridge between fragmented systems and agentic work.

It is not just a vector database. It is not just an integration layer. It is the set of source rules, permission checks, retrieval paths, evidence surfaces, review gates, and write-back controls that let an agent operate inside a workflow.

Context layer map

Fragmented sources

  • CRM
  • Docs and contracts
  • Email and Slack
  • Tickets and support
  • ERP and finance

Permissioned context layer

  1. 1. Identity and permissions
  2. 2. Retrieval and source rules
  3. 3. Evidence packaging

Workflow action

  1. 1. Agent prepares output
  2. 2. Human reviews evidence
  3. 3. Approved write-back
  4. 4. Audit log and feedback

The map should be drawn for a named workflow. “Enterprise context layer” is too broad. “Renewal brief context layer” or “invoice exception context layer” is concrete enough to build.

Workflow inspection map

Context work is useful only when it changes the output and the record. Use this map to decide where source rules, retrieval evidence, and write-back behavior have to be designed.

Source contract

AI prepares

Which system owns which field

Metric

Conflicting-record rate

Retrieval path

AI prepares

Records, examples, policies, and documents used

Metric

Output acceptance rate

Write-back rule

AI prepares

Where approved work lands

Metric

Manual copy-paste removed

Risks to catch before production

These risks show when the context layer is still too fragile for production. The workflow needs source rules, freshness, and visible evidence before the output can be trusted.

Conflicting truth

Catch early

Signal: CRM, docs, email, and spreadsheets disagree, and the agent blends them together.

Control: Define source-of-truth rules by field and workflow.

Stale retrieval

Catch early

Signal: Outputs degrade after docs, schemas, policies, or customer records change.

Control: Monitor context freshness and retrieval health.

Invisible evidence

Catch early

Signal: Reviewers cannot see which records or policies shaped the recommendation.

Control: Expose the evidence chain in the review surface.

What to Do Next

Pick one workflow where people already spend time reconciling context. Then build a source inventory around that workflow:

  • Required business objects
  • Systems that hold those objects
  • Source-of-truth rules
  • Permission boundaries
  • Evidence the reviewer needs
  • Final write-back destination

That inventory is where the agent project becomes real. The model is the visible part. The context layer is the part that decides whether the output can be trusted.