Skip to main content
Data Engineering11 min read

Data Pipelines Are Becoming the Control Plane for AI Agents

Fivetran and dbt Labs have completed their merger, positioning the combined company around data infrastructure for trusted AI agents. For engineering leaders, the bigger signal is clear: agentic AI will depend less on flashy interfaces and more on maintainable ingestion, transformation, lineage, and quality systems.

AI agents are only as useful as the data they can safely use. If an agent is expected to answer business questions, trigger workflows, recommend code changes, or automate operational decisions, the real question becomes: can it trust the data plane underneath it?

That is why the completed merger of Fivetran and dbt Labs matters beyond the data engineering world. As announced in the dbt Blog post, “Fivetran + dbt Labs Complete Merger to Create the Data Infrastructure for Trusted AI Agents”, the combined company is explicitly framing its mission around building the data foundation for the agentic AI era. For developers, platform teams, and CTOs, this is a signal that data pipelines are becoming a control plane for AI-enabled software and business operations.

The merger is about more than vendor consolidation

Data Pipelines Are Becoming the Control Plane for AI Agents
Data Pipelines Are Becoming the Control Plane for AI Agents

Fivetran and dbt Labs occupy two critical parts of the modern data stack. Fivetran is widely known for automated data movement and ingestion: extracting data from operational systems, SaaS tools, databases, and event sources into analytical platforms. dbt Labs is closely associated with analytics engineering: transforming raw data into modeled, tested, documented, and reusable datasets.

The merger brings ingestion and transformation closer together under one organizational umbrella. That alone is significant, but the strategic framing is even more important. The announcement positions the combined company as building data infrastructure for trusted AI agents, not just dashboards, warehouses, or analytics teams.

That framing reflects a broader shift. In the last decade, data pipelines mostly served human consumers: analysts, executives, finance teams, product managers, and customer success leaders. Today, those pipelines increasingly serve software consumers as well: AI agents, copilots, automation systems, retrieval-augmented generation pipelines, and decision engines.

When software begins acting on data instead of merely displaying it, the standards change. Stale data, undocumented transformations, duplicated metrics, and unclear lineage are no longer just reporting annoyances. They become automation risks.

Why agentic AI raises the bar for trusted data

Traditional analytics workflows are relatively forgiving. If a dashboard shows a strange number, a human analyst can pause, investigate, and ask follow-up questions. In an agentic workflow, the system may summarize the number, recommend a course of action, create a ticket, update a customer record, or trigger another process.

That makes trust boundaries more important.

An AI agent needs to know not only what data is available, but also whether that data is complete, current, governed, and appropriate for the task. It needs context about definitions, joins, ownership, freshness, and lineage. Without that context, agents can amplify the same data quality issues that already frustrate analytics teams.

Common examples include:

  • A revenue agent using a deprecated bookings table because it still exists in the warehouse
  • A support automation workflow relying on stale customer health scores
  • An engineering productivity assistant misinterpreting issue tracker fields because custom workflows are undocumented
  • A finance agent combining actuals and forecasts without understanding transformation logic
  • A product analytics agent recommending roadmap changes from incomplete event data

These are not model problems alone. They are data maintenance problems.

Data technical debt becomes AI technical debt

Many organizations already carry significant data technical debt: inconsistent ingestion patterns, one-off scripts, unclear ownership, fragile transformations, duplicated metrics, undocumented business logic, and manual quality checks. Before AI agents, that debt often surfaced as slow reporting cycles or stakeholder mistrust.

In agentic systems, the same debt becomes operational risk.

If an agent is connected to a messy data environment, it can produce confident but unreliable answers. Worse, it may take action based on those answers. This is why the Fivetran and dbt Labs merger lands at an important moment. The combined emphasis on ingestion and transformation maps directly to the maintenance work teams must do before they can safely expand AI-assisted workflows.

Modernization is not just about migrating to a newer warehouse or adopting a new orchestration tool. It is about making data assets reliable enough to be consumed by both humans and machines.

That requires engineering discipline across the full lifecycle:

  • Standardized data ingestion
  • Version-controlled transformations
  • Automated testing and validation
  • Clear lineage from source to model to consumer
  • Documented ownership and definitions
  • Observability around freshness, volume, schema, and quality
  • Deprecation strategies for outdated models and metrics

In other words, the future of AI agents depends on many of the same practices that software teams already apply to maintainable application code.

Pipelines as the control plane for AI agents

A control plane is where policies, routing, configuration, permissions, and operational decisions are coordinated. In cloud infrastructure, the control plane determines how resources are provisioned and managed. In Kubernetes, it coordinates desired state. For AI agents, data pipelines increasingly play a similar role.

They determine what an agent can see, how information is shaped, which definitions are trusted, and whether outputs are grounded in governed datasets.

This does not mean every agent needs direct access to a warehouse. In many cases, agents will interact through semantic layers, APIs, vector indexes, feature stores, or application services. But all of those interfaces still depend on upstream data pipelines being correct and maintainable.

The ingestion layer defines what enters the analytical ecosystem. The transformation layer defines what that data means. The lineage layer explains where it came from and how it changed. The quality layer determines whether it is safe to use. Together, these layers become the practical boundary between useful automation and unreliable automation.

That is the deeper implication of bringing Fivetran-style ingestion and dbt-style transformation together around trusted AI agents.

Lineage is no longer just for debugging dashboards

Lineage has historically been treated as a data engineering convenience. It helps teams understand what breaks when a source changes, which dashboards depend on a table, and how metrics are produced. In an AI-enabled environment, lineage becomes a safety feature.

If an agent produces a recommendation, teams need to answer questions such as:

  • Which source systems informed this answer?
  • Which transformations were applied?
  • Was the dataset fresh enough for this task?
  • Were any upstream tests failing?
  • Is this metric still approved for use?
  • Who owns the model or data product?

Without lineage, agent outputs are difficult to audit. With lineage, teams can trace recommendations back to data sources, transformation logic, and quality checks. That traceability is essential for regulated industries, financial workflows, customer-facing automation, and any environment where AI decisions need to be explained.

For CTOs, this should influence AI architecture decisions. Before connecting agents to operational workflows, evaluate whether your data estate can support investigation, rollback, and accountability.

Analytics maintenance becomes a platform concern

The merger also reinforces a trend that many engineering organizations are already experiencing: analytics is becoming part of the software platform.

Historically, application teams owned production systems while data teams owned reporting environments. AI blurs that boundary. Agents may need application data, product telemetry, customer interactions, billing records, CRM history, support tickets, and internal documentation. They may also feed insights back into product experiences or business processes.

That makes analytics maintenance a platform engineering concern, not just a BI concern.

Teams should treat important datasets more like production services. That means applying software maintenance practices such as code review, automated tests, dependency management, release planning, observability, and deprecation policies. Data models that power executive dashboards, customer health workflows, fraud detection, or AI agents deserve the same operational rigor as APIs.

At Vibgrate, we see this as part of the broader modernization challenge: organizations cannot safely layer advanced automation on top of brittle legacy foundations. Whether the legacy system is a monolith, an outdated dependency tree, or an ungoverned data pipeline, the pattern is the same. Modern capabilities require maintainable infrastructure underneath.

Practical implications for engineering teams

The Fivetran and dbt Labs merger does not mean every team needs to immediately change tools. It does mean engineering leaders should reassess how ready their data foundation is for agentic workflows.

1. Inventory the datasets agents are likely to use

Start with the obvious candidates: customer data, product usage, financial metrics, support history, incident data, engineering delivery metrics, and sales pipeline information. Identify which datasets are already trusted and which are informally used but poorly governed.

For each dataset, ask:

  • Who owns it?
  • How fresh is it?
  • What are its upstream dependencies?
  • Are transformations version controlled?
  • Are tests in place?
  • Is there a canonical definition?
  • Is it safe for automated decision-making?

This inventory often reveals that the datasets most attractive for AI workflows are also the ones with the most accumulated technical debt.

2. Consolidate ingestion patterns

Unmanaged ingestion is a common source of fragility. Teams accumulate custom scripts, ad hoc exports, manually scheduled jobs, and overlapping connectors. This creates inconsistent schemas, hidden dependencies, and unclear failure modes.

Modernization should include standardizing how data enters the analytical environment. Whether you use Fivetran, another managed ingestion platform, open-source connectors, or internal tooling, the goal is consistency: predictable sync behavior, schema change handling, monitoring, and ownership.

3. Treat transformations as code

Transformation logic is business logic. If it defines revenue, churn, activation, account health, or engineering throughput, it should be reviewed, tested, documented, and versioned.

This is one reason dbt became influential: it helped bring software engineering practices into analytics workflows. For AI agents, this discipline becomes even more important. Agents need stable, well-defined data products, not a warehouse full of ambiguous tables.

4. Add data quality gates before agent access

Do not let agents consume critical datasets without automated validation. At minimum, teams should monitor freshness, volume anomalies, null rates, uniqueness, referential integrity, accepted values, and schema drift.

Quality gates should be tied to access and workflow design. If a critical upstream test fails, an agent should either avoid using the dataset, warn the user, or fall back to a safer mode. This is similar to circuit breaker patterns in application architecture.

5. Make lineage visible to developers, not just data teams

If developers are building AI-powered features, they need visibility into the data dependencies behind those features. Lineage should not be locked away in a data team tool that application engineers never see.

Expose lineage through documentation, catalogs, pull request checks, or internal developer portals. When a schema change could affect an agent or downstream workflow, developers should know before production breaks.

6. Create a deprecation process for data assets

Old tables and metrics are dangerous when agents can discover and use them. If deprecated datasets remain accessible without clear warnings, they may be treated as valid context.

Establish a lifecycle for data assets: experimental, certified, deprecated, and retired. Make the status machine-readable where possible so tools and agents can distinguish between approved and risky sources.

What CTOs should watch next

The combined Fivetran and dbt Labs company is positioning itself around the data foundation for trusted AI agents. Whether or not your organization uses either platform, the direction is important: the modern data stack is being reinterpreted as AI infrastructure.

CTOs should watch for three developments.

First, expect tighter integration between ingestion, transformation, lineage, observability, and governance. Fragmented data workflows are harder to operate when agents depend on them.

Second, expect semantic layers and governed metrics to become more important. Agents need shared business definitions, not just raw access to tables.

Third, expect data maintenance to become part of AI risk management. The reliability of agentic systems will depend on the reliability of the data supply chain.

The modernization mandate: make trusted data maintainable

The Fivetran and dbt Labs merger is a milestone because it reflects where the industry is heading. Agentic AI will not be powered by prompts alone. It will be powered by data infrastructure that can deliver trusted, explainable, and maintainable context.

For engineering teams, the path forward is practical: reduce data technical debt, standardize ingestion, treat transformations as code, invest in lineage, and enforce quality gates before automation depends on the results. The organizations that do this well will be better positioned to use AI agents safely—not as experimental side projects, but as reliable extensions of their software and business systems.

Vibgrate CLI

See a real scan run

A replay of the actual CLI running against our test repositories — live progress, real findings, a genuine DriftScore. Nothing executes in your browser.

Replay
demo@vibgrate — bash
❯ npx @vibgrate/cli scan
 
╭──────────────────────────────────────────╮
│ Vibgrate Drift Report │
╰──────────────────────────────────────────╯
 
── node-turborepo (node) .
Runtime: >=18.0.0 (6 majors behind)
Frameworks:
Turbo: 1.13.4 → 2.11.8 (1 behind)
TypeScript: 5.9.3 → 7.0.2 (2 behind)
Dependencies:
1 current 1 1-behind 3 2+ behind 1 unknown
 
── @repo/admin (node) apps/admin
Frameworks:
TanStack Query: 5.104.2 → 5.104.2 (current)
React: 18.3.1 → 19.3.0 (1 behind)
React DOM: 18.3.1 → 19.3.0 (1 behind)
TypeScript: 5.9.3 → 7.0.2 (2 behind)
Vite: 5.4.21 → 8.3.4 (3 behind)
Dependencies:
3 current 9 1-behind 3 2+ behind 4 unknown
 
── @repo/api (node) apps/api
Frameworks:
Express: 4.22.3 → 5.3.0 (1 behind)
TypeScript: 5.9.3 → 7.0.2 (2 behind)
Vitest: 1.6.1 → 5.0.4 (4 behind)
Dependencies:
7 current 4 1-behind 4 2+ behind 4 unknown
 
── @repo/web (node) apps/web
Frameworks:
Next.js: 14.2.35 → 16.4.0 (2 behind)
React: 18.3.1 → 19.3.0 (1 behind)
React DOM: 18.3.1 → 19.3.0 (1 behind)
TypeScript: 5.9.3 → 7.0.2 (2 behind)
Dependencies:
2 current 6 1-behind 3 2+ behind 5 unknown
 
── @repo/config (node) packages/config
Frameworks:
TypeScript: 5.9.3 → 7.0.2 (2 behind)
Dependencies:
2 current 2 1-behind 5 2+ behind 0 unknown
 
── @repo/database (node) packages/database
Frameworks:
Prisma: 5.22.0 → 7.10.0 (2 behind)
TypeScript: 5.9.3 → 7.0.2 (2 behind)
Dependencies:
1 current 0 1-behind 3 2+ behind 1 unknown
 
── @repo/types (node) packages/types
Frameworks:
TypeScript: 5.9.3 → 7.0.2 (2 behind)
Dependencies:
0 current 0 1-behind 1 2+ behind 1 unknown
 
── @repo/ui (node) packages/ui
Frameworks:
React: 18.3.1 → 19.3.0 (1 behind)
TypeScript: 5.9.3 → 7.0.2 (2 behind)
React: 18.3.1 → 19.3.0 (1 behind)
Dependencies:
1 current 4 1-behind 1 2+ behind 1 unknown
 
── @repo/utils (node) packages/utils
Frameworks:
TypeScript: 5.9.3 → 7.0.2 (2 behind)
Vitest: 1.6.1 → 5.0.4 (4 behind)
Dependencies:
0 current 1 1-behind 2 2+ behind 1 unknown
 
Tech Stack
Frontend: React, React DOM
Meta-frameworks: Next.js
Bundlers: tsx, Turbo, Vite
CSS / UI: Autoprefixer, PostCSS, Tailwind CSS
Backend: Express
ORM / Database: Prisma, Prisma Client
Testing: Vitest
Lint & Format: ESLint, ESLint Prettier, ESLint React, Prettier, typescript-eslint
 
Services & Integrations
Auth: JWT 9.0.3
Databases: Prisma 5.22.0
 
TypeScript
v5.3.3 · strict ✔ · MIXED · target: ES2022
 
Build & Deploy
Package Managers: pnpm
Monorepo: npm-workspaces, pnpm-workspaces, turbo
 
Product Purpose Signals
Frameworks: react, nextjs
Evidence: 177
Top Signals:
- [heading] Dashboard (apps/admin/src/pages/Dashboard.tsx)
- [title] Revenue Overview (apps/admin/src/pages/Dashboard.tsx)
- [copy] workspace:* (packages/ui/package.json)
- [copy] ./dist (packages/ui/tsconfig.json)
- [copy] ./src/index.ts (packages/ui/package.json)
- [copy] @repo/config/tsconfig-base.json (packages/ui/tsconfig.json)
- [copy] @repo/ui (packages/ui/package.json)
- [copy] #3b82f6 (apps/admin/src/pages/Dashboard.tsx)
Unknowns:
- No pricing or billing evidence found.
- No integrations/connectors evidence found.
- No route structure evidence found.
 
Security Posture
Lockfile ✖ · .env ✔ · node_modules ✔
 
Platform
Native modules: turbo
 
Code Quality
Files: 36 · Functions: 183 · Avg complexity: 2.62 · Avg length: 21.13 lines
Max nesting: 2 · Circular deps: 0 · Dead code: 0%
God files: apps/admin/src/pages/Products (448 lines)
 
Database Schema
postgresql · 8 models · 1 enum
Models: Address, CartItem, Category, Order, OrderItem (+3 more)
 
Findings (16 errors, 11 warnings)
✖ @types/node is 6 major versions behind (spec: ^20.11.0, latest: 26.6.5).
vibgrate/dependency-major-lag in .
✖ 60% of dependencies are 2+ major versions behind in node-turborepo.
vibgrate/dependency-rot in .
✖ Node.js runtime ">=18.0.0" reached end-of-life on 2025-04-30 (latest: 24.0.0).
vibgrate/runtime-eol in .
✖ vite is 3 major versions behind (spec: ^5.0.12, latest: 8.3.4).
vibgrate/dependency-major-lag in apps/admin
✖ Vite is 3 major versions behind (current: 5.4.21, latest: 8.3.4).
vibgrate/framework-major-lag in apps/admin
✖ @types/node is 6 major versions behind (spec: ^20.11.0, latest: 26.6.5).
vibgrate/dependency-major-lag in apps/api
✖ vitest is 4 major versions behind (spec: ^1.2.1, latest: 5.0.4).
vibgrate/dependency-major-lag in apps/api
✖ Vitest is 4 major versions behind (current: 1.6.1, latest: 5.0.4).
vibgrate/framework-major-lag in apps/api
✖ @types/node is 6 major versions behind (spec: ^20.11.0, latest: 26.6.5).
vibgrate/dependency-major-lag in apps/web
✖ eslint-plugin-react-hooks is 3 major versions behind (spec: ^4.6.0, latest: 7.1.1).
vibgrate/dependency-major-lag in packages/config
✖ 56% of dependencies are 2+ major versions behind in @repo/config.
vibgrate/dependency-rot in packages/config
✖ 75% of dependencies are 2+ major versions behind in @repo/database.
vibgrate/dependency-rot in packages/database
✖ 100% of dependencies are 2+ major versions behind in @repo/types.
vibgrate/dependency-rot in packages/types
✖ vitest is 4 major versions behind (spec: ^1.2.1, latest: 5.0.4).
vibgrate/dependency-major-lag in packages/utils
✖ 67% of dependencies are 2+ major versions behind in @repo/utils.
vibgrate/dependency-rot in packages/utils
✖ Vitest is 4 major versions behind (current: 1.6.1, latest: 5.0.4).
vibgrate/framework-major-lag in packages/utils
⚠ TypeScript is 2 major versions behind (current: 5.9.3, latest: 7.0.2).
vibgrate/framework-major-lag in .
⚠ TypeScript is 2 major versions behind (current: 5.9.3, latest: 7.0.2).
vibgrate/framework-major-lag in apps/admin
⚠ TypeScript is 2 major versions behind (current: 5.9.3, latest: 7.0.2).
vibgrate/framework-major-lag in apps/api
⚠ Next.js is 2 major versions behind (current: 14.2.35, latest: 16.4.0).
vibgrate/framework-major-lag in apps/web
⚠ TypeScript is 2 major versions behind (current: 5.9.3, latest: 7.0.2).
vibgrate/framework-major-lag in apps/web
⚠ TypeScript is 2 major versions behind (current: 5.9.3, latest: 7.0.2).
vibgrate/framework-major-lag in packages/config
⚠ Prisma is 2 major versions behind (current: 5.22.0, latest: 7.10.0).
vibgrate/framework-major-lag in packages/database
⚠ TypeScript is 2 major versions behind (current: 5.9.3, latest: 7.0.2).
vibgrate/framework-major-lag in packages/database
⚠ TypeScript is 2 major versions behind (current: 5.9.3, latest: 7.0.2).
vibgrate/framework-major-lag in packages/types
⚠ TypeScript is 2 major versions behind (current: 5.9.3, latest: 7.0.2).
vibgrate/framework-major-lag in packages/ui
⚠ TypeScript is 2 major versions behind (current: 5.9.3, latest: 7.0.2).
vibgrate/framework-major-lag in packages/utils
 
╭──────────────────────────────────────────╮
│ Top Priority Actions │
╰──────────────────────────────────────────╯
 
1. Upgrade EOL runtime in node-turborepo
End-of-life runtimes no longer receive security patches and block ecosystem upgrades.
./.
>=18.0.0 → 24.0.0 (6 majors behind)
Impact: −10 drift points (runtime & EOL)
 
2. Fix security posture: no lockfile found
Without a lockfile, installs are non-deterministic. Run the install command to generate one and commit it.
./
Missing: package-lock.json, pnpm-lock.yaml, or yarn.lock
 
3. Upgrade Vitest 1.6.1 → 5.0.4 in @repo/api (+2 more)
4 major versions behind. Major framework drift increases breaking change risk and blocks access to security fixes and performance improvements.
./apps/api
Vitest: 1.6.1 → 5.0.4 (4 majors behind)
./packages/utils
Vitest: 1.6.1 → 5.0.4 (4 majors behind)
./apps/admin
Vite: 5.4.21 → 8.3.4 (3 majors behind)
Impact: −5–15 drift points
 
4. Reduce dependency rot in @repo/types (100% severely outdated)
1 of 1 dependencies are 2+ majors behind. Run `npm outdated` and prioritise packages with known CVEs or breaking API changes.
./packages/types
typescript: 5.9.3 → 7.0.2 (2 majors behind)
Impact: −5–10 drift points
 
5. Reduce dependency rot in @repo/database (75% severely outdated)
3 of 4 dependencies are 2+ majors behind. Run `npm outdated` and prioritise packages with known CVEs or breaking API changes.
./packages/database
@prisma/client: 5.22.0 → 7.10.0 (2 majors behind)
prisma: 5.22.0 → 7.10.0 (2 majors behind)
typescript: 5.9.3 → 7.0.2 (2 majors behind)
Impact: −5–10 drift points
 
╭──────────────────────────────────────────╮
│ Architecture Layers │
╰──────────────────────────────────────────╯
 
Archetype: nextjs (80% confidence)
Files classified: 24 (11 unclassified)
Folders classified: 8
apps/admin/src presentation 100% 4 files
apps/admin/src/pages presentation 100% 2 files
apps/api/src/middleware middleware 100% 2 files
apps/api/src/routes routing 100% 2 files
apps/web/src/app presentation 100% 4 files
apps/web/src/app/products presentation 100% 2 files
apps/web/src/app/products/[id] presentation 100% 1 file
packages/ui/src presentation 100% 6 files
Unclassified source (sample): 11
 
presentation 15 files drift ████████████████████ 100 risk high
routing 4 files drift ████████████████████ 100 risk high
middleware 2 files drift ███████▍░░░░░░░░░░░░ 37 risk moderate
config 2 files drift ░░░░░░░░░░░░░░░░░░░░ 0 risk none
shared 1 file drift ████████████████████ 100 risk high
 
╭──────────────────────────────────────────╮
│ DriftScore Summary │
╰──────────────────────────────────────────╯
 
DriftScore: 70/100
Risk Level: HIGH
Projects: 9
Classified: 8 nano · 1 micro · 0 small · 0 standard
Billable: 0.42 · 9 detected → 0.42 billable projects (micro-project pricing)
0.1 micro · 0.32 nano
These fractions add up across repositories, then round down to whole billable projects.
 
Score Breakdown
Runtime: ████████████████████ 100
Frameworks: ███████████▊░░░░░░░░ 59
Dependencies: ██████▌░░░░░░░░░░░░░ 33
EOL Risk: ████████████████████ 100
 
Scanned at 2026-10-14T06:07:19.277Z · 5.4s · 286 files scanned · 56 workspace files · 27 dirs
❯
Press Run to start.