IBM and Confluent Bring AI Forecasting Directly Into Live Data Streams
A new partnership lets businesses run AI predictions on data as it arrives, without a data science team or months of setup.
Key points
- IBM's Granite Time Series models, which have logged more than 44 million downloads, are now in Early Access on Confluent Cloud.
- The models run inside Apache Flink, a tool that processes streaming data in real time, so forecasts happen at the moment business conditions change.
- Teams can call the models using standard SQL, a common database language, with a single line of code and one parameter to switch between models.
- IBM tested these models in its own operations and with partners in cement, steel, food manufacturing and telecoms before public release.
- Productivity gains from pilot deployments ran 5 to 10 times compared to previous approaches, according to IBM.
Most AI tools work on stored data: you gather it, clean it, run a model, and read a report. By the time the report lands, the moment it described has already passed.
IBM and Confluent are trying to close that gap. Their new partnership, first detailed on Hugging Face, puts IBM's Granite Time Series models, a family of AI models trained to understand how measurements change over time, directly inside Confluent's data streaming platform. The result: a forecast or an anomaly alert at the exact second the data arrives, not hours later.
What does this actually do for a business?
It lets one AI model watch thousands of data streams at once and flag problems or predict outcomes without anyone having to build a custom model for each stream.
Take a chocolate factory. A single production line sends temperature, speed and output readings every few seconds. Today, a team might watch those readings against fixed thresholds: if the temperature crosses a set number, an alarm fires. The problem is that fixed thresholds miss slow drifts. A line can creep toward a bad run for hours and never trip a single alarm until product quality fails.
Drop a Granite Time Series model into that stream and the picture changes. The model forecasts what the line will produce through the evening shift. It scores today's run against how the line normally behaves on dark chocolate, so a gradual drift surfaces early. It can even search plant history to find the last time conditions looked similar and tell the engineer how that run ended.
No data scientist required. The demand planner or process engineer who already owns that decision can set it up themselves.
How does the technical side work?
Confluent's platform moves business data continuously between systems, the way pipes move water. Apache Flink, a processing engine that sits inside Confluent Cloud, handles the moment-to-moment computation.
The four Granite Time Series models slot directly into Flink and are called through two existing SQL functions: AI_FORECAST and AI_DETECT_ANOMALIES. SQL is the standard language most database tools already use, so teams do not need to learn anything new. Switching from one model to another takes a single parameter change, no pipeline redesign.
| Model focus | What it answers |
|---|---|
| Forecasting (TTM) | What comes next, with a range of outcomes |
| Anomaly detection | When a stream stops behaving normally |
| Similarity search | Which historical pattern looks like this one |
| Optimization | Which settings best hit a target |
All four are in Early Access on Confluent Cloud running on AWS. An on-premises version via Confluent Platform follows.
One privacy point worth noting: data stays inside Confluent Cloud during inference, meaning your sensor readings and business signals do not travel to a third-party model-serving service. Confluent's existing access controls and data governance rules apply throughout.
The other practical upside is cost. Running models this way eliminates the need for dedicated GPU servers, the specialised chips that do the heavy number-crunching AI needs, and there are no fees for moving data in or out of the cloud.
Common questions
Do I need a data science team to use this?
No. IBM and Confluent designed these models for domain experts such as demand planners, fraud analysts and process engineers who can call them directly using standard SQL, without writing custom model code.
Is this available right now?
The models are in Early Access on Confluent Cloud on AWS today. Support for Confluent Platform, which covers on-premises and hybrid setups, is coming next.
What kinds of data can these models handle?
Anything measured over time: electricity load, sensor telemetry, payment transactions, application metrics. IBM piloted the models in cement, steel, food manufacturing, pulp and paper, and telecoms before the public release.
