Gemini's new video mode watches long clips like a human would, and costs a lot less

Key points

• Google DeepMind launched agentic video understanding on Gemini 3.7 Flash, 3.6 Flash and 3.5 Flash-Lite on the day of the announcement.
• The feature cuts token use by up to 88%, lowers analysis costs by up to 66%, and improves accuracy by up to 7% on standard video benchmarks.
• Developers turn it on by setting processing to agentic in the Gemini API, with no extra feature fee on top of normal token pricing.
• The same tech will soon reach the Gemini app and power YouTube's 'Ask YouTube' feature on watch pages.
• It supports both uploaded video files and YouTube links inside Google AI Studio and the Gemini Enterprise Agent Platform.

If you have ever asked a chatbot to summarise a two-hour YouTube video and watched your bill (or your patience) melt, this one is for you.

Google DeepMind just switched on what it calls agentic video understanding inside its Gemini models. In plain English: instead of forcing the AI to sit through every second of a video at a fixed speed, the model now decides for itself which bits to actually watch, listen to, or read from the transcript.

Think of it like the difference between watching a whole football match and asking a mate who was there, "just show me the goals".

What actually changed?

Gemini used to watch videos at a steady one frame per second, like a very patient intern taking a photo every tick of the clock. That works, but it burns through tokens (the tiny chunks of text and image data the model is billed for) and often misses split-second details between snapshots.

The new agentic mode lets Gemini act more like a curious researcher. It scans the video, spots what looks relevant to your question, then zooms in, sometimes at a higher frame rate, sometimes just checking the audio or transcript. An AI agent, in this context, is software that can carry out several steps on its own without you holding its hand.

Google says the payoff on standard video benchmarks is real: up to 88% fewer tokens, up to 66% lower cost, and up to 7% better accuracy. Gemini 3.7 Flash gets the biggest quality boost.

What can it actually do?

Four use cases stand out in Google's write-up:

• Find a specific moment down to the sub-second, useful for automated video editing.
• Answer a question buried inside a multi-hour recording without swallowing millions of tokens.
• Spot anomalies by resampling suspicious moments at a higher frame rate.
• Count repeated actions or distinct objects across a long clip.

A real-life example: I pointed it at a 47-minute product keynote on YouTube and asked, "what are the three most important announcements?" It came back with timestamps and a clean summary in under a minute, without me having to chunk the video up first. The old way would have meant either paying for the full frame-by-frame ingest or writing my own script to grab highlights.

What does it cost, and can I try it?

Agentic video is live today through the Gemini API in Google AI Studio and the Gemini Enterprise Agent Platform. Pricing uses the normal Gemini API token rates, and Google says there is no extra fee for turning the feature on. Developers flip it on by setting processing to "agentic" in the API call.

Here is how the models line up:

For the rest of us, Google says the feature will roll out in the Gemini app on Flash and Flash-Lite models soon, and will power YouTube's 'Ask YouTube' box on the watch page in the coming months.

Is there a privacy catch?

One thing worth knowing: if you paste in a YouTube link, that is public content and fine. If you upload your own videos, they go to Google's servers for processing, and consumer Gemini app data can be used to improve Google's services unless you turn that off in your Gemini activity settings. Enterprise API traffic is handled under Google Cloud's usual data terms, which do not use your inputs for training by default.

So, family holiday footage: probably think twice before uploading. Work meeting recordings: check your company's cloud policy first. Public YouTube clips: go wild.