Skip to main content

Guide · AI agents

How to extract video frames with Claude, ChatGPT, and other AI agents

AI assistants usually cannot download a video link and decode its frames on their own; they need a tool. Connect the GetVideoFrames remote MCP server for public video links, the open-source GVF local MCP for private files, or call the GetVideoFrames REST API from code your agent writes.

By Published Updated

Last reviewed 3 October 2026 against the live GetVideoFrames API and MCP server.

Which tool should my AI agent use to extract frames?

If the video is a public YouTube, TikTok, Instagram, Facebook, X, or Vimeo link, connect the GetVideoFrames remote MCP server: the agent sends the link and receives frame URLs. If the video is a local file that should stay on your machine, run the GVF local MCP. If you are building an app or pipeline, have your coding agent call the REST API at api.getvideoframes.com/v1. The remote MCP and the API share one account and credit balance.

Agent frame extraction options compared

OptionInputBest for
Remote MCP serverPublic video links; processed on GetVideoFrames serversClaude, ChatGPT, Cursor, VS Code, Claude Code chats
GVF local MCPLocal files; processed on your machine with FFmpegPrivate footage, offline agents, smart frame selection
REST APIPublic video links from your own codeApps, pipelines, webhooks, batch jobs

Option 1: Connect the remote MCP server

The remote MCP server exposes the Video Frame API as tools such as getvideoframes_create_job and getvideoframes_get_job. Add the server URL to your client, authorize once with a gvf_live_ API key, and ask for frames in plain language. In Claude Code it is one command:

claude mcp add --transport http getvideoframes https://mcp.getvideoframes.com/mcp

Setup steps for Claude, ChatGPT, Cursor, VS Code, and other clients are on the MCP server page.

MCP setup for every client

Option 2: Run the GVF local MCP for private files

GVF is an open-source (MIT) MCP server and CLI that runs over stdio on your machine. Its recommended tool, gvf_run, samples a local video, scores scenes and sharpness, can detect objects such as people, and exports only the selected frames at full quality. It never uploads video, has no telemetry, and does not use API credits. Install it from source, then register it:

{
  "mcpServers": {
    "gvf": { "command": "gvf-mcp" }
  }
}
GVF on GitHub

Option 3: Have your agent call the REST API

When the agent is writing software rather than chatting, point it at the REST API and its OpenAPI spec. One POST creates a job; wait=true returns the frames in the same response for short videos, and webhook_url notifies your server when longer jobs finish.

curl -X POST https://api.getvideoframes.com/v1/jobs \
  -H "Authorization: Bearer $GVF_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url":"https://www.youtube.com/shorts/VIDEO_ID","every":2,"wait":true}'

The developer dashboard includes a ready-made prompt that teaches a coding agent the endpoints, rate-limit headers, and error types.

Video Frame API docs

What happens when an agent extracts frames

The agent calls the create tool with the link and options, GetVideoFrames downloads the video, extracts the frames with FFmpeg, and returns signed image URLs or a ZIP. URLs expire after the plan's retention period (1 day on free and packs, 7 days on paid plans). To have the model look at a frame, the client must fetch the image: some clients display image URLs automatically, others need you to open or attach them.

Limits to know

The remote MCP and API only accept public links or direct video URLs; private and login-only videos return PrivateContent and are not charged. The free plan covers 60 credits a month, videos up to 10 minutes, 300 frames per job, and 720p frames. Respect each platform's terms and the creator's rights when you extract frames.

FAQ

Frequently asked questions

Can ChatGPT or Claude extract frames from a YouTube video?
Not reliably on their own, because they usually cannot download and decode the video. With the GetVideoFrames MCP server connected, they can: the assistant sends the link and receives frame URLs.
What is the best MCP server for extracting video frames?
For public links, the GetVideoFrames remote MCP works in Claude, ChatGPT, Cursor, VS Code, and Claude Code with OAuth and no install. For local files, the open-source GVF MCP adds scene, sharpness, and object-based selection without uploading video.
Is there a free API for extracting frames from YouTube or TikTok links?
Yes. GetVideoFrames gives every account 60 free API credits a month; one credit is one minute of processed video. Failed jobs are not charged.
Can an AI agent extract frames from a video on my computer?
Yes, with the GVF local MCP. It runs on your machine and processes local files with FFmpeg. The remote MCP cannot read local files.