AI Models & Generation

Video to Prompts: 20 Templates for Reference Clips

ChatCut Team
20 min read
Video to Prompts: 20 Templates for Reference Clips
Contents
  1. What you get from video to prompts
  2. Describe a clip in five steps
  3. Choose an analysis method
  4. Prompts to extract the evidence
  5. Prompts for motion and style
  6. Prompts for different reference formats
  7. Prompts to reuse and refine
  8. Generate a new shot or recreate the reference

To turn a video into prompts, take one shot at a time, write down its subject, action, setting, camera movement, light and ending, check each detail against playback, then rewrite the notes as a prompt a video generator can use. No tool can recover the original prompt, model or settings; what you get is a checked description you can reuse. This guide covers video to prompts by hand, with Gemini, ChatGPT or Claude, and with five dedicated tools, then gives you 20 copyable templates.

What you get from video to prompts

The useful output is a brief for a new video, built from three kinds of notes that you keep apart:

  • Observations you can point to in the clip: a hand picks up a cup at 0:03.
  • Inferences that need checking: the hand probably turned the cup while it was out of frame.
  • New directions for your version: make the cup green.

The flow is reference clip → timestamped observations → a checked shot prompt → generate a new shot or recreate the reference. Pick a starting point:

  • Watch it yourself when you can describe the scene and want control over every detail.
  • Ask a multimodal assistant when you want a structured first draft and can upload the clip or ordered screenshots.
  • Use a dedicated extractor when a ready-made upload form suits your file. Check its draft as strictly as your own notes.

Only upload and adapt clips you have permission to use, and keep your viewing notes next to the final prompt so you can trace any doubtful detail back to the source.

Describe a clip in five steps

  1. Choose one scene. Note its start and end time. Leave other locations and actions for later prompts.
  2. Watch the opening, the action and the ending. Note what changes and what stays fixed. Listen separately if sound matters.
  3. Log evidence and gaps. Write down timestamps, unreadable text, hidden actions and anything you can’t hear. Leave missing details as unknown.
  4. Decide what to keep. Separate the action, framing or palette you want from the people, products and wording you’ll replace.
  5. Write one prompt per shot. Check every instruction against playback or your own plan. Delete guessed equipment, focal lengths and model names.

Fill in this worksheet for each shot, using your own timestamps rather than ones an assistant made up.

FieldYour notes
Source rangeStart and end time
Subject and actionOpening → action → ending
SettingPlace and visible objects
Framing and cameraComposition; moving or locked
Light and colorDirection, shadows, main colors
End stateFinal pose or composition
UnknownsTimestamp of each uncertain detail

Worked example: a cup on a table

Imagine a yellow ceramic cup on a blue tabletop. A hand rotates it and lets go with the handle facing right. The camera stays fixed in a medium close shot, and soft light comes from the left. (This is an invented teaching example.)

  • Observed: the cup, the tabletop, the hand’s action, the fixed camera, the light direction and where the handle ends up.
  • Unknown: lens, camera model, original prompt and soundtrack. Leave them out.
  • Your change: a green cup instead of yellow, noted as your choice.
Try this promptOpen in ChatCut
One continuous medium close shot of a yellow ceramic cup on a blue tabletop. A hand rotates the cup until its handle faces right, then lets go. The camera stays locked and the tabletop stays still. Soft light from the left of frame. End with the cup at rest, handle facing right.

Duration and aspect ratio are settings you choose in your generator, not measurements of the reference. Before adding anything else, check that the action, the camera instruction and the ending agree with each other.

Take your checked shot description into a video project.Download DesktopDownload for macOSDownload for WindowsDownload ChatCut Desktop

Choose an analysis method

Gemini with the clip attached

Gemini can analyze uploaded videos once you’re signed in. As of November 12, 2026, Google’s help page lists up to 5 minutes of video in total, or 1 hour with Google AI Pro or Ultra. Start with a short scene, attach the file, and use template 1. Check its timestamps against playback yourself.

ChatGPT with an attachment

OpenAI says ChatGPT accepts video files through supported upload methods, with availability depending on account, platform and upload method. The same page warns that its analysis can be incomplete or inaccurate. Ask what it could actually inspect before you trust the description, and use template 4 if you’re working from screenshots. Our guide to ChatGPT video analysis explains the input options.

Claude with ordered screenshots

Claude’s upload documentation lists image formats, not video files, so give it ordered screenshots labeled with their source times, plus a transcript or audio notes if sound matters. Use template 4. A change between two frames shows that something moved, not exactly how the camera got there.

Dedicated video-to-prompt tools

We read each vendor’s page on November 12, 2026 but didn’t upload clips, so this compares the inputs they list, not output quality, speed, privacy or free allowances.

ToolListed inputCheck before use
videotoprompt.orgFiles up to 20 MB; YouTube Shorts and youtu.be linksOther social links
videotoprompt.comMP4, WebM or MOV, max 50 MBOutput quality
DeeVidMP4 or MOV under 60 seconds; social video URLWhich sites work
ImaginPromptExtracts 6 keyframes in your browserGaps between frames
Vora (Fineshare)File or link, optional contextLimits and processing

ImaginPrompt’s keyframes are taken locally, but that alone doesn’t tell you where the rest of the analysis happens. Read each service’s current terms before uploading.

How we chose these methods

ChatCut publishes this guide. We picked methods by their documented inputs and how easily you can check what they return, and we didn’t benchmark extraction accuracy or generation quality. ChatCut doesn’t have a one-click video-to-prompt extractor; it appears below as a place to generate or recreate the result.

Prompts to extract the evidence

Paste a template into the assistant with the inputs it lists, adding any notes below the template. Templates 1–15 are analysis requests; only the shot prompt they produce goes into a video generator. We wrote these templates for this guide and haven’t benchmarked them.

1. Analyze one whole clip

Use when: you need a first description of a short reference. Input: the clip, attached as a video.

Try this promptOpen in ChatCut
Analyze the attached clip to help me write prompts for a new video. First tell me whether you can inspect its picture, timing and audio, and which parts you can't access. List each shot with timestamps, subject, action, setting, framing, camera movement, light and visible text, and mark anything uncertain. Then write one standalone generation prompt per shot using only what you observed. Don't present anything as the clip's original prompt.

Check: replay the moments it names. Delete audio descriptions it couldn’t have heard and events it couldn’t see.

2. List prompts shot by shot

Use when: the reference has several shots you want to adapt separately. Input: the clip, or ordered frames with timestamps.

Try this promptOpen in ChatCut
Make a shot list from this reference. For each shot, give the source time range, opening composition, main action, camera instruction and final state. If you only have sampled frames, mark the gaps you didn't see and any uncertain cut times. Keep observations separate from suggested additions. End with a self-contained prompt for each shot, repeating the appearance and setting details needed for continuity.

Check: a guessed cut between two screenshots shouldn’t turn into an exact timestamp.

3. Organize your own viewing notes

Use when: you’ve watched the clip and want to turn your notes into a brief. Input: your notes, pasted below the template.

Try this promptOpen in ChatCut
Organize my viewing notes below into one record per shot: source range, subject, opening state, action, setting, framing, camera movement, light, color and ending. Write unknown in any field my notes don't cover, and list what I should rewatch. Write a plain-language shot prompt from the completed fields, and put my proposed changes in a separate list. Add no guessed dialogue, equipment or brands.

Check: every filled field should come from your notes. Anything the assistant added is a creative choice for you to approve.

4. Work from timestamped screenshots

Use when: you’re using ChatGPT or Claude with images. Input: ordered screenshots labeled with source times, plus a transcript if you have one.

Try this promptOpen in ChatCut
Treat these ordered screenshots and their source timestamps as samples of a video. Describe each frame, then list what differs between frames. Label any suggested motion as a guess and mark every interval you can't see. Don't invent continuous action, exact cut times or sound. Write a careful prompt for one new shot based on the composition, subject and light you can see, with any suggested movement as a separate optional line.

Check: a subject that looks bigger could mean the camera moved, the subject moved or the lens zoomed. Leave camera movement unknown until playback confirms it.

5. Audit an extractor’s description

Use when: a tool returned a polished prompt you haven’t checked. Input: the reference and the tool’s draft.

Try this promptOpen in ChatCut
Check the draft prompt below against the attached reference. Label each detail observed, inferred, contradicted or unknown, with the timestamp or frame where you can. Pay attention to action between frames, camera movement, lens claims, on-screen text and audio. Remove details the reference doesn't support. Return a corrected shot prompt and a short list of moments to rewatch, with any optional creative additions kept separate.

Check: a confident lens or soundtrack description still needs evidence, however plausible the terminology sounds.

Prompts for motion and style

6. Isolate the camera movement

Use when: you want the camera work without borrowing the subject. Input: the clip; with stills only, expect uncertainty labels.

Try this promptOpen in ChatCut
Study the camera in this reference separately from the subject's movement. Describe the opening and closing framing of each shot. Say which of pan, tilt, tracking, orbit, zoom or locked camera the evidence supports, and write unknown where it doesn't. Write one reusable camera instruction per shot, without naming equipment or guessing a focal length.

Check: a person walking toward the camera doesn’t by itself prove the camera pushed in.

7. Describe the action over time

Use when: the physical action matters more than the look. Input: the clip.

Try this promptOpen in ChatCut
Describe the main action in this clip as starting pose, change over time and ending pose. Separate the movement of the subject, any objects they handle, and the background. Point out actions that are hidden and leave them unresolved. Write one standalone shot prompt around the clearest action, keeping the setting and camera movement you observed. Add no new events or cuts.

Check: read the prompt as a sequence; both the start and the end should match the clip.

8. Extract the light and color

Use when: you want the look on a different subject. Input: the clip or a few frames.

Try this promptOpen in ChatCut
Describe this reference's light and color: light direction, contrast, how soft the shadows are, the main colors, and how the subject separates from the background. Keep what you can see apart from guesses about how it was made. Write a reusable style paragraph for a different subject, without names, logos or the exact composition. Don't name a light, camera or LUT unless I've told you which was used.

Check: keep descriptions like “soft side light”; delete production details nobody confirmed.

9. Turn the pacing into an edit brief

Use when: the order and rhythm matter more than any single shot. Input: the clip with checked timestamps, or your timed shot list.

Try this promptOpen in ChatCut
Using the timings provided, describe the reference's shot order, shot lengths, pauses, action beats and visible transitions, labeling approximate timings. Write an edit brief for new footage with the same relative rhythm. If new shots are needed, list their generation prompts separately. Keep assembly instructions apart from shot descriptions, and don't promise exact timing from a single generation.

Check: check durations against playback. Edit instructions belong in the assembly plan, not inside each shot prompt.

10. Separate picture and sound

Use when: the soundtrack might be shaping how you read the picture. Input: the clip with audio, or frames plus your audio notes.

Try this promptOpen in ChatCut
Write separate picture and sound briefs for this reference. First tell me whether you can hear the audio. Describe the visible action on its own, and record dialogue only if I supplied it or you heard it clearly, marking unclear words unknown. Return a visual shot prompt plus a separate list of voice, music and sound-effect needs. Label any new audio idea as a suggestion, not something heard in the clip.

Check: silent frames can’t tell you about a voiceover, a musical beat or a sound effect.

Prompts for different reference formats

11. Adapt a product ad

Use when: you want a new product sequence inspired by an ad. Input: the reference and your product photo or description.

Try this promptOpen in ChatCut
Break this reference ad down by shot purpose, reveal order, camera direction, light and relative pace. Using my product materials, propose three original shots: an introduction, a feature detail and a closing view, each with a standalone prompt. Ask me for a product photo where the look needs more than words. Leave out the reference's logo, script and claims, and don't invent product features.

Check: compare the proposed shapes and selling points with your real product before generating.

12. Map a talking-head or UGC structure

Use when: you want to borrow a presenter video’s structure. Input: the clip (or frames plus transcript) and your product facts.

Try this promptOpen in ChatCut
Map this reference into hook, demonstration, evidence and call to action, including only the sections it actually has. Separate what is said from what is shown, and mark anything you can't access. Using my product facts, write a new outline for an original presenter, with a shot prompt for each visual beat. Don't copy the script or invent testimonials, results or product facts. List what I still need to supply.

Check: a made-up endorsement is still made up, even when the reference uses that format.

13. Adapt a cinematic shot

Use when: you want a new scene built on a composition you like. Input: one reference shot.

Try this promptOpen in ChatCut
Analyze this reference shot for subject placement, depth, light direction, action and camera movement. Choose a new subject and setting and mark them as my creative choices. Write one original shot prompt with one main action and one camera instruction, carrying over only the visual principles you can see, and explain which ones you kept. Don't guess the lens, the filmmaker's influences or hidden techniques.

Check: the prompt should say what you want to see rather than stack style labels.

14. Describe an animation reference

Use when: you want the shapes, materials and movement of an animation. Input: the animation clip or ordered frames.

Try this promptOpen in ChatCut
Describe this animation through its shapes, material look, depth cues, movement rhythm and transitions, marking guessed movement if you only have frames. Propose new characters and a new setting, then write an original animated-shot prompt using them and the visual principles you observed. List exact timing and typography needs separately for an editable animation tool. Don't guess the software or model used.

Check: keep any guess about how it was made apart from what you can see.

15. Adapt the opening hook

Use when: the first few seconds give you a structure for a new topic. Input: the opening segment and your topic.

Try this promptOpen in ChatCut
Look at the opening of this reference: the first subject, the first visible change, the reveal and what's left unanswered. Don't guess at retention, sales or virality. Using my topic below, write three original hook prompts with different actions and compositions, and for each explain which structural idea you borrowed. Use new wording and subjects, and none of the reference's people, brands or footage.

Check: make sure each hook leads into your actual content. The reference alone doesn’t prove the hook performs.

Prompts to reuse and refine

16. Prepare one shot for a generator

Use when: your description has passed the evidence check. Input: the checked description, pasted below.

Try this promptOpen in ChatCut
Turn the checked description below into one self-contained video generation prompt with the subject, opening composition, main action, camera movement, light and final state. Leave out unknown details. Put duration, aspect ratio, reference roles and constraints in a separate settings checklist for my generator. Don't add model-specific syntax or assume my tool supports a given control.

Check: match the checklist to the controls your generator actually has.

17. Plan a short storyboard

Use when: a new sequence needs several connected shots. Input: a checked shot list and your topic.

Try this promptOpen in ChatCut
Use this checked shot list and my topic to plan a three-shot storyboard. For each shot, give its purpose, a standalone generation prompt, a continuity note and a closing composition that leads into the next shot. Repeat the key appearance and setting details in every prompt. Put the shot order and timing in a separate edit plan, and don't assume one generation can produce the whole sequence.

Check: compare continuity across the finished shots before you assemble them.

18. Swap the subject or product

Use when: you want the reference’s principles with your own subject. Input: a checked description and photos of your subject or product.

Try this promptOpen in ChatCut
Adapt the checked description to my subject or product. First list the visual principles to keep, then the identities, brands, wording and scene details to change. Write an original shot prompt that gives each of my reference images a clear role. Flag anything that would need a video reference or video editing to achieve, and don't claim text alone will keep the exact movement or timing.

Check: decide whether you need a fresh interpretation or a tight change to the existing clip; that decides the generation mode.

19. Animate a starting image

Use when: you already have the look as a still and need a motion brief. Input: the image and your checked motion notes.

Try this promptOpen in ChatCut
Use my starting image for appearance and the motion notes below for the action. Write an image-to-video prompt that says what moves, what stays still, the camera instruction and the final state. Ask to keep my subject and setting as they are, without promising it will. List any unclear or unsupported motion requests separately instead of filling them in.

Check: use a mode that accepts a starting image. For more motion ideas, see our image-to-video prompts.

20. Fix the biggest mismatch

Use when: the generated shot differs from the reference in a specific way. Input: the reference, the result and the prompt that made it.

Try this promptOpen in ChatCut
Compare the reference and the generated result using only what you can inspect. Mark the subject, action, camera direction, light and ending as matched, partly matched or different. Find the mismatch that matters most and revise only the instruction responsible for it, leaving the rest unchanged. Return the revised prompt, the evidence for the change, and one thing to check in the next result.

Check: watch both videos yourself; the checklist helps you review, it doesn’t score accuracy.

Generate a new shot or recreate the reference

Generate a new shot when the scene can change and your checked description captures what matters. Recreate from the reference itself when you want its exact motion, shot timing or editing with your own person, product or footage.

  • Viral Video Cloner recreates a reference video with your own person, product, clothing, location or footage. It can keep the original motion, replace part or all of the picture, or borrow the editing approach. See the Viral Video Cloner page and its guide.
  • Talking-Head Edit Recreation edits your own talking-head recording to match a reference’s pacing, captions, motion graphics, B-roll, layout, transitions and sound, without face swaps or generated shots. Open the Skill page.

Our guide to recreating a video’s style compares these routes in more depth.

To generate the new shot in ChatCut, follow the AI Video Generation guide:

  1. Switch the AI composer to Video Gen and choose a model.
  2. Open Video settings and, under Input, choose a supported operation such as text, frames or references.
  3. Set Aspect ratio, Resolution and Duration. Supported inputs and limits depend on the model and mode.
  4. Add any references and say what each one controls (appearance, composition or motion) and what may change.
  5. Paste the checked shot prompt, check the credit estimate beside Send, and select Send message.
  6. Follow progress in My Assets, then drag the finished clip to the timeline and compare its action, camera and ending with your brief.

A reference guides generation; it isn’t placed in your edit automatically (generation references). Judge resemblance from the result, not the prompt.

Manual timeline editing, uploads and transcription don’t use ChatCut credits. Video generation requires Pro and uses credits, and messages to ChatCut’s built-in Agent use credits depending on the request. See the credits policy.

Generate one shot, review it, then build the sequence.Download DesktopDownload for macOSDownload for WindowsDownload ChatCut Desktop

Questions about video to prompts

How do I extract a prompt from a video?
Pick one short scene, note its subject, action, setting, camera movement, light and ending with timestamps, check each note against playback, and write one prompt per shot. An AI assistant or extractor can draft this for you, but check its draft the same way.
Can AI recover the original prompt of a video?
No. Any tool that turns a video into a prompt is describing what it sees. It can't tell you the original prompt, model, seed or camera settings, so treat its output as a description, not the source.
Is video to prompts free?
Doing it by hand costs nothing, and we didn't verify the free allowances of the dedicated tools. In ChatCut, manual timeline editing, uploads and transcription don't use credits; video generation needs Pro and uses credits, and built-in Agent messages use credits. If you work through Claude Code or Codex, the agent's work is covered by your Claude or ChatGPT plan and ChatCut credits are used only for ChatCut-hosted generation.
What is the best video to prompt generator?
It depends on your file and what you need back. Compare the inputs each tool accepts, whether it samples frames or reads the whole clip, and how easily you can check its output. This guide lists documented inputs and doesn't rank accuracy or speed.
What makes a good video generation prompt?
One shot, described as subject, opening composition, action over time, setting, camera movement, light and ending. Keep what you observed apart from what you want changed, and set duration and format in your generator's controls.
Can screenshots replace the full clip?
Partly. Timestamped screenshots show composition, subjects and light, but not continuous action, exact cut timing or sound between frames. Label them with source times and mark the gaps.
What do I do with the prompt once I have it?
Paste the checked shot prompt, not the analysis request, into a video generator, set its controls, review the result, and fix the biggest mismatch first. If you need the reference's exact motion or editing, recreate from the reference instead.

Checking your footage...

Less editing. More creating.

Download ChatCut Desktop free and make your first video today.

Download Desktop Download for macOS Download for Windows Try it for free