How to replace an actor in a video without reshooting

Runbo Li
Runbo Li
·
· 4 min read
Replace an Actor Without Reshooting

Quick answer

To replace an actor without reshooting, upload the existing clip and an authorized reference image to Magic Hour Character Replace, generate one short representative shot, then review identity, motion, hands, occlusion and background continuity across the full clip. Use face swap when only the face should change; use manual VFX when the shot requires frame-level control.

This workflow changes generated pixels, not contracts or permissions. Obtain rights to the source footage, performance, likeness, voice, music and final commercial use. Disclose a synthetic or materially altered person when the distribution context requires it.

Magic Hour publishes this guide and includes its own product in the comparison. Treat the recommendations as editorial guidance from a vendor, and verify the linked first-party product details and your own output requirements before choosing a tool.

Choose the right replacement workflow

Workflow

Changes

Preserves

Use it when

Magic Hour Character Replace

Primary person or character

Source timing, poses, camera motion and scene are the intended anchors

The whole subject appearance should change from one reference image

Magic Hour Face Swap Video

Face only

Body, hair, wardrobe, shot and motion

The performer can remain and only identity at the face should change

Magic Hour Lip Sync

Mouth movement to new audio

The selected video and visual identity

A replacement needs localized or revised dialogue after visual approval

Adobe After Effects

Artist-defined masks, mattes, tracking and compositing

Whatever the artist explicitly controls

Occlusion, interaction or delivery standards require frame-level intervention

Test one actor replacement shot

Start with a short representative shot and a clear, authorized reference image. Review the entire output before scaling to more footage.

Try Character Replace

When actor replacement is a good fit

  • Ad and campaign variants. Keep the approved shot and test a different authorized spokesperson or character.

  • Casting and previsualization. Explore a look in an existing performance before committing to a shoot or VFX build.

  • Training updates. Replace an unavailable presenter, then separately review the script, voice and lip sync.

  • Stylized transformations. Turn a visible person into an authorized illustrated, animated or fictional character while retaining the source performance as the guide.

Use a manual compositing workflow when people overlap, the subject leaves frame, foreground objects cross the body, lighting changes sharply, hands interact with props, the camera cuts frequently, or every frame must satisfy a broadcast or VFX delivery standard.

What to prepare before you start

  • Source clip. Begin with one continuous representative shot. Cleaner visibility, less motion blur and fewer occlusions make failures easier to diagnose.

  • Reference image. Use a sharp, well-lit image where the replacement character is clearly visible. Match angle, framing and lighting to the source when possible.

  • Acceptance checklist. Define which identity cues, wardrobe details, products, background elements, actions and timing must remain correct.

  • Rights record. Keep written permission for every real person's likeness and voice plus the source footage and distribution use.

  • Fallback plan. Decide whether a failed shot will be simplified, cut, masked or handed to a VFX artist.

How to replace an actor step by step

1. Select Replace or Animate

Open Magic Hour Character Replace. Use Replace when an existing video supplies the performance. Animate is a different starting route and should not be treated as the same edit.

2. Upload the source video

Choose the shot containing the primary subject. Test the hardest representative motion early rather than processing an entire sequence before discovering that an interaction or occlusion fails.

3. Add the reference image

Upload the authorized person or character image that defines the new appearance. Avoid tiny, blurred, heavily filtered or obstructed references. A closer match in lighting and viewpoint gives the system a clearer constraint.

4. Choose Character or Scene mode

Use Character mode when the source background, timing and camera movement should remain the anchors. Scene mode regenerates the broader frame and is appropriate only when changing the whole look is intentional.

5. Generate one representative shot

Keep the source, reference and settings fixed for the first few attempts. The current product page says the browser tool can be tried without signup with three free generations per day; free results may include a watermark, and paid plans permit commercial use. Recheck the linked page because allowances and plan terms can change.

6. Review the full clip

Watch at normal speed and frame by frame around difficult moments. Check face and body identity, silhouette, hair, hands, clothing, product geometry, contact with props, shadows, reflections, camera motion, background continuity, flicker and drift.

7. Finish audio and compositing separately

Approve the visual replacement before changing dialogue. Use Lip Sync for authorized new audio, then verify exact words, names, numbers, timing and mouth movement. For masks, edge repair or foreground occlusion, use a manual compositor such as Adobe After Effects.

Character replace vs face swap

Character Replace changes the primary subject's broader appearance while using the source motion and scene as anchors. Face Swap Video changes the face while retaining the original body, hair, wardrobe and performance. Choose the narrower operation whenever it satisfies the brief; it preserves more of the original shot.

How to evaluate cost and quality

Cost per accepted shot = all generation charges + rejected attempts + review and correction time + finishing costs, divided by approved shots.

Retain the source, reference, settings and every output. A technically completed generation is not an accepted shot. Record why each rejection occurred so you can determine whether a better reference, simpler source, different operation or manual VFX path fixes the problem.

Frequently asked questions

Yes. Character replacement can use an existing clip as the motion and scene guide while changing the primary subject from a reference image. Difficult occlusion, interaction, lighting or fast cuts can still require regeneration or manual finishing.

Yes. Use face swap when the body, hair, clothes and original performance should remain. Use full character replacement when the broader subject appearance should change.

Treat each identity and interaction as a separate QA problem. Start with a single visible subject. For a multi-person scene, test whether the selected tool explicitly exposes multi-person mapping; otherwise isolate shots or use manual compositing.

A tool's commercial-use terms do not grant permission to use a person's likeness, voice, performance, footage or music. Obtain the required rights and disclosures for the market and channel where the ad will run.

AI character replacement generates a new subject guided by the source clip and reference. Rotoscoping and compositing let an artist define masks, tracking, mattes, layers and corrections frame by frame. Manual work costs more time but gives precise control over difficult shots.

Related workflows

Use the video face swap guide for face-only replacement, the best face swap tools for a broader shortlist, and the AI video editing tools guide when replacement is one step in a larger edit.

Runbo Li
Runbo Li
CEO of Magic Hour
Runbo Li is the Co-founder and CEO of Magic Hour, where he builds AI video and image tools for content creation. He is a Y Combinator W24 founder and former Data Scientist at Meta, where he worked on 0-1 consumer social products in New Product Experimentation. He writes about AI video generation, AI image creation, creative workflows, and creator tools.
View author →

Continue Reading

A Free AI Guide for 2026
How to replace a character in a video with AI for free
Edit Photos With Flux Kontext
How to edit photos with FLUX.2: 10 practical recipes
AI Video Editing Tools
8 best AI video editing tools (2026): choose by workflow
Keep Characters Consistent in AI Video
How to keep characters consistent in AI video
AI image generators for character consistency cover, with an illustrative three-view character sheet on a tablet.
8 best AI image generators for consistent characters
Keep Characters Consistent Without Manual Editing
Best reference image-to-video tools (2026): character and product consistency