Claude for video editing (motion graphics)

What that means is that we people people won't be editing our videos but AI tools like Claude will do everything from cutting out silences to adding transitions to adding cool zooms, b roll, et cetera.

The thing is that future is already here.

Just last week I went viral on Twitter by by sharing a clipping tool that turns long form content into short form content I made that in an hour using Claude.

My video on remotion where you can use Claude to generate motion graphics and you no longer need motion graphic skills to add to your videos.

Is now at 20,000 views.

and some of my favorite creators like Renee are already editing their YouTube videos Using Claude.

Renee is actually the one who put me on to using Claude for video editing.

I've since personalized my workflow a little bit, but credits due where it's due.

In this video I'm sharing my end to end workflow using Claude to edit my videos.

I'll go over how it does things like cutting silences, ums and ahs.

It'll find places to add b roll as well as generate said b roll.

Either using tools like Seedance or in our case remotion.

We're going to create motion graphics in.

I'll show you how you can easily add photos, sounds, etc.

Without going into your editor and actually finding the spots to add them.

and I'll hint at how you can turn longer form content into social short form content.

You'll also learn how in this age of agentic editing, you can avoid all of your videos looking the same as other people's videos by making sure that you use Sounds that only you know, or memes that are really niche, or or really specific references to Let's get into the workflow Okay, step one of my video editing process is making a rough cut, a big cut to remove any silences, repetitions, mistakes, filler words, etc.

I created a skill for this that you can give to Claude or Codex, whatever you're using.

It removes all silences, etc.

And makes a cut while preserving laughter for comedic effect.

So I'm going to show you how to use this skill in Claude.

we're just going to open Claude and then we're going to go cut video.

So just to install this, if you haven't done so already, just grab the, link to the skill and give it to Claude and say install this skill and then you're going to probably have to restart your terminal.

So here we have cut video and then what we need is obviously a source file or RAW recording.

This is a recording with my dad.

It's seven and a half minutes long and as you can see, it hasn't been cut at all.

So I'm gonna give it that and then we're gonna wait for the output.

if you don't like this aggressive cut, I tend to cut all of the silences out and leave very little space just because I want my videos to be engaging to watch.

So then you can just prompt it and do this differently to match your editing style.

or what I did to create the skill is I actually gave it a reference video of mine initially, so it knows how I manually edit my videos.

So that might be an idea for you to customize it to your editing style just so you know what's going on in the background.

that's easier to edit.

And then it uses tools like Whisper to analyze the transcript as well as FFmpeg to look at the frames in the video.

And then it's gonna decide what to cut out.

Just as a time estimate, there's lucky days and unlucky days with Claude, but it takes a few minutes to make these cuts, especially if you're asking for a lot of cuts.

So this is a seven minute video and it is already running for three minutes.

But again, this means you won't have to manually touch a video editor ever again, which I think is great, especially if you build agents around this, you can just give your raw cuts and give it instructions on how to cut this.

And it'll do it in the background while you do other work.

All right.

It has outed a video, and it reduced it by a minute and a half.

Let's watch some of this to see how well it did.

Number one, we're going to guess the photo is AI or real.

Yes.

Yes.

This is a picture.

Okay.

Remember what we talked about yesterday?

Cool.

So I think it did a good job of cutting, things out.

I can see that in the beginning, I mean, I was speaking as I was getting the camera set up.

So you could also tell it to get rid of that point.

just going to tell it to cut out the beginning So again, it looks at transcript.

So it assumes that when you're speaking, you might want to that in there.

To be honest, depending on the style of the video, I would want to keep it in there.

So you see here it's saying, check out the lights.

That's good.

so it's going to drop that part where I say checking the lights.

And I think it picks up on that.

Well, let's check if it cut it out.

Okay, so we're going to speak in this little mic.

Yeah.

Great.

So it cut it out just based on a prompt, which is kind of crazy.

Now, that's step one of our editing process.

So you can see this is an interview with my dad.

And you may have noticed that we're showing something on screen.

So I want to overlay whatever I'm showing him on screen.

he's doing an AI guessing game, basically.

So I'll show you what this looks like in the video that I already edited here.

So I'm just gonna play that.

And you can see that he's looking at these Photos and guessing whether or not they're AI.

I kind of want to give Claude the slide deck, where I have all of these photos just because I'm a little bit lazy.

So here is my quiz that I made for my dad.

I'm just going to share this and make it accessible for everyone.

And so I'm going to tell Claude, extract all of the or images in this slide deck, So I'm saying that it should put it in my Assets folder.

I have an Assets folder where I save things like screenshots or, yeah, funny photos that I want to use in videos as well as, videos or sounds that I use can give Claude while I'm editing.

Funnily enough, I just created a Slack bot where I just drop any screenshot into and then it saves it to that Assets folder.

So this way, whenever I'm working on a project and I see a fun screenshot or a stat or anything that I need for a video project, I save it to my finder and.

And then Claude can easily access that.

I forgot to give it my Google Slide link.

So I'm going to do that now.

Right.

So here we can see that it created a folder called dad, Projects.

I'm going to move that to Project soon.

but we'll see.

When we open this, we have some PDFs, and it's probably going to extract the photos from that PDF and cut them.

And then we'll see that we can magically overlay all of these photos at the exact right timestamps.

Now, this process is a bit longer than it would have been in the beginning, because as I was editing this video manually, I was saving all of these photos to my computer.

I just wanted to show you that you can literally give it any format, a PDF or anything else, and it can extract photos for you to use as well.

So you can do this with logos, with anything you want.

So here we have the raw and it's outputted that I wanted to get rid of the, white padding.

so I'm going to just ask it to do that so we can see.

It also recognizes what's on the slide.

So it obviously took all of the slides out of the PDF, but it sees that not every slide contains a photo.

So hopefully it's just going to grab the photo ones.

All right.

Live we're seeing that it's cropping all of these images.

So that saved me a lot of time finding these images again.

Great.

And now we're going to tell it to overlay the image for maybe a second or three, two or three, right before my dad needs to guess what the image is.

But I just wanna show you that step two of overlaying images is very much possible with Claude editing without doing any manual work.

We can see here that it's mapping the 20 photo moments, slides one to 20, to when my dad is doing the guessing.

So let's take a look at these overlays.

That's where the game starts.

Number one, we're going to guess if a photo is AI or real.

Yes.

Yes.

Show me the picture.

It's a fake.

It's AI.

A picture.

It's real.

It's real.

Okay.

Okay.

Remember what we talked about yesterday.

Okay.

So here it looked at the transcript and mistakenly added an overlay.

But that's an easy fix.

We just need to tell it to move that one.

This is, I think, AI tool, but it could be real because it existed.

you can see here that it actually overlaid that one at the right moment.

So it did well for the majority of these.

I looked at the, the video, and for any ones that are not aligned well or like come at the wrong moment, you could just say, it should move that.

But that should show you that you can add any image to a specific timestamp.

So So even if you are going through your video like this, no longer in an editor, you say, hey, at minute 156, I want to add this image.

And then you just refer to your assets library and it's going to add that image.

So my third step in this case would be to add sound effects.

So I'm just going to show you how I'm going to use the Duolingo correct sound add to my video whenever my dad gets something correct, and then I'll do the wrong sound if he gets it incorrect, And I'm going to show you exactly how I save a sound effect from YouTube I give it to my Slackbot and then it saves it to my sounds folder.

So I'll only have to save this once in my life.

My Slackbot recognizes what it is, so it's gonna say it's the Duolingo sound.

And then I'm always gonna be able to refer to it All right, so I'm going to go to my Slackbot and I'm going to copy paste the Duolingo sound effect link.

And then it's going to pick up on what this is.

In this case, it's a sound effect.

it's going to automatically save it.

As we can see here, it's going to save it directly to my sound effects, asset folder.

So here we have it.

It's going to open here, but that's fine.

Now we're going to tell Claude to To add the Duolingo sound effect to whenever my dad is correct in the video.

And then find it in my Assets folder under sounds.

let's see if it applied the Duolingo sound effects whenever you get something.

Right.

So let's play this first one It's a fake.

It's AI.

Nice.

So it applies the whenever.

He's right.

Just Always make sure to do a double triple check.

especially if he's doing a lot of them like he is, or he, Claude is basing himself off the transcript.

And sometimes it's kind of hard to tell where to add it.

But he did a good job of adding those sound effects.

So that was step three.

I showed you how to add sound effects.

I want to show you, in a similar technique using my Slack bot, how I can save a meme and then use that in my videos.

So, so I'm just going to go to Slack and I'm going to drop this link in there and it's going to download it as, a video.

And then that way I have the Confused Math ladies, meme in my Assets folder forever.

Let's head over to my Assets folder Again.

You're seeing this is turning into the holy Grail.

And here we can see it describes it as Confused Math Lady.

We can actually play that.

I kind of want to use this meme after my dad's confused about something.

named in Assets folder and add And to make my life a little bit easier, I'm going to have some manual intervention where I want to add it to a specific moment, in the video.

So let me just rewatch this and find the specific timestamp that I want to add the meme Okay.

I think it'd be funny to add it at around the 150 mark.

150 mark.

So let's see how it does.

And it's going to play that meme.

Of course, you can also cut the meme.

you can shorten it.

Just tell it to shorten it.

Or only include a small excerpt of a video.

so here it's going to search for that meme in my assets folder and it's going to add it.

The best way, in my opinion, to edit with Claude is to do a lot of the prep work where you source all of the screenshots or the memes that you want to use, and then it can just go into one folder in your finder and add those where it thinks it's right.

let me just head over to the 150 mark.

Here we go.

Was it?

Yeah.

So great job adding the meme at actually corrected, 146 instead of 150 because it noticed that my dad was the most confused there.

So you can see Claude's already doing good thinking here.

All right, next part of editing might be to add fun transitions between clips, Or I kind of want to add zooms on my face or my dad's face whenever he says something really funny.

to one of the two speakers whenever something funny happens suspense or awkwardness.

So let's see how it does there.

you could also give it cinematic terms like use a Ken Burns effect, which just zooms into something slowly.

you could also say you want to add, a harsh zoom.

and just kind of play around with how you like to edit your videos.

Again, if you have a lot of reference videos, maybe you found on YouTube, from other people's editing or your own, then you can ask Claude to describe what those cuts are or what those effects are that are being used.

let's have a look at these zooms that it did or not.

H.

It did a few.

Let's see, towards the end here.

Do you think AI will replace me anytime soon?

I hope not.

You hope not?

now we're going to do a little bit of current.

How can you say that?

Okay.

And we're going to see if you can guess what these words mean.

Right.

And because it's so addicting without learning anything.

So your brain.

Very good.

No.

Are you an unk?

No idea.

Okay.

I I think this did an okay job, but I think I I need to be a bit more specific with the times the times I wanted to zoom in.

It actually gave us a list here of when it zooms in.

no, it's not the last one.

let's look at 315, and let's see if I agree with that.

It's a game now.

Very good.

Do you know who it is?

Yeah.

So at this moment, that was actually a really good idea to zoom to my dad's face because he was arguing with me So you can definitely, look at your video and say, I would have added, zooms whenever my dad completes a sentence of mine.

So I can say, add a zoom to dad when rots.

so that's my manual, intervention there.

You can actually see that it found the exact timestamp where it should add that zoom.

So.

So let's wait for the zoom.

okay, so he added that at 5:37.

Let's watch that together because it's so addicting without learning anything.

So your brain.

Very good.

Okay, the important part here is to explain in as much detail as possible how you like your edits to be done and which transitions, et cetera, you'd like to use.

Now before we move on to my demo of how I would edit screen recordings, specifically ones recorded in Tella, I'm just going to show you how how we can use another skill that I've built, to turn this long form video into a short form clip and actually add captions as well.

So yes, you can even add captions to this.

So this completely gets rid of the need for a tool like Opus Clip, which generates captions and turns something into a video.

here it's pulling what he thinks are the funniest moments in terms of clips.

I want the clip where he describes what I do and we can select a few more if we want.

but let's just do next and then the format, I want it to be reels format and then, and then we're going to submit those answers.

So as I said, you can get this specific clipify *skill that actually got 300 stars On my GitHub.

So you can get that repo there and you can just set that up in Claude and use it for any long form to short form flow.

So let's wait for it to generate this and I'll show you what the final result is.

it's asking us if it wants the hard cut version.

and let's do big, you know what, I kind of want big bold captions.

So it asks us about the format of the captions and if you wanted our vertical video to have our faces in a split screen or if it should zoom in on me when I'm speaking, zoom in on my dad when he's speaking.

And I prefer that version.

Let's take a quick look at the vertical video it made of this video.

Now I'd like you to describe as best you can what you think I do as a job, it's.

I can't describe it because I have no clue.

Everybody asking me, I said, I don't know.

She makes money with a computer.

That's accurate, that's all.

you can see it clipped it here.

And also you could tell it to do this on the RAW recording instead of the already zoomed in version of this video.

So yeah, that was it for the non screen recording.

Editing your videos with Claude, there's so much you can do connecting it to tools like 11 labs as well.

to do narration for example, or even connected to an AI generation, video to like Seedance , to generate AI B roll.

All right, for this last portion, very quickly, I want to show you how you can edit your screen recordings that you record in Tella using our mcp.

So you can actually perform actions in Claude that are directly reflected in your Tella editor.

So you're just going to go to our Docs page and find the mcp.

And then if you haven't done so already, you're just going to copy this and install through your terminal.

Now, I've already installed our mcp, so I'm just going to open Claude and I'm going to show you where it is.

so.

Or the tools that exist.

So you can obviously list your videos, etc.

But you can also upload clips.

So you can upload your own clips next to your screen recordings.

You can Sorry, you can cut clips.

you can even get frames from your video.

That would be good for A thumbnail, for instance.

I just did that earlier today.

You can, you can remove filler words, et cetera.

But I'm going to show you how I'm going to cut my video in Tella because it's super easy to do that there with AutoCAD.

And then I'm going to add a B roll layout, which is super new, which is essentially a layout where we add B roll.

And the B roll I'm going to add is going to be generated in another tool called Remotion.

And all of that's going to happen in Claude.

first thing we're gonna do is we're gonna grab a video.

You can see here that it has no cuts applied to it.

So I'm gonna remove all of these silences, remove the filler words, etc.

I would maybe do a more clean cut here.

but here we can see that there are no applied beside the base layout.

So we're going to ask Claude to go through and apply layouts where it thinks it would be.

Right.

we're just going to grab the video link here and we're going to head over to Claude again.

layouts.

motion graphic generated in Remotion as B roll.

I mean, I'm being purposely lazy and vague because I know what I talked about in this intro and I always want to add B roll in my intros to make them more exciting.

So I'm going to see if it can add B roll, there to describe a process.

This video was about how Claude is now editing video.

And I just want to show that with motion graphics.

So let's see how well it does.

In our first go, I should add, if you haven't done so already, watch my video on how to generate motion graphics with Remotion.

Because I go over the steps of installing Remotion into Claude, which is super easy.

but you do need to set that up before you can actually generate motion graphics in this way.

So Claude will just remember Remotion as a skill and then it can actually use it to do, similar such things and generate B roll.

So be sure to watch that first.

Cool.

We can see the steps here.

So it's looking at the uncut transcript, and it's checking for B roll moments.

It's going to generate the motion graphic.

It's going to upload that motion graphic as MB4 into TELLA, and then it's going to add, B roll layouts with said MP4.

So it's asking me, yeah, it's giving me three suggestions.

And I like the idea of messy files flying in and then going into organized folders.

And then, I'm going to go with fast and submit those answers.

generating the motion graphic and then it's going to upload it as an MP4 to the B roll segment, which is new and you should try.

All right.

Supposedly it has generated these layouts.

So let's have a look together.

We're just going to have to always refresh our page whenever we add, changes.

So here we can already see it applied our new B roll layout.

So let's play this together.

First impressions.

So fun.

Okay, so generated that in remotion and then it added that, as I was describing this.

So this was about my slack bottom and how basically I created this assets folder.

however, I think this is a really cool way of just, being able to edit your screen recordings that you make.

this was just a small example of things you can do in our mcp.

It's still work in progress, but I'm going to be playing around with it over the coming weeks and I'd love some of you to play around with it as well.

I'm going to show you a second thing that the, MCP can do.

So we're just going to say find frames in this video of my full face that I could use as a YouTube thumbnail.

Let's see.

It can actually get frames as well from Tella directly.

So I'm going to see if it can find, that from the camera source file.

and then it's going to save that to our It's selecting for wherever my eyes are pointing forward.

because I know I don't always do that when I'm filming.

And I expect it to return some frames that I can use.

It says it found the winner killer shot, which I'm animated.

My mouth is open.

So let's see what it comes up with.

okay, in all fairness, I did interrupt Claude because it was taking too long.

But look at these thumbnails that it found using Tela's MCP now lets you edit your videos using Claude.

And what this opens up is that you can integrate many more tools into your editing process.

Not just ll, not just capcut, not just one tool, By having it all be in AI model.

I hope you liked his introduction to how I edit my videos with Claude.

There's a long way to go, as you saw.

Sometimes we run into some slowness issues, some understanding issues, but as you start to edit your videos with Claude, You're going to become much better at defining technically how it is you like to edit.

So it removes all manual work, which we all hate, and it just becomes more of a conversation which I've really liked.

I'm going to link all of the skills that I used below so you can add them to your own Claude and play around with and then if you like this video, please be sure to subscribe.

A lot of time goes into these videos and I'd really love to have you around.

I'll see you for the next video.