I Used Photoshop's INSANE New Feature To Fill Videos!
ฝัง
- เผยแพร่เมื่อ 31 พ.ค. 2024
- Revolutionize Your Videos with Photoshop's Generative Fill: A Matte Creation Guide
Generative Fill is officially part of Photoshop!
Chapter Markers:
00:00 - Intro
00:25 - What is a matte painting?
00:54 - Explanation of how matte paintings work
02:18 - Generative Fill Shooting tips
02:37 - Generative Fill: Starting with your editing system
05:00 - Generative Fill: Photoshop Beta to create your Matte Paintings
10:49 - Generative Fill: Back into your editing system to see the results in action
12:56 - Generative Fill: Closing remarks
13:31 - Outro
Transform your videos into cinematic masterpieces with Adobe Photoshop's Generative Fill feature. This powerful tool allows you to effortlessly replace backgrounds or specific areas of your footage with a simple click. Instantly transport your viewers to any location by adding elements to your scenes that were once thoughts from your imagination. This tutorials methods work with any editing system as long as you have access to Adobe Photoshop.
It's easy and I'll show you how.
⭐️ This video is not sponsored ⭐️ Here a some affiliate products links. If products are purchased through the links, my channel receives a small concession.
Some footage in this video was sourced from Envato Elements.
Stock Video, templates, Music, Sound Effects, Photo's and Fonts and more!
1️⃣ 1.envato.market/4Pn4AM
Music for this video was from Epidemic Sound. A excellent place for all of your your music and sound effect needs:
2️⃣ www.epidemicsound.com/referra...
VIDIQ continues to be extremely helpful for training and coaching to help focus my efforts to improve my TH-cam channel!
3️⃣ vidiq.com/ProfessorKlaus
Drones add a special touch to most videos and help tremendously with a solo crew. Get the same DJI Air 3 Drone as me!
4️⃣ click.dji.com/ACtyBarjOcSFxyE...
360 Cameras are amazing! Nobody is better at providing affordable 360 action cameras that can shoot incredible quality than Insta360! Here is a link to the brand new Insta360 X4 with 8K resolution!
5️⃣ www.insta360.com/sal/x4?...
►►►SUBSCRIBE for more: tinyurl.com/Professor-Klaus
I have a few things I can show you. If you already have the skills, I may give you some inspiration.
Do want to learn anything in particular? Let me know in the comments!
#AI #fcp #photoshop #adobe #premierepro #generativefill #compositing #finalcutpro #videoshort #cinematic #cinematography #professorklaus #mikewittig #shortsfeed #Shortvideo #photshopbeta
#Firefly #photshopbeta - แนวปฏิบัติและการใช้ชีวิต
![Mirrr x BUS5 - กี่เหตุผล (1000REASONS) [Live Session]](http://i.ytimg.com/vi/6Ta00hFr2qU/mqdefault.jpg)
Informative but can you rethink your background music and volume? Overshadows your hard work I think?
Thanks.
I agree. Better ducking would help. Awesome content nonetheless!
@ProfKlaus No man, I really your background music. I think you used around 4-5 different music. Sorry. But I like it 😂
@@reign5426 Very much appreciated.
@@quirkworks4076 I appreciate your comment and noted!
The ONLY problem with this stuff is when you want to do different angles of the same location. Mountains will never be the same ones. Can definitely be smart and work around it.
I think the same, it's an amazing tool but we can have a lot of continuity problems
I could see that being the sort of thing that's easily resolved in the future. Just being able to do this as it is now is a huge step, and as generative AI continues to improve I'm sure being able to generate consistent images will be one of the first things that's figured out. Along with fingers... 😀
Be cool to see what these tools offer in a year or two.
I can barely believe what I see online at times, and this is extraordinary technology. Incredible.
I completely agree! Thanks for your comment!
Thank you for creating this tut! Very helpful!
Thanks for taking the time to let me know!
Great, step by step tutorial! Thank you so much. Great way to embrace new technology. Creative minds will always find a way to be creative.
Thanks for the comment! I'm happy you enjoyed the video!
Thank you very much for this tutorial, you have opened a range of possibilities in my mind. I'll show you what I'm going to do with time. You really are a teacher. 🙌🏽🙌🏽
Thanks Alex! I can't wait to see what you create!
If there's anything you like to learn in particular, I'm always open for suggestions!
BEST TUTORIAL ON GENERATIVE FILL!!!
I am humbled by your statement! Thank you!
Great tutorial! Thank you so much! Clear and precise!
Thank you for the comment!
Thanks for showing actual potential of generative fill and its use..
My pleasure!
Oh! So beautiful🎉
That's d most interesting editing video I've watched this year👌🏻🥂
Thanks!
@@ProfKlaus 🎯🎯🎯
This was informativ and great, and your story telling with the ambient music is relaxing. Perfect length, thank you🎉
Thanks for the nice comment. I appreciate it!
Your videos are simply amazing 👏
You made my day!
What an impressively easy way to completely change your cinematography quality! Dear sir, your video was so well made that it really made me think that this is not that hard and all it requires it a bit of foresight. My head is buzzing with possibilities.
Thank you for letting me know! It's great hearing that the video is doing what it intended for!
It really isn't hard to create a matte this way. I began trying generative fill tool with some photos I had. When I learned how easy it is, I started pondering how useful it could be for video.
I want to try the doorway trick shown @ 1:19.
Thanks again for the comment!
I'd love to see what you come up with!
Well done. Thanks for this!
My pleasure. 😉
Keep rocking bro.NICE video.I love it
I love your comment!
That was so great! Thanks 🙏
I appreciate your comment!
Great tip. Thanks for sharing!
Thanks for commenting!
Thank you for sharing your tips. Very clear 😊
Thank you! I plan on creating more very soon. I also just recieved an Air 3 Drone so I will have a more stable shot from above moving forward. :)
Thank you. This is brillant!
Thank you! I’m so glad you enjoyed the video!
amazing mate. Thanks for the great idea.
Thanks for the comment!
Awesome. Thanks and Good Luck!
Thanks so much!
Thanks for this video, it helped me a lot 💪🏻
I love to hear that! Thanks!
Thanks, amazing stuff!
Thank you!
there is no video on youtube like this one thanks for sharing ur ideas
So nice of you. Thank you. It means a lot!
This video helped me to understand the vast possibilities of generative fill@@ProfKlaus
This is massive. But how simple it is!
Wow !! Thx dude !
No problem!
That's the most clever use of generative AI I learned about, it's coherent, production ready, the quality is awesome and the results are almost invisible. Great work!!!!
Thanks for comment! I appreciate it!
Thanks, this is inspiring.
Thank you for letting me know! It means a lot!
Great help & insight :)
Thanks for the great comment!
Great video professor 🙂. Editing videos is now much creative.
Thank you!
Great work!
Thanks so much!
Super🎉
Thanks
Time to make our blockbuster movie ourselves. Awesome work
Yes indeed! It opens so many options!
Thanks for the comment!
This is massive :)
Awesome video. Great channel. Liked & subscribed
Thank you for saying that!
Really well done
Thanks for the comment. I love positive feedback!
so dope
Absolutely genius! I would mention that you want the drone shots to be as stable as possible and to stabilise in post to remove any shake
This is true. I did stabilize 2 of the shots.
Awesome content!
Thanks! I'm glad you enjoyed it!
Thanks Ma men! Blessing
Awesome thanks!
great work
Thank you!
That's awesome
Thank you for leaving a comment!
Well made tutorial
Thank you
Thank you 😊
For me this is an amazing demonstration. I imagine it won't be long before this will be able to be done in the video apps with live backdrops instrad of only still shots.
It's really something to know where you placed the mask, and yet not be able to detect any signs of transition between the layers.
It is impressive. I’m excited to see what “generative fill” will do when it’s released into Photoshop officially. Hopefully they change the name. Haha It just doesn’t roll off the tongue very well.
Thanks for the comment!
Great idea
Thanks!
Professor ♥
This is really impressive
Thanks so much for your comment. I think that the key to success with this tool is subtlety.. If people naturally believe what they are seeing, they will be less critical.
@@ProfKlaus Yes, the tool can be very useful when the shot is filmed steadily and when the AI generates good images that look real!
brilliant
Thank you!
nicely done ;o)
Creating the perfect ambiance for your peaceful moments. Remember to like and subscribe for more serene tunes! 🍃💙
🔥🔥 video
Thank you very much!
OSM 🤩😍
Thank you!
Wow
*good job bro*
Thanks!
Woah! This is very cool 😎
Thank you! I just learned some more methods that may speed this process up a bit too! Watch for more videos!
Adobe should integrate this feature into premiere and AE :)
Heard the will soon. Going to make my videos so much cooler
Great idea, have you thought about frame tracking the generated backgrounds for clips with movement ?
I have but haven’t had any luck with it yet. I’ll certainly post something when I do! thanks for the comment!
great, but problems in these kinds of shots might become if the clouds are not moving at all + the trees are static and so. but definitely an amazing thing with lots of uses.
Yes. You always need to consider these type of things.
(Next time you watch Spielberg's Jaws, watch the sky from shot to shot)
Nice Professor!
Thank you very much! I just figured out some other methods! More to come soon!
@@ProfKlaus Love the channel, keep it going!
Great channel! Very informative and interesting.
@@gabrieleausten2600 Glad you liked it!
Oh, another thing...
If you're using a LUT with your video, along with color grading, should you export the rendered frame or the original untouched video? With the former, you can't go back and change the grading, contrast, etc. because it won't apply to the matte. With the latter, I guess you should include the LUT, as that's color space info that should have been metadata but that's the difference between dSLR's and real video cameras. But, if it's not graded, will the "off" color cast or whatever hurt the generative fill AI?
I understand what you are asking. In this case I did not do any color correction before exporting a picture for photoshop. It was the video as I shot it. I did not use a LUT in this tutorial. The rain and camera tilt effect was created once the mask was applied.
I have used the effect with color corrected footage and it still looks great. The Generative Fill feature is surprising.
Great content! The only downside is that the resolution of the image produced is not very high. I am optimistic that it will improve with time.
Thanks for the comment! The Beta version is what it is (amazing still). It will be a higher resolution soon though. In the meantime, I'm going to keep learning how to use it.
Right; you left out the step to upscale the resolution, or generate in pieces if it's a long stretch across the frame.
@@JohnDlugosz I didn’t upscale anything. Everything that was done is shown in the video.
Amazing. Can we see another video for how to use PS beta to zoom out a video in final cut?
I mean widening a scene
Do you mean expand all surrounding sides? If so, you could probably use the same method as this video. th-cam.com/users/shortsStLzReK03aQ?si=8xxxEBWa81oklAHR
You won't want to have and movement on any of your edges. This one may also help you make sense of the concept.
th-cam.com/users/shortsn_aEut13WJc?si=PmFpWC7rUD3GwNPj
I'm working on a few new longer videos that should be coming soon!
@@ProfKlaus almost the same what I meant. Cool. Thank you so much
I think this technique is also interesting if you mix it with your own static background shots taken to blend it perfectly in
I completely agree!
Great Video. Can I create the effect of a person walking in front of the Generative fill back ground (upper body showing over the horizon for example) or will the person have to stay below the created background for the entire shot?
That’s a great question. If you want to be faster, try not cross the effect (matte) with any motion.
What you’re asking for could be created by:
1. Using a green screen.
2. Rotoscoping around your upper half (as per your example), but this is my least favorite option. (I’m a bit lazy sometimes)
3. You could also use Final Cut Pro’s Scene Removal Mask (if you use FCP)
You’ve given me some ideas for content! Thank you!
@@ProfKlaus Thanks! I bought the program an hour or so ago and am playing with it. One more question if you have time. I've been using magix 2021 for video editing. What do you recommend for video editor?
@TUCOtheratt For me personally, Final Cut Pro. I know it inside and out and I’ve always loved it. For creating TH-cam videos, it’s so fast to edit on for me.
For you, I would recommend Premier Pro if you have not started on another program yet. Premier Pro is a very good editor and I do use it from time to time. You may even have access to it with your Adobe subscription.
I’ve noticed Adobe has played the game right with Colleges and Universities by giving full access to Adobe Cloud while a student. Smart. Many business ask that you edit with Premier if you do work for them. (So they can open the files down the line again)
I think people should be able to edit on whatever works for them but Adobe wins by having schools and big business’s using their Product.
I’ll continue to use FCP as my main editor though. 😉
@@ProfKlaus Thanks!😃
@@TUCOtheratt You could do something like this. www.dropbox.com/scl/fi/gjspqrekzz2r4k4w7xexi/Mountains-and-Cactus.jpg?rlkey=061x4zj956aj66gg8cf56vvz6&dl=0
Cool channel by the way!
I wonder if Generative Fill will require Creative Cloud subscription to be used in future. I read Photoshop Beta is currently free for Adobe Photoshop users but in future, i worry about that Adobe might charge more only because of this feature; similar to other graphical ai developers who are already charging their users monthly for usage of their online ai application interfaces.
I'm thinking it will probably be in Photoshop since it is in the "Photoshop Beta". You never know though.
Such an insane feature but I have a question. Let's say you wanted to use a real mountain in the background, like Everest, from a stock video, how would I tweak this process to generative fill a blend between the clip of the mountain and my own footage?
would take a off your everest footage and arrange it in PS with your other video,
compositing it, then gen fill what you need to fill to make it all blend.
Good question. I'll try to make a short this week to show it being done. If you apply the same methodology as this video, it should make sense. I'll also make a long form video going through in detail as soon as I can. 😊
Heres a quick short I threw together for you. th-cam.com/users/shortsn_aEut13WJc?si=ujcK9z8Hlj59Xgms
That last shot where you are driving off along the road, you could generate a cliff on this side of the car could look cool like you driving along a cliff edge. Anyway great video, thanks..
I love that idea!
❤5 hundred and eighty second subscriber
Thank you so much for subscribing! Really!
good tutorial thank you
Your Welcome!
I wonder how you can achieve consistency between images where you might have the room at different angles
Easy! Just manually adjust. Not everything will be perfect.
I think what you’re asking is, “are you able to carry the look of one image into another but from another angle?
If so, I don’t think there is a way to do that automatically (yet). It’s possible to get what you need but it would likely take several attempts to get an appropriate match.
@@ProfKlaus yeah I guess the word would be continuity. Placement of props, actors, lighting etc. It seems like AI does not yet take this kind of thing into consideration. Especially placement of physical objects in the space.
@@scotthannan8669 I used to work for a major corporation in the Media Arts department. The company changed thier branding and as a result they limited the fonts, colours, and even the type of video/photos we could use.
It seemed very constricted at first but once we began following the new brand rules, our creativity came through in ways we wouldn't have discovered otherwise.
Sometimes limitations bring out some pretty unique solutions from us humans. Lol
It is possible though but it would take a little more time. You got me thinking and inspired some ideas!
I hope none of this seemed too preachy. Thanks!
@@ProfKlaus I once heard a drama professor tell his students that limitations are actually beneficial for creativity. I was surprised because I expected to hear a liberal take from this group (unrestricted freedom).
He explained just what you did. Working around limitations often leads to unexpected insights and interesting alternatives there were never considered. Sometimes a liberal and unrestricted situation simply leads to lame outcomes because it doesn’t challenge the artistic side of our human nature.
dude your music selection is amazing
Thank you! I love hearing things like that!
I guess I left some of it a bit too loud for some on this. I have to consider all types of setups I suppose.
I would be curious to watch the final edit because the generative fills were all different and so the final edit would look odd because the backgrounds are all different. Was that just for the demo? What would be cool would be if you could get the AI to generate the same scene from the different perspectives of the video footage. I guess 3D environment rendering will be the next step in AI?! I wonder if that kind of thing exists for Blender.
It was for the demo. This particular video was about how to use the Generative fill, but a scene from multiple angles would be a great video. The one thing is… if I were to make a video and not tell anyone that I used the effect, it’s likely nobody would notice. But when you do a video about it. Then the highly critical eye will be out on the prowl. haha.
I’m awaiting a new Air 3 drone which will give me a stable tripod shot from high up. My old drone isn’t always that stable in a slight wind. I think I’ll do another demo that ties together several shots to make a full scene. Thanks for the question and the idea!
Problem is the lack of consistency. If you have two shots that are supposed to be in front of the same mountain range how do you get that to match?
Thanks for your comment. If you are making something that requires multiple similar effects, you'll need to think ahead creatively. Using the AI to complement the shots but not ot to create the video.
If you look at some of the examples from "old Hollywood" in the video, some of those are just one shots. Establishing shots.
You should use the feature to improve your individual shots with subtle adjustments. Like covering or adding things. Using creative fill subtly will likely go unnoticed if people aren't aware it's been used.
My video demonstration on how it works required something more obvious. 😉
You could also use Gen Fill to blend 2 or more shots together. That way you could use multiple angles from a location too.
th-cam.com/users/shortsn_aEut13WJc?si=_sCEukrLJk206qcD
@@ProfKlaus thanks for the insightful answer! Great perspective
Great 😣!Now I will lose my job as DMP artist for features film.
I sure hope not! I heard someone say that AI is not going to take away peoples jobs. But people using the AI might! I'll bet that If someone with your skill set uses it, you'll likely be able to add so much more than the average Joe! 🙌
Thank you for commenting!
Nice job!
How about the tracking? I did a same shot with a drone but there is a slight movement in it... You then can see its fake
Yes static is key. My DJI drone has a mode called tripod which helped. You can use the most steady 4-5 seconds for your shot.
Plus stabilization if needed.
Thanks for the comment!
MAy I ask where did you get the lightning overlay.
Thanks for the question!
I’m on vacation, but will be able to answer you clearly in a couple of days. The short answer is I used a few frames from a white solid from Generators in Final Cut Pro (by titles). Just a few frames. I don’t recall if I used a blend mode or just t started at 70% opacity and took it don’t to 0%. I just need to look when I am back by my computer. I hope that helps for now.
@@ProfKlaus Thank you, I use Premier Pro not familiar with using Final Cut Pro
@@THEVROMANEMPIRE the same method will apply. Just put a white solid for a a couple of frames at a time on a layer above the video.
TIP: When using the Lasso tool.... if you hold down the OPT key (Macintosh) the lasso temporarily turns into the Polygonal Lasso tool... meaning you can just click around on your image and the lasso will create a straight selection line between where you left off and where you licked. You can click multiple points to cover large distances quickly, or click and drag to temporarily draw curved lines again (or you can simply release the OPT key to return back to regular Lasso mode). I find this most helpful as it's like having two tools in one, as you don't have to keep your finger down on the mouse button the whole time.
Thanks for the great tip!
I really want to do this as a way to make vertical videos out of longform.
I’m actually working on a video that will show you how to do that. :)
Even tho its impressive, there are many improvements Adobe should bring to the table for the resolution situation, being able to output only 1024x1024 ai generative fills, its quite a limit.
For your example of paintings there are clear gaps between the original footage and the generated layers, because of the ai output. that could be solved by generating separate 1024x1024 square selections to expand the image, but it takes way much longer. Adobe should soon add up support for larger resolutions.
Yeah. I think that will be different once they move past the beta stage. Fingers crossed.
Just how specific instructions can you give the AI to generate fills? With few words it made an acceptable job, but I'm sure with detailed instructions it can make better.
Yes my demonstrations in the video were simple solutions. I suggest with any effect that subtlety is better. If you were watching one of those scenes in a video that wasn’t about Generative Fill, you probably would have just accepted it without suspecting that something had been altered.
However, you can get pretty darn specific. For smaller fills the shape of your selection helps. You can add complements to your scenes. Like flowers on a desk or an entirely different office space in the background. You can be specific on type, color, type of vase. You can add broken down cars on the side of a road. It takes lighting into consideration. It’s pretty amazing. When using the effect with video, you don’t want to cross the effect with movement (unless you don’t mind masking). With a little foresight to consider where you can add things, your imagination is the limit.
You should download a trial of Photoshop and give it a whirl. It’s now out of Beta and part of regular Photoshop.
❤
Thanks!
Whats the best way to add rain in FCP?
Hi Dave, I'm not sure if its the best way, but for my video I used the Rain filter in FCP and found it useful. It allows you to adjust in a way that I found to be pretty easy. The settings will be unique to whatever scene you create but here is mine.
The filter is under stylize, Go here to see my settings. :) www.dropbox.com/scl/fo/oqtb5gmzpnzde3bohrqmq/h?rlkey=snsi9l5d0bb2ecf43mwuvo18h&dl=0
@@ProfKlaus This is by far the most inspiring video on Generative compositing, and the rain effect at the end, knocked the ball outta the park; thank you so much. for sharing your creative knowledge.😊
@@daveschmidt9367 Thank you for the kind words! It's means a lot!
Is it allowed to use the elements for paid work?
It is completely allowed now that it is part of Photoshop officially.
I’ve had no luck with generative fill. Artefacts and colour discrepancy. All AI imaging I have used like mid journey have been useless in getting images that match my vision. And yes I have researched prompting and done some homework. But it never kicks out what I am after. Fine for random, non-specific work. Better to learn to make it yourself or hire an artist.
I have had issues with prompting as well. However I have had no issues with colour discrepancies. Are you including a small sample of what you are connecting the image to?
Thanks for the comment.
Weird. In PS, it's been amazing: in and out paintsingspecific items and backgrounds I ask for, AND it follows the depth, color, light and shadow direction and perspective of what I'm basing the prompts on in my original images. As of yesterday Midjourney (which I don't care for) actually introduced some amazing in painting features too, by the way.
These are all steady filmed shots… but if the camera moves or, for example, the car drives into the „ filled area“…how does that work ?🤷🏻♂️
Thanks for the question. You can only do this with static shots. You can add motion in post as I did in the example.
🎉
😁 I am Phil.
Generative Phil.
Okay, name order, but it's funny, imho. :D
Haha. Nice.
Generative Fill describes the action but I personally find it hard to say. It really doesn't roll off the tongue.
Maybe add a before/after clip. Its sometimes not easy to understand instantly which is the original.
maybe watch the whole video ?!
🤣
@@MountMatze Your answer make no sense.
Good advice. Appreciate you letting me know it wasn’t clear 😉
Just did this on my 2011 xD. In my case, getting at that 14 mm bolt was a real chore. The rest of the operation probably amounted to 15 minutes or less, but that one bolt was easily a half hour between removing amd reinstalling it.
Thanks for the video.
please dont use the background NOISE...its so distracting :(
Thanks for the comment.
I did not use any. It could be because Generative Fill is in beta and only does 1080 X 1080.
He meant the annoying music in your video 😅
I like your background music
Thanks for letting me know! I liked it too.
@ProfKlaus You are welcome. And great content, it's straight to the point and easy to follow. I subscribed and turned on all notifications 🤍
Isn't photoshop's generative fill technically in beta and not able to be used commercially?
That is correct. Still a good time to learn how you can use it when it becomes part of Photoshop officially.
Update *** it is now been added into Photoshop this week. You can use it commercially😉
I thoight adobe already covered all thier AI copyright.
@@peacefusion Adobe just released Generative Fill officially into Photoshop this week. It is now okay to use commercially. The AI gets its source imagery from Adobes own stock footage service. I believe the artists receive a payment of some sort
I’m assuming strictly tri pod videography for this ?
At this point yes. Although almost all of my shots were from a drone.
@@ProfKlausdid premier somewhat stick the new png to follow the videos?
@@bogdan3978 Yes. You can use the exact same method with Premier. PNG’s are transparent so can just lay it on top of your footage.
(I hope I answered your question correctly).
Ah yes, my entire job as a matte painter decimated by adobe. Thank you.
If someone experienced in the craft uses Generative Fill, they would probably be light years ahead still.
I imagine that if were to provide this particular videos example scene as a concept for a scene in a film or show... you would be able to make it so much better using the same software! It's not going away so use it to your advantage!
Thank you for the comment!
The problem is the nature of capitalism. Instead of this giving me more options and freedom in my work, it's probably just going to mean our clients are going to expect us to be able to work faster and for less. I've been in this industry for almost a decade and every year all I hear is "we need everyone to work faster." I hope you're right and this does lead to better quality work. That would be nice.@@ProfKlaus
@@fretstain I totally understand your point.
as a matte painter you actually have an advantage if you make use of this tool.
sick in ten years I wont even have to leave the house to be creative..
make more
Thanks for the encouragement!
I have more on the way! Sept has proven to a busy time!
May I ask what video topics you would prefer seeing?
@@ProfKlaus i would like any
DaVinci Pro? You mean DaVinci Resolve?
My bad. Sorry about that.
Only 1024x1024px for the moment.
This is true currently, but learning how to use the tools is crucial.
This is true currently, but learning to use the tools is crucial.