Hi Luc As a DIT I would always do YYYYMMDD on date entry. So you can sort by folder name a get it in order by date. DDMMYYYY will not work on long project.
All my files that matter have YYDDMM tagged into the filename. I've been teaching my son photography, and more than a few of us have said "it's easy to take photos, it's organizing them that matters.
YYYYMMDD is important, and I add to many other files as well for organization. Whether for file names, or within notes, I type this many time per day. I use a text expander so that all I need to do is type "dd", and I get this format for the current date. (Text expanders have a setting that only expands to the date when these characters are typed alone, and not within words like "middle", for example)
I’m from Europe and using YMD is so unnatural, but since I’ve switched to it, I find it A LOT easier to find all my projects especially if I have smaller ones in a row in a few days time (or a larger one than spans through more days).
Year/Month/Day, non-negotiable haha. I think one way to make it easier for people to process, other than easiest to sort, is your folder structure goes from large to small (project > date > camera)…your date folder should be named large to small (year, month, day).
For Davinci Resolve users the media import functionality will do a similar process wherein it can copy to multiple destinations and generate the checksums validation. Pretty sure it’s included in the free version as well. Has been a game changer for me.
9:34 One thing that I highly recommend doing instead of labeling the cards when you get them off the camera is labeling AT the camera: you put the label on the camera at the place of the card slot, so you can't forget the tape when removing the card and you deliver the card already labeled to the DIT. Zero space to mix cards.
I'd like to add three more techniques I use when offloading: 1. Use a copy software that creates a checksum I once had a video file that always crashed my editing software. Other files were fine. I noticed Windows hadn't copied one clip correctly. Since then I recommend using a software like TeraCopy that compares the copied files to the originals. 2. Don't make a backup of a backup If your first backup has a problem its copy on the second drive will. Always copy from the source to each drive. 3. Format your media on the day before the next shoot Leave your cards alone until you prepare your camera for the next job. Don't format them after offloading! If you experience a problem with the copies you might still have your original files.
Man, I discovered you channel quite recently and your practical, boots-on-the-ground, approach to teaching filmmaking is unbeatable. I feel as though I'm just beginning to "mature" as a filmmaker, and your channel is an incredible resource for me right now. I still have a long way to go before I can really call myself a professional, but I'm slowly getting there after 5(ish) years. Thank you for making these videos!
Happy to see that the workflow is still the same since I've been on a professional set. One thing to add being a DIT is also a great way to get into editing. Anyone who gets into it should know a little bit about editing and grading. You never know when a producer walks up to you and says: Can you put these two shots together.
What's your backup workflow like? DO anything different? Let me know! ALSO - Thanks to @jackobEvers for pointing out my mistake: used YYYYMMDD for your folder naming structure, not DDMMYYYY. I was tired and not thinking!
Great video! This stage of the production is arguably the most important and most overlooked. Not getting a shot in the field is nothing compared to loosing all the shots on that card/day. Creating a system that is foolproof is important, so even after a 12+ hour day, nothing can happen. How I do backups for doc shoots is pre-make my folders before the shoot starts. I love folders so an example of my file structure would be, Project Name -> Video -> Day 1 (or date) -> Cam A -> Card 1. Same structure for audio. My process for cards are, once the card leaves the camera, it’s exposed film. Tape does over the contacts immediately labeling what it is and it never goes back into the camera. Director wants ‘just one more shot’, new card. The DIT is the only one allowed to take the tape off. End of the day, tape comes off and card goes into the reader with the tape stuck to the reader it’s in. I sometimes have 8-12 cards to backup at the end of the day so having many on the go at once is the only way. Knowing what is what when something needs to be ejected is important. I do the same as you Luc where the left of my computer is transferred (where the backup SSD’s are) and the right side is exposed. When all is done, I check the bites, as you do in your video. Shotput makes the copies 100% the same (unlike Hedge) so I check the project folder on both drives and they are always the same. I then go through each card on one of the backups and check the clip numbers to make sure all the clips are there and a card wasn’t missed. Once I confirm everything is there, including the last clip of the day on each camera, the cards are formatted and prepped for the next day. Lots of steps but like pilots, if a step list is followed, you can be sure to not miss anything. Oh and the second copy never leaves me. Never leave both copies in a hotel room, in a vehicle or on set/site. SSD’s are so small, just put them in a pocket or give a copy to production for safe keeping during the day. Keep doing what you’re doing, Luc. This is amazing, real world content
Loving your videos! I just wanted to point out, I don't think it's good idea to backup footage from disk to disk. If you get corrupted or damaged file from copying footage from card to disk, if you don't check the files, you can easily backup that damaged files to other disk. And if you in the meantime format card, you can get in trouble.
You're not wrong! A pro media manager would copy direct from source twice using shotput, but when I"m a solo shooter I'll usually take the risk. Have never gotten burned...yet!
I love Hedge's OffShoot for offloading cards. All sorts of options and integrations for the DIT (or IT) folks yet easy enough to use in the field. I usually transfer SD or CFExpress cards to fast M.2 SSD in the field, using something like an OWC Helios with OffShoot. Those files make it back to my edit suite (I don't do as much travelling as you) and are copied twice - once onto a RAID 5 for use in editing and a second time onto a second RAID 5 for medium-term storage. I also do an incremental archive to LTO-8 tape as I go. LTO-8 tapes get stored off-site. Additional working copies on HDDs and SSDs (U.2s and M.2s) are always available as needed. Backups and multiple redundant backups are highly important, especially as a producer who has to insure your own productions. CMF in Canada has a requirement, for example, for digital media to be covered under production insurance (and well they should, 1s and 0s are easily corrupted and deleted and are the equity in the production) and minimum levels of digital media coverage need to be budgeted for in the production. Having an existing redundant backup system (and workflow) in place already helps reduce your risk.
Nice chat about this Luc. I want to add, that as a solo filmmaker, even if it is only a few cards a day, Shotput Pro is absolutely 100% worth it. After every shoot, I immediately get the cards started with Shotput Pro, copying to an edit external SSD, and another external HDD for backup and files ready to edit. The verification process is huge here. Yes, lt takes more time, but you know the files are all good to go when the software is finished. My projects are usually 3-5 minute docs, so one external SSD works well to edit from. After the project is finished, the story is delivered, and I need to archive. I will come back to Shotput Pro and copy the entire External SSD drive(my edit drive for the project) to two identical Internal HDD's sitting in a USB dual drive bay. This sometimes takes awhile, but for archiving, I then have a drive to keep at home, and a drive to keep at the office. Internal HDDs are cheap, and very reliable. I came from an IT background and those things are robust for long term storage compared to SSD. Anyway, Thanks for bringing this topic to attention, and safe travels back home!
I try to use Hedge (now OffShoot) for transfers, clones, etc. The odds of a copy having an issue are vanishly low, but I sleep better knowing that OffShoot is computing checksums as it goes. And frankly it's an easier workflow anyway, as I can use two origin sources and two target drives in one operation.
Another great video Luc! And it was so nice of Hank to participate, he gave some neat insights. These discussions around the real day to day are invaluable to get a grip of how things work in the real world. It took me a while to get to this video as I was busy doing my first PA gig on a short film :D
Great protips as always. I occasionally burn to a secondary hard drive and keep it in a fire box just to be extra careful when I'm working on giant projects.
If you are somewhat confident in using console based applications, rsync is probably one of the best ways to achieve secure backups and data copying. Rsync is pretty much the industry standart for stuff like that on a more low level and enterprise scale. And it is open source and comes with MacOS and most Linux Distributions by default, which is always nice. I have a very simple shell script, that copies and automatically organises my footage based on its metadata (Shot date and Camera Model). Since it is script based, it is quite secure and I can not mess something up if I am tired or in a rush and it automatically validates copied files. The best thing about such a solution in my opinion is, that you can re- run the script any time for example if you re-arrange something, add files, delete stuff, pause syncing, or edit file names, etc. You just run the script again and rsync copies only the changed files, making sure that source folder and destination are always in sync. Again this requires beeing confident with the console and a bit of scripting but to me feels like the most secure and efficient way.
I work on windows and I use teracopy and multiple card readers. I just give the command to copy and verify on many HDDs and the program will just queue the files and copy them one by one and verify them automatically. Afterwards I can compare the files on the HDDs with total commander to see exactly why there is a small difference between file sizes.
It would be really helpful if you made a video that explains the features and components of a camera that you look for in a camera body for doc shooting. I know these things vary from person to person and of course from shoot to shoot, but having a baseline foundation would be great to hear from your perspective. Do you like AF, or hate it? Pro auto ports, or don’t bother? Etc etc
Congrats on wrapping up your gig out there in the wild! It's exciting to hear you have that one in the bag and are on to the next. I am sure you are taking a lot of new and wild memories home with you. Thanks for the awesome tips as always. I never considered/looked into the media manager position before. That could be a great gig!
Thanks a lot for paying attention to my request and giving us these valuable information. Congratulations for successful completion of a mega project.Yash.
I use multiple stills cameras at events and also video cameras for corporates etc and they all have the ability to have the file # prefix customised. I find this really helpful to identify and work with the files from different cameras as they are all different even if they are supposed to be the same sensor. I use the camera model # or Acam and Bcam etc as prefixes. Find it in the file structure menu and set and forget...Congratulations on the shoot and still keeping up the great content for us. It really is time you got a haircut though....and a rest.
Great video, I think it's a very relevant topic. I had to check your workflow to see if the way I do it is way off. Turns out I do pretty much the same. I have 2 types of sd card cases: blue ones and silver ones. Cards in the silver case are formatted and ready to use. Cards in the blue case serve as a 3rd backup. I like to also keep my sd drive no larger than 2TB. This way I "only" loose 2TB of data instead of 4TB and so on. It takes some extra managing but I think it's worth it. Tanks for sharing great content :)
Thank you would be great if you could continue with this subject; as to how to handle the files and cut out unwanted parts or how to only keep the best parts for future projects etc
Great video. Thanks for posting. One thing I'd suggest regarding the naming convention is that it's best practice to name as follows: YEAR/MONTH/DAY as opposed to DAY/MONTH/YEAR. For example in the video, it would be better to call it 20231123 (instead of 23112023 as shown). Reason being that when a shoot lasts more than one month, or starts at the end of one month and carries over into the next month, the folders remain in order. To use the example in the video, think of what happens when you go from the last day of November (30112023) to the first day of December (01122023). The December date is numerically lower than the November date -- which puts them out of chronological order in the project folder. Whereas if you go YEAR/MONTH/DAY... the last day of November (20231130) is numerically lower than the first day of December (20231201), so the files remain in order. Furthermore, that order will remain in perpetuity if a project carries over from one year into the next. So the last day of December, 2023 (20231231) to the first day of January, 2024 (20240101) the order remains. Thanks for all your videos. I've learned a lot!
Quick question for either Luc or a DIT: When you're all done with a project, what is your archival process like? What do you keep vs what do you get rid of?
Great video. I like the bowl idea. When corralling up to 10 photographers a day for an event, I found these tiny “coin envelopes” ULINE sells them in a box of 500, shooter pulled their cards, put one in each envelope, initialed and time stamped the outside, and they go to bed. All night I just kept opening envelopes and processing. When I had copied and verified the shots were there, I initialed and timestamped the envelope clearing the card for formatting. These are great for SD cards, may not be so good for some of the newer larger high speed cards. Still have about half a box left for the next series of events.
Personally, I only work with the default indicators of the Mac OS. The most important thing is not to check if the copy has been well done, but to ensure that the native files are not corrupted due to the hardware or recording issues. In both cases, verification software is not helpful at all because, according to him, the data appears fine, but unfortunately, the files are corrupted from the start. However, it's super important for big productions where there are insurances involved. In that case, we are obliged to work with this kind of software to have concrete proof that the job has been done properly
Great video really needed this guide. How long do you retain the multiple location copys? Until your project is in editing, completed, or longer. Any long term storage considerations?
Well, this "backup" perspective from a DIT would have been helpful BEFORE I lost all my drives a few months ago 😅 The thing is, I did back up 2-3 times. The problem was that it was in the same computer. Anyways, I have to say, that tip of labelling the cards individually as they come out the camera is a GREAT tip that I'm DEFINITELY going to be doing from now on.
Parashoot is a great software for solo ops. No checksums like shotput but it "fake" formats the card in the computer so the camera forces you to format on the next use. Great for not shooting on half filled media lol.
Alot of higher end docs will stipulate the BU drives have to be kept in separate rooms , a few Ive been on even said one must be in a separate building ! , which is totally unrealistic , even seperate hotel rooms is very inconvenient at the end of the day . 3 x BU is the usual . Thats why using software ,shot put , or I use Hedge (offshoot) is way better than drag and drop , you can copy to 3 at thew same time if your computer has the ports. TBH I would never just drag and drop , and even worse , then drag that BU to another drive , that will bite you in the arse one day . And most shoots they will stipulate downloading software has to be used in my contract , as they need the download report for their insurance , and its also your own insurance if post screw things up , they will blame you straight away , Ive had this more a few times , but having the down load verification report has been my winning card . Once it seemed some idiot just couldn't even plug in a drive correctly and first thing they did was claim the downloading was at fault .
nice tip with the bole , most of the time i empty cards to my work server hd , they get trascode on hd1(trascod keep a original copy) , then i take the trascoded footage go on work hd2 , and get automaticky backup on external drive on insert , and also in the vault server , and every year the work server get purge ,, to the vault server and copy to the backup server , the work server is always power on , the vault and backup get power only when i need them , at some point i will put the backup server in some other location ,
am using 2brightsparks SyncBack, has free vesion , and you can automate your back ups , to run on change ,on scedule and on insert work well so far , @@LucForsyth
@@NKRDBL because MacOs journalled was the file system used years ago for Intel based and HDDs and older MacOS.APFS has many advantages and also way faster transfer on same disk. Also way easier to index, etc etc.
I'm wonder what "extra time" is added by using that program? I use hedge and transfer to multiple drives at once. It doesnt really take any more time. It also provides verification the tranfers were successful.
if you have a big card reader array it's not a problem, but becuase it makes both transfers at the same time it's slower than one at a time and then cloning the drive. i.e If you're trying to get a backup done late at night and then go to sleep while it clones it's slower. Not a problem if you have a media manager or if you have lots of time, but when alone and working long days it's painful watching the progress bar tick ahead
We filmed an entire movie. Filmed, edited, it was done and ready to go. The theatre was booked for the premiere and tickets were already purchased. The night before the first showing, the director called us to let us know his daughter had accidentally broken the ONE ssd he used to store the movie. The entire movie was on ONE ssd. ONE!!! We just wrapped on the second go around, but that was a hard lesson for everyone involved. Please, PLEASE, backup your stuff!
My heart dropped when I saw you were using Lexar cards on such a big shoot. I heard too many horror stories with these cards on Sony cameras, I would never take the risk to use them. Have you or your team ever ran into any issues with this brand ?
I only use Lexar x2000 v90 128GB SD-cards and they always work fine for me. However, on one occasion a A7s3 crashed with a Lexar x2000 v90 128GB inside. I am not sure it was related to the Lexar card but one file got corrupted, but since the A7s3 crashed about 4 minutes into an interview, we just started the interview again which lasted for about 8 minutes. This happened about 12 months ago. It was the first and last time it happened. Could this be card related?
Do you do any cloud backups. If so, what service are you using? Anyone in the comments please pitch in which cloud storage/file sharing service you use. Thanks.
Yeah, that made me nervous. If you're starting with formatted drives, I wouldn't expect there to be any difference at all, assuming the file names are of equivalent sizes.
On PC the difference should be zero. Doesn't matter if the drives were formatted, or were not. Actually, there are always displayed "size on disk" witch could differ slightly, and "size" witch should be exactly the same.
User's Comment: "Great video! I've always struggled with finding a reliable backup power solution for my outdoor adventures. This Segway Portable PowerStation Cube Series looks like it could be the answer to my prayers. Thanks for sharing!"Response: "I'm glad you enjoyed the video! The Segway Portable PowerStation Cube Series is definitely a game-changer when it comes to backup power for outdoor adventures. Its massive capacity, fast recharging, and waterproof technology make it a reliable choice. I highly recommend it for anyone looking for a dependable power solution while camping or RVing. Happy exploring!"
I'm getting triggered seeing those cards fall into the bowl like that. Is it an OG troll throwing Lexar cards around. I've always heard to shoot on any card besides Lexar. This is a great refresher video and a kick in the but to put good protocols in place. Always amazing and educational videos, appreciated it!
Sorry! I've never had an issue with them, but I use a mix of Sony, Lexar, and Angelbird. So far I've never had a card fail in 10 years from any brand, but maybe I'm just lucky!
Me shooting wedding for 20 years leaving the files unatended not backed up in the cards for days or weeks without having a single error or lost or problem with them. Hundreds of events covered and not a single issue whatsoever.
As always, nice video and good information. If you use YYYYMMDD, instead of DDMMYYYY, when you name your subfolders they will automatically appear in the correct sequence in the folder.
Hi Luc As a DIT I would always do YYYYMMDD on date entry. So you can sort by folder name a get it in order by date. DDMMYYYY will not work on long project.
All my files that matter have YYDDMM tagged into the filename.
I've been teaching my son photography, and more than a few of us have said "it's easy to take photos, it's organizing them that matters.
YYYYMMDD is important, and I add to many other files as well for organization. Whether for file names, or within notes, I type this many time per day.
I use a text expander so that all I need to do is type "dd", and I get this format for the current date. (Text expanders have a setting that only expands to the date when these characters are typed alone, and not within words like "middle", for example)
I’m from Europe and using YMD is so unnatural, but since I’ve switched to it, I find it A LOT easier to find all my projects especially if I have smaller ones in a row in a few days time (or a larger one than spans through more days).
Year/Month/Day, non-negotiable haha.
I think one way to make it easier for people to process, other than easiest to sort, is your folder structure goes from large to small (project > date > camera)…your date folder should be named large to small (year, month, day).
100% Always YYMMDD-hhmmss.camModel.scene.angle.extention
For Davinci Resolve users the media import functionality will do a similar process wherein it can copy to multiple destinations and generate the checksums validation. Pretty sure it’s included in the free version as well. Has been a game changer for me.
I second this. The Davinci Resolve Clone Tool is incredibly useful and worth using.
Great tip, I'll look into that!
9:34 One thing that I highly recommend doing instead of labeling the cards when you get them off the camera is labeling AT the camera: you put the label on the camera at the place of the card slot, so you can't forget the tape when removing the card and you deliver the card already labeled to the DIT. Zero space to mix cards.
I'd like to add three more techniques I use when offloading:
1. Use a copy software that creates a checksum
I once had a video file that always crashed my editing software. Other files were fine. I noticed Windows hadn't copied one clip correctly. Since then I recommend using a software like TeraCopy that compares the copied files to the originals.
2. Don't make a backup of a backup
If your first backup has a problem its copy on the second drive will. Always copy from the source to each drive.
3. Format your media on the day before the next shoot
Leave your cards alone until you prepare your camera for the next job. Don't format them after offloading! If you experience a problem with the copies you might still have your original files.
I love that you use a $1100 laptop. I use an m1 Macbook Pro as well and it honestly works totally fine.
Man, I discovered you channel quite recently and your practical, boots-on-the-ground, approach to teaching filmmaking is unbeatable. I feel as though I'm just beginning to "mature" as a filmmaker, and your channel is an incredible resource for me right now. I still have a long way to go before I can really call myself a professional, but I'm slowly getting there after 5(ish) years. Thank you for making these videos!
Thanks Josiah, really appreciate that!
Luc and Matt Porwoll are the best teachers on TH-cam. It's not even close.
Happy to see that the workflow is still the same since I've been on a professional set.
One thing to add being a DIT is also a great way to get into editing.
Anyone who gets into it should know a little bit about editing and grading. You never know when a producer walks up to you and says: Can you put these two shots together.
Great addition, thanks. DIT can be a good foot in the door on a lot of levels..well worth thinking about!
What's your backup workflow like? DO anything different? Let me know!
ALSO - Thanks to @jackobEvers for pointing out my mistake: used YYYYMMDD for your folder naming structure, not DDMMYYYY. I was tired and not thinking!
Great video! This stage of the production is arguably the most important and most overlooked. Not getting a shot in the field is nothing compared to loosing all the shots on that card/day. Creating a system that is foolproof is important, so even after a 12+ hour day, nothing can happen. How I do backups for doc shoots is pre-make my folders before the shoot starts. I love folders so an example of my file structure would be, Project Name -> Video -> Day 1 (or date) -> Cam A -> Card 1. Same structure for audio. My process for cards are, once the card leaves the camera, it’s exposed film. Tape does over the contacts immediately labeling what it is and it never goes back into the camera. Director wants ‘just one more shot’, new card. The DIT is the only one allowed to take the tape off. End of the day, tape comes off and card goes into the reader with the tape stuck to the reader it’s in. I sometimes have 8-12 cards to backup at the end of the day so having many on the go at once is the only way. Knowing what is what when something needs to be ejected is important. I do the same as you Luc where the left of my computer is transferred (where the backup SSD’s are) and the right side is exposed. When all is done, I check the bites, as you do in your video. Shotput makes the copies 100% the same (unlike Hedge) so I check the project folder on both drives and they are always the same. I then go through each card on one of the backups and check the clip numbers to make sure all the clips are there and a card wasn’t missed. Once I confirm everything is there, including the last clip of the day on each camera, the cards are formatted and prepped for the next day. Lots of steps but like pilots, if a step list is followed, you can be sure to not miss anything. Oh and the second copy never leaves me. Never leave both copies in a hotel room, in a vehicle or on set/site. SSD’s are so small, just put them in a pocket or give a copy to production for safe keeping during the day. Keep doing what you’re doing, Luc. This is amazing, real world content
Loving your videos! I just wanted to point out, I don't think it's good idea to backup footage from disk to disk. If you get corrupted or damaged file from copying footage from card to disk, if you don't check the files, you can easily backup that damaged files to other disk. And if you in the meantime format card, you can get in trouble.
You're not wrong! A pro media manager would copy direct from source twice using shotput, but when I"m a solo shooter I'll usually take the risk. Have never gotten burned...yet!
I love Hedge's OffShoot for offloading cards. All sorts of options and integrations for the DIT (or IT) folks yet easy enough to use in the field. I usually transfer SD or CFExpress cards to fast M.2 SSD in the field, using something like an OWC Helios with OffShoot. Those files make it back to my edit suite (I don't do as much travelling as you) and are copied twice - once onto a RAID 5 for use in editing and a second time onto a second RAID 5 for medium-term storage. I also do an incremental archive to LTO-8 tape as I go. LTO-8 tapes get stored off-site. Additional working copies on HDDs and SSDs (U.2s and M.2s) are always available as needed.
Backups and multiple redundant backups are highly important, especially as a producer who has to insure your own productions. CMF in Canada has a requirement, for example, for digital media to be covered under production insurance (and well they should, 1s and 0s are easily corrupted and deleted and are the equity in the production) and minimum levels of digital media coverage need to be budgeted for in the production. Having an existing redundant backup system (and workflow) in place already helps reduce your risk.
Nice chat about this Luc. I want to add, that as a solo filmmaker, even if it is only a few cards a day, Shotput Pro is absolutely 100% worth it. After every shoot, I immediately get the cards started with Shotput Pro, copying to an edit external SSD, and another external HDD for backup and files ready to edit. The verification process is huge here. Yes, lt takes more time, but you know the files are all good to go when the software is finished. My projects are usually 3-5 minute docs, so one external SSD works well to edit from.
After the project is finished, the story is delivered, and I need to archive. I will come back to Shotput Pro and copy the entire External SSD drive(my edit drive for the project) to two identical Internal HDD's sitting in a USB dual drive bay. This sometimes takes awhile, but for archiving, I then have a drive to keep at home, and a drive to keep at the office. Internal HDDs are cheap, and very reliable. I came from an IT background and those things are robust for long term storage compared to SSD.
Anyway, Thanks for bringing this topic to attention, and safe travels back home!
I try to use Hedge (now OffShoot) for transfers, clones, etc. The odds of a copy having an issue are vanishly low, but I sleep better knowing that OffShoot is computing checksums as it goes. And frankly it's an easier workflow anyway, as I can use two origin sources and two target drives in one operation.
Great workflow, thanks for sharing!
I have been binging this channel. So much gold. Time to get to work 😅
Another great video Luc! And it was so nice of Hank to participate, he gave some neat insights. These discussions around the real day to day are invaluable to get a grip of how things work in the real world. It took me a while to get to this video as I was busy doing my first PA gig on a short film :D
Great protips as always. I occasionally burn to a secondary hard drive and keep it in a fire box just to be extra careful when I'm working on giant projects.
If you are somewhat confident in using console based applications, rsync is probably one of the best ways to achieve secure backups and data copying. Rsync is pretty much the industry standart for stuff like that on a more low level and enterprise scale. And it is open source and comes with MacOS and most Linux Distributions by default, which is always nice. I have a very simple shell script, that copies and automatically organises my footage based on its metadata (Shot date and Camera Model). Since it is script based, it is quite secure and I can not mess something up if I am tired or in a rush and it automatically validates copied files. The best thing about such a solution in my opinion is, that you can re- run the script any time for example if you re-arrange something, add files, delete stuff, pause syncing, or edit file names, etc. You just run the script again and rsync copies only the changed files, making sure that source folder and destination are always in sync. Again this requires beeing confident with the console and a bit of scripting but to me feels like the most secure and efficient way.
I work on windows and I use teracopy and multiple card readers. I just give the command to copy and verify on many HDDs and the program will just queue the files and copy them one by one and verify them automatically. Afterwards I can compare the files on the HDDs with total commander to see exactly why there is a small difference between file sizes.
Yep love Teracopy!
Great tip, thanks!
It would be really helpful if you made a video that explains the features and components of a camera that you look for in a camera body for doc shooting. I know these things vary from person to person and of course from shoot to shoot, but having a baseline foundation would be great to hear from your perspective. Do you like AF, or hate it? Pro auto ports, or don’t bother? Etc etc
informative topic informative content Thanks Luc.
You're welcome John!
Congrats on wrapping up your gig out there in the wild! It's exciting to hear you have that one in the bag and are on to the next. I am sure you are taking a lot of new and wild memories home with you. Thanks for the awesome tips as always. I never considered/looked into the media manager position before. That could be a great gig!
Thanks! It's a great way in for sure, definitely worth looking into
Keep the commitment please ! Thank you Luc.
Thanks a lot for paying attention to my request and giving us these valuable information. Congratulations for successful completion of a mega project.Yash.
Thank you!
I label the containers as “full” & “safe to format” instead in&out because after a long day your brain won’t recognise what in&out mean
I use multiple stills cameras at events and also video cameras for corporates etc and they all have the ability to have the file # prefix customised. I find this really helpful to identify and work with the files from different cameras as they are all different even if they are supposed to be the same sensor. I use the camera model # or Acam and Bcam etc as prefixes. Find it in the file structure menu and set and forget...Congratulations on the shoot and still keeping up the great content for us. It really is time you got a haircut though....and a rest.
great tips! And yes, 100% agree on the haircut - not a lot of barbers out there!
This is perfect timing! Been looking for a proper backup process
Good luck friend!
Awesome content, thank you Luc!
You're very welcome!
Great video, I think it's a very relevant topic. I had to check your workflow to see if the way I do it is way off. Turns out I do pretty much the same.
I have 2 types of sd card cases: blue ones and silver ones. Cards in the silver case are formatted and ready to use. Cards in the blue case serve as a 3rd backup.
I like to also keep my sd drive no larger than 2TB. This way I "only" loose 2TB of data instead of 4TB and so on. It takes some extra managing but I think it's worth it.
Tanks for sharing great content :)
I appreciate these tips!
I like the hard drive tip...probably quite a bit more expensive, but definitely safer!
I think it's only slightly more expensive. Again, thanks for the breakdown, very useful 👍
Thank you would be great if you could continue with this subject; as to how to handle the files and cut out unwanted parts or how to only keep the best parts for future projects etc
Good idea! That happens in the editing program mostly, not at the backup stage
Great video. Thanks for posting. One thing I'd suggest regarding the naming convention is that it's best practice to name as follows: YEAR/MONTH/DAY as opposed to DAY/MONTH/YEAR. For example in the video, it would be better to call it 20231123 (instead of 23112023 as shown).
Reason being that when a shoot lasts more than one month, or starts at the end of one month and carries over into the next month, the folders remain in order. To use the example in the video, think of what happens when you go from the last day of November (30112023) to the first day of December (01122023). The December date is numerically lower than the November date -- which puts them out of chronological order in the project folder.
Whereas if you go YEAR/MONTH/DAY... the last day of November (20231130) is numerically lower than the first day of December (20231201), so the files remain in order. Furthermore, that order will remain in perpetuity if a project carries over from one year into the next. So the last day of December, 2023 (20231231) to the first day of January, 2024 (20240101) the order remains.
Thanks for all your videos. I've learned a lot!
Reset file number on each shooting. Then number of last file must to be the same of the all file count(+-) on your PC.
Like a checksum 😁
This is the video I needed!
👊🏻
3:48 🥶 (N)ice day of filmmaking! 😅 RESPECT!! 👊🏻 love your vids
Thanks!
Quick question for either Luc or a DIT:
When you're all done with a project, what is your archival process like? What do you keep vs what do you get rid of?
Great video. I like the bowl idea. When corralling up to 10 photographers a day for an event, I found these tiny “coin envelopes” ULINE sells them in a box of 500, shooter pulled their cards, put one in each envelope, initialed and time stamped the outside, and they go to bed. All night I just kept opening envelopes and processing. When I had copied and verified the shots were there, I initialed and timestamped the envelope clearing the card for formatting. These are great for SD cards, may not be so good for some of the newer larger high speed cards. Still have about half a box left for the next series of events.
Great tip! I've seen some pelicans made just for this as well, but I'm always looking for low budget options that work
Personally, I only work with the default indicators of the Mac OS. The most important thing is not to check if the copy has been well done, but to ensure that the native files are not corrupted due to the hardware or recording issues. In both cases, verification software is not helpful at all because, according to him, the data appears fine, but unfortunately, the files are corrupted from the start.
However, it's super important for big productions where there are insurances involved. In that case, we are obliged to work with this kind of software to have concrete proof that the job has been done properly
Great video really needed this guide. How long do you retain the multiple location copys? Until your project is in editing, completed, or longer.
Any long term storage considerations?
Well, this "backup" perspective from a DIT would have been helpful BEFORE I lost all my drives a few months ago 😅 The thing is, I did back up 2-3 times. The problem was that it was in the same computer. Anyways, I have to say, that tip of labelling the cards individually as they come out the camera is a GREAT tip that I'm DEFINITELY going to be doing from now on.
Oh no, that's the nightmare! Sorry to hear it man!
That's how we learn 😄
What a great vid! Yes thanks for posting! Looks like Ill be pruchasing yet another 4TB SSD!! 😂🤣
Yo Luc! when recording are you recording simultaneously to each card or record to card 1 then to card 2 in camera?
a boring topic. but concerns everyone who takes pictures or shoots videos... on earth. thanks you very much for this useful video initiative
You're not wrong!
Parashoot is a great software for solo ops. No checksums like shotput but it "fake" formats the card in the computer so the camera forces you to format on the next use. Great for not shooting on half filled media lol.
Thanks for that, I'll check it out!
OffShoot (formerly Hedge, ShotPut alternative) also pairs well with Parashoot. It automatically does the fake format after the validated-transfer.
When you're on location, what are some tips for "geographically" separating the backup drives?
Good point! Pack in separate bags, ship one set off location when full, put copies in different rooms when leaving for the day's shooting
Alot of higher end docs will stipulate the BU drives have to be kept in separate rooms , a few Ive been on even said one must be in a separate building ! , which is totally unrealistic , even seperate hotel rooms is very inconvenient at the end of the day . 3 x BU is the usual . Thats why using software ,shot put , or I use Hedge (offshoot) is way better than drag and drop , you can copy to 3 at thew same time if your computer has the ports. TBH I would never just drag and drop , and even worse , then drag that BU to another drive , that will bite you in the arse one day . And most shoots they will stipulate downloading software has to be used in my contract , as they need the download report for their insurance , and its also your own insurance if post screw things up , they will blame you straight away , Ive had this more a few times , but having the down load verification report has been my winning card . Once it seemed some idiot just couldn't even plug in a drive correctly and first thing they did was claim the downloading was at fault .
nice tip with the bole , most of the time i empty cards to my work server hd , they get trascode on hd1(trascod keep a original copy) , then i take the trascoded footage go on work hd2 , and get automaticky backup on external drive on insert , and also in the vault server , and every year the work server get purge ,, to the vault server and copy to the backup server , the work server is always power on , the vault and backup get power only when i need them , at some point i will put the backup server in some other location ,
That's a serious workflow! Thanks for sharing!
am using 2brightsparks SyncBack, has free vesion , and you can automate your back ups , to run on change ,on scedule and on insert work well so far , @@LucForsyth
Also. If you use Mac formats. Just use APFS and not the old MacOS Journaled.
Why
@@NKRDBL because MacOs journalled was the file system used years ago for Intel based and HDDs and older MacOS.APFS has many advantages and also way faster transfer on same disk. Also way easier to index, etc etc.
interesting...new for me!
@@LucForsyth it is the standard mac file format for years now.
Learnt this recently , I used to just have all drives ExFat , but the new Mac OS hates it , APFS is much faster .
I'm wonder what "extra time" is added by using that program? I use hedge and transfer to multiple drives at once. It doesnt really take any more time. It also provides verification the tranfers were successful.
if you have a big card reader array it's not a problem, but becuase it makes both transfers at the same time it's slower than one at a time and then cloning the drive. i.e If you're trying to get a backup done late at night and then go to sleep while it clones it's slower. Not a problem if you have a media manager or if you have lots of time, but when alone and working long days it's painful watching the progress bar tick ahead
We filmed an entire movie. Filmed, edited, it was done and ready to go. The theatre was booked for the premiere and tickets were already purchased. The night before the first showing, the director called us to let us know his daughter had accidentally broken the ONE ssd he used to store the movie. The entire movie was on ONE ssd. ONE!!! We just wrapped on the second go around, but that was a hard lesson for everyone involved. Please, PLEASE, backup your stuff!
Wow! Totally a hard lesson. Agree. I guess you need to learn the hard way even if taking advice from others is free.
What’s the controversy with the drag and drop copy? I’ve been using Super Duper for cloning drives successfully.
It's just not quite as safe as having a confirmed record that the transfer was completed. Small chance of an error, but still a chance
My heart dropped when I saw you were using Lexar cards on such a big shoot. I heard too many horror stories with these cards on Sony cameras, I would never take the risk to use them. Have you or your team ever ran into any issues with this brand ?
I have a mix of lexar, sony and angelbird cards. None of them have given me problems in the last 2 years. Maybe just lucky though!
I only use Lexar x2000 v90 128GB SD-cards and they always work fine for me. However, on one occasion a A7s3 crashed with a Lexar x2000 v90 128GB inside. I am not sure it was related to the Lexar card but one file got corrupted, but since the A7s3 crashed about 4 minutes into an interview, we just started the interview again which lasted for about 8 minutes. This happened about 12 months ago. It was the first and last time it happened. Could this be card related?
Do you do any cloud backups. If so, what service are you using? Anyone in the comments please pitch in which cloud storage/file sharing service you use. Thanks.
I personally don't, other than dropbox and icloud. The file sizes are just too big shooting multicam 4k projects
@@LucForsyth Ok, and is that a Dropbox Business account you are using?
@13:36 Difference is more like 50,000 bytes and not 900. though
Yeah, that made me nervous. If you're starting with formatted drives, I wouldn't expect there to be any difference at all, assuming the file names are of equivalent sizes.
On PC the difference should be zero. Doesn't matter if the drives were formatted, or were not. Actually, there are always displayed "size on disk" witch could differ slightly, and "size" witch should be exactly the same.
User's Comment: "Great video! I've always struggled with finding a reliable backup power solution for my outdoor adventures. This Segway Portable PowerStation Cube Series looks like it could be the answer to my prayers. Thanks for sharing!"Response: "I'm glad you enjoyed the video! The Segway Portable PowerStation Cube Series is definitely a game-changer when it comes to backup power for outdoor adventures. Its massive capacity, fast recharging, and waterproof technology make it a reliable choice. I highly recommend it for anyone looking for a dependable power solution while camping or RVing. Happy exploring!"
What?
Do you ever do online backups? What’s the best way to do this?
I don't, but that's because the file sizes are just too big when shooting multiple 4k cameras
Any fellow Red camera users struggling with those R3D file sizes when backing up?
Not to brag. But I traditionally use the technique of idea-film-backup - review - think idea sucked - leave on hard drive.
But that’s just me. 😂
Huh?
@@DougPipersr it’s a joke.
@@justonepersonsorry ....I missed the punch line 😊
@@DougPipersr a poor joke at best.
No worries.
hahah....#relatable!
I'm getting triggered seeing those cards fall into the bowl like that. Is it an OG troll throwing Lexar cards around. I've always heard to shoot on any card besides Lexar. This is a great refresher video and a kick in the but to put good protocols in place. Always amazing and educational videos, appreciated it!
Sorry! I've never had an issue with them, but I use a mix of Sony, Lexar, and Angelbird. So far I've never had a card fail in 10 years from any brand, but maybe I'm just lucky!
Me shooting wedding for 20 years leaving the files unatended not backed up in the cards for days or weeks without having a single error or lost or problem with them. Hundreds of events covered and not a single issue whatsoever.
As always, nice video and good information. If you use YYYYMMDD, instead of DDMMYYYY, when you name your subfolders they will automatically appear in the correct sequence in the folder.