Data Wrangling 101

แชร์
ฝัง
  • เผยแพร่เมื่อ 8 ก.ย. 2024

ความคิดเห็น • 103

  • @flickcine
    @flickcine  5 ปีที่แล้ว +13

    Welcome to all the new subscribers! Lovely to have you here. I hope, despite how dry this topic is for a video, you learnt something from it. Let me know below what you would like to see on this channel. :)

  • @steveworonko5307
    @steveworonko5307 3 ปีที่แล้ว +42

    As a long time Loader, just wanted to make a couple comments. In the U.S., on most projects, the 2nd and Loader are 2 different jobs. Small budgets and some commercials, you might be a loading 2nd. Living in the southern U.S. with heat and humidity, we don't put the tape over the pin ends. The reason is with the heat, the glue residue can stick onto the card which can then gunk up the reader or the camera. Most of us put blank P-Touch pieces on the card so we can write the card number directly on the card, as well as the mag tag, which alleviates the need to put another piece of tape on the card, which is an effort to not add to waste.
    And it doesn't matter which checksum you use, this doesn't get said enough, the checksum doesn't ensure the footage doesn't have issues, but just the number of files and size match. So it's important to scrub the footage, I know Loaders, as well as production, think the checksum ensures the footage is good and it doesn't. Which is why scrubbing is important, and make time for it. Like film loading, you should figure out your system and do it the same way every time, and not to change it because the 1st time you do, you'll get burned.
    As far as computers, in the U.S. almost everyone uses Mac's, a few people use pc's but it's rare you will see one on set. And you don't have the latest, greatest computer because if you're just dumping footage, having every bell and whistle maxed out won't make a difference if they hand you a Lacie rugged or some other cheap drive. That's where your bottleneck happens. I have 2018 and 2013 MacBook Pros and still use the 2013 because it's just as fast just for dumping cards. If I'm having to transcode, then I'll bring the 2018, otherwise the older one works just as well.
    This was a good basic video, keep up the good work.

    • @grunt12000
      @grunt12000 3 ปีที่แล้ว

      th-cam.com/video/_IwMNp78VdI/w-d-xo.html DIT Detailed including the humidity tape tip and the P-Touch solution.

  • @drumobsession8644
    @drumobsession8644 3 ปีที่แล้ว +12

    Doing my first wrangling job on in a couple of days, I’ve been taught before but it’s great to see someone else go over the same things as I’ve been taught, must mean I’m doing it right! Thanks!

    • @liberacecruzuee6333
      @liberacecruzuee6333 ปีที่แล้ว

      hope your job went well! im also about to start doing this kind of work!

  • @ehvway
    @ehvway ปีที่แล้ว +1

    Great value brought to you from a lady from Down Under!
    Thanks you for sharing ma'am!

  • @LukeCypert
    @LukeCypert ปีที่แล้ว +1

    A note about Exfat and Windows/Mac compatibility. Mac is picky about what allocation unit sizes it accepts. If at all possible, format to Exfat on a Macos system to ensure compatibility on Mac and Windows. It happens mostly on larger drives, but Mac will refuse to read/mount some Exfat drives unless they were formatted on Mac.
    Windows will mount any Exfat drive.

  • @mmarrotte101
    @mmarrotte101 4 ปีที่แล้ว +6

    You rock Felicia. Got a massive project coming up that requires some pretty intense DIT workflows so this video is muy bueno for me right now. Thank you for taking the time and well done :)

  • @joeyalvero438
    @joeyalvero438 ปีที่แล้ว +1

    I love how the “my camera is sick” got me to audibly go awww and feel real concern haha

  • @theCART00N1ST
    @theCART00N1ST 3 ปีที่แล้ว +2

    I've got a job interview for an editor in a few days and data wrangling was in the responsibilities of the job description, I'm feeling a bit daunted, I'm fresh out of film school looking for work and I have this fear that my lack of experience in certain areas such as data wrangling will jeopardize the interview but I'm glad I found this video. You explained everything well and I now have a basic understanding, so thank you!

    • @gabbehs3417
      @gabbehs3417 2 ปีที่แล้ว

      how is your career doing now?

    • @theCART00N1ST
      @theCART00N1ST 2 ปีที่แล้ว +1

      @@gabbehs3417 I got my first job! Been at it for 2 weeks now, feels good to finally get started :)

    • @gabbehs3417
      @gabbehs3417 2 ปีที่แล้ว

      @@theCART00N1ST sounds great! i have my first job as 2nd ac tomorrow. its a pretty big project and i am a little bit scared haha

  • @Pluralizeent
    @Pluralizeent 3 ปีที่แล้ว +3

    I've just started watching your entire channel cause the knowledge you have is so easily digestible and important, thank you!

  • @fightofdestiny
    @fightofdestiny 23 วันที่ผ่านมา

    Nice Video first of all.
    My recommendation for anyone would be to not use an outlet stripe with switches on it, so you can not accidentally turn off any docking station or any other devices which could interrupt the transfer if there is a power outtage.
    If available use a power backup battery. Some productions have one on their own and can provide one.

  • @stydix.mxrtinski
    @stydix.mxrtinski 3 ปีที่แล้ว +1

    This video has made my day. I have my first 2nd AC job in two days and I am so nervous. Thank you for making this video, it has helped so much!

    • @flickcine
      @flickcine  3 ปีที่แล้ว

      Key is to just try keep calm and always think efficient and logical. 👍👍 Good luck!!

  • @mertkaracayil
    @mertkaracayil 6 หลายเดือนก่อน

    I done data wrangling 12 years ago on a feature film set in Sydney. i was the 2nd camera assistant & the directors personal assistant. after a week it was just to much work for me running around on set doing many other things while also doing the data wrangling at the same time. i eventually had a breakdown from all the stress. also to mention the 1st camera assistant was heavily pushing me around. he really didnt understand i had to much on my plate. i ended up just doing the data wrangling for the remaining few weeks. data wrangling was a job on its own. there was so much responsibility on one person hands to copy the files, triple check the files are copied then back up up the footage in multiple locations then return the card for it to safely be reshot on. the work wasn't just onset to copy the cards it was also backing up the cards at home way after the shoot ended late at night triple check the files and repeat early next morning onset till late night. successful completed everything safely eventually without errors. it was such a great experience.

  • @STONJAUS_FILMS
    @STONJAUS_FILMS ปีที่แล้ว

    Thank you for the helpful video. I used to back up my data by simply dragging and dropping files, but I have recently become interested in checksums since I now back up to two destinations at once.
    As a DOP/editor, I have found that folder structure is not always useful. Rarely do I need to know whether a file comes from card 1, 2, or 3. Instead, I prefer to rename files directly on the card with a naming structure that makes sense and to add the card number to the end of the name if necessary. For example: "2023 Feb 19 Toyota Rav4 Comercial Acam - 001". Not renaming files can lead to dangerous and confusing situations where multiple files have the same name.
    When shooting documentaries or commercials with multiple cameras, I find it very helpful to arrange files chronologically according to the time they were shot. To do this, I ensure that all cameras have the same date and time settings before the shoot and put all footage in the same folder, then arrange by date. I also include any relevant information about the shot in the file name, rather than in the folder structure. Here is an example of what my files might look like:
    2023 Feb 19 Toyota Rav4 Comercial Acam - 001
    2023 Feb 19 Toyota Rav4 Comercial Bcam - 002
    2023 Feb 19 Toyota Rav4 Comercial Acam - 003
    2023 Feb 19 Toyota Rav4 Comercial Acam - 004
    2023 Feb 19 Toyota Rav4 Comercial Bcam - 005
    2023 Feb 19 Toyota Rav4 Comercial Bcam - 006
    2023 Feb 19 Toyota Rav4 Comercial Drone - 007
    Additionally, I use Mac's color-coding feature to help differentiate between cards and to assign colors to good shots.
    Checksum software seems overpriced even tho they are among the easiest to code. there are even tutorials about how to quickly code your own data wrangling software. that's why I use Davinci's new CLONE feature but I agree it could be better. Mac can also checksum using Terminal but that might be next level for most people.

  • @nadamuchu
    @nadamuchu หลายเดือนก่อน

    thank you so much for the captions!!

  • @stephenrichards4175
    @stephenrichards4175 2 ปีที่แล้ว +1

    its not boring its technical excellence

  • @brycemyrah8770
    @brycemyrah8770 3 ปีที่แล้ว

    As a camera PA just getting into second ACing, this is super useful. Love the channel!!!

  • @intelligentcontentacademy
    @intelligentcontentacademy 8 หลายเดือนก่อน

    This was great! Thanks for doing this. Not boring at all!

  • @jasminexbishop
    @jasminexbishop 4 ปีที่แล้ว +1

    Thankyou so much! I'm a film student currently studying in Sydney and about to work on my first Masters degree set (i'm only in the BA) as a Data Wrangler. This definitely helped calm some of my nerves, but the irrational fear of messing something up is still there... oh well.

    • @flickcine
      @flickcine  4 ปีที่แล้ว +1

      That irrational fear sticks around a looooong time 😂
      All the best!

  • @JamesPero
    @JamesPero 5 ปีที่แล้ว +1

    Hey Felicia! Thank you so much for putting all this content together, it's already proving invaluable!

  • @wesammoh7330
    @wesammoh7330 5 ปีที่แล้ว +1

    Your video was so informative to me and it made my day. it came absolutely at the right time to me. Thank you very much.

  • @curtofilms4813
    @curtofilms4813 ปีที่แล้ว

    I loved this video. Made me feel more confident with my first set

  • @durandtom7721
    @durandtom7721 ปีที่แล้ว

    C'est très bien et très clair ! Merci Felicia.

  • @TheEli008
    @TheEli008 3 ปีที่แล้ว

    I wasn't aware of offloading software. Very helpful video!

  • @biscuitpunch1129
    @biscuitpunch1129 4 ปีที่แล้ว

    Hey Felicia! doing my first job for Nickelodeon this Monday. And was really nervous. Really aprecciate your tips. Calms me down. Ill do a great job now I hope. Have a great year.

    • @flickcine
      @flickcine  4 ปีที่แล้ว

      Wonderful! Just stay cool headed and keep everything organised. You'll do great!

  • @samrossfilm
    @samrossfilm 4 หลายเดือนก่อน

    Thank you!!!

  • @KIMCHINAM
    @KIMCHINAM ปีที่แล้ว

    Heyy this is so helpful! thanks !

  • @laiscipri
    @laiscipri 2 ปีที่แล้ว

    this video is so helpful. Tks for sharing your knowledge

  • @Bennymoth
    @Bennymoth 4 ปีที่แล้ว

    FELICIA! This helped me a lot!!! Thanks for sharing your knowledge

  • @dallasdandigitalproduction393
    @dallasdandigitalproduction393 4 ปีที่แล้ว

    Great vid Felicia. I envy your organization skills.

  • @cugan83
    @cugan83 4 ปีที่แล้ว

    Just found this channel, fantastic stuff. Thank you for such a wealth of information.

  • @paulinem2527
    @paulinem2527 5 ปีที่แล้ว +1

    Thanks you for your videos, they are very helpfull ! they help me to be ready for the job of camera assistant ! ( I write to you from France :) )

    • @flickcine
      @flickcine  5 ปีที่แล้ว

      Merci, Pauline! It's always lovely to see these sorts of comments. 😊

  • @user-us4ni4wv8p
    @user-us4ni4wv8p 4 ปีที่แล้ว +1

    Hello from Russia. After back up data wrangler need use parashoot!)

    • @flickcine
      @flickcine  4 ปีที่แล้ว

      Ooo I will have to look at Parashoot. Not used that before. Thanks for watching!

  • @mikiinaba0115
    @mikiinaba0115 3 ปีที่แล้ว

    Hi! from Data Wrangler here in Philippines!

  • @dutchvideoshooter
    @dutchvideoshooter 5 ปีที่แล้ว

    Nice interesting info! On my first 48H where i was DOP I just took the card out and brought it to the editor and she did the data handling. Also I used 2x 256gb in mirror so I could shoot the whole day without any other cards.

    • @flickcine
      @flickcine  5 ปีที่แล้ว

      Yeah wonderful! Ah yeah its really nice when the editor does it too. They can set it up exactly how they want!

  • @seanyoman
    @seanyoman 4 ปีที่แล้ว

    Legend. Thanks a mill!!

  • @alanstandsalone2802
    @alanstandsalone2802 2 ปีที่แล้ว

    Fantastic and well produced video. I/O Coordinators, could you please publish a video regarding the ins and outs of this position? I am very interested in it due to it data collecting, sorting and distributing which is what I love to do but there are no videos regarding the details of this position. Great channel! Liked, subbed and rang the bell.

  • @sisteradmn
    @sisteradmn 4 ปีที่แล้ว

    Excellent info! Thanks!

    • @flickcine
      @flickcine  4 ปีที่แล้ว

      You're very welcome! Thanks for watching 😊

  • @theemrtaco
    @theemrtaco 4 ปีที่แล้ว

    I appreciate you making this video. I am a data Wrangler and when I started there weren't any videos really on this topic. I am sonn gonna be on a shoot after having being out of the Industry for over a year, so I definitely found this helpful and refresh my memory. I like the idea of the bin a lot. I might steal that idea from you lol. I must ask though, what power station was that? I liked that the USB c dock you had, had pretty much everything on it. I want something like that for myself.
    Also something to think about, I recommend getting a UPS over just a regular surge protected power strip. That way if power is ever lost, everything would still be running. I plan to add one of them if this gig works out. We shall see.

    • @flickcine
      @flickcine  4 ปีที่แล้ว

      Of course! Yep I agree with you there. Nice to see your comment because I don't do data for a living, it's occasionally a part of my job but it's not the only thing I do so I don't have perfect knowledge on it. Always good to see suggestions and more insight from people who know a lot more! All the best with your next gig!

  • @tauya80
    @tauya80 5 ปีที่แล้ว

    Thank you for your videos they have been really helpful God bless

  • @vidshepherd4686
    @vidshepherd4686 3 ปีที่แล้ว

    So awesome

  • @heloisaangeli8331
    @heloisaangeli8331 ปีที่แล้ว

    damn i got lost for a sec, i was searching data wrangling for data science (IT) and suddenly you talked about videos and stuff and i got confused lol

  • @WHITEDIRTV
    @WHITEDIRTV 2 ปีที่แล้ว

    I lost a 7 hr shoot because my SD drive reformat itself mid shoot. Lesson learned. None of anything I’ve ever learned or no matter what I’m skilled at; it doesn’t matter if you lose all the footage

  • @joshvalenti9154
    @joshvalenti9154 3 ปีที่แล้ว

    good shit

  • @za3rorzozo205
    @za3rorzozo205 3 ปีที่แล้ว +1

    Hello Flick, I work as 2and AC, I sometimes lose some job because I can't do data , I was bit scared because I don't understand Apple software, and I see everyone on set use Apple MacBook, so can I do data with Windows laptop? Wat do you recommend me?

  • @thefilm-psychologist4163
    @thefilm-psychologist4163 5 ปีที่แล้ว

    Subscribed! Thanks for sharing

    • @flickcine
      @flickcine  5 ปีที่แล้ว

      Thanks for watching and subbing!

  • @inkaddo
    @inkaddo ปีที่แล้ว

    100th comment! .... Thanks for the insight

  • @krzemian
    @krzemian 3 ปีที่แล้ว

    Wow, this channel is golden, so much knowledge, thanks Felicia. Btw your IG handle does not work, thought you might wanna know that

  • @ofrimargalit4066
    @ofrimargalit4066 4 ปีที่แล้ว

    Amazing video! thank you so much!
    I have a question, can you copy to 2 drives from the card at the same time?

    • @flickcine
      @flickcine  4 ปีที่แล้ว

      Absolutely. Just assess if it slows down your transfer too much. Sometimes it's faster to do one at a time, strangely enough. All has to do with how good your hardware is.

  • @lolomre
    @lolomre 4 ปีที่แล้ว +1

    HI FELICIA..... FROM SPAIN.
    Can you say me ..... the diferences between “RUSHES” and “BACKUP”
    Thank you

    • @cuttercarlo547
      @cuttercarlo547 4 ปีที่แล้ว

      MARCONIA Filmaking ‚Rushes‘ is the copy being sent to the editorial to work with, ‚Backup‘, as the name states, is the Backup, this usually should stay at a different and safe location.
      ‚Backup‘ then should only be used if something goes wrong with the ‚Rushes‘ copy, e.g. hardware failure etc., otherwise don‘t touch it until production is finished.

    • @flickcine
      @flickcine  4 ปีที่แล้ว

      Thanks so much! So sorry MARCONIA Filmaking. I didn't get a notification for your comment and didn't see it until just now with Cutter Carlo's response.

    • @lolomre
      @lolomre 4 ปีที่แล้ว +1

      @@flickcine THANKS, CARLO and FELICIA

  • @johnmcnally7812
    @johnmcnally7812 4 ปีที่แล้ว

    Hello! Big fan! I've learnt a lot from you (and also got a discount on a clapperboard as you may be able to tell from my profile picture).
    I was wondering if I could ask you some more specific questions re:data wrangling via email or some other means of communication?
    Or if you could point me in the direction of any suitable Data Wrangling/DIT forums that might help me, that would really be appreciated.
    Love your videos, and I learn so much from them (I no longer dress in all fuchsia on set!)

    • @flickcine
      @flickcine  4 ปีที่แล้ว

      Hey John! Yeah I can try answer what I can via email if you like. Email is in the about section of my TH-cam page. 😊
      I'll try my best to answer what I can!

  • @joaquinfilms
    @joaquinfilms ปีที่แล้ว

    Where do you get your camera tape from?

  • @teresa.zamorano
    @teresa.zamorano 4 ปีที่แล้ว

    Can I use Premiere Prelude instead of shotput pro?

  • @aaronm9353
    @aaronm9353 5 ปีที่แล้ว

    Is the data wrangler the equivalent role of a DIT?

    • @flickcine
      @flickcine  5 ปีที่แล้ว +1

      I believe the DIT is a little more involved than just data wrangling. I've never actually worked on a set with a DIT but from what I am aware they also keep track of the imagery, making sure that the exposure, framing, everything works in the way the DP intended it to look and if anything is wrong or won't work in post, they will notify someone so it can be redone before that issue arises in post production?

  • @riotskater4
    @riotskater4 4 ปีที่แล้ว

    Do you just use gaffer tape to mark your cards?

    • @flickcine
      @flickcine  4 ปีที่แล้ว

      Nah, not Gaffer tape. That is way too strong for something like this. Camera tape or Permacel/fluoro cloth tape are usually what is used. At least over here in Australia that is what is used in the industry. :)

    • @riotskater4
      @riotskater4 4 ปีที่แล้ว

      @@flickcine Okay cool, the video was very helpful, thank-you!

  • @NMAPLondon
    @NMAPLondon 4 ปีที่แล้ว

    What is the dell dock you have there?

    • @flickcine
      @flickcine  4 ปีที่แล้ว

      I'll have to check for you! Can't remember the exact model. Picked it up when I bought my laptop. It's USB C and also charges the laptop when in use which is great!

  • @SHVWNCOOPER
    @SHVWNCOOPER 3 ปีที่แล้ว

    you ever use post haste?

    • @flickcine
      @flickcine  3 ปีที่แล้ว

      No I haven’t. What’s Post Haste?

    • @SHVWNCOOPER
      @SHVWNCOOPER 3 ปีที่แล้ว

      @@flickcine idk if you're on us time or aus but here's a link
      www.digitalrebellion.com/posthaste/
      i use it with offload to dump and backup footage.
      for editing, you can set it up like this dude which is where i got the idea:
      th-cam.com/video/vmKEMoatxgE/w-d-xo.html
      i organize youtube templates for vlogs, client templates for production nice and tidy so i can find stills, raw footage, contracts, etc. you just set it up and it automates it.

    • @flickcine
      @flickcine  3 ปีที่แล้ว +1

      Ohhhhh that looks cool! I'll check it out. I'm based in Aus

    • @SHVWNCOOPER
      @SHVWNCOOPER 3 ปีที่แล้ว

      @@flickcine my ex is over there somewhere i actually have been waiting for the vaccu to approve my travel visa now since oct 2017. they're so strict my cancer treatment was even an issue. i had to have a physical and tons of tests and turn all that over to your govt. lol. hoping covid makes them expedite things to boost tourism and this is approved finally soon haha

    • @flickcine
      @flickcine  3 ปีที่แล้ว

      That's a looooong wait! All the best with it 😊

  • @FlushyTheDrummer
    @FlushyTheDrummer 5 ปีที่แล้ว +1

    what is Dartar?

    • @flickcine
      @flickcine  5 ปีที่แล้ว +2

      The Australian accent is pretty great hey! 😂

  • @karmenchan6866
    @karmenchan6866 5 ปีที่แล้ว

    What laptop are you using here?

    • @flickcine
      @flickcine  5 ปีที่แล้ว

      Heya, Carmen. I'm using the Dell XPS 15 9570 (core i9) :)

    • @karmenchan6866
      @karmenchan6866 5 ปีที่แล้ว

      @@flickcine Oh cool. Thanks for the reply. I'm getting into DIT and been looking at laptops and I still don't know what to get :)

    • @flickcine
      @flickcine  5 ปีที่แล้ว

      You're welcome! The industry standard (well at least in Australia) is MacBook Pro If that helps. But the XPS 15 is a great alternative. You just have to remind production that you'll be formatting drives to EX FAT so they can be used on PC and MAC. :)

    • @karmenchan6866
      @karmenchan6866 5 ปีที่แล้ว

      @@flickcine I also live in Australia so I've been thinking of either getting a new Windows or a second hand MacBook Pro (one with lots of ports). Love your videos Felicia! Gets me through uni

    • @christykail3314
      @christykail3314 5 ปีที่แล้ว

      @@flickcine Worth noting if you are using an Alexa you need to be using Mac OSX unfortunately.

  • @OldSchoolFilm1930
    @OldSchoolFilm1930 4 ปีที่แล้ว

    Everything about the Laptop part blew all crApple laptops to splinters! Couldn't resist laughing.
    crApple laptop:
    reliable? Nope
    various connections? Nope
    build in card reader? Nope
    work with dongles? Nope
    There is a reason why the professional world turned their back on crApple years ago.