How to Import (use) Kaggle datasets in Google Colab?

แชร์
ฝัง
  • เผยแพร่เมื่อ 19 ธ.ค. 2024

ความคิดเห็น • 279

  • @MeMonarch
    @MeMonarch 4 หลายเดือนก่อน +16

    For those who are starting in the updated Kaggle site. The API command might not be available on the "Data" card so what you have to do is click on 3 dots, right after the "Download" button on top right of your dataset. Once you click that you will see an option "Copy API command". Click that and you are good to go!

    • @musahabdulmumini2701
      @musahabdulmumini2701 3 หลายเดือนก่อน +1

      @MeMonarch Thank you for the additional guide

    • @MeMonarch
      @MeMonarch 3 หลายเดือนก่อน

      @@musahabdulmumini2701 you're welcome

    • @kerry_ky
      @kerry_ky 20 วันที่ผ่านมา

      Thank you!

  • @adnaneaboutalib5595
    @adnaneaboutalib5595 ปีที่แล้ว +13

    Very Helpful ! Thank you !
    Summary commands :
    1- Install kaggle
    !pip install kaggle
    2- Upload you API token kaggle.json:
    from google.colab import files
    files.upload()
    3- Create a directory kaggle , move the kaggle.json to kaggle directory , change permissions to the file :
    !mkdir ~/.kaggle
    !mv kaggle.json ~/.kaggle/
    !chmod 600 ~/.kaggle/kaggle.json
    4- Copy API command in dataset section in Kaggle , (ADD '!' at the first of the command)
    Enjoy the ride as your data models take flight! 😍

  • @akhilam2217
    @akhilam2217 3 ปีที่แล้ว +14

    Thanks for the tutorial but what if the chosen dataset doesn't contain the API command to copy into the colab..?

  • @goutamdas641
    @goutamdas641 3 ปีที่แล้ว +3

    Perfect tutorial for Kaggle--->Colab. Thank you

  • @ms.mousoomibora9526
    @ms.mousoomibora9526 3 ปีที่แล้ว +6

    I was struggling for this for quite a long time..Thank you very much for the video..it helps a lot for the new researcher in the DL field.

    • @ShriramVasudevan
      @ShriramVasudevan  3 ปีที่แล้ว

      Thanks and glad u liked it

    • @shroukmohamed5664
      @shroukmohamed5664 2 ปีที่แล้ว +1

      @@ShriramVasudevan
      Could you help me?
      I stopped at 7:55. I can't find this point in Kaggle.
      I didn't find the file in the description could you send again

  • @kalpanayadav1142
    @kalpanayadav1142 3 ปีที่แล้ว +12

    Very efficient, helpful and easy to understand
    Thank you!

  • @greeshmaaeligeti6179
    @greeshmaaeligeti6179 2 ปีที่แล้ว +1

    7:56 im getting 403 forbidden for this statement
    !kaggle competitions download - dogs-vs-cats-redux-kernels-edition
    please help me out

  • @dharshiniravikumar6383
    @dharshiniravikumar6383 2 ปีที่แล้ว

    Very nice session sir.
    Thankyou for your detailed video.

  • @kinuthiasteve4505
    @kinuthiasteve4505 ปีที่แล้ว

    Shriram! This tutorial is undefeated. Thanks

  • @aadarshkumar2257
    @aadarshkumar2257 2 ปีที่แล้ว

    Thank You so so much.
    I can't explain how much irritated and lost i was feeling before watchin this video.
    Now it's clear to me and i can explain to anyone else.
    Once again Thanks a lot.....

  • @honest_review2492
    @honest_review2492 2 ปีที่แล้ว

    Great work simple and to the point very basic steps are addressed which are not found in many videos.you have solved my big problem.thank you sir

  • @aegisds1094
    @aegisds1094 3 ปีที่แล้ว +2

    Very simple video, very nicely explained. The task which seemed impossible to me, you made it very simple. Jai Shriram

  • @durgaprasadmurapaka3965
    @durgaprasadmurapaka3965 ปีที่แล้ว +2

    sir, but when i am creating a direc it shows you can not creat any direc, now what should i do for this

  • @NagamalliParasa
    @NagamalliParasa 8 หลายเดือนก่อน

    Your tutorial is really so much helpful to me. It means a lot. Thanks for sharing such wonderful content to us

  • @mwarnsle
    @mwarnsle 3 ปีที่แล้ว +9

    It appears Kaggle's interface has changed a bit already since January, and I'm at loss at where the command line for this dataset it...
    Edit: never mind, found it(on side, 3 dots["copy API command"])!

  • @vyakhyarastogi
    @vyakhyarastogi 7 วันที่ผ่านมา

    Thankyouu soo mch sir you saved my 50marks

  • @AllAboutBI
    @AllAboutBI 3 ปีที่แล้ว +1

    Sir, you have made it simple. It is very useful for the beginners like.me

  • @sukanya4498
    @sukanya4498 2 ปีที่แล้ว +2

    Crisp & Precise explanation, Thank you! 👌🙌

  • @JoshKonoff1
    @JoshKonoff1 3 ปีที่แล้ว +3

    What if the chosen dataset doesn't contain the API command to copy into the colab..?

  • @onesaditya3689
    @onesaditya3689 ปีที่แล้ว +1

    Such a clear and efficient explanation..!!
    Thanks man..!!

  • @chittithotiakhila9280
    @chittithotiakhila9280 2 ปีที่แล้ว +2

    Hi sir thank you so much for this information
    But while I am running the step 2 that is "*from google.colab import files
    files.upload" I can't get "Choose Files" option in my laptop what I can do? and error raised it's shown

  • @anandhuramesh3462
    @anandhuramesh3462 10 หลายเดือนก่อน +2

    chmod: cannot access '/root/.kaggle/kaggle.json': Not a director not getting this

  • @archanas8463
    @archanas8463 3 ปีที่แล้ว +5

    Very nice explanation, easy to understand and where is the code in the description.? I couldn't find

  • @chaitanyaravi4482
    @chaitanyaravi4482 3 ปีที่แล้ว

    Love this video
    Thankyou so much Shriram garu

  • @sagarpadhiyar3666
    @sagarpadhiyar3666 2 ปีที่แล้ว

    Superb video. so so so much helpful. thank you

  • @musahabdulmumini2701
    @musahabdulmumini2701 3 หลายเดือนก่อน

    Thank you for your clear explanations. It was useful

  • @shireenkhan2105
    @shireenkhan2105 3 ปีที่แล้ว +1

    Thank you so much sir.... U made me understand this method in such a easy way.🙏🏻

  • @jantojanistdio
    @jantojanistdio 8 หลายเดือนก่อน

    Thank you Sir. U save my life❤

  • @CricketTube9905
    @CricketTube9905 2 ปีที่แล้ว +1

    Couldn't download the dataset. i'm getting 403 - Forbidden as the output. can you please explain why?

    • @joekanaan2548
      @joekanaan2548 2 ปีที่แล้ว

      I'm getting the same thing

    • @rizwanakhan0610
      @rizwanakhan0610 10 วันที่ผ่านมา

      did you find any solution?

  • @unnimayanarayanan2503
    @unnimayanarayanan2503 3 ปีที่แล้ว +1

    Very interesting... something very useful for beginners in coding

  • @ASUSPC-yh5cy
    @ASUSPC-yh5cy ปีที่แล้ว

    Very Nice Sir ..Very Nice

  • @PradeepKumar-jj7fb
    @PradeepKumar-jj7fb 3 ปีที่แล้ว

    i couldn't find that type of command which was at 7:43 for my dataset , please help mme

  • @AmeerHamza-c7h9e
    @AmeerHamza-c7h9e 2 หลายเดือนก่อน +1

    When i go for this command
    # to list all the datasets in kaggle
    !kaggle datasets list
    it shows error 401 - Unauthorized - Unauthenticated"
    so what is its solution and due to this the step afterwards are not working in mine one

  • @iabdulwahablearning
    @iabdulwahablearning ปีที่แล้ว

    Thanks a lot for this helpful information...

  • @eswaranbalamurugan8526
    @eswaranbalamurugan8526 3 ปีที่แล้ว +2

    Hi I am facing "403 forbidden"
    How can i resolve. ? I tried !pip install kaggle --upgrade
    and !pip install --upgrade --force-reinstall --no-deps kaggle.... Still same

  • @imroze8840
    @imroze8840 ปีที่แล้ว

    Thanks a lot sir, this is very helpful

  • @bardandhakal7300
    @bardandhakal7300 5 หลายเดือนก่อน

    colab tends to disconnect when not used for a longtime. Do we have to run all the commands and upload the api every single time the colab notebook disconnects?

  • @sachinmathew6809
    @sachinmathew6809 ปีที่แล้ว

    nice work sir !

  • @souradippaul7466
    @souradippaul7466 3 ปีที่แล้ว +1

    Sir I have question, I was trying to create a kaggle directory, but I was unable to generate it. Could you please suggest me how I can generate it ?

  • @lee_badda
    @lee_badda 2 ปีที่แล้ว

    Thank you so much sir! It is my first time participating on a competition in Kaggle

  • @sachindubey7560
    @sachindubey7560 ปีที่แล้ว

    That's made my day. Thank you so much sir. Worked smoothly.
    💙

  • @plavali_znaem
    @plavali_znaem 3 ปีที่แล้ว

    God bless you Shriram, brilliant!

  • @biggusmaximus1651
    @biggusmaximus1651 3 ปีที่แล้ว

    Great video sir, from tamil

  • @krishnapisudde9593
    @krishnapisudde9593 2 ปีที่แล้ว

    great work sir

  • @lisandrodelfino5106
    @lisandrodelfino5106 ปีที่แล้ว

    Excuse me Mr Vasudevan.
    Any chance you could share that word with the step by step in the description of this video?
    Thanks!

    • @lisandrodelfino5106
      @lisandrodelfino5106 ปีที่แล้ว

      You know what? Never mind.
      Following your tutorial works just fine. Thanks

  • @datacodedesign
    @datacodedesign 6 หลายเดือนก่อน

    ut this is for a competition, what about normal datasets?

  • @aqsaishrat9086
    @aqsaishrat9086 2 ปีที่แล้ว

    I want to ask a question... What if only have train.zip file and don't have a test.zip file?

    • @ShriramVasudevan
      @ShriramVasudevan  2 ปีที่แล้ว

      It's required to have both. Else, you can create

  • @dheerajnalapatdheerajnalap8226
    @dheerajnalapatdheerajnalap8226 3 ปีที่แล้ว +1

    what if the data set does not have the code needed for download

  • @mekkicharfi5454
    @mekkicharfi5454 8 หลายเดือนก่อน

    Thank you very much . And how to carry out the reverse process, that is to say convert a Colab application to Kaggle? That's what's important, because notebooks are not the same.

  • @shahabasmuhammed7523
    @shahabasmuhammed7523 ปีที่แล้ว

    Should we do all the steps again in other collab file to download another dataset or can we directly copy the API command and run it to download another set of data ?

  • @robharris3269
    @robharris3269 3 ปีที่แล้ว

    Any suggestions for : 401 - Unauthorized

  • @saurabhk6004
    @saurabhk6004 3 ปีที่แล้ว

    do we have to use ( ! ) this before importing datasets

  • @zooltechno7065
    @zooltechno7065 ปีที่แล้ว +1

    after running command " ! kaggle competitions download -d 'name-of-dataset'"
    it is generating
    Error 403: forbidden

    • @rizwanakhan0610
      @rizwanakhan0610 10 วันที่ผ่านมา

      any solution you found?

    • @rizwanakhan0610
      @rizwanakhan0610 10 วันที่ผ่านมา

      i am getting the same error

  • @NadinMagdy
    @NadinMagdy 3 ปีที่แล้ว +1

    Why can I not find an API command for datasets, only competitions? I want to use a dataset

    • @keremdogan5792
      @keremdogan5792 3 ปีที่แล้ว

      Same here. Any advice or solution?

    • @FuriaKKK
      @FuriaKKK 2 ปีที่แล้ว

      @@keremdogan5792 ! kaggle datasets download [UserName/DatasetName]

  • @abdulrahmanalsaka1345
    @abdulrahmanalsaka1345 ปีที่แล้ว

    after unzipping the folders how could i import this to be used in my model?

  • @arjavjain8338
    @arjavjain8338 5 หลายเดือนก่อน +1

    I'm getting the problem while using this dataset. I'm getting this error "403 - Forbidden - You must accept this competition's rules before you'll be able to download files.". How to solve this problems anyone can tell to me

  • @atulsain6170
    @atulsain6170 2 ปีที่แล้ว

    Thanks. That was very helpful. If I had watched it 1 day ago, it would save from wasting 2 gb data and a day of headache. 😄

  • @abhijeet6431
    @abhijeet6431 3 ปีที่แล้ว

    I want to import great barrier reef (GBR) dataset into colab , GBR dataset has few folders of different types of data files like images ,videos, csv, apis , zip files .. I used your method but in my colab I am only able to see few 100 images but in dataset there are 23000 images, what should I do to get entire data in colab?

  • @liyasimon7742
    @liyasimon7742 2 ปีที่แล้ว +1

    Thank you so much for this great tutorial, You tell that to paste the commands in the description box, I could not get it. I got some errors in it please paste the commands if you can.

  • @prasadshiva8075
    @prasadshiva8075 11 หลายเดือนก่อน

    while creating folder i am getting msg like mkdir: cannot create directory ‘/root/’: File exists. please suggest sir

  • @faizanrana9049
    @faizanrana9049 3 ปีที่แล้ว

    how much data set can we upload my data set is 42GB is it work for me

  • @luisaraujo6824
    @luisaraujo6824 2 ปีที่แล้ว

    Thank you so much!! Very well explained👊

  • @jasdeo5652
    @jasdeo5652 2 ปีที่แล้ว

    Hello Sir, I got this message for the last command to get data in collab Kernel log downloaded to /path/to/dest/eda-to-prediction-dietanic.log instead of data in the file folder. can you tell me why so

  • @archanaramesh9118
    @archanaramesh9118 3 ปีที่แล้ว +1

    It appears cannot create directory '/root/.kaggle ' : file exists
    Help me sir what may be the reason???

  • @mdameen5590
    @mdameen5590 2 หลายเดือนก่อน

    How can we access these data sets into projects

  • @Kashish-hw9gd
    @Kashish-hw9gd ปีที่แล้ว

    Do i have to go through all these steps everytime i want to import datasets from kaggle in colab ?? or just doing it for one time is enough for using datasets

    • @iitianritesh5961
      @iitianritesh5961 6 หลายเดือนก่อน

      In every new sheet, you have to do again

  • @jatinmor4216
    @jatinmor4216 3 ปีที่แล้ว

    very helpful video brother

    • @ShriramVasudevan
      @ShriramVasudevan  3 ปีที่แล้ว

      Glad u liked

    • @jatinmor4216
      @jatinmor4216 3 ปีที่แล้ว

      @@ShriramVasudevan bro could you please tell how to give path of that downloaded file ...I want to build a model of gender recognition with the help of cv2 but I am unable to give the path so that I can read every image of that folder

  • @RAVIKUMARSARANU
    @RAVIKUMARSARANU หลายเดือนก่อน

    The API command might not be available on the "Data" card so what you have to do is click on 3 dots, right after the "Download" button on top right of your dataset. Once you click that you will see an option "Copy API command". In my case this option also not showing sir

  • @mohanks7144
    @mohanks7144 3 ปีที่แล้ว

    thank u sir. very much needed and useful

  • @ngwemo
    @ngwemo 8 หลายเดือนก่อน

    Thanks for insights bro.
    Notes for the commands , can't seem to find it. Will be great to have
    😊

  • @sn__sn
    @sn__sn 2 ปีที่แล้ว

    Thank you for your time, help me a lot!

  • @ngwemo
    @ngwemo 8 หลายเดือนก่อน

    Please do another one now setting it inside the Kaggle notebook itself any directions would be appreciated.

  • @tonihullzer1611
    @tonihullzer1611 3 ปีที่แล้ว

    thanks man, very helpful, have a nice day:)

  • @Khani-id3og
    @Khani-id3og 2 ปีที่แล้ว

    Asalam-o-Alikumsir
    sir test.zip file or train.zip file khn li hn ap ny?? or sir in files mn data khn sy liya tha

  • @marliusardi9973
    @marliusardi9973 3 ปีที่แล้ว

    nice.
    next part show me the OUTPUT sir.

  • @AnjaneyuluPHD
    @AnjaneyuluPHD 3 ปีที่แล้ว

    thank you so much sir with clear explanation ca we have continuation video after importing dataset in colab...

    • @ShriramVasudevan
      @ShriramVasudevan  3 ปีที่แล้ว

      Sure..

    • @AnjaneyuluPHD
      @AnjaneyuluPHD 3 ปีที่แล้ว

      @@ShriramVasudevan sir can i download the steps in word document

    • @AnjaneyuluPHD
      @AnjaneyuluPHD 3 ปีที่แล้ว

      sir you have explained for json files , how to do import for csv fiels ...

    • @ShriramVasudevan
      @ShriramVasudevan  3 ปีที่แล้ว

      I will do a video shortly

  • @Sreeja2202
    @Sreeja2202 3 ปีที่แล้ว

    Sir..Wt to do if it shows " no such file or directory" when trying to make directory

  • @asinusmurtareed4038
    @asinusmurtareed4038 2 ปีที่แล้ว

    thank you so much. it's really working!!!!!

  • @lakshmikanthagc607
    @lakshmikanthagc607 2 ปีที่แล้ว

    Hello Sir, very helpful video you have done. Can you share that word document ?

  • @anilveeraghattapu
    @anilveeraghattapu ปีที่แล้ว

    ! kaggle datasets list
    401 - Unauthorized
    Please tell me, what should I do?

  • @NCHANDRASEKHARPHD
    @NCHANDRASEKHARPHD 3 ปีที่แล้ว

    great ....please put command descriptions under the video

  • @AshishKumar-qt1rk
    @AshishKumar-qt1rk 2 ปีที่แล้ว

    Sir can you tell me "How can I unzip the CSV files downloaded when the .zip file is not present"

  • @gideonnketiah-v5z
    @gideonnketiah-v5z 8 หลายเดือนก่อน

    what happens if the process doesn´t code successfully

  • @dattanidumukkala8178
    @dattanidumukkala8178 8 หลายเดือนก่อน

    Cannot stat kaggle.json no such file or directory

  • @musicalvlogs4418
    @musicalvlogs4418 2 ปีที่แล้ว +1

    very helpful,thank you

  • @RajeshYadav-xw7tn
    @RajeshYadav-xw7tn 3 ปีที่แล้ว

    Could you please provide the installation step guide that is used in video .

  • @Rahul_Singh_Rajput_04
    @Rahul_Singh_Rajput_04 2 ปีที่แล้ว

    sir , please also show us how to submit data in kaggle through google colab

  • @Wurfenkopf
    @Wurfenkopf 3 ปีที่แล้ว +3

    Thank you very much for the explanation... Actually, I came here for a problem that's probably trivial with respect to all this, but I couldn't solve it.
    In a Kaggle code I found the initial instruction:
    from shutil import copyfile
    copyfile(src = "../input/lrp-scripts/utils.py", dst = "../working/utils.py")
    For sure I have to update those paths, but how can I do it?
    Thank you very much!

  • @sakthi1192
    @sakthi1192 3 ปีที่แล้ว

    I have copied the API and pasted it in the code section. After execution, kernel log downloaded to '.log'. Like this, it is showing. Sir, please comment how to solve this?

  • @goodmusic284
    @goodmusic284 3 ปีที่แล้ว

    Thank you so much sir! You should create a tip char and I will happily donate!

  • @vishalisharma3883
    @vishalisharma3883 9 หลายเดือนก่อน

    i am not able to see my dataset when i try to get it from kaggle

  • @onnm1981
    @onnm1981 2 ปีที่แล้ว

    Thanks a lot, it helped me a lot !!

  • @pratibhagoudar6817
    @pratibhagoudar6817 3 ปีที่แล้ว

    thankful to u sir .. .. it's helps

  • @ashishgoyal7020
    @ashishgoyal7020 3 ปีที่แล้ว +1

    Hi there,
    Thank you for uploading this video.
    I tried to understand the complete procedure but couldn't understand '600' here:
    #CHANGE THE PERMISSION OF KAGGLE.JSON FILE
    ! chmod 600 ~/.kaggle/kaggle.json
    One request, pls explain a bit more about the queries we are running.
    Thank you again.

    • @ShriramVasudevan
      @ShriramVasudevan  3 ปีที่แล้ว

      Thanks and sure would do that

    • @abhinaygupta8243
      @abhinaygupta8243 3 ปีที่แล้ว +1

      pls use ur file name
      #change the permission
      !chmod a+rx sample_data ~/.kaggle/kaggle.json
      a+rx u can also use 600 and instead of sample_data write ur own file name

  • @Mathi-o4d
    @Mathi-o4d 2 หลายเดือนก่อน

    how to see the output sir

  • @santoshsp9466
    @santoshsp9466 3 ปีที่แล้ว

    If the folder already exists then what are the steps sir

  • @la_cientifica3938
    @la_cientifica3938 2 ปีที่แล้ว

    Wonderfull explanation. Do you have any video with all the process: importing from kaggle o Drive until the training results?. Thank you so much ♥♥♥♥♥

  • @abdullahalfahad4634
    @abdullahalfahad4634 3 ปีที่แล้ว

    Thanks for the great session

  • @felipe100hq
    @felipe100hq 3 ปีที่แล้ว

    how can I use the labels?

  • @jumana.ahmed0
    @jumana.ahmed0 3 ปีที่แล้ว

    I couldn't do the downloading part. it is showing "403 forbidden". what is the solution?

    • @ShriramVasudevan
      @ShriramVasudevan  3 ปีที่แล้ว

      Let me check n getback

    • @jumana.ahmed0
      @jumana.ahmed0 3 ปีที่แล้ว

      @@ShriramVasudevan also how can we save that dataset to google drive?

    • @eswaranbalamurugan8526
      @eswaranbalamurugan8526 3 ปีที่แล้ว

      I too face the "403 forbidden" error

    • @yixiasun7286
      @yixiasun7286 3 ปีที่แล้ว +3

      @@eswaranbalamurugan8526 You need to accept the rules of the competition. Go to the dataset, in the data tab click the download all button, which will prompt you to the rule tab to accept all the terms and conditions^^

    • @ankitagangwar8623
      @ankitagangwar8623 3 ปีที่แล้ว

      @eswaran thankyou.