Text Preprocessing | tokenization | cleaning | stemming | stopwords | lemmatization

แชร์
ฝัง
  • เผยแพร่เมื่อ 5 ก.ย. 2024
  • An Introduction to Natural Language Processing and chatbots
    In this video we will cover :
    - Text Preprocessing
    - Cleaning
    - Tokenization
    - Stopwords
    - Lemmatization
    - Stemming
    Statistics Tutorial for data science playlist : • Statistics tutorial fo...
    Python Tutorial to learn Python programming for Data Science with examples.
    Complete Python Tutorial for Beginners Playlist : • Python tutorial for Da...
    stats by mathsisfun: www.mathsisfun...
    Reach out to me if you have any questions :
    Email: baskyutsav@gmail.com
    Linkedin: / utsav-aggarwal
    website: www.skilltoai.com

ความคิดเห็น • 48

  • @Lucifer-wd7gh
    @Lucifer-wd7gh 3 ปีที่แล้ว +16

    Guys always remember :
    Tokens : is every word in a sentence
    Word: Token which is not stopword
    Stopword: Unwanted words ( should be removed but not all words . Words like not, ok should be avoided )

    • @tristennasir5954
      @tristennasir5954 3 ปีที่แล้ว

      pro tip: you can watch movies at flixzone. I've been using it for watching all kinds of movies these days.

    • @houstonlochlan9001
      @houstonlochlan9001 3 ปีที่แล้ว

      @Tristen Nasir definitely, been watching on flixzone} for since december myself =)

    • @marcelnoel6717
      @marcelnoel6717 3 ปีที่แล้ว

      @Tristen Nasir yup, been watching on Flixzone} for months myself :D

  • @arshiavashisht3481
    @arshiavashisht3481 ปีที่แล้ว +4

    It would be helpful if you could attach the code in the description

  • @joelkazadi3199
    @joelkazadi3199 ปีที่แล้ว +3

    This video was extremely helpful to me, especially the last code cell. Thank you so much!

  • @piyankarajayadewa7157
    @piyankarajayadewa7157 2 หลายเดือนก่อน

    Well-explained! 👏👏👏

  • @GauravSharma-td2fd
    @GauravSharma-td2fd ปีที่แล้ว

    Good video . Jai Hind from Scotland.

  • @linguist7713
    @linguist7713 หลายเดือนก่อน

    Earned a sub

  • @reynaldipradana4308
    @reynaldipradana4308 2 ปีที่แล้ว

    Sir, i wanna say thanks because this video help me a lot for my thesis. thank you so much sir.

  • @muzcool4
    @muzcool4 4 ปีที่แล้ว

    Good explanatory Video on data pre-processing and in very simple language.
    Waiting for the next video.

  • @ArshitPatel2
    @ArshitPatel2 4 ปีที่แล้ว

    Thank you sir for this much simplistically explanation!, waiting for next videos...

  • @oluniyikofoworola5912
    @oluniyikofoworola5912 4 ปีที่แล้ว +1

    Hello, thank you so much for this video. But, when I got to the part of applying the preprocessing on my dataset, I keep getting the error 'method' object not iterable. Please how can I sold this

  • @KrishnaRamchandani
    @KrishnaRamchandani 3 ปีที่แล้ว +3

    how to perform all these pre processing steps at a same time on a csv file containing data. and giving output in a new csv file. if someone knows how to do it. please share some resources/ references. its urgent.

    • @utsavaggarwal_ds
      @utsavaggarwal_ds  3 ปีที่แล้ว

      It's is applied in next videos

    • @KrishnaRamchandani
      @KrishnaRamchandani 3 ปีที่แล้ว

      @@utsavaggarwal_dsokay.
      I've tried data.ix but it's not working. i also tried data.loc and data.iloc but they both are also not working they are showing error. any other option regarding this or how solve this error please tell.

  • @navdhaagarwal5862
    @navdhaagarwal5862 4 ปีที่แล้ว

    Best video on data pre processing. 😇

  • @himanshuarora6822
    @himanshuarora6822 4 ปีที่แล้ว +1

    please upload the next videos of applying NLP technique to processed data in this video.

  • @79-surajyadav26
    @79-surajyadav26 ปีที่แล้ว

    Very simple explanation 👍

  • @mesayshemsu2134
    @mesayshemsu2134 8 หลายเดือนก่อน

    Good tutorial
    But I got some error in the last code.
    data.ix[index,'Title'] = filter_sentence
    It says **AttributeError: 'DataFrame' object has no attribute 'ix'**

  • @shikharsaxena8328
    @shikharsaxena8328 2 ปีที่แล้ว

    Very well Explained...

  • @anisjumri3027
    @anisjumri3027 5 หลายเดือนก่อน

    12:55 what does [0:10] mean in sentence data [Title] [0:10] ? need fast reply, thank you 🥹

  • @hariniprabakaran5434
    @hariniprabakaran5434 4 ปีที่แล้ว

    Nice Video,Please add the next video soon!

  • @venkateshperumal2695
    @venkateshperumal2695 2 ปีที่แล้ว

    Sir plz upload data set for preprocessing

  • @shivnathgaur5381
    @shivnathgaur5381 2 ปีที่แล้ว +1

    Why not do these all thing on data set why take simple example because there are some error when do with data set

  • @arslancreation9829
    @arslancreation9829 3 ปีที่แล้ว +1

    AttributeError: 'DataFrame' object has no attribute 'ix'
    I got this error when I add ix attribute .kindly give me any solution

    • @utsavaggarwal_ds
      @utsavaggarwal_ds  3 ปีที่แล้ว

      Use .loc function

    • @KrishnaRamchandani
      @KrishnaRamchandani 3 ปีที่แล้ว +1

      @@utsavaggarwal_ds i tried using ix, iloc and loc but still getting error. and yes pandas is also up to date.
      any other way to remove the error.? if possible provide solution fast, currently working on a project, but work is stopped due to this error.

    • @sheshbikel5911
      @sheshbikel5911 2 ปีที่แล้ว

      @@KrishnaRamchandani have you solved your problem?

  • @unitegaming46
    @unitegaming46 2 ปีที่แล้ว

    Very well explained

  • @SimonFerocius
    @SimonFerocius 9 หลายเดือนก่อน

    How to download all the results into csv

  • @sangameshkulkarni8303
    @sangameshkulkarni8303 4 ปีที่แล้ว

    Waiting for next videos in this section..
    Plz...upload it sir.

  • @ankitadutta97
    @ankitadutta97 4 ปีที่แล้ว +1

    Hello Sir, When will you be updating the next video for chatbot. Your way of explaining is very simple and easy to grasp. Looking forward for the next video.

  • @parthrajauria6520
    @parthrajauria6520 4 ปีที่แล้ว

    When will you release video to build chatbot

  • @krishna7440
    @krishna7440 4 ปีที่แล้ว

    Amazing videos sir

  • @barlettemakuwe4910
    @barlettemakuwe4910 2 ปีที่แล้ว

    great 🤝

  • @babuo7682
    @babuo7682 2 ปีที่แล้ว

    Utsav , for single line the regex works , how it will work for entire column ? do we need to run for loop ?
    Thanks in advance.!

    • @utsavaggarwal_ds
      @utsavaggarwal_ds  2 ปีที่แล้ว +1

      Yeah run it on loop or use lambda function, it'll be simpler

  • @adityanain2342
    @adityanain2342 2 ปีที่แล้ว

    Thanks man 👍

  • @oyadirantunnifemi3229
    @oyadirantunnifemi3229 ปีที่แล้ว

    where did ix come from please?

  • @user-fw2fc4ro4w
    @user-fw2fc4ro4w ปีที่แล้ว

    How can i get this dataset , can you send it as a pdf file ?

  • @aniladesha1923
    @aniladesha1923 4 ปีที่แล้ว

    good session

  • @veraldolisura6604
    @veraldolisura6604 3 ปีที่แล้ว

    Hey, What apps or web are you using to compile the code ?

  • @manansoni815
    @manansoni815 ปีที่แล้ว +1

    Why your notebook is cutting from the left? bro improve first.

  • @ContentWriterGoals1
    @ContentWriterGoals1 ปีที่แล้ว

    plz share source code