Chat Bot With PyTorch - NLP And Deep Learning - Python Tutorial (Part 1)
ฝัง
- เผยแพร่เมื่อ 8 ก.ย. 2024
- In this Python Tutorial we build a simple chatbot using PyTorch and Deep Learning. I will also provide an introduction to some basic Natural Language Processing (NLP) techniques.
1) Theory + NLP concepts (Stemming, Tokenization, bag of words)
2) Create training data
3) PyTorch model and training
4) Save/load model and implement the chat
Resource:
This tutorial was inspired and adapted from the following article:
"Contextual Chatbots with Tensorflow": chatbotsmagazi...
✅ Write cleaner code with Sourcery, instant refactoring suggestions in VS Code & PyCharm: sourcery.ai/?u... *
📚 Get my FREE NumPy Handbook:
www.python-eng...
📓 Notebooks available on Patreon:
/ patrickloeber
⭐ Join Our Discord : / discord
If you enjoyed this video, please subscribe to the channel!
NLTK:
www.nltk.org
You can find the code on GitHub:
github.com/pat...
PyTorch Beginner Course:
• PyTorch Tutorials - Co...
Please checkout my website to see all tutorials:
www.python-eng...
You can find me here:
Twitter: / patloeber
GitHub: github.com/pat...
Icons:
fontawesome.co...
fontawesome.co...
#PyTorch #NLP #DeepLearning
----------------------------------------------------------------------------------------------------------
* This is a sponsored or an affiliate link. By clicking on it you will not have any additional costs, instead you will support me and my project. Thank you so much for the support! 🙏
Very clear. Much better than the later tutorials. I understood the meaning of tokenization and bag of words when you demonstrated what happens during the execution of the code.
You are the best!! Among all the youtube videos about chabot , you are the only one to explain step by step the fundamentals of coding a chatbot.
glad you like it!
You can tell the difficult theory to the easy one,you're the master!😁
Such a good explanation, seriously anyone with a negative IQ can also understand!
Never stop uploading please :)
thanks so much!
.👆Friendship often ends in love; but love in friendship
I saw many videos but your explanation is great.
Glad to hear that :)
Waited for months from your last series on pytorch :). Please make videos on NLP with pytorch
yes I finally got around to do some pytorch tutorials! part 2,3, and 4 will be released in the next 3 days. I hope to do even more NLP in the future
Very informative and explains everything! Please do more videos like this!
Oh man I love that, I'm working on a chatbot based project and these videos will definitely help me
glad to hear that!
Amazing tutorial, I've no idea about ML or DL, but the video is crisp enough to make understand everything 😊
Glad to hear that!
I am really happy to see your efforts. You have done a great job. thanks sir
thanks!
Watched this video... And boom 💥 SUBSCRIBED!!! 😍
yeah thanks a lot :)
you sound a lot like Kumail Nanjiani. Great video btw
Not at all weeb
you made it much easier for me , great job
thank you so much for this helpful video! would you consider teaching how to implement a GUI along with it?
Yes good suggestion! I’ll consider it
Beautiful Explanation bro! just wow!
glad to hear that!
great video man. Really helpful for my course project. Thank you.
thank you so much for a wonderful tutorial! by the way, I was curious as to which vscode theme you were using-i find it very nice!
.👆look at the girls
Love your playlist on this! Can we use Word2Vec instead of Bag of Words for word embedding?
This is really awesome. After this I want you to develop a machine learning model and deployment using flink kafka hadoop
I will have a look at this...
@@patloeber Please have a look. It will be like a big data archteciture for a bank where each transaction will be monitoried
very clear and easy to understand..thank you for this tutorial :)
Thanks! Glad you like it
Sir, thanks for this video seeing this video has made me love love NLP. I was looking for where to specialise in. Thanks 👍
Really great!! Keep uploading.
This tutorial is more german than Germany itself. But great tutorial anyways!
Haha thx
lucky you, you haven't experienced bavarian English xD
Very helpful video and implementation is very clear, Thanks Man
glad you like it!
It looks like training dataset is same as test set, am I right? Using an AI method to recognize the chat instead of using "if--else" structure.
Great explanation buddy !
Nice video, thanks! Just one question: Is this bag of words methode really also how chatbots (as far as I understand also assistants like siri?) with huge amounts of data work. So apple really has millions of tag with possible inputs that can be labelled to one of the tags like "greeting" and so on? Hard to imagine, since it would be such a long way for it to work well :O
I guess they are self learning bots ,they don't have huge data chunks they rather learn as they progress talking with you
no they use much better method like word2vec.
I like it. Thank you! Is this rule-based or learning-based (retrieval or generative)?
Nice - thanks for taking the time to make the video
Hey,
Can you build a notification reader(who speaks what's the notification) using python...?
By the way
Your videos are just awesome ❤️
Glad you like it! Will add it to my list
I watched all parts and Deployment. I executed also. Amazing work, thank you for sharing 😍. One funny thing I noticed is coffee and tea delivery needs 2-4 days🤣.
This is a nice video man!, I was hoping if you could do also a chatbot in web? Thank you so much for the effort
very understandable
Great job, thank you so much
Glad it was helpful!
@@patloeber I would like to ask you for a favor, how may I find Covid19 psychologic Dataset other than Kaggle. Thank you in advance
genial, gracias por la informacion
Danke für das tolle Video.
Ich habe einen Fehler, würde mich über einen Kommentar freuen
line 134, in _check_not_importing_main
raise RuntimeError('''
RuntimeError:
An attempt has been made to start a new process before the
current process has finished its bootstrapping phase.
This probably means that you are not using fork to start your
child processes and you have forgotten to use the proper idiom
in the main module:
Vermutlich unter Windows, num_workers=0 for the DataLoader, and use if __name__ == "__main__" could be tried to solve this
Thank you so much for this great project! I have a slight doubt... In 20:21 part of the video, when we are running the stem function, why doesn't the output show `['organiz', organiz', organiz']` because when you were explaining the concept of stemming you had shown another example where the words universe and university were stemmed as univers and univers repectively
this course is amazing!!! I'm familiar with python, but have no any experience on ML.
any prerequisites for building the chat bot? TensorFlow Tutorial or PyTorch Tutorial both are needed?
Can you also show how to do entity extraction in a video or a blog post?
i know this might not be seen but at 14:10 in the stemming stage why did the 'e' get chopped off form the word 'anyone'?
I believe this is a mistake
Thanks a lot keep up the good work
Thanks!
Many Thanks!!
Thank you very much for this video.I always search to find this kind of explanations and knowledges.You are really great :)
thanks :)
I am chemist actually .I ve learning python and machine and deep learning and NLP for 3 years.I rarely need to help but sometimes I really need too but there is nobody to ask
I am trying to do this code on google colab but facing some issues like how to creat environment or use pytorch there, can you guide me through? also getting errors on tokenizing(sentence)
Can I work on this project in jupyter notebook
you re the best:)
What a great video
thank you!
Very easy to follow. Very good explanation. Thank you very much.
Thanks for the instructive content! Can you tell me what editor/ IDE you use with python?
I use VS Code. I have a tutorial about my editor setup on this channel :)
14:49
yes before is theory :)
nice
Thanks!
thnx
Thank you so much for this great project! I have a slight doubt...Every time I import a new package like numpy or random on my VS Code, my system isn't able to read it. It says 'ModuleNotFound' I tried everything from changing to path to reinstalling multiple times but it doesn't work. Please help me out with this. Thank youu
having the exact same problem for installing and importing anything. did you find any general solution?
Hey, I’m creating a twitter bot that searches for tweets that indicate suicidal tendencies and I want to implement an AI that identifies this kind of tweets.
That’s an awesome application! I have a tutorial where I set up the titter api if you want to have a look at that: th-cam.com/video/yCYPzoG25ak/w-d-xo.html
U r amazing
PS C:\Users\Jane_Brit\Desktop\ProjeTasarimi\ChatBot> conda activate pytorch
Could not find conda environment: pytorch
You can list all discoverable environments with `conda info --envs`.
I'm getting an error like this. Can you help?I'm getting an error like this. Can you help?
The environment is not created so it gives an error that way
is it possible to recive files(upload files) from a bot like pdf and word file?, I found no tutorials teaching that concept
This is really great tutorial, and currently I have a problem about using TF-IDF instead of boW, anyone has any resources to figure it out, please? I will appreciate it!
Do I need to learn pytorch before I learn this??
Hi all,
i'm getting a error while downloading punkt, i searched everywhere but no answer ,please someone give me a alternative
[nltk_data] Error loading punkt:
Best programming channels I know :
She online classes Arduino
Python engineer
Edureka
thanks!
could u add about how to link database for storing different credentials
Please make a chatbot more advance using rnn And other techniques
great video !! just one doubt what do i have to specify in data.pth
Great tutorial! The bot works perfectly fine! Is there any chance you could recommend any german stemmer which works as simply as the PorterStemmer? Really struggling to get this bot to talk german with me....
spacy has german lemmatization support, which is better than stemming anyway. You can also try to skip this part and see if it works without it
hey there great tutorial! i'm having just one problem, when stemming the words when i debug i always get 'None' as a result
can we get the slides you used for the theoretical parts?
Just a quick question what is the IDLE used in the video? Could I just use pyCharm.
I use VS Code but Pycharm is great, too :)
You are awesome
thanks!
Thanks so much. It was very understandable. But every time I put a new package in python and run it, it still says Module not found error.
Hi! I'm an early beginner to coding in general. I too am trying to create a chatbot I can use for my website. I just don't know which IDE to use. Which one is Mr. Loeber using in this video?
Hey ive seen all your videos for chatbot and even made specifically for my needs, however I just want to ask how do you break into new line in chatbot UI, what to write in intents.json to break in new line in chatbot UI??
This is a great explanation!!
I have one doubt...what should you include in your intents file so that the bot responds with some default message every time it does not recognize a sentence asked by the user
I implemented this in part 4. You don't need to put the default message into the intents. You can simply put it in your code and whenever the probability for intent classification is not high enough, you can return the default message
Why not lemmatize vs. stem?
Great video, But I get an error from testing stemming...... stemmed_words = [stem(w) for w words] ...... The error is invalid syntax Perhaps I forgot a comma? Anyone know whats wrong? Keith
Is there a way for a chatbot to answer questions and select responses that have been predetermined through a database we have created? If I saw your video, the chatbot still answers and responds to questions manually according to what is written in the code. I want to make it able to answer and determine its responses online through the database
If I wanted to make this bot only respond with questions and never anything other than a question, would it be possible to train it with just the intent file or would I need extra code?
Should work with the intent file
What IDE are you using? Great video!
Vs code
I reckon this might be a dump question, but NLTK is that minded for english only?
how can we add voice recognition in the chatbot?
and how and where should I put the code ?
Hey ! Can u add button response in this ?
Good video sir, can I use pyttsx3 on this model?
Which model of chatbot is being used here in this chatbot and why? Please reply
Will it answer questions regarding Home Remedies?
Can we run this without setting up a virtual environment? If yes, how?
Yes you can, just install it with pip. This will install all packages into your main Python site-packages folder
What kind of algorithm did you use for this entire system? I hope you can reply.
For some reason, my print statement is not working. nothing is being printed yet I dont get any error
download permission,,thank
How do you check the accuracy and model summary in pytorch
Hey wanted to ask what is the use of NLP and pytorch if it answers only particular questions. Can anyone clear my doubt?
Hello! can you create a video on how to create a bot on facebook user account not on page using python or js ?
Can anyone plz tell me how to install pytorch and conda, everytime I type conda activate pytorch it says no such command as conda, plz help me!
Check his channel. He has a video dedicated to introducing and installing PyTorch.
yes and I also have a tutorial how to install anaconda
what to do for multiples intent?
How to train a model to attach a transformer?
Hey can you tell which ide you are using visual studio code or atom and can you please tell which is better thanks
VS Code!
Hello Patrick, How Can I Stemm in Spanish?
What if you misspell a word? Does bow take it as a 0?
Is it necessary to create a virtual environment
@pythonengineer Thanks a lot for creating this Tutorial Series! I combined your code with Gareth Dwyer's Telegram bot code to make a Transactional Telegram Chatbot as my first project. It took ages but the code is here and I've credited both of you in the Readme.md
I've learnt a lot from this series, thank you!
github.com/cjl12377/Personal-Telegram-Bot
This is an awesome project! Am I allowed to share it?
@@patloeber sure thing :) the code's arguments aren't very sophisticated though so I think its bound to be slower, run into more errors. More testing is still needed
Hi python engineer, do you know the ideal epoch batch size for small training data of less than 50? I want to ensure that the model is not too 'strict when making prediction. How do I do that?
You have to try it out :) maybe 4 or 8, or even without batches
@@patloeber Thankewww >:)
how to integrate pytroch model in android studio.