i guess Im randomly asking but does anybody know of a tool to log back into an instagram account? I was dumb forgot my password. I would love any help you can give me!
Thanks for making good content. For the people following along the notebook is referring to websocket-client package. Also the use ws = websocket.create_connection('ws://localhost:8000/ws/polData/') to connect from ipnyb. Also I would recommend author to use requirements.txt files to using pip freeze to make it easier for people to follow the course
I have now got a good understanding how django channels work. Thank you for the perfect content. Please can you make a video about how to use it to fetch data from database. Much love🥰❤❤❤
@@dnj86 Scaling is a different beast, what I did was a PoC where people with few resources or a single resource are just trying to get something in action. to showcase, if a scalale solution needs to be built, another tech stack needs to be introduced. Not just python In my opinion.
Apparently for python versions greater than 3.6 they recommend adding .as_asgi to the url routing. websocket_urlPattern=[ path('ws/polData/',consumer.DashConsumer.as_asgi()), ] using the adjustment to the url and the following in the client code I was able to establish a connection ws = websocket.WebSocket(sslopt={"check_hostname": False}) ws.connect("ws://localhost:8000/ws/polData/") Thanks John
Very nice tutorial. I am facing a problem of ws=websocket.WebSocket().It is throwing an error of -__init__() missing 3 required positional arguments: 'environ', 'socket', and 'rfile'
Great tutorial! How can I send data from a server to a ML algorithm in Django that then process it and send the data to a real time graph? Any suggestion? Thanks!
Thank You, I've been understanding really well, but at 38:52, after trying to connect the subscriber to the server I get: in main async def queue_factory() -> asyncio.Queue[str]: TypeError: 'type' object is not subscriptable , please help!
@@technologyfornoobs Now after installing websocket-client it says: No module named websocket.__main__; 'websocket' is a package and cannot be directly executed
@@technologyfornoobs If I will implement the system in IoT, some architectures involve broker (redis) and worker (celery), why is that? Here you show, the django channel can solve this problem. Then what about the role of the MQTT broker (mosquitto)? can redis replace it? Maybe you can help explain it. Regards
@@doditsuprianto4304 I am not an expert in IoT infra kinds of stuff, yes Redis is still needed in our implementation as well for obvious reasons, and WebSockets is another protocol and MQTT is a diff protocol, where the data packet is even smaller than what we have done in WebSockets.
Great tutorial. I have a use case of creating a real time dashboard by fetching continuous data points from a websocket API exposed by a third party app. How do I establish a ws connection with that API using channels?
@@technologyfornoobs I want the real time data points to be stored in the database as well. The architecture I thought of is similar to what you have demonstrated here. Is there a way to run the process of Jupyter notebook in the Django app itself, as a continuous background task or something?
awesome tutorial ...i request you to make tutorial on how many users click the link, their ip address,i mean tracking their activities in graph from in backend side of blog website?
Actually i am making web app for my final year project. can you tell me how can i open socket for each edge device, like in my project there will be edge device for each individual client and graph should only be plot for client who logged in into the system.
I would recommend you to go through the concepts again, may be you already know the answer, and also the video is quite old now, many things have change and many other technologies are available to do such things.
@@technologyfornoobs i just want token authentication for user authentication.Each edge device have unique token so that data sending from user edge device must display on their own homepage. if you have discord then we can chat there.
Yes you can, in my video I kept the channel value as constant, you can also pass channel value as dynamic and accordingly websocket will send data and our server will update based on the channel the data belongs.
Great Content but how did you connect the websocket server from jupyter notebook since i keep getting this error: ws=websocket.WebSocket() TypeError: __init__() missing 3 required positional arguments: 'environ', 'socket', and 'rfile'
If you're on Windows and you have problems installing channels with an error like: Microsoft Visual C++ 14 is required, Download Twisted from www.lfd.uci.edu/~gohlke/pythonlibs/#twisted. Choose the win32 one corresponding to your python version. For instance, I used Python 3.8; so I downloaded Twisted‑20.3.0‑cp38‑cp38‑win32.whl (Notice "cp38"). Once downloaded, navigate to the download folder in your command prompt and run 'pip install ' followed by the file u just downloaded. After this you can install channels or whatever. You're welcome!
Dude totally underrated video. You did such a great job of explaining the theory and implementation of this thank you. I am definitely subscribing and will be eagerly waiting for new videos. Btw as a windows user I ran into a few issues. Below are the solutions that helped: Issue 1: When installing channels (pip install channels) I kept getting an error when it attempted to install Twisted Solution: Use Python 3.7 instead of 3.8, twisted is not supported on 3.8 Issue 2: aioredis.errors.ReplyError: ERR unknown command 'BZPOPMIN', this happens because redis is not supported on windows Solution: Install the Ubuntu 20 app in the windows store and activate the WSL. When you run the app update+upgrade your repos (sudo apt update; sudo apt upgrade -y) then install redis-server and redis-cli (sudo apt install redis-server -y; sudo apt install redis-cli -y) this should install redis version 5. type the command, redis-server to start redis then you shouldnt be good to run django and publish data. I hope this helps.
Hey man , I had this twisted problem before , for python 3.8 u need to download twisted urself for python 3.8 and then install it locally with pip in your project ,at least that's what I did , I'd like to know if u came up with a better solution. and for the redis you could use docker it's very easy u just start a redis server. good luck :) I hope this helps a little
@@ashkanoliaie6548 I've tried many solutions like using WSL 2, installing an older version of redis and using docker on my windows machine to use redis and have not been able to shake the BZPOPMIN error. I've gotten the redis server running in a bunch of different ways but am yet to successfully connect. Does anyone have an explicit basic step-by-step solution on how to run and connect to a redis server in windows? I'm sure I'm missing something simple, docker seems to be easy enough but I just keep getting this error. Thanks in advance
I am getting an error on the ws=websocket.WebSocket. Follow the error msg: "TypeError: __init__() missing 3 required positional arguments: 'environ', 'socket', and 'rfile'". Any idea what is wrong?
@@technologyfornoobs I found the issue. I installed websocket instead of websocket-client. Thanks for answering. Then later in the video, I also had to install websocket. It would be easier if I had follow your requirements.txt. I also had problems with the newer version of channels_redis(as I am on windows). Then I had to specify the correct channels_redis version to install. Now it is working.
@@technologyfornoobs Thanks for the reply. I was able to upload it to cloud. The roadblock was that Google App Engine doesn't support websockets, so I ended up using Google Compute Engine. I have a follow up questions. If you have multiple windows on a page all streaming, how do you extend the code?
do you mean multiple graphs? or just browser windows?, if multiple graphs, just make an addition in the consumer.py where I have fixed the channel name make it dynamic by sending it as a url parameter and do the required changes in the respective codes.
I looked into consumer.py as you mentioned and created two classes and routed each websocket to different class. It has worked! Thanks for the suggestion.
Hi , i need to do a time series analysis of stock data. Where as i have to show live data graph on frontend ? How can u perform using lstm algorithm to show data and prediction on ui in django?
that could be simple and could be complicated.what's your input structure for LSTM would define the complication in approach, as in real time you will get a single data point, and LSTM would need some window of data to process and predict. but just a clue in Consumer.py file >> receive part you would have the logic to predict.
@@technologyfornoobs thankyou for solution . I appreciate. Can you please tell me more about it. Like how can i exactly use realtime time series analysis of stock data. As of now i only have data in csv where as i could use the same in db and fetch in dashboard but when it comes to real time analysis, it really become hard.
@@storememory I think you need something more robust that this. There are dedicated tools for this problem e.g time series databases like KDB. if you want to have a crude implementation think about using a redis solution with a siding window and performing the calculation there using a pub sub mechanism. UI framework like django and channels are really not the place where business logic and critical processing should happen
we need consumer for creating the webserver which can publish the data real-time to other consumers if you already have a WebSocket somewhere else you do not need Django component
I have little confusion about it that We can can send data from client(publisher) to server without redis,then why we have use redis server here? I run this code without redis but I see that it can perfectly send data to server. Hopefully you will reply and help me to know about it. Thanks
We have defined the redis server config in settings if you notice, redis helps on this communication. Django also provides a default server for websocket but it's not recommended to use. Just another point, server is using the redis not client
Setting up Django environment is a real challenge, several package dependencies. Though there is online support and forums to help but it is gets outdated within dates with new updated packages.
----> 1 ws=websocket.WebSocket() TypeError: __init__() missing 3 required positional arguments: 'environ', 'socket', and 'rfile' got this error and i didnt find the requirements.txt in the git
i m using django 3..there is already asgi.py..TypeError: object.__init__() takes exactly one argument (the instance to initialize) WebSocket DISCONNECT /ws/polData/ [127.0.0.1:57510]
Yes, you are using latest Django which gets you asgi.py file created. And I somehow do not have req.txt file missing in mostly all repositories, not sure why, But for now the error you have is not in django, but in Notebook I am assuming, and the solution for this is you need to install "websocket-client" not the "websocket" only. Try this
@@technologyfornoobs I am seeing another error now. File "test.py", line 8, in ws = websocket.create_connection('ws://localhost:8080/ws/polData/') File "/home/adtran/.local/lib/python3.8/site-packages/websocket/_core.py", line 592, in create_connection websock.connect(url, **options) File "/home/adtran/.local/lib/python3.8/site-packages/websocket/_core.py", line 248, in connect self.sock, addrs = connect(url, self.sock_opt, proxy_info(**options), File "/home/adtran/.local/lib/python3.8/site-packages/websocket/_http.py", line 120, in connect sock = _open_socket(addrinfo_list, options.sockopt, options.timeout) File "/home/adtran/.local/lib/python3.8/site-packages/websocket/_http.py", line 200, in _open_socket raise err File "/home/adtran/.local/lib/python3.8/site-packages/websocket/_http.py", line 175, in _open_socket sock.connect(address) ConnectionRefusedError: [Errno 111] Connection refused
@@technologyfornoobs Using IP of the server in connect request gives a different error. websocket.create_connection('ws://x.4.95.208:8080/ws/polData/') Traceback (most recent call last): File "", line 1, in File "/home/adtran/.local/lib/python3.8/site-packages/websocket/_core.py", line 592, in create_connection websock.connect(url, **options) File "/home/adtran/.local/lib/python3.8/site-packages/websocket/_core.py", line 252, in connect self.handshake_response = handshake(self.sock, *addrs, **options) File "/home/adtran/.local/lib/python3.8/site-packages/websocket/_handshake.py", line 79, in handshake status, resp = _get_resp_headers(sock) File "/home/adtran/.local/lib/python3.8/site-packages/websocket/_handshake.py", line 164, in _get_resp_headers raise WebSocketBadStatusException("Handshake status %d %s", status, status_message, resp_headers) websocket._exceptions.WebSocketBadStatusException: Handshake status 500 Internal server error ########################### Error on Django Server: Exception inside application: No application configured for scope type 'websocket' Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/channels/routing.py", line 73, in __call__ raise ValueError( ValueError: No application configured for scope type 'websocket' WebSocket DISCONNECT /ws/polData/ [x.4.95.208:43598]
Hello, you need to have both websocket and websocket client in your env, websocket is used in django side, websocket-client is used in notebook to communicate as a 3rd party tool or device.
Thanks, sir for this amazing tutorial. I have a requirement where instead of a dashboard, there will be a table. And data in that table should update automatically when new data is added in DB and that is without refreshing the page. Can we use Channel in that case?
Great tutorial! When I tried to do Websockers connect, I got this error: ... WebSocket HANDSHAKING /ws/polData/ [127.0.0.1:64222] WebSocket CONNECT /ws/polData/ [127.0.0.1:64222] Exception inside application: ERR unknown command 'BZPOPMIN' ... aioredis.errors.ReplyError: ERR unknown command 'BZPOPMIN' WebSocket DISCONNECT /ws/polData/ [127.0.0.1:64222] Any idea to address the error?
Great work brother It solved major portion of my problem and helped me to design my code flow. But i am confused about channel layer, and redis. Do we have to run redis on another server in production?? And can you please make a video or deployment?
@@technologyfornoobs Hey hope you're doing good, do you know any free resoucre where i can deploy my django-channels applicaiton free/without credit card
Nice tutorial..!! Can you please explain how we can integrate celery with this project. As I am new to django I dont know how to do it. Specifically , what if I want to request some api for data which is sending to receive in websocket instead of running stand alone script in notebook??? it will be great for me if you suggest. Thank you.
I hope you have gone through this link for celery with django: docs.celeryproject.org/en/stable/django/first-steps-with-django.html You are asking, to call an rest API and then send the response to the websocket and proceed on >>> it is possible, but what would be your logic to call the rest, as websocket works on a concept of event, if event happens then all things initiated, So even in my application in the notebook I created a client which was subscribed to my websocket service and event happened and all process started. In your case you also have to write some client whether it is calling a rest or any data event by any device, but at the end it must be subscribed and push the data to your websocket service.
@@technologyfornoobs Thank you for quick reply.. I have read celery doc and implemented it. Problem I am facing is how can I push data from my task function within same project. Means as in your notebook app we first define websocket and send data with "ws.send(URL)" method. Should I use this way to push data in same project or is there any other method to do that. Sorry for my lack of knowledge. But I want to learn.
@@technologyfornoobs at 28:52 from where are you sending data to the routing port. Cause i am receiving error, "no connection made, because target machine actively refused it." which website are you using to generate client side data? How can i generate the same on my system itself? please elaborate
@@technologyfornoobs Ya But I think it is real-time and I want to store the message so that whenever anyone loads the page all the message will be there forever
Thank you for the video. I am trying to develop a django dashboard for sensor data so it is really in line with what I am trying to do. I am getting an error with the Jupyter code. I have installed websocket-client and uninstalled websocket and websockets. The first error I get is ws=websocket.WebSocketApp() TypeError: __init__() missing 1 required positional argument: 'url' If I put the url in ws=websocket.WebSocketApp('ws://localhost:8000/ws/polData/') The following error comes up. ws.connect('ws://localhost:8000/ws/polData/') AttributeError: 'WebSocketApp' object has no attribute 'connect' No Handshake occurs Thoughts appreciated.
bro could you make a recommendation system using tensorflow and integrate the model in a e - commerace type web application of django. please bro... by the ways loved your videos
works with 3.1, I tried this with 3.1 and definitely works, see my other comment for very minor change you might have to make. Another minor change might be required to use the same with Daphne where you need to get the 'default' application and setup django instead of just the asgi application
Hi, I got this issue with websocket connection as it is getting closed due to handshake error , The error Message are as below: WebSocket HANDSHAKING /ws/polData/ [127.0.0.1:59304] Exception inside application: object.__init__() takes exactly one argument (the instance to initialize) Traceback (most recent call last): File "/usr/lib/python3.7/site-packages/channels/routing.py", line 71, in __call__ return await application(scope, receive, send) File "/usr/lib/python3.7/site-packages/channels/sessions.py", line 47, in __call__ return await self.inner(dict(scope, cookies=cookies), receive, send) File "/usr/lib/python3.7/site-packages/channels/sessions.py", line 172, in __call__ return await self.inner(self.scope, receive, self.send) File "/usr/lib/python3.7/site-packages/channels/auth.py", line 181, in __call__ return await super().__call__(scope, receive, send) File "/usr/lib/python3.7/site-packages/channels/middleware.py", line 26, in __call__ return await self.inner(scope, receive, send) File "/usr/lib/python3.7/site-packages/channels/routing.py", line 160, in __call__ send, File "/usr/local/lib/python3.7/dist-packages/asgiref/compatibility.py", line 33, in new_application instance = application(scope) File "/usr/lib/python3.7/site-packages/channels/generic/websocket.py", line 159, in __init__ super().__init__(*args, **kwargs) TypeError: object.__init__() takes exactly one argument (the instance to initialize) WebSocket DISCONNECT /ws/polData/ [127.0.0.1:59304]\
Consumers receive the connection’s scope when they are initialized, which contains a lot of the information you’d find on the request object in a Django view. It’s available as self.scope inside the consumer’s methods.
@@technologyfornoobs how to check , second user disconnected or not. I think in websocket _ disconnect function we have to use , self.channels.group_send( Group_name, { Type:'leave.room', message:'leve room'} ) method , am right or not .
yes some thing similar, by this logic you can also add how many user are in the chat room or if any user left the room kind of functionality, as the connection get closed by the user it does reach to disconnect functionality and as I haven't written anything so it does not do any thing.
I can but don't you think it will be over killing and all people will just ping and so all those notorious things will happen like sharing irrelevant contents
@@technologyfornoobs no bro i meant making a chatroom like app where users can create a room and others can join you can also give them the option to make public or private rooms that's what i have to for school but i already know about websockets and channels i just don't know how to create a database for the rooms and allow real time messaging in it
Hey, really amazing content, I was searching for this only. I am working on my own data analysis backend and I have very similar requirement, but the source of data is different and I am stuck on that. I would like to get your insight on same. How can I contact you ? Hope you will reply
Hi It's a Nice Video. Is it require to have python code on third party sensors. or please let me know how to featch data from sensors to phyton programe . Appreciate if you help me and share your email Id.
can we just take a moment to appreciate the fact that this guys still responds to queries 8 months after upload
i guess Im randomly asking but does anybody know of a tool to log back into an instagram account?
I was dumb forgot my password. I would love any help you can give me!
Thanks!
you can use password reset.
this is one of the best tutorials, fast and in structure explaining
Thanks!
Thanks for making good content. For the people following along the notebook is referring to websocket-client package. Also the use ws = websocket.create_connection('ws://localhost:8000/ws/polData/') to connect from ipnyb. Also I would recommend author to use requirements.txt files to using pip freeze to make it easier for people to follow the course
Super!
I actually now understand the django channels. Thank you!
Thanks!
This is truly the tutorial of all time
Thanks!
Don't underestimate the coding of small creators👍👍❤️❤️
Yo!
Worthy video for getting started with web sockets. Thanks bro
Glad you liked it
I have now got a good understanding how django channels work. Thank you for the perfect content. Please can you make a video about how to use it to fetch data from database. Much love🥰❤❤❤
Noted
@@technologyfornoobs That would add the icing on the cake!
Thanks for the tutorial. How would this solution works when scaling up (horizontal scaling - multiple instance of the server) ?.
I would not recommend this approach then.
@@technologyfornoobs Any recommendations for scaling?
@@dnj86 Scaling is a different beast, what I did was a PoC where people with few resources or a single resource are just trying to get something in action. to showcase, if a scalale solution needs to be built, another tech stack needs to be introduced. Not just python In my opinion.
Apparently for python versions greater than 3.6 they recommend adding .as_asgi to the url routing.
websocket_urlPattern=[
path('ws/polData/',consumer.DashConsumer.as_asgi()),
]
using the adjustment to the url and the following in the client code I was able to establish a connection
ws = websocket.WebSocket(sslopt={"check_hostname": False})
ws.connect("ws://localhost:8000/ws/polData/")
Thanks
John
yes now Django provide wsgi.py and asgi.py when we create project.
Very nice tutorial. thanks for sharing.
Thank you! Cheers!
Thanks for this amazing tutorial and example code
You are welcome!
Best tutorial i've watched
Thanks!
omg such an amazing content. loved it ❤❤
Thank you so much!!
Great explanation. But how are you creating the messages which is shown in 28:42 ?
The error message? It's default from the server
@@technologyfornoobs - no, how are sending messages through websocket-client
websocket client is a library which provides api to communicate with websockets, more detailed info github.com/websocket-client/websocket-client
@@technologyfornoobs thanks
Very nice tutorial. I am facing a problem of ws=websocket.WebSocket().It is throwing an error of -__init__() missing 3 required positional arguments: 'environ', 'socket', and 'rfile'
there are 2 libraries websocket-client==0.57.0, websockets==8.1, the one in notebook is client one.
I am facing the same problem.
Great Work. Worth watching if you want to learn and implement basic Web sockets in django
Thanks!
Great tutorial! How can I send data from a server to a ML algorithm in Django that then process it and send the data to a real time graph? Any suggestion? Thanks!
I think you might know the answer after going through the video.
great video, nice way of showing on charts!
Glad you liked it!
Thank You, I've been understanding really well, but at 38:52, after trying to connect the subscriber to the server I get:
in main
async def queue_factory() -> asyncio.Queue[str]:
TypeError: 'type' object is not subscriptable
, please help!
check the websocket library which you are using, the one in notebook is websocket-client
@@technologyfornoobs Now after installing websocket-client it says:
No module named websocket.__main__; 'websocket' is a package and cannot be directly executed
see you are missing some points in video, you need both websocket-client and websockets
Great work sir..
Thanks a ton
I want to deploy channels with apache any leads on how to configure apache2 to perfom this
I have tried with daphne and redis in development server is working fine but in apache I am getting error
man.... this is a very cool tutorial, good job.
Glad you liked it!
@@technologyfornoobs If I will implement the system in IoT, some architectures involve broker (redis) and worker (celery), why is that?
Here you show, the django channel can solve this problem.
Then what about the role of the MQTT broker (mosquitto)? can redis replace it?
Maybe you can help explain it.
Regards
@@doditsuprianto4304 I am not an expert in IoT infra kinds of stuff, yes Redis is still needed in our implementation as well for obvious reasons, and WebSockets is another protocol and MQTT is a diff protocol, where the data packet is even smaller than what we have done in WebSockets.
Great Video! Can you identify the versions of the libraries you use?
I will check,
Great tutorial.
I have a use case of creating a real time dashboard by fetching continuous data points from a websocket API exposed by a third party app.
How do I establish a ws connection with that API using channels?
you just need a javascript here, unless you want to save it somewhere. you consume that api in the ui and show the graph.
@@technologyfornoobs I want the real time data points to be stored in the database as well. The architecture I thought of is similar to what you have demonstrated here.
Is there a way to run the process of Jupyter notebook in the Django app itself, as a continuous background task or something?
just amazing !! beautifully explained !!
Glad it helped!
awesome tutorial ...i request you to make tutorial on how many users click the link, their ip address,i mean tracking their activities in graph from in backend side of blog website?
use signals from django
Actually i am making web app for my final year project. can you tell me how can i open socket for each edge device, like in my project there will be edge device for each individual client and graph should only be plot for client who logged in into the system.
I would recommend you to go through the concepts again, may be you already know the answer, and also the video is quite old now, many things have change and many other technologies are available to do such things.
@@technologyfornoobs i just want token authentication for user authentication.Each edge device have unique token so that data sending from user edge device must display on their own homepage. if you have discord then we can chat there.
oh i got it i have to open channel for individual user.
Thank you very much awesome tutorial very useful and complete. If I want to send 6 different values what can I do?
Yes you can, in my video I kept the channel value as constant, you can also pass channel value as dynamic and accordingly websocket will send data and our server will update based on the channel the data belongs.
Awesome video.
Please make a series on django channels
Will surely do that.
Great Content but how did you connect the websocket server from jupyter notebook since i keep getting this error:
ws=websocket.WebSocket()
TypeError: __init__() missing 3 required positional arguments: 'environ', 'socket', and 'rfile'
there are 2 libraries websocket-client==0.57.0, websockets==8.1, the one in notebook is client one.
@@technologyfornoobs Thanks for getting back to me and for your help. Really appreciate. Do you have an email address I can message you on?
@@mayurg2661 techfornoobs01@gmail.com
@@technologyfornoobs sent you an email
looking a django project which will store the console output to a txt file and same thing need to be displayed on the UI page as well
Could be a good exercise, don't look for it, you may already know now how to implement it.
If you're on Windows and you have problems installing channels with an error like: Microsoft Visual C++ 14 is required, Download Twisted from www.lfd.uci.edu/~gohlke/pythonlibs/#twisted. Choose the win32 one corresponding to your python version. For instance, I used Python 3.8; so I downloaded Twisted‑20.3.0‑cp38‑cp38‑win32.whl (Notice "cp38"). Once downloaded, navigate to the download folder in your command prompt and run 'pip install ' followed by the file u just downloaded. After this you can install channels or whatever. You're welcome!
Nice tip!
Pip install pipwin
Pipwin install twisted
This is super trick if any pkg getting error in installing..
Great video bro! Thanks
Glad you liked it!
Dude totally underrated video. You did such a great job of explaining the theory and implementation of this thank you. I am definitely subscribing and will be eagerly waiting for new videos. Btw as a windows user I ran into a few issues. Below are the solutions that helped:
Issue 1: When installing channels (pip install channels) I kept getting an error when it attempted to install Twisted
Solution: Use Python 3.7 instead of 3.8, twisted is not supported on 3.8
Issue 2: aioredis.errors.ReplyError: ERR unknown command 'BZPOPMIN', this happens because redis is not supported on windows
Solution: Install the Ubuntu 20 app in the windows store and activate the WSL. When you run the app update+upgrade your repos (sudo apt update; sudo apt upgrade -y) then install redis-server and redis-cli (sudo apt install redis-server -y; sudo apt install redis-cli -y) this should install redis version 5. type the command, redis-server to start redis then you shouldnt be good to run django and publish data.
I hope this helps.
Great!
Hey man , I had this twisted problem before , for python 3.8 u need to download twisted urself for python 3.8 and then install it locally with pip in your project ,at least that's what I did , I'd like to know if u came up with a better solution.
and for the redis you could use docker it's very easy u just start a redis server. good luck :)
I hope this helps a little
@@ashkanoliaie6548 I've tried many solutions like using WSL 2, installing an older version of redis and using docker on my windows machine to use redis and have not been able to shake the BZPOPMIN error. I've gotten the redis server running in a bunch of different ways but am yet to successfully connect. Does anyone have an explicit basic step-by-step solution on how to run and connect to a redis server in windows? I'm sure I'm missing something simple, docker seems to be easy enough but I just keep getting this error. Thanks in advance
clear cut explanation! Awesome
Glad it was helpful!
I am getting an error on the ws=websocket.WebSocket. Follow the error msg: "TypeError: __init__() missing 3 required positional arguments: 'environ', 'socket', and 'rfile'". Any idea what is wrong?
please check the python and websocket version you are using, you can match it with requirement.txt file in the git.
@@technologyfornoobs I found the issue. I installed websocket instead of websocket-client. Thanks for answering. Then later in the video, I also had to install websocket. It would be easier if I had follow your requirements.txt. I also had problems with the newer version of channels_redis(as I am on windows). Then I had to specify the correct channels_redis version to install. Now it is working.
Great explanation.🔥🔥🔥🔥🔥🔥🔥
Glad you liked it!
Thanks! perfect tutorial
You're welcome!
Great content, thanks for simplifying it. Do you deal with websocket addresses when you port the django app to google cloud?
i guess it would as in normal deploy scenario, noting needs to be changes, just care for the allow domain option.
@@technologyfornoobs Thanks for the reply. I was able to upload it to cloud. The roadblock was that Google App Engine doesn't support websockets, so I ended up using Google Compute Engine. I have a follow up questions. If you have multiple windows on a page all streaming, how do you extend the code?
do you mean multiple graphs? or just browser windows?, if multiple graphs, just make an addition in the consumer.py where I have fixed the channel name make it dynamic by sending it as a url parameter and do the required changes in the respective codes.
@@technologyfornoobs Multiple Graphs
I looked into consumer.py as you mentioned and created two classes and routed each websocket to different class. It has worked! Thanks for the suggestion.
Hi , i need to do a time series analysis of stock data. Where as i have to show live data graph on frontend ? How can u perform using lstm algorithm to show data and prediction on ui in django?
that could be simple and could be complicated.what's your input structure for LSTM would define the complication in approach, as in real time you will get a single data point, and LSTM would need some window of data to process and predict. but just a clue in Consumer.py file >> receive part you would have the logic to predict.
Or you score it outside and send as another data point for dashboard, no need to include it in Django app.
@@technologyfornoobs thankyou for solution . I appreciate. Can you please tell me more about it. Like how can i exactly use realtime time series analysis of stock data. As of now i only have data in csv where as i could use the same in db and fetch in dashboard but when it comes to real time analysis, it really become hard.
@@storememory I think you need something more robust that this. There are dedicated tools for this problem e.g time series databases like KDB. if you want to have a crude implementation think about using a redis solution with a siding window and performing the calculation there using a pub sub mechanism. UI framework like django and channels are really not the place where business logic and critical processing should happen
@@storememory Hey Nishant, have you completed your analysis of stock data work? I just wanted a little help.
Can we authentic the request that which user is sending the request
yes
Thanks bro...!! Can you make a video regarding deploying this project on production server.
Yes, soon
Why we need consumer if we can directly pass data from websocket into js
we need consumer for creating the webserver which can publish the data real-time to other consumers if you already have a WebSocket somewhere else you do not need Django component
I have little confusion about it that We can can send data from client(publisher) to server without redis,then why we have use redis server here? I run this code without redis but I see that it can perfectly send data to server.
Hopefully you will reply and help me to know about it.
Thanks
We have defined the redis server config in settings if you notice, redis helps on this communication. Django also provides a default server for websocket but it's not recommended to use. Just another point, server is using the redis not client
Can we integrate a tensorflow python chatbot in a django website using this?
that could be a good project, let me check.
@@technologyfornoobs sure.thank you for the help!
consumer.DashConsumer.as_asgi() When I add .as_asgi(), my code worked at routing.py. Why? Thanks for your sharing.
In routing.py, "as_asgi()" is required for versions over python 3.6.
Yo!
Excelente video you have a new subscriber!
Awesome, thank you!
Cool, I understand, but I don't understand why use group in costumer please make more videos about this. Thanks God bless you 👍
Noted
Setting up Django environment is a real challenge, several package dependencies. Though there is online support and forums to help but it is gets outdated within dates with new updated packages.
that's why it is important to work in a separate environment.
@@technologyfornoobs Can you please provide answers to previous questions below?
amazing tutorial
Thank you! Cheers!
How do I get an analog sensor's data values?
Where is your sensor connected, depends on that, if raspberry pi then all sensor has some module which can help you on sending the data.
@@technologyfornoobs My sensor is connected to ESP8266 NodeMCU.
is there a way to make rest calls in this device?
----> 1 ws=websocket.WebSocket()
TypeError: __init__() missing 3 required positional arguments: 'environ', 'socket', and 'rfile' got this error and i didnt find the requirements.txt in the git
i m using django 3..there is already asgi.py..TypeError: object.__init__() takes exactly one argument (the instance to initialize)
WebSocket DISCONNECT /ws/polData/ [127.0.0.1:57510]
Yes, you are using latest Django which gets you asgi.py file created.
And I somehow do not have req.txt file missing in mostly all repositories, not sure why,
But for now the error you have is not in django, but in Notebook I am assuming, and the solution for this is you need to install "websocket-client" not the "websocket" only.
Try this
@@sambitsahoo8071 I am getting the same error!
@@technologyfornoobs The error is on the CLI. Not in the notebook.
I am seeing this problem, can you help resolve it.
AttributeError: module 'websocket' has no attribute 'create_connection'
you need to install "websocket client", "websocket" is a separate module.
@@technologyfornoobs I am seeing another error now.
File "test.py", line 8, in
ws = websocket.create_connection('ws://localhost:8080/ws/polData/')
File "/home/adtran/.local/lib/python3.8/site-packages/websocket/_core.py", line 592, in create_connection
websock.connect(url, **options)
File "/home/adtran/.local/lib/python3.8/site-packages/websocket/_core.py", line 248, in connect
self.sock, addrs = connect(url, self.sock_opt, proxy_info(**options),
File "/home/adtran/.local/lib/python3.8/site-packages/websocket/_http.py", line 120, in connect
sock = _open_socket(addrinfo_list, options.sockopt, options.timeout)
File "/home/adtran/.local/lib/python3.8/site-packages/websocket/_http.py", line 200, in _open_socket
raise err
File "/home/adtran/.local/lib/python3.8/site-packages/websocket/_http.py", line 175, in _open_socket
sock.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
@@technologyfornoobs Using IP of the server in connect request gives a different error.
websocket.create_connection('ws://x.4.95.208:8080/ws/polData/')
Traceback (most recent call last):
File "", line 1, in
File "/home/adtran/.local/lib/python3.8/site-packages/websocket/_core.py", line 592, in create_connection
websock.connect(url, **options)
File "/home/adtran/.local/lib/python3.8/site-packages/websocket/_core.py", line 252, in connect
self.handshake_response = handshake(self.sock, *addrs, **options)
File "/home/adtran/.local/lib/python3.8/site-packages/websocket/_handshake.py", line 79, in handshake
status, resp = _get_resp_headers(sock)
File "/home/adtran/.local/lib/python3.8/site-packages/websocket/_handshake.py", line 164, in _get_resp_headers
raise WebSocketBadStatusException("Handshake status %d %s", status, status_message, resp_headers)
websocket._exceptions.WebSocketBadStatusException: Handshake status 500 Internal server error
###########################
Error on Django Server:
Exception inside application: No application configured for scope type 'websocket'
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/channels/routing.py", line 73, in __call__
raise ValueError(
ValueError: No application configured for scope type 'websocket'
WebSocket DISCONNECT /ws/polData/ [x.4.95.208:43598]
@@technologyfornoobs Can you please help provide answers for below questions?
Hello, you need to have both websocket and websocket client in your env, websocket is used in django side, websocket-client is used in notebook to communicate as a 3rd party tool or device.
where can i add an url if I am calling through an api?
Any where in apps url or in project urls or in ASGi urls
Thank you so much
You're most welcome
what are you doing in 29:23 ?
trying to communicate to the app using a simulated env, i.e notebook in this case.
many thanks to you sir
Thanks!
Please tell how to use channels in production. I'm having an error
I need to check about this, will update you, have you checked if Gunicorn supports ASGI?
Awesome :D Thank you !
Glad you like it!
such an amazing content, how can I connect this with angular service worker
instead of using the django templates for UI, we need to just use it as a API.
Thank you Brother
❤❤❤❤❤❤❤❤❤❤
Thank you too
Thanks, sir for this amazing tutorial. I have a requirement where instead of a dashboard, there will be a table. And data in that table should update automatically when new data is added in DB and that is without refreshing the page. Can we use Channel in that case?
Yes, correct, there is a another video where I am updating the table real time
check for it.
Great tutorial! When I tried to do Websockers connect, I got this error:
...
WebSocket HANDSHAKING /ws/polData/ [127.0.0.1:64222]
WebSocket CONNECT /ws/polData/ [127.0.0.1:64222]
Exception inside application: ERR unknown command 'BZPOPMIN'
...
aioredis.errors.ReplyError: ERR unknown command 'BZPOPMIN'
WebSocket DISCONNECT /ws/polData/ [127.0.0.1:64222]
Any idea to address the error?
Can you check your redis version, also try the default django channel server instead of redis, that might solve the problem for now.
@@technologyfornoobs For solution, I installed Memurai as advised in stackoverflow.com/questions/62786988/redis-err-unknown-command-bzpopmin
thank you🌹
You're welcome 😊
Great work brother It solved major portion of my problem and helped me to design my code flow.
But i am confused about channel layer, and redis.
Do we have to run redis on another server in production??
And can you please make a video or deployment?
not in another server at the same server, and defied it in the settings.
@@technologyfornoobs can i contact you on whatsapp or your email if you dont mind??
Ping me at Techfornoobs01@gmail.com
@@technologyfornoobs Hey hope you're doing good,
do you know any free resoucre where i can deploy my django-channels applicaiton free/without credit card
I guess no, credit card is mandatory step in any service now a days.
Awesome !!!!
Thanks!!
can u make tutorial Django Rest Framework. OAuth, JWT, Sessions, cookies, etc. Security related concepts in Django.
All ready in the pipeline, will update soon.
@@technologyfornoobs thx.
Nice tutorial..!!
Can you please explain how we can integrate celery with this project.
As I am new to django I dont know how to do it.
Specifically , what if I want to request some api for data which is sending to receive in websocket instead of running stand alone script in notebook???
it will be great for me if you suggest.
Thank you.
I hope you have gone through this link for celery with django:
docs.celeryproject.org/en/stable/django/first-steps-with-django.html
You are asking, to call an rest API and then send the response to the websocket and proceed on >>> it is possible, but what would be your logic to call the rest, as websocket works on a concept of event, if event happens then all things initiated,
So even in my application in the notebook I created a client which was subscribed to my websocket service and event happened and all process started. In your case you also have to write some client whether it is calling a rest or any data event by any device, but at the end it must be subscribed and push the data to your websocket service.
@@technologyfornoobs Thank you for quick reply..
I have read celery doc and implemented it. Problem I am facing is how can I push data from my task function within same project. Means as in your notebook app we first define websocket and send data with "ws.send(URL)" method. Should I use this way to push data in same project or is there any other method to do that. Sorry for my lack of knowledge.
But I want to learn.
please do complete tutorail on django rest framework
That is in progress!
+1
great video!
Thanks for the visit
please make projects on Shipping management system in django
Will Keep it in mind.
how to do this in MQTT?
Some work are already done , I guess you should be able to find it.
How Have you created this web socket client to send data to the server
using a package websockets in python
@@technologyfornoobs at 28:52 from where are you sending data to the routing port. Cause i am receiving error, "no connection made, because target machine actively refused it." which website are you using to generate client side data? How can i generate the same on my system itself? please elaborate
@@yashmathur1389 have you started the django server and redis server?
@@technologyfornoobsyou are using redis server or the default server django provides
i am not using redis server and default server is on
How to create 2nd page after login and to display Images ..
To display images in such a way that..it should display person who added name and no of times others downloaded
You have to maintain a database to show the records,and with the action in button click add a value to the number of download counts
@@technologyfornoobs Please show that in your channel
..
Can you make chatting appliaction on web with this?please
Thats the default app which people create using websockets and channels. Its in the Channels documentation as well.
@@technologyfornoobs Ya But I think it is real-time and I want to store the message so that whenever anyone loads the page all the message will be there forever
the moment you get the message in your websocket server, you can add the logic to add it in database.
Thank You sir
Most welcome
Thank you !
yo!
Thank you for the video. I am trying to develop a django dashboard for sensor data so it is really in line with what I am trying to do.
I am getting an error with the Jupyter code. I have installed websocket-client and uninstalled websocket and websockets.
The first error I get is
ws=websocket.WebSocketApp()
TypeError: __init__() missing 1 required positional argument: 'url'
If I put the url in ws=websocket.WebSocketApp('ws://localhost:8000/ws/polData/')
The following error comes up.
ws.connect('ws://localhost:8000/ws/polData/')
AttributeError: 'WebSocketApp' object has no attribute 'connect'
No Handshake occurs
Thoughts appreciated.
You dont need to uninstall the websocket and websockets. as they are needed for Django App
@@technologyfornoobs Thank you - it is working now.
niceeyyy
Thanks
bro could you make a recommendation system using tensorflow and integrate the model in a e - commerace type web application of django. please bro... by the ways loved your videos
yes, its possible, its just the stack would be different and video would be long. :)
@@technologyfornoobs i request you please make a video on that😍😍
But recommendation using Neural network is itself a challenging task, mainly those are done using other algotithms
@@technologyfornoobs bro.... Plz make a video of django integration with react js and any simple project on it....
When i tried,it showed me connection lost,why it was!!!
Please try to debug or at least give some error details
🔥 🔥 🔥 Awesome Tutorial
Can we stream serial data or output through websockets ?
I think it's possible, but need to be tried first, but I guess its possible sending a bit at a time.
Django 3.1??
2.2.3 but would work on 3 as well
works with 3.1, I tried this with 3.1 and definitely works, see my other comment for very minor change you might have to make. Another minor change might be required to use the same with Daphne where you need to get the 'default' application and setup django instead of just the asgi application
Jupyter code not working as error
Not sure what issue you have, but may be if issue is at websocket line, then install websocket client
@@technologyfornoobs I have sent email error
do chat bot application using django without any frontend framework
You mean using console?
@@technologyfornoobs using js but not js framework(react,angular)
The default example in Django Channels has the same chat project, its plain javascript
Hi,
I got this issue with websocket connection as it is getting closed due to handshake error , The error Message are as below:
WebSocket HANDSHAKING /ws/polData/ [127.0.0.1:59304]
Exception inside application: object.__init__() takes exactly one argument (the instance to initialize)
Traceback (most recent call last):
File "/usr/lib/python3.7/site-packages/channels/routing.py", line 71, in __call__
return await application(scope, receive, send)
File "/usr/lib/python3.7/site-packages/channels/sessions.py", line 47, in __call__
return await self.inner(dict(scope, cookies=cookies), receive, send)
File "/usr/lib/python3.7/site-packages/channels/sessions.py", line 172, in __call__
return await self.inner(self.scope, receive, self.send)
File "/usr/lib/python3.7/site-packages/channels/auth.py", line 181, in __call__
return await super().__call__(scope, receive, send)
File "/usr/lib/python3.7/site-packages/channels/middleware.py", line 26, in __call__
return await self.inner(scope, receive, send)
File "/usr/lib/python3.7/site-packages/channels/routing.py", line 160, in __call__
send,
File "/usr/local/lib/python3.7/dist-packages/asgiref/compatibility.py", line 33, in new_application
instance = application(scope)
File "/usr/lib/python3.7/site-packages/channels/generic/websocket.py", line 159, in __init__
super().__init__(*args, **kwargs)
TypeError: object.__init__() takes exactly one argument (the instance to initialize)
WebSocket DISCONNECT /ws/polData/ [127.0.0.1:59304]\
I think you have wrong version of redis installed
@@technologyfornoobs also got this exact same issue, have the newest version of redis
@@woutvandroogenbroeck8047 github.com/sharmasw/realTime-Tables-with-Django-Channels
Use redis from this repo
Awesome video mate. Do you have a twitter handle to follow?
No, sorry
Pip install pipwin
Pipwin install twisted
This is super trick if any pkg getting error in installing..
Great!
Why u not mention scope ?
Consumers receive the connection’s scope when they are initialized, which contains a lot of the information you’d find on the request object in a Django view. It’s available as self.scope inside the consumer’s methods.
@@technologyfornoobs how to check , second user disconnected or not.
I think in websocket _ disconnect function we have to use , self.channels.group_send(
Group_name,
{
Type:'leave.room', message:'leve room'}
) method , am right or not .
yes some thing similar, by this logic you can also add how many user are in the chat room or if any user left the room kind of functionality, as the connection get closed by the user it does reach to disconnect functionality and as I haven't written anything so it does not do any thing.
group add none type error beacause of channel layer
github.com/django/channels/issues/1036
it doesn't matter that you follow video
can you please make a group chat like whatsap
I can but don't you think it will be over killing and all people will just ping and so all those notorious things will happen like sharing irrelevant contents
@@technologyfornoobs no bro i meant making a chatroom like app where users can create a room and others can join you can also give them the option to make public or private rooms that's what i have to for school but i already know about websockets and channels i just don't know how to create a database for the rooms and allow real time messaging in it
@@mostnotoriouspinpin7581 the project you are talking about is the example given in django real time websocket documentation
@@technologyfornoobs ok thanks man I'll take a look btw i sub
Hey, really amazing content, I was searching for this only. I am working on my own data analysis backend and I have very similar requirement, but the source of data is different and I am stuck on that. I would like to get your insight on same. How can I contact you ? Hope you will reply
Connect via email @ techfornoobs01@gmail.com
My Suggestion: can you make telegram group for communicate better way.
you can connect at techfornoobs01@gmail.com, will check about telegram.
Hi
It's a Nice Video.
Is it require to have python code on third party sensors. or please let me know how to featch data from sensors to phyton programe .
Appreciate if you help me and share your email Id.
Not required in 3rd party sensor, you just need a measure to subscribe to the websocket to send data. might be using curl, c any thing
@@technologyfornoobs Thank you
Do you have any such video or referance document, Please
@@Vilasppatil No videos as of now. Just search for the same stack which you are looking for apart from python
@@technologyfornoobs Ok Thanks for reply.
please let me know, if you can provide paid online coaching. My Email ID : vilasppatil@gmail.com
You can reach me at techfornoobs01@gmail.com
Amazing video. I needed some help with something. How can I contact you? Can I ask here?
How can I help you?