Thanks for the video. i follow the steps and ran into this error( "errorMessage": "module 'botocore.vendored.requests' has no attribute 'Session'",) please kindly look into it and help with a fix.
Handshake status 500 Internal Server Error while trying to create connection. Terminal is getting started & then this error is coming in the lambda. Please help..
Thanks for the video. I implemented the same solution and it was working fine, but from last few days I get error WebSocketBadStatusException: Handshake status 500 from Lambda. Could you please guide me if there are any solutions to automate the sagemaker notebook instance (I have also tried life cycle configuration but that's not the suitable solution in my case) . Thanks
@@nancyandrew9755 Sorry Nancy, I've not run into this issue before so can't really give much specific advice. Are there more details in the error message?
Hi - fantastic tutorial thanks for uploading! Quick question - is there anyway to pass environment variables to the notebook. My notebook is a sagemaker processing job and I would like to dynamically pass an s3 location to the notebook as this s3 location will be where the raw data is stored. Is it possible to pass this in the post request to the API gateway and then pass it into the notebook? Thanks in advance :)
Everything works for me EXCEPT: I don't know if others have noticed this but when executing in the Jupyter notebook when it runs a block of many code lines, it doesn't execute? If your first code line is print('This works') it will execute that perfectly, but if you have import over 10 - 20 lines different packages, it doesn't execute it at all - why does it do that?
thx for the video! I would like to create a trigger that runs notebook every morning (at specified time) could you do a video on how to modify your example to do that?
Hi sebtac, will definitely take note of this and make a video if I can. But from a quick search, maybe one of the solutions here might be a good place to start: filipstollar.medium.com/how-to-schedule-a-jupyter-notebook-to-run-every-day-week-or-month-ae3f992f3afc
Thanks for Sharing, I have 1 question, If my notebook takes 20-30 minutes to complete processing, will it fine to call it directly from lambda function?
Hi, I know this response is late, but for anybody facing this issue in the future. The Handshake error is caused by websocket.create_connection. Replace that part of the code with this instead . As you can see, he was using the botocore.vendored import requests but this was removed from botocore by AWS. Instead you use import requests instead ws = websocket.create_connection( "wss://{}/terminals/websocket/5".format(http_hn), cookie=cookies, host=http_hn, origin=http_proto + "//" + http_hn, header = [ "User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/100.0.4896.127 Safari/537.36" ] ) Be careful with the indentation (TH-cam messed the order). Much love to everyone
@@CuriouslyWatching Hello, i was able to fix the problem with this solution, thank you. Now, my Lambda Function is working fine without any error but the notebook isn't running. Do you have any idea ?
Thanks for sharing! , I've got a question, How can I execute several Jupiter notebooks automatically into an EMR cluster (Not transient ) daily? I need to reduce execution time, for this reason, aws glue is not my ideal option.
I've not done something like before, but I've heard of tools such as nbconvert and Papermill (papermill.readthedocs.io/en/latest/). Maybe there's a way to integrate such tools into your workflow?
Not able to use one of the OpenCV command cv2.imshow to view the video in was Aws juypter notebook. It shows error kernel dead please restart the kernal. Please help.
I've not tried using cv2 in AWS jupyter notebook, but perhaps you can try opening a terminal instance and checking if the package is installed? For example, you could open up the Python interpreter in the directory you want and try running the same command as what you have in your notebook to see if it works. Let me know if this helps!
@@ProgrammerError other command of this cv2 is running. As this line cv2.imshow create a new window in which the output is shown doesn't works on the AWS juypter notebook
@@ProgrammerError Thanks friend for the help. I just had a call with the AWS support team they said it doesn't allow a new window to pop up. So cv2.imshow won't work on AWS Juypter notebook.
Hi... Thanks for the video. I have 2 questions, one is requests package is not available via vendor anymore so I installed it separately and then tried running but the get method was throwing error. Second because of this I am not able to get the cookie for the url and hence not passing that to websocket connection and then websocket connection throws an error saying https scheme is invalid. Any inputs?
Hi, I am getting "errorMessage": "Handshake status 200 OK", "errorType": "WebSocketBadStatusException" regarding the "websocket.create_connection()" call. This was working for me a week ago, made no changes to the code, and am now stuck getting this error.
@@raghavgurbaxani1251 yes go into cloud watch logs and you can see the error logs in the folder of your lambda functions name. Also this method is depreciated its better to use an ec2 instance and upload your files in that instance and run the scheduler through crontab
Did you run into any bugs? Feel free to drop a comment below if you have any questions!
Thanks for the video. i follow the steps and ran into this error( "errorMessage": "module 'botocore.vendored.requests' has no attribute 'Session'",) please kindly look into it and help with a fix.
@@psalmist2226 At which step did you get this error? Doesn't seem to be an issue with jupyter themes.
Handshake status 500 Internal Server Error while trying to create connection. Terminal is getting started & then this error is coming in the lambda. Please help..
Thanks for the video. I implemented the same solution and it was working fine, but from last few days I get error WebSocketBadStatusException: Handshake status 500 from Lambda. Could you please guide me if there are any solutions to automate the sagemaker notebook instance (I have also tried life cycle configuration but that's not the suitable solution in my case) . Thanks
@@nancyandrew9755 Sorry Nancy, I've not run into this issue before so can't really give much specific advice. Are there more details in the error message?
Hi - fantastic tutorial thanks for uploading! Quick question - is there anyway to pass environment variables to the notebook. My notebook is a sagemaker processing job and I would like to dynamically pass an s3 location to the notebook as this s3 location will be where the raw data is stored. Is it possible to pass this in the post request to the API gateway and then pass it into the notebook? Thanks in advance :)
Great video!
Thanks topaz! 👍
Everything works for me EXCEPT: I don't know if others have noticed this but when executing in the Jupyter notebook when it runs a block of many code lines, it doesn't execute? If your first code line is print('This works') it will execute that perfectly, but if you have import over 10 - 20 lines different packages, it doesn't execute it at all - why does it do that?
Do all imports not get executed, or is it only specific ones? Maybe you could try inserting print statements between the import statements?
any idea how many notebook instances can run concurrently on aws?
Thanks for the video. Have you tried doing this with sagemaker studio?
Nope, unfortunately. I believe it should be similar though?
thx for the video! I would like to create a trigger that runs notebook every morning (at specified time) could you do a video on how to modify your example to do that?
Hi sebtac, will definitely take note of this and make a video if I can. But from a quick search, maybe one of the solutions here might be a good place to start: filipstollar.medium.com/how-to-schedule-a-jupyter-notebook-to-run-every-day-week-or-month-ae3f992f3afc
Thanks for Sharing,
I have 1 question, If my notebook takes 20-30 minutes to complete processing, will it fine to call it directly from lambda function?
Hi Amit, did you by anychance get error code 200 handshakeerror? I am getting that and not able to fix it.
Thank you for sharing! I am receiving a Handshake error (Handshake status 500 Internal Server Error), do you have any idea about this? Thanks again
having the same issue here.
Having the same issue. Any solution?
Hi Joao! Can you provide more details on the error? I've not run into that before, but will try and help if I think of something.
Hi, I know this response is late, but for anybody facing this issue in the future. The Handshake error is caused by websocket.create_connection. Replace that part of the code with this instead . As you can see, he was using the botocore.vendored import requests but this was removed from botocore by AWS. Instead you use import requests instead
ws = websocket.create_connection(
"wss://{}/terminals/websocket/5".format(http_hn),
cookie=cookies,
host=http_hn,
origin=http_proto + "//" + http_hn,
header = [
"User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/100.0.4896.127 Safari/537.36"
]
)
Be careful with the indentation (TH-cam messed the order). Much love to everyone
@@CuriouslyWatching Hello, i was able to fix the problem with this solution, thank you. Now, my Lambda Function is working fine without any error but the notebook isn't running. Do you have any idea ?
Thanks for sharing! , I've got a question, How can I execute several Jupiter notebooks automatically into an EMR cluster (Not transient ) daily? I need to reduce execution time, for this reason, aws glue is not my ideal option.
I've not done something like before, but I've heard of tools such as nbconvert and Papermill (papermill.readthedocs.io/en/latest/). Maybe there's a way to integrate such tools into your workflow?
Not able to use one of the OpenCV command cv2.imshow to view the video in was Aws juypter notebook. It shows error kernel dead please restart the kernal. Please help.
I've not tried using cv2 in AWS jupyter notebook, but perhaps you can try opening a terminal instance and checking if the package is installed? For example, you could open up the Python interpreter in the directory you want and try running the same command as what you have in your notebook to see if it works.
Let me know if this helps!
@@ProgrammerError other command of this cv2 is running. As this line cv2.imshow create a new window in which the output is shown doesn't works on the AWS juypter notebook
@@aiknowledge8855 Maybe you could check that you have installed all the required libraries correctly. Not sure what else could be the issue
@@ProgrammerError Thanks friend for the help. I just had a call with the AWS support team they said it doesn't allow a new window to pop up. So cv2.imshow won't work on AWS Juypter notebook.
@@aiknowledge8855 Ah I see. Maybe there’s a way to save the image to a file so you can view it later? Sorry I’m not too familiar with OpenCV
Hi... Thanks for the video. I have 2 questions, one is requests package is not available via vendor anymore so I installed it separately and then tried running but the get method was throwing error. Second because of this I am not able to get the cookie for the url and hence not passing that to websocket connection and then websocket connection throws an error saying https scheme is invalid. Any inputs?
Hi Harsiddhi, let's try fixing the first issue first. Are you importing Python's requests or the requests from botocore.vendored?
Hi, I am getting "errorMessage": "Handshake status 200 OK",
"errorType": "WebSocketBadStatusException" regarding the "websocket.create_connection()" call. This was working for me a week ago, made no changes to the code, and am now stuck getting this error.
Hi Orkan, that's strange that the error is coming up all of a sudden. Perhaps something might have changed on AWS?
well, i try this solution, but I got this error: 'Handshake status 500 Internal Server Error" when I tested
Hi Joaquin, do you have an idea which step might be causing this?
@@ProgrammerError Getting while calling the websocket.create_connection function
but when we change wss: to ws: then the timeout error came
I am getting an error that 500 internal error I dont know what to do I just followed whatever you told
Which step are you getting this? Are you getting any other information about the error?
@@ProgrammerError this WebSocket client method is obsolete I had a chat with one of the AWS guys as you cant directly push into url
@@csoham96 how did you resolve this error ? any tips from the AWS folks ?
@@raghavgurbaxani1251 yes go into cloud watch logs and you can see the error logs in the folder of your lambda functions name.
Also this method is depreciated its better to use an ec2 instance and upload your files in that instance and run the scheduler through crontab
@@csoham96 Hi, may i know more details about it? like use ec2 to upload the zip file into what instance?
This video need an update.
Hi, which part are you having an issue with?
Ws = websocket.createconnection()
WebSocketBadStatusException: Handshake status 200 OK
I believe because AWS dropped support for Python 3.6
@@ARBazroon I see, thank you for sharing!
hi sir i am getting this error:
errorMessage": "module 'botocore.vendored.requests' has no attribute 'Session
any idea how to solve this error
import requests instead of botocore.vendored.requests
Thank Ashish! @SMART EMITRA You can try `import requests` instead as suggested by Ashish.
@@ProgrammerError Actually botocore.vendored.request works fine with Python3.6