วีดีโอ

GCP is not a free platform, it's cheap for sure, not free though.

Thanks a lot, Renato.

Thank you so much, Arjun. Really appreciate your kind words 🙂

Good catch, Anthony. If you see the query 2 I executed @ 27:53 you would notice that I mistakenly didn't put the ticket num in my query. Though I am reading it, and setting up in the variable, but not putting it in my query. Tat's the reasons you see NULL there in the final updated table. Hope it helps you. Thanks a lot for point this out :)

Thanks a lot for sharing the link here, Ryszard. Much appreciate it

Thanks! I couldn't connect due to the same reason. Now I'm wondering how to connect from a Docker container now? I mean waht would be the ip address of a docker container? :(

thanks dude!

Hey Brian, I honestly haven't tried it, I can do so and let you know for sure.

Hey Kleber, thank you so much for your comment and wishes. Apologies, I haven't really done that. I can try to do it, and can share the steps with you later on.

Hey buddy, it's running on my local system

It already has python 3. I would recommend creating a venv.

Hey buddy, which command are you looking for?

@@KunalKMehta08 create table

@@hins751 Hey buddy, sorry for being late, it seems like I missed this comment. I have a handbook that I created for SQL commands a while back, along with some information about how it works, at a very basic level, and I am sharing the same here with you, hope this helps. drive.google.com/file/d/1rKW5gDJfLPzDFpM7bLNilnDW4j6KvzWi/view?usp=sharing Again, apologies for being late.

I find the solution thank you "pip install --upgrade google-cloud-storage "

Hey Matt, I haven't really worked on Postgre, let me look into it, if I cn find some information aroung it.

a trick: you can watch movies at kaldrostream. I've been using it for watching lots of of movies these days.

@Alvaro Porter definitely, been using kaldroStream for months myself =)

@Alvaro Porter Definitely, have been using kaldroStream for months myself :D

Yaar, absolutely we can. I can give you a small algorithm for that. I would prefer doing it on a VM, so here it goes: 1) On VM write a function to read a CSV from GCS, and then create a datFrame from that 2) Create connection with Python and Cloud SQL, ensure that your database and table are defined within cloud SQL 3) Then insert your dataframe into the cloud SQL table. 4) Close the SQL connection 5) If you want, you can delete the file from GCS 6) Create a cron job to run this job et regular intervals on the VM. You will be able to write this code pretty easily, let me know if you face any issue, i can write the sample functions for you :)

Thank you so much, Nandan, you have always been very supportive, thanks a lot :)

Hey Sabu, thanks a lot for your comment. Absolutely, it does open up a lot of possibilities, once you have data in your programming environment, then you can play with it the way you would want to, or need to. I believe for creating a scheduled pull from your local scheduler, you can use Windows scheduler to run your Python code. But I myself, try to use Google Functions and Cloud Scheduler to run it, or very simply, use a VM within GCP, and put a Cron job there, using crontab. There are a lot of ways, so you can be innovative :) For uploading files into GCS, they have to be stored in some location, let's say a remote location, you can very well use GCP's schedulers, dataflow pipeline (in case your data needs some kind of inflight transformation) and pub/sub events to do the same. I will be covering most of this in my subsequent sessions, but if you are looking for something quick fix, you can use these tools. In case you want to stream data within GCS through Airflow or Kafka, you can again do that, but that is an area, where I haven't explored much, honestly. Once again, thanks for your comment, will look forward to suggestions and ideas from you :)

@@KunalKMehta08 sure Thanks for great response with explicit details. Would like to continue the conversation.

Hey Praveen, thanks a lot for your comment. That is actually scheduled for next Monday :) I have articles and everything, along with codes, scheduled on weekly basis, so that everyone gets time to read and get themselves familiarized. Thanks again for going through it and helping me improve, man :)