Load data from CloudSQL to BigQuery
ฝัง
- เผยแพร่เมื่อ 5 ต.ค. 2024
- Looking to get in touch?
Drop me a line at vishal.bulbule@gmail.com, or schedule a meeting using the provided link topmate.io/vis... #gcp #googlecloud #googlecloudtraining #googlecloudplatform How Load data from CloudSQL to BigQuery
Associate Cloud Engineer -Complete Free Course
• Associate Cloud Engine...
Google Cloud Data Engineer Certification Course
• Google Cloud Data Engi...
Google Cloud Platform(GCP) Tutorials
• Google Cloud Platform(...
Python For GCP
• Python for GCP
Terraform Tutorials
• Terraform Associate C...
Learn Python Basics
• Playlist
Linkedin
/ vishal-bulbule
Medium Blog
/ vishalbulbule
Git repo for Source code - github.com/vis...
Email - vishal.bulbule@techtrapture.com #googlecloud #devops #python #devopsproject #kubernetes #cloudcomputing #video #tutorial
![[Watch Party] RoV Pro League 2024 Winter | ( Bacon Time Vs FS )](http://i.ytimg.com/vi/lD6z1BugdZw/mqdefault.jpg)
Do you have anything that explains extracting data from BQ and writing it to cloud SQL ?
Hi Vishal,
Thanks for the video .Here, the connectivity is established between Cloud SQL instance and Bigquery. But in case - if it's to be done with On-Premise data (mysql, oracle or sql server) , do we need to follow the same steps or any change is to be done ?
From ETL perspectives, can we consider this because if there is any transformation change then do we need to handle it in Bigquery (then it will become ELT ). If the table is huge then what would be the best option ?
If source is at on-prem then you have to use third connection method that is private connectivity, which can be done using VPN or Cloud interconnect . This is standard procedure if you have hybrid connectivity with your onprem datacenter.
For large data , backfill may take time and need round of POC before actual migration.
Transformation, I don't see any option directly with Datastream.
If I want to take data from SQL server or Oracle on premise (from my laptop) to Bigquery , will it be challenging to create it on laptop ?
Any video which can be helpful to create this ?
I tried it by using one artcle from medium but faced some challenges while setting up mysql instance as it was giving message i.e not able to allocate IP
Connect Private Data Fusion instance with a Private Cloud SQL instance using CloudSQL proxy
Thanks