- 21
- 34 934
Datasudh
India
เข้าร่วมเมื่อ 18 มิ.ย. 2021
Hello, I'm Neha and welcome to my channel.
Here, I upload content in form of structured courses, tutorials, troubleshooting tips, quick how-to's on different topics of technology work stack.
I created this channel with the intent of adding value to technology engineering learning with a subtle approach of Why {conceptual understanding}, How {practical implementation} & What {impact and significance}. Professionally, I am a Data Engineer with a demonstrated history of working in the data analytics field.
I would appreciate your like and subscription, if the content was helpful for you. If you have any questions or video requests, please leave a comment and I will get back to you. I usually check and reply during the lunch hour or late evening on weekdays, and during the daytime on weekends.
I can also be contacted via any of my socials listed in the banner links!
Happy Learning!
Here, I upload content in form of structured courses, tutorials, troubleshooting tips, quick how-to's on different topics of technology work stack.
I created this channel with the intent of adding value to technology engineering learning with a subtle approach of Why {conceptual understanding}, How {practical implementation} & What {impact and significance}. Professionally, I am a Data Engineer with a demonstrated history of working in the data analytics field.
I would appreciate your like and subscription, if the content was helpful for you. If you have any questions or video requests, please leave a comment and I will get back to you. I usually check and reply during the lunch hour or late evening on weekdays, and during the daytime on weekends.
I can also be contacted via any of my socials listed in the banner links!
Happy Learning!
Dynamic Pivot Columns | How to generate dynamic Pivot Columns in BigQuery
SQL Code available at : datasudh.com/blogposts/generating-dynamic-pivot-columns-in-bigquery
มุมมอง: 9 635
วีดีโอ
Multi-Line in Scripting Query | How to create Multi-line for queries in BigQuery Scripts
มุมมอง 1.1K2 ปีที่แล้ว
SQL Code available at : datasudh.com/blogposts/multi-line-query-in-scripts-in-bigquery
BigQuery Metadata | How to retrieve metadata information in BigQuery
มุมมอง 3K2 ปีที่แล้ว
Explore what all metadata information is available in Google BigQuery and how to retrieve the same using INFORMATION_SCHEMA views Also, a quick cheat sheet available at datasudh.com/blogposts/how-to-retrieve-metadata-in-bigquery
BigQuery Setup | How to start using BigQuery
มุมมอง 5K3 ปีที่แล้ว
Learn how to start using BigQuery in Google Cloud and what options are available 1. For Practice / Exploration Purposes 2. For Individual / Small Team Project 3. Organization Setup
Data Filtering using operator "IN" (Google BigQuery)
มุมมอง 2983 ปีที่แล้ว
Learn how to filter data in BigQuery for 3 different scenarios 1. filtering with static values 2. filtering with changing values 3. filtering with subquery
Tree Structure Creation for Hierarchical Data in Google BigQuery
มุมมอง 1.2K3 ปีที่แล้ว
Learn how to create a tree hierarchy in BigQuery for hierarchical data, a structure in which items are linked to each other via parent-child relationships
Hosting a Static Website in Google Cloud using HTTPS & HTTP with Cloud DNS as DNS Service
มุมมอง 2K3 ปีที่แล้ว
#staticwebsitehosting #googlecloud #CloudDNS #HTTP #HTTPS
Hosting a Static Website in Google Cloud using HTTP & HTTPS with GoDaddy DNS Service
มุมมอง 11K3 ปีที่แล้ว
#staticwebsitehosting #googlecloud #GoDaddyDNSservice #HTTP #HTTPS
Module 3 | Lesson 4 | Scoring Model with Test Dataset
มุมมอง 333 ปีที่แล้ว
#machinelearning #mlalgorithms #spark #modeltraining #modelevaluation #sparksetup
Module 3 | Lesson 3 | ML Model Metrics Calculation in Spark
มุมมอง 803 ปีที่แล้ว
#machinelearning #mlalgorithms #spark #modeltraining #modelevaluation #sparksetup
Module 3 | Lesson 2 | Metrics Understanding and Calculation
มุมมอง 363 ปีที่แล้ว
#machinelearning #mlalgorithms #spark #modeltraining #modelevaluation #sparksetup
Module 3 | Lesson 1 | Introduction to ML Model Evaluation
มุมมอง 563 ปีที่แล้ว
#machinelearning #mlalgorithms #spark #modeltraining #modelevaluation #sparksetup
Module 2 | Lesson 5 | Build and Train Classification Models
มุมมอง 293 ปีที่แล้ว
#machinelearning #mlalgorithms #spark #modeltraining #modelevaluation #sparksetup
Module 2 | Lesson 4 | Creating Feature Vector Column in Spark
มุมมอง 753 ปีที่แล้ว
#machinelearning #mlalgorithms #spark #modeltraining #modelevaluation #sparksetup
Module 2 | Lesson 3 | Train and Test Split of the dataset
มุมมอง 1713 ปีที่แล้ว
#machinelearning #mlalgorithms #spark #modeltraining #modelevaluation #sparksetup
Module 2 | Lesson 2 | Dataset Understanding for model build and reading into Spark
มุมมอง 743 ปีที่แล้ว
Module 2 | Lesson 2 | Dataset Understanding for model build and reading into Spark
Module 2 | Lesson 1 | Model Training Introduction
มุมมอง 603 ปีที่แล้ว
Module 2 | Lesson 1 | Model Training Introduction
Module 1 | Lesson 3 | Spark Setup in Google Cloud
มุมมอง 553 ปีที่แล้ว
Module 1 | Lesson 3 | Spark Setup in Google Cloud
Module 1 | Lesson 2 | Spark Setup in Win 10 PC
มุมมอง 703 ปีที่แล้ว
Module 1 | Lesson 2 | Spark Setup in Win 10 PC
Module 1 | Lesson 1 | Introduction to Spark Setup
มุมมอง 1513 ปีที่แล้ว
Module 1 | Lesson 1 | Introduction to Spark Setup
Implementing ML Algorithms with Spark - Course Introduction
มุมมอง 3623 ปีที่แล้ว
Implementing ML Algorithms with Spark - Course Introduction
How I can get the metadata of yesterdays table
Start with google
Really helpful 🎉
Your speech is very good understandable God bless you...
Hi, you post informative videos. One Que. I have an Excel365 file which has data from the odbc connection, which updates automatically in scheduled intervals, how can I sync that Excel data into Google Sheets with auto updates?
Can you plz make a video on how to sort and filter data in a spreadsheet. Thank you. I like your videos
Well done. This is awesome. Thank you
Great demonstration, thank you!
When I added those IPs in Namecheap A records my website stopped working..
I can't find domain verification in GCP.. What shall I use now?
Right now I am facing a issue while retrieving metadata about (region specific ) data it is showing some error which is saying “ Access Denied: Table famous-design-417916:region-us.INFORMATION_SCHEMATA: User does not have permission to query table famous-design-417916:region-us.INFORMATION_SCHEMATA, or perhaps it does not exist in location US. ”
Firstly I would like to appreciate the way you are teaching , it’s good
Hi, do google charges for load balancer in this case and how much is the charge.
In my experience using the load balancers this way is a very expensive solution. Im paying about 20 eur per month per website. Im looking for an alternative solution that is cheaper
Great Video..! Thanks Ma'am
Can you make word document for this please and share
great one!!!
how did you get that IP i mean from where, i know it need to be external IP but i have tried copy mine external IP and paste inside DNS A and it dosent work..
GREAT VIDEO!!!
How to get user email who access our view under our project id?
Thanks for this direct and simple to follow tutorial. ❤❤❤
Good work
Mam in this query region-us means why u are used this region-us in that query
i am not able to find domain verification from google closud ?
After 2 Year GCP seems little more different , Good to update this with latest GCP UI
How could i connect this to sheets?
Great Video!
This is bad, a much cleaner way to do this is by using CTE recursive.
That's right! and i have mentioned that in video. When I created this, there was no recursive CTE in Bigquery, but google has now provided that functionality. So, that's the way to go.
This is perfect! Thank you for this complete tutorial \o/
how to use it from my local desktop. i can't connect it
Awesome! Congrats for the videos! Keep posting to the BigQuery series please!!! Cheers
Thank you much for the tutorial! Just what I need it. Now, how can you create an new table from the results in a way you can do it scheduled? I believe that would be using STORE PROCEDUREs with this scripting, but I don't know what would be the syntax to store the results into a final TABLE that can be reconstructed every time I run the PROCEDURE. I tried using SCHEDULED QUERIES but the scripting is not allowed there. Any help would be much appreciated.
Excellent video ma'am, really impressed with your teaching style. And a proposal 🤣 If your age is between 24 to 29 and ur unmarried, I am ready to marry you😉
Thansk, can I use this with a CTE?
Awesome 👍🏻👍🏻👍🏻
Excellent and thorough tutorial. Thank you very much!
Would this be a RESPONSIVE Website?
WHAT OTHER WAY NOT USE HTTP(S) Load Balancing? THIS SERVICE COST VERY HIGH, TKS
WHAT OTHER WAY NOT USE HTTP(S) Load Balancing? THIS SERVICE COST VERY HIGH, TKS
You are a life saverrrrr!! Thank you soo much for this!!!
Domain verification is not the same now in GCP console. Could you please share how to verify with the new settings?
sure, will look at it and share.
@@datasudh Thank you.
@@datasudh I need your assistance as i am unable to access website
I get an error. Invalid format specifier character "R" in FORMAT string. Anyone can help? DECLARE MONTHS STRING; SET MONTHS = ( SELECT CONCAT('("', STRING_AGG(DISTINCT cast(MONTH as string), '", "'), '")'), FROM ( select distinct date_trunc(jakarta_data_date, month) MONTH, from `data-gojek-id-mart.corporate_strategy.detail_booking` a where jakarta_data_date >= date_sub(date_trunc(current_date('Asia/Jakarta'), month), interval 3 month) order by 1 ) ); select MONTHS; EXECUTE IMMEDIATE format(""" SELECT * FROM ( select date_trunc(jakarta_data_date, month) AS MONTH, sa.service_area_name AS CITY, regexp_extract(UPPER(a.service_type_name),'(CAR|RIDE|FOOD)') as service_type_name, count(distinct order_no) AS BOOKING, from `data-gojek-id-mart.corporate_strategy.detail_booking` a left join `data-gojek-id-presentation.location.dim_service_area` sa on a.service_area_id = sa.service_area_id where jakarta_data_date >= date_sub(date_trunc(current_date('Asia/Jakarta'), month), interval 3 month) and (upper(a.service_type_name) like '%RIDE%' OR upper(a.service_type_name) like '%CAR%' OR upper(a.service_type_name) like '%FOOD%') and upper(sa.service_area_name) = 'BANDUNG' group by 1,2,3 ) PIVOT (SUM(BOOKING) FOR MONTH in(%s))""", MONTHS);
Exactly what I was looking for with an easy-to-understand example! Thanks!
Thank you for the wonderful explanation. Is there a similar way by which we can dynamically aggregate string columns in bigquery sql? Usually we would just use Select STRING_AGG(col_1), col_2 From table1 Group BY col_2. What if the number of columns are increasing dynamically?
Hi Hasan, if you have a scenario where in you want to keep creating aggregate values for dynamic columns which can exist at any point of time then basically you need a query which adds that column formula at run time. You can achieve that by using combination of metadata table which will tell about new column and then add the same to dynamic SQL with string agg function. Do you have a use case where in your columns are increasing dynamically ?
@@datasudh I have a ‘contacts’ table in which new columns (containing information about the contacts like their age etc.) are being added everyday. These columns have either nulls or string values. I want to string aggregate all these columns and group by contact id so that I get one unique row per contact ID.
@@datasudh thanks for your reply. I have been trying to use INFORMATION_SCHEMA.COLUMNS with dynamic sql to solve this problem but have been unsuccessful so far.
@@hasanasim3980 ok, I will give this a try this week and share results with a blog
Thank you!!!! It reallly helps a lot.
This is amazing! Thank you so much!!
very well explained
Great video. Thank you!
Thanks Mam After onetime uploading how to update the index.html page
Go to the bucket and Click on upload file button. It will ask you if you want to overwrite the existing file
Thanks, Google's guide was horrible, this is much better.