And the answer would be "because I work with a multinational enterprise customer". If you have a large market share in China (1 bill people) , India (1 Bill people), Europe 0.75 Bill, USA (350M people) it doesn't take long to get to 100 BIllion transactions. If you want to do Financial Year on Year comparisons, you need to keep at least 24 months of data, usually 36 months. .
Hello sir. I tried to import 400k data into big query sandbox. But ended with more errors. Is this possible to import those data. Pls anyone help me it's urgent ( interview assignment)
Heyy, very informative. I came here around searching for big data processing in seconds. Ive a question, I would like to build a system where I import terabytes of data into single table with keys and I want to perform all the DML operatiom in such a way it should take very less execution time as shown. Please help me out, how I can acheive. Im stuck.
what to do when I want to overwrite 100 millions of rows into new table, in minutes? df.write.mode("overwrite").saveAsTable("FINAL"), if you could please help with this?
Please for 50 days I am looking for this i wanna to create 2000 users in mysql and set the phone number as user name and password my be say me how can i create most users with default password? That's
This is nice but not that impressive. Obviously, the table is being stored using Columnstore Compression techniques. So you only need to query the columns in the select list. And they are typically grouped in blocks of 1 M or more. These header pages keep rowcount values. So you are not reading every row. Just the block headers of a single column. If your query forced the scan of all rows in the "block" asking it to be combined with other fields in the same row or in other tables before you could filter it. You will no longer be in the columnstore sweet spot. and the difference in query speed would be more striking. Still good thou, as that is a common use case.
The first question you should always ask when working with a 100 billion row database: “Why do I have a 100 billion row database?”
And the answer would be "because I work with a multinational enterprise customer". If you have a large market share in China (1 bill people) , India (1 Bill people), Europe 0.75 Bill, USA (350M people) it doesn't take long to get to 100 BIllion transactions.
If you want to do Financial Year on Year comparisons, you need to keep at least 24 months of data, usually 36 months. .
ebay? amazon store?
Simple and concise, thank you!
Thanks for the explaination. I am curious that is it just scaling of the systems, or BigQuery does query optimization to reduce the latency as well?
we can download this database to do some testes ?
I nice ideal for next video is compare this same situation with noSQL database.
Great, Thanks a lot, sir.
excellent sir thank you so much highly motivational for passionate person
Wow.. this experiment was really amazing to benchmark the bigquery .
So I don't have to carry about performance when I make projects ?!
Hi Bro, what if I apply FELLTEXT INDEX(View) prior to the query apply
Wow what a gr8 video sir ji..pls sir make video on sql with ml and sql also..
Awesome . Keep it up.
Well Explained, Thanks a lot
Hello sir. I tried to import 400k data into big query sandbox. But ended with more errors. Is this possible to import those data. Pls anyone help me it's urgent ( interview assignment)
Nice video but while voicing better to expand the screen than side by side videos
Heyy, very informative. I came here around searching for big data processing in seconds. Ive a question, I would like to build a system where I import terabytes of data into single table with keys and I want to perform all the DML operatiom in such a way it should take very less execution time as shown. Please help me out, how I can acheive. Im stuck.
Hi
I have similar requirement, could you please share your analysis/solution if you find any, thank you.
what to do when I want to overwrite 100 millions of rows into new table, in minutes?
df.write.mode("overwrite").saveAsTable("FINAL"), if you could please help with this?
Hello, can I connect it on php?
I appreciate your effort. Could you put the used link for the google cloud project?
Please organize the videos and make playlists , great video , very informative and helpful, which led me to subscribe , thanks 😊
marketer of google cloud.. nothing states what to improve
Great explanation
Amazing!
@Arpit Agrawal, Good. Let me know what database is behind this Console?
Google Cloud Bigquery 😁
This is good...
Nicely explained.
Im confused were these indexes?
BigQuery doesn't have indexes. It has partitions and clustering.
wow!
Please for 50 days I am looking for this i wanna to create 2000 users in mysql and set the phone number as user name and password my be say me how can i create most users with default password? That's
it's always an Indian guy!
I need your help
👍
This is nice but not that impressive. Obviously, the table is being stored using Columnstore Compression techniques. So you only need to query the columns in the select list. And they are typically grouped in blocks of 1 M or more. These header pages keep rowcount values. So you are not reading every row. Just the block headers of a single column.
If your query forced the scan of all rows in the "block" asking it to be combined with other fields in the same row or in other tables before you could filter it. You will no longer be in the columnstore sweet spot. and the difference in query speed would be more striking.
Still good thou, as that is a common use case.