May I ask how did a 44.2 GB csv file size manage to operate? I thought there is a maximum of 2 million rows in a single file of excel? Thank you for clarifying.
Hi John, thanks for the question. The 2 million row limit applies to Excel sheets, not CSV files. CSV files are essentially plain text files (hence why it's a .txt file here) that can store data in a tabular format with no inherent row or column limits. In the demo, DuckDB reads from the file directly without using Excel. I hope that clears things up
![Hannes Mühleisen - Data Wrangling [for Python or R] Like a Boss With DuckDB](http://i.ytimg.com/vi/GELhdezYmP0/mqdefault.jpg)
![Hannes Mühleisen - Data Wrangling [for Python or R] Like a Boss With DuckDB](/img/tr.png)
Thank you for this very useful video!
May I ask how did a 44.2 GB csv file size manage to operate? I thought there is a maximum of 2 million rows in a single file of excel? Thank you for clarifying.
it wasnt an excel file, it was a .txt
Hi John, thanks for the question. The 2 million row limit applies to Excel sheets, not CSV files. CSV files are essentially plain text files (hence why it's a .txt file here) that can store data in a tabular format with no inherent row or column limits. In the demo, DuckDB reads from the file directly without using Excel. I hope that clears things up