R-Ladies Ottawa (English) - Introduction to Arrow - Nic Crane and Steph Hazlitt

Ever wished for a faster way to work with large datasets in R? Discover how Arrow can speed up your workflow!
On April 10th, 2024, the R-Ladies Ottawa chapter was joined by Arrow experts Nic Crane and Steph Hazlitt who guided us through a 2-hour introductory workshop on the arrow package in R.
This workshop covered topics such as:
- What is Apache Arrow?
- What are Parquet files?
- What can the arrow R package do, and how can we use it?
The materials for this workshop can be found here: github.com/thi...

[@derekborba]

Great presentation and package, thank you!

[@taiwankyh]

Thanks so much, clear and concise

[@haraldurkarlsson1147]

I have a file from the Collegeboard (scorecard) that is 566 MB as a csv on my hard drive. However, the parquet file of the same data only takes up 54 MB. Seems incredible.

[@haraldurkarlsson1147]

I am running a M1 Mac and getting errors even though the arrow package is installed. The message is: Error: This build of the arrow package does not support Datasets

[@haraldurkarlsson1147]

I heard that there is an attempt to develop arrow for shape files to generate maps. How is that coming along?