Get Data Into Databricks - Simple ETL Pipeline

In this short instructional video, you will learn how to get data from cloud storage and build a simple ETL pipeline
Get started with a Free Trial!
www.databricks.com/try-databr...
Get insights on how to launch a successful lakehouse architecture in Rise of the Data Lakehouse by Bill Inmon, the father of the data warehouse. Download the ebook: dbricks.co/3YaVYpv

[@julius8183]

Very clear and quick tutorial. Well done, thanks!

[@nicky_rads]

Solid demo for an intro to data engineering !

[@rendorHaevyn]

Great demo

[@user-tp2vb4gh3h]

Nice. Is the notebook available to download and try?

[@vaddadisanthoshkumar4143]

Thank you. 🙏

[@UntouchedPerspectives]

What about on prem data and iot data? Does DBX has ingestion capabilities?

[@omer_f_ist]

In the video orders/spend information data is exported as csv files. Should source OLTP systems export data? Is it more practical than the other methods(jdbc, etc...) ?

[@rabish86]

Can u provide us the data file or source for practice shown in this video?

[@sumantra_sarkar]

Thanks for the demo. Do you all have a link to the slide deck and the data set please?

[@ongbak6500]

Hi, where I can get this code that you are showing here?

[@dhruvpathi941]

where can i find this notebook ?

[@TheDataArchitect]

You have not append any meta data with the bronze layer, like when it was ingested, which file is the source of it?
bronze layer should have all historical data, no?
and what should be done next at the silver layer, so that only unprocessed data is processed to the silver table?

[@7effrey]

Is this the recommended way of doing ETL with databricks? I thought delta live tables where the recommended approach now

[@uditranjan2432]

This is one of the ways to build a simple pipeline with Databricks - how one can easily get data from cloud storage and apply some transformations on it. Delta Live Tables (DLT) is the recommended approach for modern ETL/more complex workflows. We will publish an explainer video on DLT soon.

[@borrarao1525]

Good

[@peterko8871]

So what is the challenge here, because this is like a 12 year old person can set up, basically just organizing some tasks in sequential order.