วีดีโอ

Register for upcoming bootcamp afroinfotech.teachable.com/p/bootcamp-azure-data-engineering

For more details on Databricks For Each please refer to docs.databricks.com/en/jobs/for-each.html#:~:text=You can add a For,in the Task name field. For details about my bootcamp, see link below. It starts Sept 24, 2024 afroinfotech.teachable.com/p/bootcamp-azure-data-engineering You can also visit my official Data Engineering coaching website at afroinfotech.teachable.com/. Follow me on other p...

Join me as I demo a real-world, metadata-driven, and configurable data pipeline that processes files landing in a data lake into the Databricks Medallion Architecture. This pipeline is a simplified version of a real-world project I built. I developed it using Databricks and Azure Data Factory with PySpark. Watch as I guide you step by step from requirements to production code. For the input fil...

As a databricks developer navigating the UI is crucial, but tricky. Watch this video to help you get started I am Nnaemezue Obi-eyisi, a Senior Azure Databricks Data Engineer at Capgemini and the founder of AfroInfoTech, an online coaching platform for Azure data engineers specializing in Databricks If you’re interested, join my waitlist for the upcoming Data Engineer bootcamp by signing up wit...

In this video, I go over the various Admin roles someone needs to have to properly administer access and manage Databricks workspaces and objects I am Nnaemezue Obi-eyisi, a Senior Azure Databricks Data Engineer at Capgemini and the founder of AfroInfoTech, an online coaching platform for Azure data engineers specializing in Databricks If you’re interested, join my waitlist for the upcoming Dat...

I demonstrate how to do some basic Databricks Administration to set up an Azure service Principal and use it to run Databricks workflow jobs with UI I am Nnaemezue Obi-eyisi, a Senior Azure Databricks Data Engineer at Capgemini and the founder of AfroInfoTech, an online coaching platform for Azure data engineers specializing in Databricks If you’re interested, join my waitlist for the upcoming ...

In this video, we discuss how to design an incremental load pipeline for update and insert use case using ADF and using the Max value of Watermark date approach. I am Nnaemezue Obi-eyisi, a Senior Azure Databricks Data Engineer at Capgemini and the founder of AfroInfoTech, an online coaching platform for Azure data engineers specializing in Databricks If you’re interested, join my waitlist for ...

In this interview, I talk about myself, my experiences in data engineering, what I teach in my bootcamp and why data engineering. I am Nnaemezue Obi-eyisi, a Senior Azure Databricks Data Engineer at Capgemini and the founder of AfroInfoTech, an online coaching platform for Azure data engineers specializing in Databricks If you’re interested, join my waitlist for the upcoming Data Engineer bootc...

In this video, I explain how we can design an incremental data pipeline. I explain the basic design and considerations. I hope it is helpful for beginners Connect with me on Linkedin: www.linkedin.com/in/nobieyisi/ Connect on medium: medium.com/@afroinfotech Connect on Instagram: afroinfotech Email: mezulity@gmail.com Phone Text: 435.565.1641

Connect with me on Linkedin: www.linkedin.com/in/nobieyisi/ Connect on medium: medium.com/@afroinfotech Connect on Instagram: afroinfotech Email: mezulity@gmail.com Phone Text: 435.565.1641

This video will show you how to handle NULL values that create bugs when you do a conditional Merge Upsert I show 3 different approaches to solve this problem.... watch till the end for the best approach SQL Script used can be found here: github.com/nobieyi00/SQLNULLS/blob/main/MergeUpsert_null.sql Connect with me on Linkedin: www.linkedin.com/in/nobieyisi/ connect on medium: medium.com/@afroin...

In this video, I go over SQL Nulls thoroughly revealing some of the common nuances we have with SQL Nulls and come mistakes developers make. SQL file used in Demo: github.com/nobieyi00/SQLNULLS/tree/main Connect with me on Linkedin: www.linkedin.com/in/nobieyisi/ connect on medium: medium.com/@afroinfotech #sql #null #data #analytics #database

Data Engineering information session hosted by UIU. In this information session, we discuss what is data engineering, how to become a data engineer, how to prepare resume and job interviews and more... The presentation link can be found here docs.google.com/presentation/d/1KFBmc69381mJW6yC5QYMpmMHdr0hwJ9u/mobilepresent#slide=id.p1 Connect with me on Linkedin: www.linkedin.com/in/nobieyisi/ conn...

This video is a real world demonstration of how we can implement databricks change data feed to optimize our ELT pipeline in Delta Lake house. You can use this for practicing your data engineering skills. I go over full load, incremental load, Merge Upsert, Change Data capture, ETL logic. I hope this really helps someone gain experience as a Data engineer. Find the notebook and source files her...

Data Engineer tries to use ChatGPT

Top 5 reasons why I am not using Delta Live tables

Learn how to use Spark/Databricks as a SQL Developer

Optimize your Datawarehouse ELT data pipeline NOW

SQL Window Function Partition by Orderby Deep Dive

How to mount an Azure Data Lake to Databricks cluster: Raw Uncut

Part 2 Using Databricks to ingest incremental CDC data

Part 1 Using Databricks to ingest Incremental CDC data Raw Uncut

Part 10: Raw Uncut Real World Data Engr Project: ETL Change Data Capture Full and Increment load

Part 9: Raw Uncut Real World Data Engr Project: ETL Change Data Capture Full and Increment load

Part 8: Raw Uncut Real World Data Engr Project: ETL Change Data Capture Full and Increment load

Part 7: Raw Uncut Real World Data Engr Project: ETL Change Data Capture Full and Increment load

Part 6: Raw Uncut Real World Data Engr Project: ETL Change Data Capture Full and Increment load

Part 5: Raw Uncut Real World Data Engr Project: ETL Change Data Capture Full and Increment load

Part 4: Raw Uncut Real World Data Engr Project: ETL Change Data Capture Full and Increment load