- 105
- 23 163
Soda
Belgium
เข้าร่วมเมื่อ 13 ธ.ค. 2019
Data Engineering in Action: Building a Self-Service Data Quality Platform on AWS with Soda Core
At Soda, we believe that trust in data starts with ensuring its reliability-whether that’s through testing pipelines, validating data post-ingestion, or collaborating across teams to establish a robust data quality framework.
This 45-minute webinar with Mohamed Dyab, is a fantastic example of how data engineers are putting this philosophy into action. Mohamed brings over nine years of industry experience working at organizations including Air Liquide, Disneyland Paris, ManoMano and LegalPlace, focusing on data quality and data infrastructure.
In this session, Mohamed share his experience building a self-service data quality platform at Air Liquide using Soda Core on AWS. A few highlights are:
* The buy-vs-build dilemma his team faced.
* The evaluation process and architecture of their platform.
* How they transformed business requirements into actionable data quality checks.
* Lessons learned in customizing the user experience for data owners, consumers, and engineers.
This session is designed for data practitioners, especially those working with AWS or solving data quality challenges in the cloud.
This 45-minute webinar with Mohamed Dyab, is a fantastic example of how data engineers are putting this philosophy into action. Mohamed brings over nine years of industry experience working at organizations including Air Liquide, Disneyland Paris, ManoMano and LegalPlace, focusing on data quality and data infrastructure.
In this session, Mohamed share his experience building a self-service data quality platform at Air Liquide using Soda Core on AWS. A few highlights are:
* The buy-vs-build dilemma his team faced.
* The evaluation process and architecture of their platform.
* How they transformed business requirements into actionable data quality checks.
* Lessons learned in customizing the user experience for data owners, consumers, and engineers.
This session is designed for data practitioners, especially those working with AWS or solving data quality challenges in the cloud.
มุมมอง: 28
วีดีโอ
S1 Ep#25: Revolutionizing Social Media Management
มุมมอง 21วันที่ผ่านมา
The Data Product Management In Action podcast, brought to you by Soda and executive producer Scott Hirleman, is a platform for data product management practitioners to share insights and experiences. This episode of Data Product Management in Action, host Michael Toland sits down with Max Fritzhand, the creator of Bolta AI, to explore how he turned a simple frustration into a powerful platform ...
S1 Ep#25: Revolutionizing Social Media Management
มุมมอง 16วันที่ผ่านมา
The Data Product Management In Action podcast, brought to you by Soda (www.soda.io/) and executive producer Scott Hirleman, is a platform for data product management practitioners to share insights and experiences. This episode of Data Product Management in Action, host Michael Toland sits down with Max Fritzhand, the creator of Bolta AI (bolta.ai/) , to explore how he turned a simple frustrati...
How to Harness GenAI for Data Quality
มุมมอง 6514 วันที่ผ่านมา
Learn how to leverage the power of Generative AI (GenAI) to enhance data quality, streamline your operations, and drive productivity across your data teams. This 30-minute session will explore how Soda’s GenAI Assistants can transform your data quality processes by reducing manual intervention and improving data reliability. Discover how to: * Use GenAI to automate data quality checks, reducing...
How to Detect Bad-Quality Data in Business Reporting
มุมมอง 2514 วันที่ผ่านมา
Bad data is expensive, frustrating, and avoidable. With the right data quality practices, you can ensure your business reports deliver accurate insights and enable better decisions. In this 30-minute product showcase, our customer engineers, Arthur and Vivi present how to detect and prevent bad-quality data breaking business reports. You’ll learn how to: * Spot and resolve data quality issues b...
Operationalizing Data Governance for Accountability and Transparency
มุมมอง 714 วันที่ผ่านมา
A session on operationalizing data governance, featuring perspectives from both data governance and data engineering teams. Latravia White, Data Governance Manager, and Anand Sethukumar, Operations Engineer, will walk through a successful transition from reactive data management to a proactive approach that transformed their data governance landscape. This session is designed for data governanc...
S1 Ep#24: Product at the Core: Managing Data, AI, and ML
มุมมอง 2914 วันที่ผ่านมา
The Data Product Management In Action podcast, brought to you by Soda and executive producer Scott Hirleman, is a platform for data product management practitioners to share insights and experiences. In Episode 24 of Data Product Management in Action, our host Nick Zervoudis is joined byTefi Churbuki, Data Platform Product Manager at SumUp, to discuss her experience transforming a reactive data...
S1 Ep#23 Building a Data Mesh
มุมมอง 2621 วันที่ผ่านมา
Building a Data Mesh The Data Product Management In Action podcast, brought to you by Soda and executive producer Scott Hirleman, is a platform for data product management practitioners to share insights and experiences. In Episode 23 of Data Product Management in Action, our host Frannie Helfoursh is joined by Soheil Mirchi, a technical product manager. Soheil discusses his company’s shift fro...
S1 Ep#23 Building a Data Mesh
มุมมอง 4121 วันที่ผ่านมา
Building a Data Mesh The Data Product Management In Action podcast, brought to you by Soda (www.soda.io/) and executive producer Scott Hirleman, is a platform for data product management practitioners to share insights and experiences. In Episode 23 of Data Product Management in Action, our host Frannie Helforoush is joined by Soheil Mirchi, a technical product manager. Soheil discusses his com...
S1 Ep#24: Product at the Core: Managing Data, AI, and ML
มุมมอง 1914 วันที่ผ่านมา
The Data Product Management In Action podcast, brought to you by Soda (www.soda.io/) and executive producer Scott Hirleman, is a platform for data product management practitioners to share insights and experiences. In Episode 24 of Data Product Management in Action, our host Nick Zervoudis is joined byTefi Trabuchi, Data Platform Product Manager at SumUp, to discuss her experience transforming ...
S1 Ep#22 Data Dynamics: Navigating the Role of Data Product Managers
มุมมอง 53หลายเดือนก่อน
Data Dynamics: Navigating the Role of Data Product Managers The Data Product Management In Action podcast, brought to you by Soda and executive producer Scott Hirleman, is a platform for data product management practitioners to share insights and experiences. In Episode 22 of Data Product Management in Action, we welcome back our host Michael Toland as he chats with guest Chandan Gadodia. Liste...
S1 Ep#22 Data Dynamics: Navigating the Role of Data Product Managers
มุมมอง 80หลายเดือนก่อน
Data Dynamics: Navigating the Role of Data Product Managers The Data Product Management In Action podcast, brought to you by Soda (www.soda.io/) and executive producer Scott Hirleman, is a platform for data product management practitioners to share insights and experiences. In Episode 22 of Data Product Management in Action, we welcome back our host Michael Toland as he chats with guest Chandan...
Data Engineering Tutorial: Getting Started with Soda Data Quality Checks in Databricks Notebooks
มุมมอง 233หลายเดือนก่อน
In this tutorial, we will walk through the steps to quickly set up and run data quality checks within a Databricks notebook using Soda. This guide covers how to install the necessary Soda packages, configure Soda Cloud, and execute data quality checks. Visit www.soda.io/tutorials/implement-data-quality-checks-in-a-databricks-pipeline-with-soda-step-by-step-tutorial for the detailed instructions...
S1 Ep#21 Navigating AI in Data Product Management
มุมมอง 52หลายเดือนก่อน
The Data Product Management In Action podcast, brought to you by Soda and executive producer Scott Hirleman, is a platform for data product management practitioners to share insights and experiences. In Episode 21 of Data Product Management in Action, Frannie Helforoush interviews Lucca Kazan, a senior AI product manager about Navigating AI in Data Product Management. Luca shares insights from ...
S1 Ep#21 Navigating AI in Data Product Management
มุมมอง 99หลายเดือนก่อน
The Data Product Management In Action podcast, brought to you by Soda (www.soda.io/) and executive producer Scott Hirleman, is a platform for data product management practitioners to share insights and experiences. In Episode 21 of Data Product Management in Action, Frannie Helforoush interviews Lucca Kazan, a senior AI product manager about Navigating AI in Data Product Management. Luca shares...
S1 Ep#20 Navigating the Data Landscape
มุมมอง 3412 หลายเดือนก่อน
S1 Ep#20 Navigating the Data Landscape
S1 Ep#20 Navigating the Data Landscape
มุมมอง 1022 หลายเดือนก่อน
S1 Ep#20 Navigating the Data Landscape
Data Quality Use Case: How to Test Data Quality in a Databricks Pipeline
มุมมอง 2522 หลายเดือนก่อน
Data Quality Use Case: How to Test Data Quality in a Databricks Pipeline
S1 Ep#19 Mastering Data Product Management
มุมมอง 402 หลายเดือนก่อน
S1 Ep#19 Mastering Data Product Management
S1 Ep#19 Mastering Data Product Management
มุมมอง 182 หลายเดือนก่อน
S1 Ep#19 Mastering Data Product Management
S1 Ep#18 Enhancing Decision-Making with Data Products
มุมมอง 422 หลายเดือนก่อน
S1 Ep#18 Enhancing Decision-Making with Data Products
S1 Ep#18 Enhancing Decision-Making with Data Products
มุมมอง 202 หลายเดือนก่อน
S1 Ep#18 Enhancing Decision-Making with Data Products
S1 Ep#17 The Non-linear Path to Product Management
มุมมอง 262 หลายเดือนก่อน
S1 Ep#17 The Non-linear Path to Product Management
S1 Ep#16 Meet A New Host: Nick Zervoudis
มุมมอง 352 หลายเดือนก่อน
S1 Ep#16 Meet A New Host: Nick Zervoudis
S1 Ep#17 The Non-linear Path to Product Management
มุมมอง 142 หลายเดือนก่อน
S1 Ep#17 The Non-linear Path to Product Management
S1 Ep#16 Meet A New Host: Nick Zervoudis
มุมมอง 152 หลายเดือนก่อน
S1 Ep#16 Meet A New Host: Nick Zervoudis
The Minisodes, Live from Data Connect 2024: In Conversation with Morgan Templar
มุมมอง 154 หลายเดือนก่อน
The Minisodes, Live from Data Connect 2024: In Conversation with Morgan Templar
The Minisodes, Live from Data Connect 2024: In Conversation with Vishakha Gupta-Cledat
มุมมอง 174 หลายเดือนก่อน
The Minisodes, Live from Data Connect 2024: In Conversation with Vishakha Gupta-Cledat
The Minisodes, Live from Data Connect 2024: In Conversation with Morgan Templar
มุมมอง 84 หลายเดือนก่อน
The Minisodes, Live from Data Connect 2024: In Conversation with Morgan Templar
The Minisodes, Live from Data Connect 2024: In Conversation with Vishakha Gupta-Cledat
มุมมอง 124 หลายเดือนก่อน
The Minisodes, Live from Data Connect 2024: In Conversation with Vishakha Gupta-Cledat
You're doing a fantastic job! Just a quick off-topic question: I have a SafePal wallet with USDT, and I have the seed phrase. (alarm fetch churn bridge exercise tape speak race clerk couch crater letter). How should I go about transferring them to Binance?
I really appreciate your efforts! I need some advice: I have a SafePal wallet with USDT, and I have the seed phrase. (alarm fetch churn bridge exercise tape speak race clerk couch crater letter). How should I go about transferring them to Binance?
Thanks for the breakdown! Just a quick off-topic question: My OKX wallet holds some USDT, and I have the seed phrase. (alarm fetch churn bridge exercise tape speak race clerk couch crater letter). What's the best way to send them to Binance?
Can't I also just specify a SQL schema in my DWH which would handle a lot of the validation (e.g. unique, not null, ...)? If the data loaded doesn't comply with the schema then don't load it.
That would handle some aspects indeed. Contracts and checks allow for more flexibility in terms of check types, thresholding, and support for allowing more people outside the producer team to contribute checks.
pip install soda-core-contracts ModuleNotFoundError: No module named 'soda.contracts.data_contract_translator'
A very informative webinar with lots of great advice for a successful migration to Snowflake!
How to execute SQL query in SODA core. Coz I have been trying but fetching error.
I used to huff Freon with my hair dresser
Kudos Kulani, your love for data can out clear and loud ❤❤.. Data governance as an enabler to handle data🎉
Hi team, How to get our datasource name to mention it in our configuration.yml? I am strcuked here. Please reply
Hello @bvvenkatest2992 - please check out our docs.soda.io (Connect a data source) or join our community for help from our team and users: join.slack.com/t/soda-community/shared_invite/zt-1w910mbdw-tBfYW3BlSbMIgB0sq9kMPw. Good luck!
😩 P r o m o s m
💚💙💛Keep up the good work!😍😍
Can we integrate soda core with SAP hana database??
𝕡𝐫o𝕄o𝔰𝓶 🙈
Could you show some more details about the integration setup between Soda and Collibra? Thanks for the video.
Hello, Argyrios. A member of our team will be in touch with you soon. Thank you.
I walked through the GitHub sample, set up some checks and ran from my local. All was great! How would we set something up to run these commands on a schedule, and output to slack or elsewhere?
Hello Zach, great news! You'll need to connect to Soda Cloud. Head over to our Slack community: join.slack.com/t/soda-community/shared_invite/zt-pf67xl6u-n3wexBNDl71VC6vK8fSPjg