วีดีโอ

This demo application showcases a seamless integration of various technologies to create a user-friendly workflow. Built with Streamlit as the frontend, the app requires users to complete a Stripe payment through a secure checkout process. Upon successful payment, Stripe sends the confirmation to a FastAPI backend hosted via NGROK. The backend generates a unique password, which is automatically...

When I was working on the 2nd Data Engineering lab by Zach Wilson, I thought why not pushing the SCD table to a graph database and create an agentic workflow for analyzing the data. Although this was not a part of the bootcamp, I wanted to experiement and play with the tools. git repo for this project : github.com/farsim-hossain/KNOWLEDGE_GRAPH_AGENTIC_WORKFLOW.git The repo for the Data Enginee...

When I was working on the Data Engineering Bootcamp by Zach Wilson, I found out some people are struggling to connect to the Postgres instance. In this video, I showed how to easily connect to the dockerized postgres inside a VM with VScode installed in windows. The github repo for the bootcamp : github.com/DataExpert-io/data-engineer-handbook.git

The efficient search and retrieval of relevant medical literature is crucial in the healthcare industry, where access to accurate and up-to-date information can significantly impact patient outcomes. However, the complexity and volume of medical literature make it challenging for healthcare professionals to quickly find relevant information. By developing a search engine powered by domain-speci...

In this project we have covered an end to end data pipeline using AWS services. We are simulating EC2 as an application server where Kinesis agent is installed and it is pushing the log data to Kinesis Firehose. Firehose is pushing the data to the S3 bucket. We have created a Glue catalog where the schema is defined and which is used by Athena to query the data. Quicksight is using Athena as a ...

In this first part of the project, we did the pre processing for all the novels by Rabindranath Tagore and created a single dataframe for analytics. Special thanks to Md. Mahdee-Uz-Zaman bhaia from AWS for his continued support towards the community. Connect with me Linkedin: www.linkedin.com/in/mahmood-hossain-farsim Facebook : farsimhossain E-mail : farsimhossain@gmail.com

In this project, we will migrate data from MySQL to Hive with Sqoop. We used Docker to containerize the frameworks in AWS EC2. Special thanks to Mohammad Mahdee-uz Zaman Bhaia for his support, guidance and providing AWS event hash. Connect with me Linkedin: www.linkedin.com/in/mahmood-hossain-farsim Facebook : farsimhossain E-mail : farsimhossain@gmail.com

This was an assignment from The Sparks Foundation as their GRIP program. #GRIPJUNE21