HLS Adaptive Bitrate Streaming - System Design

In this video, we are going to build and understand what is adaptive bitrate streaming. We’ll see how TH-cam and other video streaming platforms transcode videos into multiple HLS streams for 360p, 720, and 1080p and then stream the video to the user depending on the user’s internet speed.
Quick Links
Full Stack Twitter Clone learn.piyushgarg.dev/learn/tw...
Docker Course learn.piyushgarg.dev/learn/do...
Master NextJS 14 learn.piyushgarg.dev/learn/ne...
Reference Video Links
Video Transcoder • How I Built Video Tran...
Vercel Clone • I built Vercel in 2 Ho...
AWS S3 • AWS S3 Simple Storage ...
Source Code: github.com/piyushgarg-dev/hls...
Video Titles
- HLS Streaming
- Video Transcoding
- HLS Video Transcoder
Hashtags
#nodejs #mernstack #docker #devops #videotranscoding #systemdesign

[@viralgupta7636]

I just love the indian yt scene for programming rn, both the youtubers (piyush, hrkirat) are trying one up each others project and we are profiting from both of em.

[@souravchaudhary2585]

Add Chai aur Code (Hitesh OG)

[@prashlovessamosa]

Roz aise topic jiska mujhe door door tak koi Idea nahi
Thanks piyush bahi

[@ShauryaIsSnipc]

Harkirat and Piyush on their way to build to create their own universe 🔥

[@algobuddy]

Fantastic overview of Adaptive Bitrate Streaming! Keep up the great work!

[@ayushKumar-9835]

We definitely need such more advanced projects tutorials and ideas ❤ Thanks!

[@akshatjain2630]

Would like you to make part 2 of this , this was highly helpful but would like to see end to end ...getting stuck at a lot of things... Will also be helpful to know all the technologies you told in the assignment together

[@ayushverma2166]

Thank you sir you have solved a lot of money for me by making this tutorial now I can create my own streaming platform

[@AdithyaVardhanReddy]

We need part 2 🔥🔥

[@debasishdutta9073]

Love everytime i see your new project

[@harshprakashofficialhpmv3237]

Thankyou so much Piyush Bhaiya i was looking HLS video transcoding after Hitesh Sir dropped out his video on video streaming.
Thankyou for such amazing video.

[@manojmohapatra986]

I have tried my self this . Learned a lot . But would love to see the end to end so that we can improve

[@saikatmu31]

Loved the Video will try to do Myself and also want a Part 2 for this, Awesome Content !

[@NikhilMhatre-xt1wr]

love the way you explained HLS, need part 2 🙏

[@manishkumarprajapati6280]

Thanks yaar. You are a blessing to us. Happy to see creators like you

[@vishalpanchal2343]

Please make a video on online code compiler like leetcode with system design. And also add how to handle online contest on it.

[@patelaryan0914]

You can use rapid apis Judge0 for output of the code (not scalable) for scalability you can use docker spin up the container and install complier in the container which could run the code there and show the output to the user🤔

[@vishalpanchal2343]

@@patelaryan0914 But how to handle live contest which can have 1 lakh+ user on a time and they will submit code. And also we have to show live ranking for that.
This is a system design interview question which is asked in many companies.

[@patelaryan0914]

@@vishalpanchal2343 my solution is not scalable if you want to try by your self than you can for that definitely we need a video from piyush..

[@ashutosh_tiwari]

Great level of information you are providing bro✨🥂

[@abdullahbinanis5971]

I want part 2 please.
It would be great learning that how you approach the coding part for this also

[@spdwivedi5925]

Making videos out of the box and explaining in simple lang.
Thanku

[@FaisalKhan-oy4zz]

we want part 2 ⚡

[@TechSpot56]

Really appreciate these videos. keep it up.

[@jaymishra1781]

Please bring part 2 of it, Loved this one ❤

[@amit-gminggeek5301]

Thnx for this, I learnt a lot of things in this video

[@rog0079]

Great video as always, need part 2

[@shuaibkhan7775]

Initially, I thought the video.mp4 would be converted into a codec format like HLS on the fly and streamed in segments. Now I understand it better, thanks to your video

[@patelaryan0914]

Not in codec but by default its using hls on the fly think so this was for understanding hls and how it works because hls is by default by all the browsers check it by using both index.m3u8 and video.mp4(here 3mb of video is loaded after some time another 3mb)

[@shubham_paliwal]

Thanks for the crisp information ✨️💯

[@user-ju6zd5us7d]

Wonderful Piyush Sir

[@khizerkamal]

amazing video, waiting for part II

[@yash-uy5ym]

I thought about the same project few weeks ago but i had no i idea how would i deploy it
My implementation was limited to localhost but after seeing your video, i got a good idea of the entire architecture.
You're amazing bhaiya and 1000 times better than other didi bhaiya influencers

[@vk19148]

Please Please continue AWS series. 🙏🙏🙏
Ese kese banega aapka humara Bond. Naa hi aap video banate hai aur Naa hi reply dete hai kisi bhi comment ka. Bus apni marzi ke content banate hai...pehle comments to padh lijiye humko kisme dikkat aa rahi hai 😢

[@PramodSharma-dq3pi]

AWS must continue...

[@MathsWithSatyamPandey]

Aws series please continue❤ brother✨

[@annoymousyt3931]

Brother very few Creator Make this type of contents. Give some time, If I couldn't do it, Definitely You will make it. I want Part 2

[@Sandeep-zd6dq]

I will definitely try to code a video transcoder 🙌

[@ajaysureshsj1585]

Absolutely loved it ❤, Let me complete the task 🏃

[@Bcs-Mohtisham]

Amazing content ❤

[@coolsai]

Great video ✅

[@iampatelajeet]

Loved it ❤

[@RaoAnkitYadav-cv5sg]

Great information 😊

[@rishiraj2548]

Wow! ekdum useful and bhayankar app hai.

[@anuragprakash7256]

Very informative !!!!

[@ayushmehrotra7286]

Great job 👍

[@yourlinuxguy]

Please also talk about the costs of running these systems. A little brief will do as well.

[@atharvakj]

Sure. waiting for part 2.

[@SSC__CLASSES]

thank a lot for the video today i got what hls streaming is

[@gauravnegi4285]

Great video! I learned a lot about streaming, and I will try to implement this in Azure using different Azure service.👍

[@shashankagarwal23]

Very nice video. You can use ffmpeg tool available for macos which provide more features and speed for transcoding video and also there is also node package for it.

[@vishanand7248]

most unique channel for the programmers

[@bhaveshverma8629]

Woh great video ❤❤❤❤❤

[@chidambarjoshi3470]

I am a thesis based Master Student, and working on the same topic with MPEG DASH adaptive streaming for CDN optimization

[@hasnainraza5384]

Very informative video Piyush sir, love from Pakistan 😊

[@himankshu]

Bhaisab 🔥

[@tejasvix]

Hey piyush again great video, also i would like to request you a comprehensive video on zookeeper, watchers, service registry, and its other features like watchers and stuff, it would be really helpful to build big scale backends

[@your_Aats]

Bring also part - 2 Piyush Bhai 💕💕

[@pranavsuryavanshi408]

What a coincidence, I just started researching HSL.

[@aadarshgurug]

I have already made an lms system which has same functionality when you uploaded teachyst transcoding architecture almost 6 months ago, but still would like to see full implementation by you

[@techkro-official]

please give me 2 part. and please continue aws series.

[@fuzailahmad3259]

part 2 bhai must

[@amansagar4948]

Hi, thanks for the tutorial. I’ve a question. 31:04 why don’t js consumer directly listens for events in s3 bucket, why a queue is needed there?

[@abdulragib6004]

bahi mast

[@akshayyadav5914]

ek number thumbnail\

[@patelronak153]

🚀 please make another part on it❤

[@sanjoyrakshit842]

Make a part 2 for fully understand HLS Streaming

[@chakshud2525]

Bro, are you for real!!!! I just watched hitesh's video streaming and was looking for other resources. You are fucking goat man!!!

[@SureshKumar-lj7ji]

Part 2 🔥

[@arnavranjan7881]

sir,is it okey to use pre-signed urls instead of sqs??
What is need of queue system and how to use sqs in this case
Please reply...

[@user-pi5fq8bc8b]

Make part 2!!!❤❤

[@mayurshirodkar1571]

Hey piyush Try discussing what if we use lambda functions instead of docker containers

[@sudeepchoudhary5467]

the docker container is downloading whole video before encoding it which wil take so much time instead better approch would be to setup a kafka stream which stream the video from s3 and setup a flink which will encode it and send it to respective stream.

[@sagarmange45]

part 2 is needed

[@user-zy3ns3jr4y]

Hi piyush I want second part of video transcoding from scratch also do include front end where user can upload video from front end

[@ritikmishra8564]

Hi Piyush,
Had a doubt. We are making the output bucket as public and then streaming it via videojs. What if the video is restricted to few people only. For example if it is a paid content we shouldn't allow everyone to just stream it. In that case should we update the CORS to only allow request from our origin.

[@Nishitbaria]

Cool

[@user-su7eh6yr7k]

great

[@sachinsingh2104]

As far as i know you said ffmpeg will run for 4 times so can you please explain the server where this docker image is running is that server is capable of running ffmpeg 4 time for a file which is of 1 gb , and if yes then what will be the configuration of machine which we have to opt for this HLS conversion process,please reply

[@ShubhamVsCode]

I have completed the task which you have given. It has frontend, backend, sqs consumer and video processer which runs on ECS. I am not able to share the github link here.

[@avijitchanda7944]

Great 👍 but do part 2

[@manojmohapatra986]

Please iska part 2 leke ao mere bhai❤🎉

[@ThrillSeeker-ec5sz]

We want part 2

[@JackSparrow-ji7bx]

Can you bring the tutorial on the Kubernetes ? ( it would be a great relief )

[@shaileshjadav8413]

Sir make video on design of recommendation service of social media apps or shopping website using kafka

[@KunalJaiswal-og7nf]

How can we also show the preview image on seeking on the progress bar like in yt???????

[@NikkMhatre]

Please make part 2

[@harsh-raj-6982]

Live streaming ke uper bhi kuch banaiye bhaiya

[@girwarsahu7498]

we want part 2

[@basirkhan4610]

Sir, please bring the part 2

[@arkodeepchatterjee]

PLEASE MAKE THE FULL WORKFLOW

[@Riteshdhapatepatil966]

Please part 2 sir

[@Aziqtech]

❤

[@arkodeepchatterjee]

WE WANT PART 2

[@DakshGamer]

we want part 2. please....

[@tarunKumar-ux9ez]

❤❤❤❤❤

[@rishiraj2548]

good day greetings

[@patelaryan0914]

also a request you to upload the system design from the eraser as a ss in the repo

[@harsh-raj-6982]

Sab hogya but last mein client mein kiska m3u8 file ka link de in order achieve different resolution streaming based on network stream?

[@AAPFans67]

Make part 2 sir

[@suryanshverma2165]

Sir sqs se message polling karne par ek message 2 to 3 times same aa jata hai jisse container three times spinn ho jata hai how to solve???

[@ShourovRoy-pk5zm]

Part 2 please

[@AmanKumar-cx9oi]

Hi piuysh pls make video on node js microservice with docker and kafka it is not available anywhere thanks

[@surajrajput-]

bhaiya please ek devops series laiye

[@Mansoorahmedofficial_777]

thank you bhai

[@thestarters9799]

Can use bullMQ + Redis instead of SNS