How Dukaan moved out of Cloud and on to Bare Metal w/ Subhash | Ep 5
ฝัง
- เผยแพร่เมื่อ 12 มิ.ย. 2024
- Build Your Own Redis / DNS / BitTorrent / SQLite - with CodeCrafters.
Sign up and get 40% off - app.codecrafters.io/join?via=...
Dukaan recently moved out of public clouds like AWS, GCP, and Azure are hosting their infra on bare metal instances. Like you all, I had several questions given how counterintuitive the move is. So, to get answers and understand their journey, we have with us Subhash Choudhary, Founder and CTO of Dukaan.
Outline:
00:00:00 Precap
00:00:26 Introduction
00:01:11 Story of Subhash and Dukaan
00:09:00 Infra need of Dukaan
00:11:45 Their DB setup and what do they run on cloud v/s bare metal
00:16:48 Their Kubernetes and CICD setup
00:32:22 Isn't bare metal a fixed investment and How does it scale?
00:40:00 Where and how are they hosting their bare metal infra?
00:44:18 Breaking production and Live failover
00:46:51 How did they do failover?
00:54:12 How to debug a production issue and Dukaan's Observability Stack?
00:58:43 Leveraging CDNs
01:01:42 What about security patches in bare metal?
01:03:45 IOPS benchmarking across cloud and bare metal
01:11:42 Number of deployments per day
01:13:29 Reducing infra cost from 90000 USD to 1500 USD
01:22:07 Isn't cloud more reliable than bare metal?
01:27:00 Random discussion on databases
01:36:24 Like, Share, and Subscribe
Arpit's System Design Masterclass
System Design for Beginners: arpitbhayani.me/sys-design
System Design for Experienced Engineers: arpitbhayani.me/masterclass
Become a member for exclusive in-depth videos: / arpitbhayani
Redis Internals: arpitbhayani.me/redis
I teach a course on System Design where you'll learn how to intuitively design scalable systems. The course will help you
- become a better engineer
- ace your technical discussions
- get you acquainted with a massive spectrum of topics ranging from Storage Engines and high-throughput systems, to super-clever algorithms behind them.
I have compressed my ~10 years of work experience into this course, and aim to accelerate your engineering growth 100x. To date, the course is trusted by 1000+ engineers from 13 different countries.
Together, we will build some of the most amazing systems and dissect them to understand the intricate details. You can find the week-by-week curriculum and topics, benefits, testimonials, and other information here
arpitbhayani.me/masterclass.
Other links
If you have solved an interesting problem and want to talk about it on my channel, check out
arpitbhayani.me/podcast
CS Engineering and Software Development books that I have read
arpitbhayani.me/bookshelf
Research papers that I have read
arpitbhayani.me/papershelf
Newsletter: arpit.substack.com
LinkedIn: / arpitbhayani
Twitter: / arpit_bhayani
To follow the blogs and papers I am reading, join my telegram channel at t.me/asliengineering
You can find handwritten notes and text notes about this video at arpitbhayani.me.
Until next time, stay awesome :)
Yours truly,
Arpit
arpitbhayani.me
#AsliEngineering - วิทยาศาสตร์และเทคโนโลยี
![ช้างศึกสู้ต่อไป!! พาเปียโน ดูบอลไทยครั้งแรก ตกรอบแบบโคตรเสียดาย!! l [Nickynachat]](http://i.ytimg.com/vi/4WloIH645Lg/mqdefault.jpg)
This is truely an insane podcast!
Subhash by default speaks in 1.5x
His brain works faster than his speech
yep. I wanted to watch in 1.25x or 1.5x but couldn't understand him
i had to listen on .75 to understand
I literally checked if I’m on 1.5x
Same..instinctively i put the video on 1.5x as soon as it started but had to switch back once he started speaking 😂
This is literally crazy podcast, I do not think i have finished any podcast without a break ever till this one arrived. A good start to the weekend. Thanks Arpit for doing this.
Same, 1st podcast I completed.
I hope Arpit bring more content like this (not necessarily in podcast) but practical hands on for "asli engineering"
Bro this cto is dope.... knowlege...curiosity....fearlessness...man insane... kudos to him...Thank you Arpit bhaiya for this podcast
Never saw a world class dev process explained in plain Hindi like this before . Also please see if sensitive info is not being shown. ❤
Man he is knowledgeable and confident enough to show the inside workings of his company.
Really respect him
This is peak of youtube! SO MUCH KNOWLEDGE in a SINGLE VIDEO!
I was like I will watch for 10 mins till my snacks would be finished and now I am having dinner watching this. Man, please do more podcasts like these. Got to learn a different thought process . Thanks Subhash and Arpit !! I hope to see more such podcasts on the channel.
It's been great working with Subhash. Really glad to be a part of his impressive operation.
Man this video is insane. I thought I'll watch first 30 mins or so and sleep. But I couldn't skip any single minute. I've literally been doing engineering for last few years but it was all about writing code and code level optimisations but no one ever talks about these optimisations from the perspective of costs, thinking in such a way from first principles is really 'Asli Engineering'. From the insights from Subhash to the insights from Arpit at the end. It was super amazing. Ive never commented on any youtube video before, creating a channel just to comment on this one. Subscribed to your channel as well. Amazing video loved it!
I recognize this writing
I'm less knowledgeable to this topic. So 10pm k around video start kiya aur 1:11am ho rha hai. 1hr 37 min ka video ko dekhne mai itna time laga...
so many thing for me to know. bahut se unknown terms ko google search kr kr ke dekhna pada.learned many things. Plz keep it up !
This discussion was really a gem, from my experience what i have observed is when people talk about response time, everyone gets so defensive that the first point of check is either code, or query run time, adding multiple indexes to make the the query run faster, but we easily ignore the network calls most of the time. Some great take aways from this discussions for sure.
This CTO is amazing! Very inspiring and logical and keeps things simple! Ankit thanks for bringing this, looking for more
Amazing ! In my recent experience working in a similar company to Dukaan but for the Middle East region. They have struggled alot to reduce the cost of AWS bills, this is the real pain for startups. Eye opener this is called "Asli Engineering" hats off, we need more podcasts with Subhash .. Already a fan of him
It's great to see.
One of the best podcast. I can say this is asli engineering and Subhash is very confident and fearless, "Fatega to dekha jayega, Zarurat hi ku h, complex krna hi ni h" 😄and he literally shutdown the actual server for the demo. I learnt, do not over design the architecture, just see the data and build.
What a brilliant podcast! Didn't shy from disclosing the real numbers... no one want's to find out the hard way. You and Subhash are proper engineers and I loved listening to you two talk technology. I've been a generalist for about 20 years, but love to experiment. I've learnt to setup servers etc. only since covid. So while my knowledge is surface level compared to you'll it was interesting to know that my learning is in the right direction. And just like you, i was astonished with the IOPS difference! Anyway, thank you for a wonderful podcast.
Its real gem, loved it Arpit and Subhash. Anticipating more.
This is a magical discussion!!! Man, this is an awesome podcast. I have Subscribed to the channel and turn the notifications ON, and kept shooting such podcasts. Really knowledgable.
Insane. Hands down the most entertaining and enlightening podcast I have ever seen.
pure knowledge..pure passion !!
no doubt why this video is most viewed in this channel..
This is the best engineering podcast I have ever seen in my life! Inspirational!! ❤
We would like to see more of this kind of in-depth sessions it was really awesome to watch you guys.
Showing the internal infra setup on TH-cam was the highlight.
Bring more of these kind of stuff.
This was pure awesome. Loved every second of it ❤.
This is one of the best Tech discussion I have ever seen on youtube.
This is truly “Asli Engineering” ❤
After a long time I watched this long podcast at once! This was truly an amazing content. Thoroughly enjoyed listening to both of you. Thank you!
Even though I didn't want to I had to pause the video and then like it before being mesmerized again 🔥🔥🔥
Wow, this is really good conversation.
Thank you Subhash for being so open.
Next level podcast💯🔥. I hope you continue inviting such talented people. Learnt alot🙌
my first podcast ever, and its full of knowledge.
Subhash's approach towards the problems and their solutions and preparedness is just awesome. I very rarely comment on any videos but on listening to his realistic approach prompted me to comment. Really impressed by the unencumbered way of thinking. All the best to Dukaan and Kudos to "Asli Engineering by Arpit Bhayani" for this interaction.. 👍
I work for a cloud provider so this is counter intuitive to I profess in general. However, the simplicity and ease with which Dukaan manage their infrastructure is amazing. My favorite thing was Subhash's enthusiasm for all this and how he takes pride in his tech work, truly inspiring!
I only worry about rapid scaling ability in future, however if the company doesn't project such an exponential growth, then this would work well for a foreseeable future.
Was so eagerly waiting for this episode!
This man has what a clear understanding of thoughts... really impressed to know how things work.
This was an amazing podcast. Hats off to how Subhash so easily touched so many aspects of Infrastructure.
Amazing CTO with tonns of knowledge and daring. Looking forward to work with him.
What an amazing podcast!!! Subhash sir is just on another level. Loved it throughout.
Enjoyed the whole discussion, bring more like this!
you've earned a subscriber by introducing me to a new type of podcast. The cocktail of education and interview is very refreshing.
This channel is underrated and this content is Gold
Crazy stuff , and crazy excitement , this shows how deeply he has done the things
Man this is dope! Would love to see a follow up podcast where we could see the database architecture. As in, are the databases sharded for a set of shops? Are all the app server regions of the same service hitting a single primary db?
Great Podcast, very enlightening even to someone who has very less knowledge about cloud Kudos to both 👏
You Indians are gold-mine of knowledge. Love you both from across the border.
Great work Dukaan team, one of the best podcast out there. Keep posting 💥💥💥
ok pranav
Great grip on his domain , a real guru .. love from Pakistan....
He is so incredibly honest. Lovely talk.
Really loved this podcast, This man is truly passionated for engineering.
what a podcast ! truly amazing .
Maza aa gya, soo much depth shared in a way like chai sutta aur charcha. Appreciate Subash for sharing things so transparently ❤
The guy gave a thorough overview of GitOps, ArgoCD, and Kubernetes principles. This video is more a tutorial than a podcast. ❤
I'm not even a CS engineer but I am all here for this kind of content.
very nice podcast, the people of my generation who started their career from cloud era only couldn't compare the bare metal and cloud performances and this is eye opening thing to see. great subhash sir
What an amazing podcast! Really inspiring!
This guy knows his stuff, awesome...
very informative, we want more content like this. And thanks to Subhash sir for sharing such an amazing info
he single handedly destroyed Devops Engineers/SRE/GCP/AWS (with facts and data of course).
But what a nice podcast full of TECHNICAL depth along with real time examples that he have shown.
My Key takeaways :
1. Learn KUBERNETES ! {will try to become the 5th SRE/Infra guy at DUKAAN}
2. Any system no matter how reliable , FATEGA !
3. Cloud vs On-prem (IOPS performance comparison)
lol how did he destroy devops engineers
@@yash_renaissance_athleteBhai most devops wala people I know can do run bare metal infra as well. Usually cloud ko padhne se pehle system handle krna aana hi chahiye. It's not really a big deal, most companies are moving some services to bare metal. Ye kaam bhi devops wale hi krenge
@@yash_renaissance_athlete not actually destroyed , destroy would be a little harsh word , but the need and use of a big devops/SRE team vs 3-4 guys who actually knows how to handle big infrastructure,(be it On-Prem vs cloud) and get stuff done.
@@animeshsingh4290 toh wahi toh mai bhi maanta hoo, but the main comment poster said “he destroyed devops engineers” and that’s why I asked him how did he destroy them
No.. he didn't.. He is just working with trade offs.. for some companies the traffic is so huge that they cannot afford the downtime with critical transactions.. and that downtime he doesn't care.. and basically managing 10 different other free services instead of using mainstream cloud.
Insane podcast…Weekend well spent
This is literally an eye-opener!!
This was a really good podcast, Arpit. As an old IT guy, I always knew self hosting is cheaper. But these insights from founder were phenomenal.
Hats off you guys, literally I loved them this is what our Indian Software developer community needs ❤❤
Why this podcast is what I was looking for all the time!!
hatsoff to the dukkan's founder..that deep insight will help people like us who are self taught
Throughly enjoyed the entire podcast, thank you!😊
I hope they make a similar episode when they go back into the cloud.
Hello Arpit!
Anycast is such an intriguing topic, and I couldn't agree more. I'm definitely looking forward to another video on BGP Anycast details. Your content is always so informative and well-explained. Keep up the great work! 🔥👍
Are mere bhai…🤯🤯 itni humbleness..❤️❤️❤️
What a gem of a podcast!!
Kya confidence hai!!!! Zabardast.
the moment he mentioned $1500 I was shocked, I've worked on both on-prem and cloud, currently working on the performance side of the applications but with these insights I will always check the underlying hardware as well.
I am flattered by this podcast. Thanks Arpit for this podcast. One of the most amazing podcast i have got lots of learnings from..
Thanks guys for this discussion. Aaj neend achi aayegi. Invaluable insights from Shubhash !
I don't know you, I don't know this guy. I clicked on the video just by reading "Dukan". As an early stage engineer myself, this is a gem 💎 podcast on devops and cloud infrastructure. Got a lot of insites. Totally worth it my time! Looking for more valuable content like this now! ❤ 🔥
This is the first channel to which I have subscribed while watching this video.
My mind is blown , got to learn so many stuff my brain can't handle!!
Asli Desi Engineering, hats off to you guys 👌👌
Would love to watch more podcast of Subhash Choudhary.
What a video! mind-blowing. Thank you for this.
Damn !!! This is insanely good discussion ... Absolutely loved it !!! Subhash proved that we can have full control of our Infra instead dumping loads of money into Cloud vendors !!! This was real fun ... keep them coming !!!
Very Nice thought process Subhash ... very real and very inspiring.
I am planning the same, I spent 5 years learning about deploying on-premises servers now it's time to use it.
The shock i got when i heard the COST difference! Man hats off!
lot of information in a single video. just wow!
Very informative video man, would love more of such videos/podcasts. Thanks 👍
There are more than 160 such videos on my channel. Do go through them. I have covered deep engineering concepts and real world systems.
@@AsliEngineering Oh, I will go through, Thanks 👍
Good one - Arpit, I was same thought and this bost my thoughts and lot of practical and proven insights form Subhash, Thank you
Thank you very much for this awesome and inspiring podcast ❤
Thanks for bringing such content. ❤
Awesome podcast. Please do this kind of pod
Subscribed befor I hit play. Something told me it was going to be worth it. Great content.
This is 🔥🔥. Didn't expected that this will change my entire though process. The content of this podcast is of worth entire eng. degree.
Bro this is a kind of podcast i was really searching for. Thanks mann
Bro this is really dope podcast. Subhash is genius guy.. Never saw such a simple thinking can solve a big problem.
Thanks Asli Engineer for doing this podcast. I became a fan of Subhash Chaudhary from now.
Knowledgable! I am also working on my startups it could give new startups a knowledge of future and critical thinking about their systems. Great!
This was great. Please keep this coming :)
Great podcast. It’s real stuff. Liked it a lot. Great if you do these similar ones from experts. May I ask one question, you mentioned why Kafka is fast. Can you please in details or give me some reference.
It's never a good content on the channel, it's always the best 😅🤣. Great insight 👍👍
This is Tanenbaum's book done bottoms up. Great talk, insight, guts and engineering.
Does that book also cover these kinds of topic? I didn't read that much. But IIRC, it was about the computer stack bottom up
Bhai, meri shuruvat ese hi hardware si hui thi, bad me cloud me move kiya and started focusing there. But this gives me enough confidence to continue on hardware.
Already downloaded video for reference purposes.
Wow, Full Interesting Podcast .
Maza aa gya .
very inspiring and informative podcast
Mind blowing discussion and knowledge 😍