Love auch JS deep dives. I am myself a C++ and now (partially because of you) Rust developer and like this performance stuff 😁 Since I just start using JS I like listening to JS ninjas like you are. This is much more interesting than most low level JS stuff on YT 😁 Thanks for your high octane videos ✌️
Man, you should definitely make more of those deep-dives, you have so much knowledge to share. If you could also drop a link to this code in the description, that'd be really useful. Thanks for the great tip!
@@odorlessflavorless yeah I suppose you could say that. Or, writing your code in a way that doesn't do as many allocations and doesn't leave much garbage behind
@@SiisKolkytEuroo bro tbh i did not understand the first function, the closure i do not understand it, never used it in real life in what case scenario would that function be used so from that i barely understood the whole video, i dont even know class components and what was he trying to do with all that props1 props2 props3 and the vocalbulary he used i didnt understand most of it, im self taught so i only understand code but not terminology.
Really enjoy the technical stuff! As someone who has more than a casual relationship with JS, these kind of engaging technical analyses are super useful on a very regular basis
I wrote a streaming regex engine and it hammers the GC pretty hard because it needs to create an object for each state it passes through, and on any real text and expression it passes through a lot. I studied its perf because I thought I'd have to pool the state objects, but instead profiling showed that I was only spending ~20% of my time doing GCs. That's because v8's generational garbage collector is optimized for the collection of objects that are small, short-lived, and have a common structure/shape. Engineers should not shy away from using those kinds of objects!
@@ThePrimeagen React's whole change detection system is built around shallow diffing two objects sooooo..... But it's not a design flaw, because it makes your code *_PURE_* 😇🙏 pure garbage
@@chrishamilton1728 Immutability is a sound concept that is. There are a number of ways to implement it in a far more performant manner. Sadly, javascript arrays and objects have pretty much none of the characteristics needed. There are libraries like Immutable JS, but that also falls short because no library is going to pass us an immutable list, for example after a database query. So you would have to make at least one copy of the array when converting to Immutable. How about we just skip JS on the server, at least where performance matters?
@@chrishamilton1728 Imo vdom is unnecessary with modern hardware. If they took that out, react dx would be much better and they also wouldn't have to do the diffing. But that's a monumental change that's never gonna happen. Good that we have other great open source ui libs
Lots of the time people are writing code that's more IO bound than CPU bound, but it's still useful to know these tricks for the areas where you are in a hot CPU loop
My favorite type of videos from you! I use JS all the time and see the spread pattern constantly, never thought to consider the GC impact under the hood but makes total sense!
Hey Mr./Ms. video editor, loved the "Not sure what he wanted me to do here lol" :D I always forget most of the good content creators have an editor making these guys much better than they would be on their own. You are doing a good job btw, whoever you are.
I really enjoyed this video and yes I would like to see more content where you do a code review just like this. TH-cam is filled with junior developer content. It is hard as an intermediate to find content that improves your skill set/skill level. I think with your knowledge base your technical review of code is extremely beneficial.
It was a great video, i would like to see more content like this. My opinion on the vid was that the setup could be shorter, the explanation of the code a bit longer and the ending was perfect! Performance is a difficult topic and these videos really help explain your thought process, please make more of them.
DAMN! Finally I found someone who teach like a savage! Usually I find myself sleeping right after couple of minutes of *explaining* something, here in a turn, I want to break my fckn retina display like rock star breaks his guitar! BTW didn't understand how you implemented test example, but it doesn't matter!
Mna, these kind of content is all I need!! Thanks for sharing. Performance, performance, performance!!! Learn how to dig inside the runner and understand what parts of your code is taking longer and then debug to get it better is what everyone should learn. I know it's advanced for a lot of people, but learn how to debug is an art that we all should give more attention to. Again, I'm 1000% for more content like this!!!
Finally a programmer that really understands what’s happening under the hood, instead of just shouting: just use the spread operator, because it is so easy to use, and then wondering why their app is so damn slow.
Personally I like the more technical videos you make. These walkthroughs and explanations are extremely valuable imo. And as always the editing is top-notch, Flip is the man.
Thanks ThePrimeagen. For now I start prepare myself to listen "Why JS spread syntax so bad and slow, and why you should use our BLAZINGLY FAST lib for that" from every blog...
I'd like to see a more in-depth breakdown of how garbage collection works as pertains to promises, and how you circumvented promises altogether. Good stuff
The idea of an object pool in a library like fastly sounds like (if I understand correctly) it would be incredibly easy to misuse, because the user needs to be very careful when to release the request object. On the one hand, if you release it too early/hold onto the object for too long and (for example) use it across an await point, the JS engine may well execute another request and it could reuse the released object (and effectively write request data of the new request to the object which is still in use by the other request). Then once it goes back to executing the old request, it has all the request data from the new request. On the other hand if you forget to release the object, it "leaks".This sounds almost like manual memory management but in JS
Yeah it's exactly like manual memory management in JS. And you run into all the pitfalls of manually memory management like in C, where you can have to worry about double free and making sure you actually don't have any more pointers to the old object when you toss it back into the pool. Otherwise you're going to have some seriously weird bugs as you could have multiple parts of your program using the same object, when in reality you want those objects to be different. You really need a very good reason to want to use a scheme like this, where for whatever reason you have a very performance critical section and need to take advantage of this. Though given the pitfalls of doing this code and maintaining it, this approach should be a last resort.
Thanks for the content. I've been working on how to rework blockchains without so much promise dependency...love these thought experiments. Best...hope the Volcano experiment works out!
Awesome & Greatness!! Very Excellent point!! That's why I sometimes, do not use Promises especially if it takes a lot of time.. But it all depends on the data how you use them and put them onto the objects.
I have pressed all the buttons! I love these videos, I am incredibly interested in internals and how performance can be increased. Please dish out more!
Node tip: `--trace_gc`, so you don't need to load your stuff in a browser just to profile it. V8's GC is also pretty interesting (in Node, at least, there's incremental sweeping in a worker, compacting is lazy) but a lot of it just comes down to common sense (don't create new objects dynamically when the data in them is static! don't throw back closures if you don't need them! use the boring-est data structure you can!). I've only rarely had to deal with GC issues in Node, but it almost always comes down to actually stupid code of my own, or actually stupid code in a library somewhere.
Grade-A chit! I'm not a fan of functional programming in everyday Javascript, but putting to work to (really) fix performance rather than do it bc you can is great
Great video!! Though I’m extremely curious about the refactor of the promises and that performance gain, can you elaborate more on it apart from GC taking so much time? I’d love a video about this :) Great job, love your channel 🔝
@ThePrimeagen: In your discussion about Promises, you hinted at other performance-related issues. I share a preference for traditional function syntax over anonymous or arrow functions, mainly due to their clearer debugging and adherence to DRY principles. Similarly, I find the async/await syntax somewhat counterintuitive as it blurs the lines between synchronous and asynchronous logic. Could you elaborate on the specific issues you've encountered with Promises, particularly in terms of performance? Your insights would be greatly appreciated.
Edit: nvm, in another comment, he used callback functions… Yeah, I don’t understand how promises could be converted as a series of functions, unless generators were used.
Yes, callbacks and function calling is faster than promises. BUT promises can be fulfilled all at once with Promises.all, without blocking the main thread! That's why we like to use 'em.
I'm pretty sure that Prime is talking about my code when he says garbage collection.
Holy sh**, i had to laugh out loud reading this
Your comment wins.
My collection of garbage is certainly slow.
This statement is true in every possible interpretation
its beautiful
but its garbage
@@ThePrimeagen I thought it was what's on the inner scope that counts :(
Big fan of the more technical stuff like this
Love auch JS deep dives. I am myself a C++ and now (partially because of you) Rust developer and like this performance stuff 😁
Since I just start using JS I like listening to JS ninjas like you are. This is much more interesting than most low level JS stuff on YT 😁
Thanks for your high octane videos ✌️
hey, please what's JS ninja?
did he mention it in this video?
ask cos I may not watch till the end 😬
100% agree
just trying to have a bit of fun out here
@@benjaminughegbe4255 it just means proficient with js
@@pchick oh, thanks a lot
Man, you should definitely make more of those deep-dives, you have so much knowledge to share.
If you could also drop a link to this code in the description, that'd be really useful.
Thanks for the great tip!
i will! for you, here you go github.com/ThePrimeagen/yt/blob/master/is-javascript-slow/test.js
@@ThePrimeagen 👈😎👈
Agreed, straight 🔥
Based
Awesome timing. Just learned about how Rust manages memory today so this will be a nice contrast!
I am a junior dev, but even understanding only about 50% / 60% I am learning so much watching your videos, thanks for this incredible quality videos!
Is there something specific you did not understand about the video, I'd be happy to explain
@@SiisKolkytEuroo I did not even the problem statement here. Is it about tweaking the code in a way the V8 engine does not run garbage collector ?
@@odorlessflavorless yeah I suppose you could say that. Or, writing your code in a way that doesn't do as many allocations and doesn't leave much garbage behind
@@SiisKolkytEuroo bro tbh i did not understand the first function, the closure i do not understand it, never used it in real life in what case scenario would that function be used so from that i barely understood the whole video, i dont even know class components and what was he trying to do with all that props1 props2 props3 and the vocalbulary he used i didnt understand most of it, im self taught so i only understand code but not terminology.
I love it. Object pool is quite a popular technique in game engines to reuse npcs and so on. Please continue with this format
Really enjoy the technical stuff! As someone who has more than a casual relationship with JS, these kind of engaging technical analyses are super useful on a very regular basis
I wrote a streaming regex engine and it hammers the GC pretty hard because it needs to create an object for each state it passes through, and on any real text and expression it passes through a lot. I studied its perf because I thought I'd have to pool the state objects, but instead profiling showed that I was only spending ~20% of my time doing GCs. That's because v8's generational garbage collector is optimized for the collection of objects that are small, short-lived, and have a common structure/shape. Engineers should not shy away from using those kinds of objects!
YES Primeee back at it with the technical stuff. For me this is your best type of content and the streams that lead up to it are so much fun!
yaya!
I do love the technical content and i think its super fun.
It’s crazy that I’ve watched your channel on twitch and TH-cam for years and learn something new every time I listen
Thank you!
I'd love to see a conversation between you and the React devs about the "Immutable" philosophy.
So many new objects, every single render, it hurts...
probably could squeeze quite a bit out on the server if they stopped
@@ThePrimeagen React's whole change detection system is built around shallow diffing two objects sooooo.....
But it's not a design flaw, because it makes your code *_PURE_* 😇🙏
pure garbage
@@chrishamilton1728 Immutability is a sound concept that is. There are a number of ways to implement it in a far more performant manner. Sadly, javascript arrays and objects have pretty much none of the characteristics needed.
There are libraries like Immutable JS, but that also falls short because no library is going to pass us an immutable list, for example after a database query. So you would have to make at least one copy of the array when converting to Immutable.
How about we just skip JS on the server, at least where performance matters?
@@marcusrehn6915 agreed
@@chrishamilton1728 Imo vdom is unnecessary with modern hardware. If they took that out, react dx would be much better and they also wouldn't have to do the diffing.
But that's a monumental change that's never gonna happen. Good that we have other great open source ui libs
Lots of the time people are writing code that's more IO bound than CPU bound, but it's still useful to know these tricks for the areas where you are in a hot CPU loop
It really worked for me after I look and try some tutorials, yours is the one that worked. Owe you a lot.
LETS GO!!
My favorite type of videos from you! I use JS all the time and see the spread pattern constantly, never thought to consider the GC impact under the hood but makes total sense!
Hey Mr./Ms. video editor, loved the "Not sure what he wanted me to do here lol" :D I always forget most of the good content creators have an editor making these guys much better than they would be on their own. You are doing a good job btw, whoever you are.
I really enjoyed this video and yes I would like to see more content where you do a code review just like this. TH-cam is filled with junior developer content. It is hard as an intermediate to find content that improves your skill set/skill level. I think with your knowledge base your technical review of code is extremely beneficial.
Please do these type of videos more. Love it
The amount of energy this guy can summon while talking about such dry topics is truly impressive
I loved this, I love your technical videos, MOAR CODE!!!
dude love this, please make more technical content like this.
I thought it was fun
@@ThePrimeagen yup it definitely was
@@ThePrimeagen learnt so much, like sucking mics, etc
It was a great video, i would like to see more content like this. My opinion on the vid was that the setup could be shorter, the explanation of the code a bit longer and the ending was perfect!
Performance is a difficult topic and these videos really help explain your thought process, please make more of them.
I love this!
This is the data based advanced stuff that no one else on TH-cam really does. With realworld fang experience to back it too!
good stuff, bro. keep it coming. thrnx!
Love these walk throughs. Great to have more
Yeah, tech-heavy videos are great. Code is life
Super high quality video. One of your best yet
DAMN! Finally I found someone who teach like a savage! Usually I find myself sleeping right after couple of minutes of *explaining* something, here in a turn, I want to break my fckn retina display like rock star breaks his guitar! BTW didn't understand how you implemented test example, but it doesn't matter!
hah, well, i do like teaching at break neck speed
2:34 -- first time I have been unable to resist the call to hit subscribe. I have subscribed, Daddy Primeagen.
your amazing but that editor does wonders too, props to that dude/lady whoever he/she is xD
Mna, these kind of content is all I need!! Thanks for sharing.
Performance, performance, performance!!! Learn how to dig inside the runner and understand what parts of your code is taking longer and then debug to get it better is what everyone should learn. I know it's advanced for a lot of people, but learn how to debug is an art that we all should give more attention to.
Again, I'm 1000% for more content like this!!!
As a newbie to programming I didn't not have a clue what the Primeagen was talking about, but I still really enjoyed it.
Real shit, thank your Prime for forcing me to care more about memory and garbage collection. Really helped me up my game as a JS developer
Man I'm so grateful for you communicating this stuff in 10 min chunks so good ty sir
Finally a programmer that really understands what’s happening under the hood, instead of just shouting: just use the spread operator, because it is so easy to use, and then wondering why their app is so damn slow.
More of this plz. CI jest runs have been killing us and this was cool to watch with that in mind
Personally I like the more technical videos you make. These walkthroughs and explanations are extremely valuable imo.
And as always the editing is top-notch, Flip is the man.
IT WORKED, THANKS I'VE BEEN LOOKING FOR THIS FOREVER, BUT NO TUTORIAL COULD EXPLAIN IT AS YOU DID
Faster prime, I need this in my project
Thanks ThePrimeagen. For now I start prepare myself to listen "Why JS spread syntax so bad and slow, and why you should use our BLAZINGLY FAST lib for that" from every blog...
this is exactly the kind of content needed, deep dive into certain things...
I'd like to see a more in-depth breakdown of how garbage collection works as pertains to promises, and how you circumvented promises altogether. Good stuff
I LOVE it! Please more technical stuff! PRIME, I AM SENDING YOU THE ALGORITHMIC SIGNALS PRIMMEEEEE!!!!
Let's go!!
actual technical content about a language that no one really thinks about technically is the true performance optimization involved here
Love this deep dive.. keep it technical, go deeeeeep sir, deeep!
Oh Prime these technical JS deep dives are fire 🔥🔥🔥
Great video, super smart way of showing off GC operations and how to work around them.
Prime!! Sending you some algorithmic clues to show more code
Man, this channel is the best 🎉
These are the primeagen videos I enjoy the most! Keep them coming
+1 more deep dives, this is the first video of yours I watched, and it was great
The idea of an object pool in a library like fastly sounds like (if I understand correctly) it would be incredibly easy to misuse, because the user needs to be very careful when to release the request object. On the one hand, if you release it too early/hold onto the object for too long and (for example) use it across an await point, the JS engine may well execute another request and it could reuse the released object (and effectively write request data of the new request to the object which is still in use by the other request). Then once it goes back to executing the old request, it has all the request data from the new request. On the other hand if you forget to release the object, it "leaks".This sounds almost like manual memory management but in JS
Yeah it's exactly like manual memory management in JS. And you run into all the pitfalls of manually memory management like in C, where you can have to worry about double free and making sure you actually don't have any more pointers to the old object when you toss it back into the pool. Otherwise you're going to have some seriously weird bugs as you could have multiple parts of your program using the same object, when in reality you want those objects to be different.
You really need a very good reason to want to use a scheme like this, where for whatever reason you have a very performance critical section and need to take advantage of this. Though given the pitfalls of doing this code and maintaining it, this approach should be a last resort.
Thanks for the content. I've been working on how to rework blockchains without so much promise dependency...love these thought experiments. Best...hope the Volcano experiment works out!
that's why pure functions are advised and returning callbacks is disadvised
I really like these break-down videos where you show us what not to do and what to do if we want to go BLAZINGLY fast!
Dude I love this video. Got to watch it again.
Prime always missing the actual place of like button. Every time he says "it's there just press it" he points to some random direction :D
Normally I need to speed up TH-cam coding videos. Prime may be the only channel I need to slow down. Great deep garbage heap dive.
yayaya!
This is great thanks. I usually don't worry too much about it since if I'm using JavaScript it's not in a performance = money scenario
This is the best content I have seen by you, do more like this!
Yay on the technical vids/amount of code. Made happy brain chemicals
love all your videos, keep up the technical side and I love your Go content!
So basically in a nut shell
You tried to make it Blazingly Fast !!
Love this stuff Prime
the deepest video about JS I've ever watched lol, now I know that I have a long road before me to become like you @ThePrimegen
I love these science adjacent videos, they are like reading scientific articles but more fun
Awesome & Greatness!! Very Excellent point!! That's why I sometimes, do not use Promises especially if it takes a lot of time.. But it all depends on the data how you use them and put them onto the objects.
I liked the video only because you send me to read the description and the way you requested was funny 😂
quite good amount of code, it did really well, nice explanations
not... blazingly fast, BUT it is HOW to become blazingly fast!
I understand like 50% of the words you’re saying but I understood 100% of that Fist of the North Star reference
life is like a box of chocolates
sometimes you leave them in the sun and they get ruined
i love these king of videos .. keep going !
I have pressed all the buttons! I love these videos, I am incredibly interested in internals and how performance can be increased. Please dish out more!
You keep apologizing for being weird with your jokes, bro, it's why we're here!
I hate those garbage collectors, they always trashing all my code!
just when I started to get confident in JS, this guy comes in and basically smashed it to the ground....again :D
Good. Never stop learning.
Great stuff! Interesting to listen these more technical topics.
This is the only video you made I have enjoyed.
Node tip: `--trace_gc`, so you don't need to load your stuff in a browser just to profile it. V8's GC is also pretty interesting (in Node, at least, there's incremental sweeping in a worker, compacting is lazy) but a lot of it just comes down to common sense (don't create new objects dynamically when the data in them is static! don't throw back closures if you don't need them! use the boring-est data structure you can!). I've only rarely had to deal with GC issues in Node, but it almost always comes down to actually stupid code of my own, or actually stupid code in a library somewhere.
Thank you, Mr. ThePrimeagen!
Awesome video, thanks for making this 🙏
definitely a fan of these JS deep dives.
Amazing stuff! For more profiling like that!!!
you sure take the fun out of spreading...
I didn't understand half of it, but this was a pretty interesting video. I think i will look into this more. Thank you for sharing
Tech papa brings JS truths. 👍
Really enjoyed this content! Would love more videos like this
@ThePrimeagen good job, you are big enough to have bots
Love the more technical deep dives
Grade-A chit! I'm not a fan of functional programming in everyday Javascript, but putting to work to (really) fix performance rather than do it bc you can is great
I like it. Really inspiring concepts. Keep it up.
Still interesting, still funny, still a great teacher.
Primeagen: man I cannot handle short-lived object creation
`for of` has left the chat
Thank you for explaining this thoroughly!
More please. I like this kind of stuff.
Great video!! Though I’m extremely curious about the refactor of the promises and that performance gain, can you elaborate more on it apart from GC taking so much time? I’d love a video about this :)
Great job, love your channel 🔝
I'll do a video on it.
Yea, me too. Definitely Left me wanting more 😊.
Really funny but the background :) killed me LOL
you are way too funny =) and also smart!! great job!!
We love you anyway Flip ❤
🙏🏼🖤
This video convinced me to subscribe. I’m finally on the Prime bandwagon.
@ThePrimeagen: In your discussion about Promises, you hinted at other performance-related issues. I share a preference for traditional function syntax over anonymous or arrow functions, mainly due to their clearer debugging and adherence to DRY principles. Similarly, I find the async/await syntax somewhat counterintuitive as it blurs the lines between synchronous and asynchronous logic. Could you elaborate on the specific issues you've encountered with Promises, particularly in terms of performance? Your insights would be greatly appreciated.
Edit: nvm, in another comment, he used callback functions…
Yeah, I don’t understand how promises could be converted as a series of functions, unless generators were used.
Yes, callbacks and function calling is faster than promises. BUT promises can be fulfilled all at once with Promises.all, without blocking the main thread! That's why we like to use 'em.