@D R yep, I caught that as well. After reading some of these negative reviews I was also considering not ordering but after really deep diving and knowing that a lot negatives are taken out of context I decided to move forward.
This illustrates my biggest issue with Whoop: that they only gauge your "recovery" stats based on what they believe to be your deep sleep. Great analysis!
Thanks for this, I’ve been looking at switching to the Apple Watch from the whoop strap and you’ve definitely made up my mind! It certainly explains why whoop’s calorie count is always so much lower than others as it’s missing those spikes in heart rate.
Just discovered your channel, great vids & very thorough. thank you for taking the time to do these as it really talked me off the edge of wasting my money on a Whoop strap with real information. I'll stick to my Wahoo Element HR strap and sleep and recovery the way I always have & keep my money :) I am however looking forward to future review with once you receive the sleep data from Whoop.
as a user of whoop for the last 6 months or so, i'm super skeptical about it and have had many occasions months after starting that make me question it's accuracy. the findings of this video are not very surprising to me. thanks for making it. had i not have opted to save money for the subscription for paying more upfront i probably would've cancelled by now.
I am a sports physical therapist and I noticed some issues with my Whoop strap a few months after starting my membership. I will briefly explain in my opinion why this video is so bad for Whoop 1. If the high rate that is quick to go up and then drop our missed by Whoop, then this strap is not accurate for Crossfit workouts and will grade the daily strain wrong. I noticed this when a CF WOD would put me at a 6 on strain, yet a brisk 5K in the part brought my strain to a 12. In return, that means the entire algorithm for my personal daily health is off since strain is one of the major factors. 2. The Quantitative Scientist has Videos factually showing the Oura ring is not as accurate as it should be with the different sleep stages. It matches my Whoop data almost 100%. It was even more damming when he said (in this video) that the Oura ring was a little more accurate. Thus, meaning the difference was in Oura’s favor. 3. Why is there data locked off? I find it very odd that he had to write them requesting the ability to download his own stats. It makes me wonder if they follow a very typical business practice in the states. Have a ok product, great marketing, and membership. 4. Membership. Personally, I feel if a company wants to have a membership based platform and continually charge for a service that it’s competition does not, then the product must warrant the the simple fact it will end up costing 10x the price of the others. In conclusion, if my strain and sleep is miscalculated then 2 out of 3 sections of Whoops algorithm is calculated off of poor data. If I were to pay for the product one time then maybe it would be justified. However, a monthly sub only to receive poor data?
Hey man, you've probably made your decision already, but having watched the majority of these now, it's pretty clear that the budget option is a fitbit (~72% accuracy) and the Dreem 2 (~84% accuracy) is the pricey option. The Oura ring is surprisingly inaccurate for the price.
The plan is to release the first video the coming weekend. I analyzed about 70% of the data I would like to include already, but want to collect 2 more nights of data to be sure. The first video will be Pillow or Sleep Cycle (I am leaning towards sleep cycle at the moment). Thanks for waiting 😄
@@TheQuantifiedScientist happy to have a response to my first ever post in TH-cam (almost 40 years old). PhD in transport engineering with love in data analytics! So happy to see your scientific approach on measuring accuracy of the devices! Well done, keep the (research oriented) work!!
Love your videos! Great work. I have a whoop and find it good overall. It tries to be alot, so there are bound to be limitations. Its helpful as a broad gauge of the days when you should push yourself or take it a bit easier when exercising. Would you recommend any products to add together in order to get more accurate results, in place of the whoop. i.e. constant heart rate monitor, sleep tracker , HRV trackers etc...?
Great video! If you do a follow on video could you look at the accuracy of the HRV measurements? Whoop relies on HRV more than any other metric to determine their recovery score. When you get the data export from Whoop I'd be curious to know how they determine the HRV value that the app displays. The measured HRV Whoop displays can change pretty dramatically if I modify the start/end times of my sleep. I'd be curious if HRV is a single point measurement or if it is averaged in some way. I suspect they are using a single point and if that is true maybe the data you get from Whoop will show at what point in the night your HRV was measured. I've got about 6 months of Whoop data I can share if you'd like. I've worn my Fenix 5X along the Whoop almost the entire time. So I have HR and sleep data from both devices. I also have about 50 cycling activities where I've worn the WHOOP and another optical HR sensor to compare against as well.
Yes! Please check into this. I'm glad I'm not the only one frustrated by the fact that my HRV can be HUGELY different if my sleep time changes. On one occasion, my recovery went from 27% to 96% simply but changing my sleep end time.
Pps contact me. I am wearing Garmin Fenix - now Quantix for 6 years. Now I wear Oura and Whoop together and hesitate which one to keep. I prone to Whoop but watched this video I am about to return. Thx. Cheers. Marian
Your videos are great, I’m just stumbling upon your channel now! Are you able to do an accuracy comparison of the Whoop 3.0 to the Fitbit Sense? I’m currently wearing both but I don’t have access to a medical grade sleep tracker to track accuracy. From what I’m seeing, it’s possibly the Whoop overestimates on REM and Deep though, would this be a correct assumption?
Surprised to see that Whoop sleep tracking was so off, despite their lofty claims. I've been interested in Whoop due to the appearance that they have interesting data analysis, but if the data is off, what's the point? Anyways, continuing to use my Fitbit Charge 4. Although I'm hoping that the Sense receives update(s) that improve heartrate accuracy.
Awesome content, subscribed. I got the Whoop strap a month ago and I'm disappointed to hear it's not quite as good for sleep tracking as I hoped. I'm curious to see your conclusions based on the larger dataset? Any idea when you'll publish that video?
I think that the current gadgets in which there is a sleep analysis function are not yet accurate ... in general, sleep is a very difficult thing and even scientists have not really figured it out ...
Just purchased the new Amazon Halo. It also does detailed sleep tracking. I would love if you reviewed this device as well. It’s available now for $100 on Amazon
I was expecting you to totally slam the Whoop but after listing to the Conclusions I see that the data still is useful considering this is a consumer device. People need to manage their expectations and learn how to use limited data accordingly.
I wonder why the WhoopStrap has no oxygen sensor, while several other tracking devices these days do? To me, this makes the device useless for sleep measuring, as the oxygen level during the day and especially during the night is crucial for me.
Hi! I guess they felt they did not need it for their most important measurements. But I suspect the Whoop Strap 4.0 will have it, even if it is just to keep up with the competition. Have a great day!
This great man, always wanted to see how accurate the Whoop strap was! I've been wearing it for 3 years and have sort of trusted it 😅 do you have any videos regarding any of the Samsung watches?!
Could you replace the biceps curls with burpees? With adjusting the burpees amount for a set, like: (7 Burpees + 40 seconds rest) x 5 and playing with the tree numbers, you could reverse engineer the step response delay. A HIIT example... instead of dicusing the form, of your curls...;-)
considering that according to measurement intensity, for movements at least, awake has the most, then light sleep, then deep sleep, then rem... why dont you plot it that way on your charts? that would explain the misinterpretations by most of these sleep trackers much better i assume?
Hi, I see this is a video from Dec 27 2020, which is not so old but the sleep phases results are quite different than results that you presented in the latest video (Whoop Strap 4.0 Announced! But, how good is the Whoop Algorithm? ) and I'm just wondering what is the cause? Is it possible that they improved the algorithm or did you had some different methodology in measuring? Thank you so much for the answer and for the all of the valuable insights you provide!
Hi Inka. I have been wondering that myself. I think it could be several things: (1) For the new analysis I used much more data, which makes it less likely to get random bad nights (2) It could be that the algorithm improved (3) It could be that they use some kind of dynamic algorithm that gets more personalised and improves over time> I am not sure. I just present the data as I have them ;-) Cheers, Rob
Hi! Thanks for the comment. I was actually wearing the Apple watch during these nights too. Had some issues with data collection because my iphone died and I had to get a new one, which took a bit of time. However, I have a few days worth of data, and I plan to make the video next week about one of the apps, probably "Pillow". Unfortunately these apps also do not have great data export possibilities, so it takes some effort to manually copy the stages ;-)
@@TheQuantifiedScientist Great, thanks for all the work that you are doing. I would think that videos on the Apple sleep apps will be a great way to get your views and subscribers up, given the many millions of people who use them. We could link them to forums on MacRumors and others.
Shame you didn't review the HRV/recovery part of Whoop since that's mainly why people wear it. (Whoop say themselves that you should get the upper-arm strap for weight-lifting/cross-fit tracking)
So do you think it would have been a lot more accurate if you wore it around your wrist how they recommend? Because I wear it around my wrist always and never higher!
It is generally agreed that the higher up your arm the band is, the more accurate Readings you'll get, this is why some shoot for getting the bicep band instead of the wrist strap for more accuracy
![[Watch Party] RoV Pro League 2024 Winter | with Moowan ( Bacon Time Vs Talon )](http://i.ytimg.com/vi/CCEDhu6dPN8/mqdefault.jpg)
![ฮักเทื่อสุดท้าย - บอย ศิริชัย [OFFICIAL MV]](http://i.ytimg.com/vi/-1PoPoQ-B-k/mqdefault.jpg)
These videos are the best! No one else is reviewing sleep trackers with this kind of detail. Great work man!
Great video man! Super pumped to cancel my membership to Whoop! 😂😂
I"m done with Whoop after 1 year, inaccurate sleep scores are not good for the psyche.!
@@ryanredman8377 ya! Totally. Read my other comment I left in more detail there. The Whoop is sadly pretty worthless
why? it's a consumer device that is not perfect but still useful. @ Conclusions and Limitations
@D R yep, I caught that as well. After reading some of these negative reviews I was also considering not ordering but after really deep diving and knowing that a lot negatives are taken out of context I decided to move forward.
Awesome video! I have been waiting for the whoop video series!
More to come!
Awesome got to whoop! Will be waiting for exported data review. ;) To see how it will perform.
I think whoop states t that you have to wear it for at least 2 weeks for the ai to get adapted to you before having accurate results
Man you are truly brilliant. I wish you all the best.
I'm somewhat surprised you're not constantly grinning in your sleep as well.
Haha, I was too when I saw the footage. I guess the muscles in my face also need some rest ;-)
@@TheQuantifiedScientist That's the thing, I thought smiling WAS your face's resting position. :P
Haha lol 🤣
@Jordan Kai DO NOT Google comments from 2 day old YT accounts with no uploads. YOU WILL GET SCAMMED. Both comments reported.
@@speckblue there's so many of these, two comment scams. Both same person
This illustrates my biggest issue with Whoop: that they only gauge your "recovery" stats based on what they believe to be your deep sleep. Great analysis!
Thanks for the feedback!
Thanks for this, I’ve been looking at switching to the Apple Watch from the whoop strap and you’ve definitely made up my mind!
It certainly explains why whoop’s calorie count is always so much lower than others as it’s missing those spikes in heart rate.
Fantastic videos! Giving the people reliable and transparent reviews. Subscribed super fast (y)
Just discovered your channel, great vids & very thorough. thank you for taking the time to do these as it really talked me off the edge of wasting my money on a Whoop strap with real information. I'll stick to my Wahoo Element HR strap and sleep and recovery the way I always have & keep my money :) I am however looking forward to future review with once you receive the sleep data from Whoop.
Awesome video as always! I look forward to the follow up. Keep up the great work!
Thanks a bunch!
Awesome video. What I loved the most is that beautiful X220.
Impressive comparison ! Thank you you have answered many of my questions !
Excellent analysis, as always. Thank you. It is always a pleasure to watch your videos.
Thank you for bringing some science to this. So appreciated.
Thanks for the video. So much value, appreciate your efforts.
"Those data" ... finally someone who uses the PLURAL word "data" correctly..ill sub
as a user of whoop for the last 6 months or so, i'm super skeptical about it and have had many occasions months after starting that make me question it's accuracy. the findings of this video are not very surprising to me. thanks for making it. had i not have opted to save money for the subscription for paying more upfront i probably would've cancelled by now.
Yes, wear it on your wrist just above the wrist bone.
You deserve my like as always sir
I am a sports physical therapist and I noticed some issues with my Whoop strap a few months after starting my membership. I will briefly explain in my opinion why this video is so bad for Whoop
1. If the high rate that is quick to go up and then drop our missed by Whoop, then this strap is not accurate for Crossfit workouts and will grade the daily strain wrong. I noticed this when a CF WOD would put me at a 6 on strain, yet a brisk 5K in the part brought my strain to a 12. In return, that means the entire algorithm for my personal daily health is off since strain is one of the major factors.
2. The Quantitative Scientist has Videos factually showing the Oura ring is not as accurate as it should be with the different sleep stages. It matches my Whoop data almost 100%. It was even more damming when he said (in this video) that the Oura ring was a little more accurate. Thus, meaning the difference was in Oura’s favor.
3. Why is there data locked off? I find it very odd that he had to write them requesting the ability to download his own stats. It makes me wonder if they follow a very typical business practice in the states. Have a ok product, great marketing, and membership.
4. Membership. Personally, I feel if a company wants to have a membership based platform and continually charge for a service that it’s competition does not, then the product must warrant the the simple fact it will end up costing 10x the price of the others.
In conclusion, if my strain and sleep is miscalculated then 2 out of 3 sections of Whoops algorithm is calculated off of poor data. If I were to pay for the product one time then maybe it would be justified. However, a monthly sub only to receive poor data?
Oh wow, first. Excellent videos
Hey, thanks!
Great video man!
After doing analyses on both Whoop and Oura, which one would you recommend in terms of the highest accuracy & precision? Thanks!
Hey man, you've probably made your decision already, but having watched the majority of these now, it's pretty clear that the budget option is a fitbit (~72% accuracy) and the Dreem 2 (~84% accuracy) is the pricey option. The Oura ring is surprisingly inaccurate for the price.
To export data from whoop you could use the HR broadcast function of the strap.
We are waiting for the Apple Watch sleep tracking accuracy!!
I have been waiting for a long time
The plan is to release the first video the coming weekend. I analyzed about 70% of the data I would like to include already, but want to collect 2 more nights of data to be sure. The first video will be Pillow or Sleep Cycle (I am leaning towards sleep cycle at the moment). Thanks for waiting 😄
@@TheQuantifiedScientist happy to have a response to my first ever post in TH-cam (almost 40 years old). PhD in transport engineering with love in data analytics! So happy to see your scientific approach on measuring accuracy of the devices! Well done, keep the (research oriented) work!!
@@TheQuantifiedScientist looking forward to hearing from you soon, much love and thanks 😊🙏
Love your videos! Great work. I have a whoop and find it good overall. It tries to be alot, so there are bound to be limitations. Its helpful as a broad gauge of the days when you should push yourself or take it a bit easier when exercising. Would you recommend any products to add together in order to get more accurate results, in place of the whoop. i.e. constant heart rate monitor, sleep tracker , HRV trackers etc...?
Thanks for this! Great review!, can we see something from Samsung and polar?
Nice review. The Apple Watch seems to have had the most accurate heart rate tracking for activities that I have seen in your videos.
I'd love to see you send the "Biostrap" through the ringer!
Great video! If you do a follow on video could you look at the accuracy of the HRV measurements? Whoop relies on HRV more than any other metric to determine their recovery score. When you get the data export from Whoop I'd be curious to know how they determine the HRV value that the app displays. The measured HRV Whoop displays can change pretty dramatically if I modify the start/end times of my sleep. I'd be curious if HRV is a single point measurement or if it is averaged in some way. I suspect they are using a single point and if that is true maybe the data you get from Whoop will show at what point in the night your HRV was measured.
I've got about 6 months of Whoop data I can share if you'd like. I've worn my Fenix 5X along the Whoop almost the entire time. So I have HR and sleep data from both devices. I also have about 50 cycling activities where I've worn the WHOOP and another optical HR sensor to compare against as well.
Yes! Please check into this. I'm glad I'm not the only one frustrated by the fact that my HRV can be HUGELY different if my sleep time changes. On one occasion, my recovery went from 27% to 96% simply but changing my sleep end time.
Pps contact me. I am wearing Garmin Fenix - now Quantix for 6 years. Now I wear Oura and Whoop together and hesitate which one to keep. I prone to Whoop but watched this video I am about to return. Thx. Cheers. Marian
Great video. I've been waiting for this video. Are you going to share your polysomnograph device design as well?
Well done!
Nice Video again! Keep on going. Thanks for your work. Will the Apple Watch Video come next?
Hi Tim! Yes, I plan to look at the "Pillow" app next weekend :-D
I love your videos as they are very comprehensive! Do you have any news when can we expect the huawei watch fit sleep testing? Thanks!
Your videos are great, I’m just stumbling upon your channel now! Are you able to do an accuracy comparison of the Whoop 3.0 to the Fitbit Sense? I’m currently wearing both but I don’t have access to a medical grade sleep tracker to track accuracy. From what I’m seeing, it’s possibly the Whoop overestimates on REM and Deep though, would this be a correct assumption?
Surprised to see that Whoop sleep tracking was so off, despite their lofty claims. I've been interested in Whoop due to the appearance that they have interesting data analysis, but if the data is off, what's the point?
Anyways, continuing to use my Fitbit Charge 4. Although I'm hoping that the Sense receives update(s) that improve heartrate accuracy.
did you do this for the apple watch? love your work man thank you for the science!
Can you try wearing the whoop on your wrist so you know it’s where it should be ? Maybe that made the sleep and HR shitty lol
Awesome content, subscribed. I got the Whoop strap a month ago and I'm disappointed to hear it's not quite as good for sleep tracking as I hoped. I'm curious to see your conclusions based on the larger dataset? Any idea when you'll publish that video?
According to you, what’s the best fitness tracker for a martial artist interested mainly in recovery, heart rate and sleep monutoring?
I think that the current gadgets in which there is a sleep analysis function are not yet accurate ... in general, sleep is a very difficult thing and even scientists have not really figured it out ...
Just purchased the new Amazon Halo. It also does detailed sleep tracking. I would love if you reviewed this device as well. It’s available now for $100 on Amazon
Hi! Indeed! Unfortunately I think we cannot get it in Europe yet...
I was expecting you to totally slam the Whoop but after listing to the Conclusions I see that the data still is useful considering this is a consumer device. People need to manage their expectations and learn how to use limited data accordingly.
Thanks for all your efforts I appreciate ...Can u review beddr sleep app??
thanks for your analysis. What device did you use to record heart rate from the Polar H10 strap?
I wonder why the WhoopStrap has no oxygen sensor, while several other tracking devices these days do? To me, this makes the device useless for sleep measuring, as the oxygen level during the day and especially during the night is crucial for me.
Hi! I guess they felt they did not need it for their most important measurements. But I suspect the Whoop Strap 4.0 will have it, even if it is just to keep up with the competition. Have a great day!
I think it takes a few days to calibrate correctly to each person. I wonder if you wore it for a month and if it would be more consistent?
This great man, always wanted to see how accurate the Whoop strap was! I've been wearing it for 3 years and have sort of trusted it 😅 do you have any videos regarding any of the Samsung watches?!
Glad I could help! At some point I hope to test Samsung for sure!
Wow...I think I'll stick with my Mi Band 5.
Could you replace the biceps curls with burpees?
With adjusting the burpees amount for a set,
like: (7 Burpees + 40 seconds rest) x 5
and playing with the tree numbers, you could reverse engineer the step response delay.
A HIIT example... instead of dicusing the form, of your curls...;-)
Any plans on retesting the fitbit sense heart rate with the latest update?
Could you try checking the accuracy of the sleep phaser v2 from Urbandroid?
I think that Fitbit has updated this issue, I beg you to make a video about if it is so. Then I can buy it .
considering that according to measurement intensity, for movements at least, awake has the most, then light sleep, then deep sleep, then rem...
why dont you plot it that way on your charts? that would explain the misinterpretations by most of these sleep trackers much better i assume?
Please review AutoSleep for Apple Watch 6!!!
Hi, I see this is a video from Dec 27 2020, which is not so old but the sleep phases results are quite different than results that you presented in the latest video (Whoop Strap 4.0 Announced! But, how good is the Whoop Algorithm?
) and I'm just wondering what is the cause? Is it possible that they improved the algorithm or did you had some different methodology in measuring? Thank you so much for the answer and for the all of the valuable insights you provide!
Hi Inka. I have been wondering that myself. I think it could be several things:
(1) For the new analysis I used much more data, which makes it less likely to get random bad nights
(2) It could be that the algorithm improved
(3) It could be that they use some kind of dynamic algorithm that gets more personalised and improves over time>
I am not sure. I just present the data as I have them ;-)
Cheers,
Rob
@@TheQuantifiedScientist thank you Rob for this super fast response!!
How do you extract the whoop data to overlay it? I can only seem to do it with polar
Any update on the Apple watch sleep apps testing ?
Hi! Thanks for the comment. I was actually wearing the Apple watch during these nights too. Had some issues with data collection because my iphone died and I had to get a new one, which took a bit of time. However, I have a few days worth of data, and I plan to make the video next week about one of the apps, probably "Pillow". Unfortunately these apps also do not have great data export possibilities, so it takes some effort to manually copy the stages ;-)
@@TheQuantifiedScientist Great, thanks for all the work that you are doing. I would think that videos on the Apple sleep apps will be a great way to get your views and subscribers up, given the many millions of people who use them. We could link them to forums on MacRumors and others.
@@TheQuantifiedScientist i think AutoSleep is a better app for sleep tracking if you can test it one day cheers ☺️
And you have to pay a monthly a subscription for this thing? I don't think it is worth it.
I am curious why it's 2 LEDs in the bottom instead of 1?
Is whoop better than oura ring 💍 / Biostrap EVO
Great video, but you can't trust anyone that goes to bed before midnight
Shame you didn't review the HRV/recovery part of Whoop since that's mainly why people wear it. (Whoop say themselves that you should get the upper-arm strap for weight-lifting/cross-fit tracking)
Can you do a review on Samsung galaxy watch 3 accuracy as well
Nice
Weird question but where are your glasses from?!
Hey, can you test the Withings BPM Core, good thing to have i Covid-19 times. Regards Claes
So do you think it would have been a lot more accurate if you wore it around your wrist how they recommend? Because I wear it around my wrist always and never higher!
I am also wondering about this
It is generally agreed that the higher up your arm the band is, the more accurate Readings you'll get, this is why some shoot for getting the bicep band instead of the wrist strap for more accuracy
What is sleep ‘alignment’???
Garmin sleep test! Garmin sleep test! Garmin sleep test! Garmin sleep test! :)
Any luck with getting your data back from whoop?
Whoop is pushing their product pretty aggressively with their TH-cam ads
Will you do a second video on whoop?
Hi Hugo! I hope so. I have been waiting several months now for Whoop to process my data export request...
Hai scientist
if you compare the extreme hearth rates, ofcourse you get a perfect line...........pffffffffffffffff
I can’t believe how crap so many devices are
Your pulse is on your wrist. The fact you put the whoop on your forearm to measure heart rate 🙃
What are you talking about. Your pulse is everywhere. You think veins are only in the wrist?
You mention that optical sensors are not great at tracking weight lifting . What is ? Thank you !
Hi! Chest straps based on ECG like the Polar H10, or a version from Garmin or other manufacturers should work much better😊
@@TheQuantifiedScientist thank you ! ! :)
Thank you for that video! #leiwand
Whoop reminds me of time share sales it’s all crap