Echoing the comments from several others, this video, once combined with the sleep tracking video you said you have coming up, is going to be an absolute game changer for the smart watch industry in terms of which watches/trackers people are going to buy
Thanks so much Adam! 😊 I hope this video helps some people. There are of course still a bunch of limitations to my testing, but I think this is a good first overview, which I hope to improve on in time.
@@TheQuantifiedScientist no problem man! Also, not sure if you'd be able to give an estimate on when you think the "sleep comparison" video will be up. I'm sure it'll take some time, but I'm guessing a lot of people, like me, are gonna wait for that video before buying a new smartwatch
@@TheQuantifiedScientist Your videos are awesome and I have made many purchasing decisions based on them. I am thinking about Muse S Gen2 for sleep tracking. Do you have any lead on it, if it is reliable or not? Would you consider testing it?
Thanks for the great analysis Rob! I bought a Charge 5 based on your C5 review. I do notice several heart rate anomalies. It is slow to pick up increased HR when walking running but after 5-7 minutes or starts to match my polar F6 fairly well. It seems to do well in most aspects of health tracking. I look forward to your sleep tracking roundup!
I am a physician and came across this. This is very good! I personally noticed that the Apple Watch didn’t used to seem to correlate well with my Polar strap. But now with Watch 7 it seems spot on. Rare anomalies, like sudden spikes that the Polar did not catch, suggesting error. Very useful! Allows me to leave the Watch on as my main driver. Would be nice to keep adding to the database with time. Especially as the newest Apple Watch, the Ultra, is now released. As it is so focused on sports, would be nice to compare to other high end triathlon and ultra watches. Also, I have always wondered about SaO2. There seems to be such a wide variation. In the day, from low to high 90’s. Makes no sense. I have always felt the the high SaO2 levels are likely accurate, and low values doubtful, what do you think? Great work!
🔴 Affiliate* (paid) link Amazon for any watch: geni.us/thequantifiedscientist 🔴 Affiliate* (paid) link Whoop: join.whoop.com/QuantifiedScientist ($30 off any new WHOOP membership) 🟢 Instagram: instagram.com/quantified_scientist/ 🔵 Newsletter: www.robterhorst.com 🟡 Twitter: @QuantifiedRob * Affiliate (paid) links support the channel by earning me a small commission on any sale, and it doesn't cost you any more! My opinions are completely my own, and this content is not sponsored. ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ 👇Amazon Affiliate* (paid) links. Supports the channel, doesn't cost you any more!👇 ▬▬▬▬▬▬▬▬▬▬BEST WATCHES▬▬▬▬▬▬▬▬▬▬ Whoop Strap 4.0: join.whoop.com/QuantifiedScientist ($30 off any new WHOOP membership) Huawei Watch GT Runner: geni.us/HuaweiWatchGtRunner Huawei Watch GT 3: geni.us/Huawei_Watch_GT3 Apple Watch 7 41 mm: geni.us/AppleWatch7_41 Apple Watch 7 45 mm: geni.us/AppleWatch7 Apple Watch 6: geni.us/0gNGeO Apple Watch SE: geni.us/Apple_Watch_SE_44 Garmin Venu 2: geni.us/Garmin_Venu_2 Garmin Instinct 2: geni.us/Garmin_Instinct_2 Polar H10: geni.us/hnXc Polar OH1+: geni.us/D7bs5 Polar Verity Sense: geni.us/polarVeritySense
How did you prevent your Apple Watch or iPhone from automatically connecting to your Polar H10? Could that result in a correlation of almost 1 for the Apple Watch?
@@rjdverbeek Hi Rene! I have multiple reasons for thinking this is not the case, the most important being: (1) I can still see that the Apple Watch does better during "easy" types of workouts than during "hard" ones, which shouldn't happen if it "hacks" the H10 (2) I connected 2 out of the 3 apple watches to different phones than to which the Polar H10 is attached (3) The correlation is not 100% perfect, and I still see small deviations Thanks for the suggestions!
@@TheQuantifiedScientist Can you please share/ publish these Graphs outside of the videos as well - So that we can go through the relative differences for various parameters?
are you thinking about doing something like this for sleep tracking? this analysis is super impressive and would be curious to understand what devices can provide high quality sleep tracking
Thank you for all your work! I hope that Fitbit and Google can get close to the Apple Watch because I'm interested in buying the Google Pixel Watch, releasing this fall
This is brilliant. It is by far the closest to a meta-analysis of these devices. I really hope you do the same for sleep tracking as well. Thanks for the loooonng hours, much love.
Wow, thanks so much Siddharth! Indeed, this video was really a beast to make, and in the end cost about 2-3 times as much time as a normal video of this length. Happy to see that people like it!
@@TheQuantifiedScientist I second this comment. Always referring to your videos when looking to buy any of these trackers/watches. Thank you from me as well.
Great summary. There was no such comparison of HR accuracy in the network, especially with the division into the exercise category. Now we are waiting for the same tests but in the GPS accuracy category. Recently, I tested the Apple Watch 7 and Huawei GT Runner and I am impressed with the high accuracy of AppleWatch GPS tracking e.g. a run in the forest. I noticed that the smartwatch from Huawei does not "collect" data as quickly in the field as the Apple Watch. By making quick turns during the run or turning perpendicularly, the AW7 does it really impressively precisely, where Huawei can "round" the perpendicular turn and cuts a few meters from the turn. In total, Huawei lost several hundred meters from the 5 km test on the route.
Nailed it! This is brilliant, Rob. Thanks again for all your time and $$ spent making these videos. Hopefully some of the companies represented here see this video and make the much needed changes to their products.
This is an excellent video. I appreciate all your hard work on how informative it is and giving a non biased view. I’ll be looking forward to future videos with other specific health measurements comparing different wearable device. Thank you Rob.
I've been waiting for this for a long time! TBH, you're the only reviewer everyone needs to refer to when it comes to buying Smart Watches for their features. 😂
Great work 👏 I’m wondering if there’s any chance if you could test which one of them could be used for AFib/arrhythmia and battery life for 24/7 tracking ❤ and optional if they have Fall Detection ( towards fading not crashing/accident)
As always, awesome work to bring this info to your channel. As a recent purchaser of Garmin's new Epix 2, I feel that even though I'm loving the watch, it seems that at the 1K price tag that Garmin could have done a much better job at competing with the Apple product at a third of the cost. I know that we'll hopefully see huge improvement in upcoming software updates but at this price point and their reputation for their expertise in the health field, they should have hit the ground running....
Garmin epix destroys apple in many other things and their heart rate quality is debetable. Garmin tracks you every second. Apple does not. There is huge battery life difference. Aswell as many other stuff durability, navigation. I saw videos where apple watch didnt do better than garmin sportclocks when comared to medical devices
Great work Rob, such incredible effort! Your scientific approach and established methodology will pave the way to see how wearables increase accuracy over time! Outstanding value on this video.
Your dedication is amazing, and it is very much appreciated! I started (at a later age) to invest in my health again by joining a gym and working with a trainer. He told me to get a fitness tracker and I am glad I found your channel. He was recommending a Fitbit Charge 5 while I was leaning towards a Withings Scanwatch, but this review just helped me cut through a BUNCH of questions I had! I settled on the Garmin Venu 2 and feel it's going to work out fine for me. Again, what you do is much appreciated and thank you!
Hi Matti! Yes, I am making that too, though of course some of that is already included on some other videos. However, these miss a lot of context, so I hope to provide a more complete overview.
Thank you so much for this video. I bought Fitbit Sense two weeks ago so i can track my heart rate during weight lifting. Result - it was never showing it above 109bpm no matter what, only on my cardio days i was able to see 117bpm which is still not reallistic, i should've watched this earlier. Short story is after watching this video the other day since i am not Apple guy, i bought GT Runner and that nailed it. I am able to get accurate heart rate readings again during weight lifting, average 130-150bpm during workout is completely different story. I wasn't aware threre are issues for most devices to get accurate readings during weight lifting. Thank you so much again. And thanks to my wife for taking the Sense so i can buy the Runner :). Keep up the good work !
Great comparison! It would be interesting to see a combined result and also accuracy vs price. An issue i have with many is that they send data to a cloud (Huawei, probably Fitbit which is owned by Goolge now) and not to the smartphone directly. That has serious privacy implications! But i guess others can make a more complete review and you are the expert for biological stats.
Superventricular tachycardia with 210 pulse was also detected. before emergency was there... Not directly by the clock itself but pretty true with 6/12 channel and long time monitoring
Love your data analysis.. having some of the better ones from your list I can concur that chest straps have been the gold standard for anything outside training. Tested it while playing tennis and rowing. Just really accurate results overall when there is a lot of movements. Now would love to see comparisons between difference chest straps ecg ones. Is the best sleep trackers coming out next? Haha that would be fun to see
Brilliant! The data and the accompanying analysis clear up all the magic and mystery that marketing brings to the products. Being able to see raw data is always worthwhile and your presentation is exceptional.
Thanks for the awesome video! Have you found any differences in testing based on the material of the watch strap, perhaps due to slippage? Fabric vs rubber vs stainless steel?
I’ve watched just about every single Oura Ring video you’ve made and I finally made the purchase! I’ve got the try-on kit coming in tmrw. Thank you again for all of the details!
Great informative video, thanks! Also I noticed the Mi Band 6 wasn't included in the weight lifting test results. Did you simply not test it in this category for some reason or was it left out of the results by mistake? The only reason I ask is I was considering it as a budget option but do some activities that would fall more in line with weight lifting. If you happen to have the data I'd be really interested to know!
Hi Jordan! I only wanted to include newer data for the Mi Band 6 that was measured on me, and I believe that did not include weightlifting. I did make a video about the heart rate of the Mi Band 6 which included some weight lifting results on other people
Your videos are the best reference when it comes to assessing which fitness tracker/smart watch to buy. Have you considered publishing these results as an academic paper?
Thank you Rob for the reference video. I still believe Huawei GT3 which I am also wearing performs on par with GT Runner since they use the same hardware and software. In my tests it had a better correlation with Polar 10 in weight lifting than yours.
Hi Yıldıray. Yes, they should be more or less the same, though the weight of the watch might have had some influence (or it was random chance). Thanks for commenting!
wow thank for your video. i have AW7 , Coros vertix and polar H10 and from my experience aw7 have the nearest results with H10 too. you are doing really unbelievable job 🙏🏻👏🏻👍🏼
THanks Ryan!! Well, some of the intro is actually a return of something old🤓. I just try to experiment and combine to make something that improves step by step over time, with some slip-ups along the way ;-)
Thanks for your awesome content! It really helps a lot! However I got a question about the HUAWEI GT3 and Runner: Why these two watches have different performance though the sensors of them are the same?
I so glad i found your videos! They really are answering all the questions about accuracy I couldn't find anywhere else online and you cover so many more watches than other channels that do this. Can't wait to see the other large comparisons for other aspects liek sleep and steps in the future!
Hi Rob, many thanks for yet another awesome review! However, I don't think you've tested any of the garmin running/ tri watches in the Forerunner series: 55, 245, 745, 945 -- that would be very useful to see. There are rumors that Garmin is about to release two new forerunner watches, a 255 and 955 -- maybe that could be a good opportunity to test one of them and see if they perform better than the other garmin watches. Many thanks, Jan
@@alga76aneeeeeee Huawei sensors tend to be better. I had both Honor GS Pro and Amazfit T-Rex, the GS Pro performs much better in comparision to my Polar H10.
Absolutely the best analysis on TH-cam. I've been waiting for you to summarize your previous videos for some time, thanks for the great job! I'm making my purchase decision based on your summary
Thanks for all the great info. Just curious what happened to the Coros watch? It was included for the indoor cycling test, but disappeared after that. 🤷♂️ Still great overall though! Thanks!
Great review, data speaks for itself. I would be interested to see a graph showing the correlation between battery life and HR accuracy and then conclude which watches are in the sweet spot
Thanks so much for this video! Could you do a review of the Huawei Watch Fit New & the Xiaomi Smart Band 7 Pro? I'm missing both these sub $100 options which would be perfect for me. I can't seem to find any heartrate info about them online, and am wondering if they can compete with the Huawei Watch Fit 2. Thanks!
Bravo Rob for your research on these products! You really made the science to the service of really life! I bought Fitbit charge 4 after watching all your videos! And I bought an extended garanti of 2 years ;) guess they are designed to be broken before 2 years.
Your channel and the work you put into it is much appreciated. It's *so hard* nowadays to find actual product reviews and tests like yours. Instead, the Internet is full of useless auto-generated product comparisons generated from scraped Amazon reviews.
Well, it seems Apple watches are the best smartwatches overall for heart rate accuracy. Some of the other companies can learn a thing or 2 from Apple about heart rate accuracy
There is a downside of worse battery life, although I had no issue lasting a whole day. Apple SHOULD look into battery life improvements in the future.
I’m 99% sure you guys are sheep. Next thing you know Apple will be the best in fitness tracking gps etc… over Garmin. This is the only video reviewing that say’s Apple is the best yet marathon triathlon all say Garmin all the reviews but yours is this a conspiracy theory. Lol it’s all good I respect your opinion it’s valid I just don’t know if it’s right like I said 99% sure and Apple only works well with Apple that’s how they make their money that’s why it’s still a lighting port instead of usb c, but I guess they make the best charging system as well. But again I respect your opinion I just don’t agree with it.
Fantastic review. A subscriber of mine suggested I transition to correlation of coefficiency calculations like you did here, versus the analytical approach I take. I think these results do a much better job at how it truly approaches it analytically so I am going to shift future tests to that! It will help add a different type of sports training assessment to the optical tests alongside yours as I do all analytical tests while doing CrossFit. Thanks again - great work
What is you current method of calculating the accuracy? I think the standard deviation of the error (sqrt(MSE)) could be a better indicator than correlation since the correlation neglects scalings and biases.
@@Qbyte248 hey! Mine is rudimentary- first I cut off the bottom half of the HR numbers of the chest strap and the same number of beats per minute of the test device, then run percentage of accuracy of the two numbers - inverting the percentage when the test unit is above the chest strap (ie 108% = 92% accurate for that one point). And then average the numbers. I’ll have to look up how you do what you are talking about. Thanks!
@@fitgearhunter Why do you cut off the bottom half of your measurements? Are there accuracy problems? You might want to look into en.wikipedia.org/wiki/Geometric_standard_deviation (and en.wikipedia.org/wiki/Geometric_mean) which is better for relative values and at the end "invert" the percentage.
As a cyclist, and what's more funny - data engineer - i just want to say thank You for this video. There are not so many videos with HR accuracy test during cycling, and Yours help me in decision, what watch i will buy! And, i think, that one of the most important parameter which impacts accuracy is.. size, and how watch fits - if the watch is too big, while the arm is too small, i don't think that accuracy will be good.
These videos are really helpful and the efforts behind them are great. I'm just wondering how accurate the data analysis is when the source and sample of data is one person only and in most cases 1 or 2 test cycles per device per function. I think you should scale your project to include larger number of people and several tests per person per function to get statistically reliable results. Keep winning !
So for Android users Huawei watch GT runner is the best option. This watch can replace now my polar m400 with chest strap H7 which I had many years. Thank you for such "scientific" data results.👍 LG
Great video, but would be great if you provided more criterias such as sleep tracking, GPS and heart rate tracking during running and swimming. Never to late to get the part 2 video out! Nevertheless, great job!
Nice work! A suggestion for improving the representation of the data: Simply use bar graphs with the correlation on the y-axis. No need for an axis to be "ordered from worst to best".
hey, great videos you have! I was wondering if you could do a video about best heart tracking/sleep tracking smart watches that dont have microphones... Alot of places don't allow devices with microphones or cameras for security reasons and it would really be helpful to get to know all the watches out there or at least the best of them for that matter! Thanks in advance!
Amazing video! Apple once again running away with it as expected. They have the best smartwatch by far that also doubles as the best fitness tracker. Only issue is the ~1 day battery life. That's too short for me. I also just use a my almost 5 year old polar h10 ecg strap for heartrate. Looking forward to the sleep tracking analysis! I got used Fitbit charge 4 for about $40 about a year ago and haven't been disappointed. Still looking forward to the new Xiaomi S1 watch when that rolls around to western markets as it doesn't run a full blown os so it should be able to get ~1 week of battery life. Hope its fitness tracking is ok. That's pretty much my only concern. Otherwise I'll keep waiting for whatever google comes out with whenever they get around to it. It's been almost 2 years google! Come on!
I don't usually leave comments on videos I watch, however, this video is so good that I have to do it. I loved the way you are doing this review. Not just from personal experience or personal taste, but from actual test and comparison of all of them, different brands, qualities, prices, looks, etc. I also love the fact you provide the correlation with the baseline from an ECG chest strap, to provide a more scientific review with solid basis. Only brand I missed was skagen since I have been temped to buy an hybrid smartchat that looks classic but I also want to get good measurements. Withings was almost perfect, but I wanted to know if I can get something similar with NFC. Thanks for putting so much time and effort in providing this scientific reviews base on actual data!!!
If you have money to burn I’ve found Apple Watch Ultra 2 to last a good 48 hours with nothing turned off. Charging while showering often gives enough charge to mean it never runs out for me. Definitely stupid overkill, but if money is no object it’s nice :)
Never cared about battery past a day; usually just throw it on a charger. I do the same for my Garmin even if it can last for like a month. If you’re staying within city limits near an outlet, I don’t see why you need something lasts a month.
Hi Rob. Thanks again for this comprehensive overview and all the work you put in. You said you were looking for suggestions? Well here are two. The new Garmin Vivosmart 5 and, as an exception to the rule, an new chest strap brand/model CooSpo H6M which got good but not in depth reviews, and whose price is less than half of the polar h10 (currently 33€ vs. 75€).
I have a condition called POTS which means I have a high resting heart rate and my heart rate can jump to 130+ just from walking up stairs in my own home. Having the best heart rate sensor is pretty essential to me because of that. I had a Fitbit, I can’t remember which one but I think it was one of the Senses, and I thought it was pretty accurate overall but I really, really hate how it forced you to pay a subscription just to get the full benefits when you already pay a hefty price for it. Because of that, and that I use iPhone, I think the 8 is definitely for me and I’m glad you agree. Looking forward to receive it next week.
Great vid, I think I'll just get the H10. I've noticed HR data isent all that usable during a workout if it's not super accurate. For tracking fitness and progression 90% is fine but for HR zone training works best with accurate measurements plus I like lifting weights.
Thank you for the review. As you add to these tests, I am interested in: - a few other chest strap HR monitors such as from Garmin and Wahoo - Suunto watches - performance with other skin tones (maybe through TH-cam channel collaboration) - running - Oura ring with the workout HR update. For these original tests, why do you think the Oura rings performed poorly for indoor cycling and much better for outdoor cycling? Was there a firmware update between tests?
I have a cheap Spovan health band, and it is so far (after almost 2 years) very accurate reading my heart rate. U have tested with the cuff at home and in the doctor's office, and it's always accurate.
Gedegen informatie en dit heeft me een duidelijk idee gegeven in welke richting ik mijn volgende smartwatch ga zoeken. Bedankt. Solid information, that has given me good ideas on what my next smartwatch will be. Thanks
Excellent comparison. I've been using H10 for several years. Lately I've been having weird problems, the signal drops sporadically. I'm very disappointed with Polar tech support, contacted them about 2 weeks ago - no response at all
Echoing the comments from several others, this video, once combined with the sleep tracking video you said you have coming up, is going to be an absolute game changer for the smart watch industry in terms of which watches/trackers people are going to buy
Thanks so much Adam! 😊 I hope this video helps some people. There are of course still a bunch of limitations to my testing, but I think this is a good first overview, which I hope to improve on in time.
@@TheQuantifiedScientist no problem man! Also, not sure if you'd be able to give an estimate on when you think the "sleep comparison" video will be up. I'm sure it'll take some time, but I'm guessing a lot of people, like me, are gonna wait for that video before buying a new smartwatch
@@TheQuantifiedScientist Your videos are awesome and I have made many purchasing decisions based on them. I am thinking about Muse S Gen2 for sleep tracking. Do you have any lead on it, if it is reliable or not? Would you consider testing it?
Please also make comparison of SpO2 from all these watches. It would be of great help to many people especially now.
Can't wait for the sleep tracking shootout!
Thanks for the great analysis Rob! I bought a Charge 5 based on your C5 review. I do notice several heart rate anomalies. It is slow to pick up increased HR when walking running but after 5-7 minutes or starts to match my polar F6 fairly well. It seems to do well in most aspects of health tracking. I look forward to your sleep tracking roundup!
Hi Loy! Yeah, I think each watch has their quirks, and not everything is captured by my analysis. Hope you like our FB Charge 5 well enough :-D
I am a physician and came across this. This is very good! I personally noticed that the Apple Watch didn’t used to seem to correlate well with my Polar strap. But now with Watch 7 it seems spot on. Rare anomalies, like sudden spikes that the Polar did not catch, suggesting error. Very useful! Allows me to leave the Watch on as my main driver. Would be nice to keep adding to the database with time. Especially as the newest Apple Watch, the Ultra, is now released. As it is so focused on sports, would be nice to compare to other high end triathlon and ultra watches. Also, I have always wondered about SaO2. There seems to be such a wide variation. In the day, from low to high 90’s. Makes no sense. I have always felt the the high SaO2 levels are likely accurate, and low values doubtful, what do you think? Great work!
I have also seen rare spikes with my Apple Watch. Sudden spikes due to movement
🔴 Affiliate* (paid) link Amazon for any watch: geni.us/thequantifiedscientist
🔴 Affiliate* (paid) link Whoop: join.whoop.com/QuantifiedScientist ($30 off any new WHOOP membership)
🟢 Instagram: instagram.com/quantified_scientist/
🔵 Newsletter: www.robterhorst.com
🟡 Twitter: @QuantifiedRob
* Affiliate (paid) links support the channel by earning me a small commission on any sale, and it doesn't cost you any more! My opinions are completely my own, and this content is not sponsored.
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
👇Amazon Affiliate* (paid) links. Supports the channel, doesn't cost you any more!👇
▬▬▬▬▬▬▬▬▬▬BEST WATCHES▬▬▬▬▬▬▬▬▬▬
Whoop Strap 4.0: join.whoop.com/QuantifiedScientist
($30 off any new WHOOP membership)
Huawei Watch GT Runner: geni.us/HuaweiWatchGtRunner
Huawei Watch GT 3: geni.us/Huawei_Watch_GT3
Apple Watch 7 41 mm: geni.us/AppleWatch7_41
Apple Watch 7 45 mm: geni.us/AppleWatch7
Apple Watch 6: geni.us/0gNGeO
Apple Watch SE: geni.us/Apple_Watch_SE_44
Garmin Venu 2: geni.us/Garmin_Venu_2
Garmin Instinct 2: geni.us/Garmin_Instinct_2
Polar H10: geni.us/hnXc
Polar OH1+: geni.us/D7bs5
Polar Verity Sense: geni.us/polarVeritySense
How did you prevent your Apple Watch or iPhone from automatically connecting to your Polar H10? Could that result in a correlation of almost 1 for the Apple Watch?
@@rjdverbeek Hi Rene! I have multiple reasons for thinking this is not the case, the most important being:
(1) I can still see that the Apple Watch does better during "easy" types of workouts than during "hard" ones, which shouldn't happen if it "hacks" the H10
(2) I connected 2 out of the 3 apple watches to different phones than to which the Polar H10 is attached
(3) The correlation is not 100% perfect, and I still see small deviations
Thanks for the suggestions!
Hi , I really like your videos and effort u put in to makes those , i have a question , Wat do u do of all the watches after u have tested them ?
@@TheQuantifiedScientist Can you please share/ publish these Graphs outside of the videos as well - So that we can go through the relative differences for various parameters?
Apple is considered a smartwatch?????
are you thinking about doing something like this for sleep tracking? this analysis is super impressive and would be curious to understand what devices can provide high quality sleep tracking
It would be garmin
Thank you for all your work!
I hope that Fitbit and Google can get close to the Apple Watch because I'm interested in buying the Google Pixel Watch, releasing this fall
This is brilliant. It is by far the closest to a meta-analysis of these devices.
I really hope you do the same for sleep tracking as well.
Thanks for the loooonng hours, much love.
Wow, thanks so much Siddharth! Indeed, this video was really a beast to make, and in the end cost about 2-3 times as much time as a normal video of this length. Happy to see that people like it!
@@TheQuantifiedScientist I second this comment. Always referring to your videos when looking to buy any of these trackers/watches. Thank you from me as well.
The amount of research, time and energy that you invest in each of your videos is just applaudable and phenomenal. All the best 👍
Great summary. There was no such comparison of HR accuracy in the network, especially with the division into the exercise category. Now we are waiting for the same tests but in the GPS accuracy category.
Recently, I tested the Apple Watch 7 and Huawei GT Runner and I am impressed with the high accuracy of AppleWatch GPS tracking e.g. a run in the forest.
I noticed that the smartwatch from Huawei does not "collect" data as quickly in the field as the Apple Watch. By making quick turns during the run or turning perpendicularly, the AW7 does it really impressively precisely, where Huawei can "round" the perpendicular turn and cuts a few meters from the turn. In total, Huawei lost several hundred meters from the 5 km test on the route.
Nailed it! This is brilliant, Rob. Thanks again for all your time and $$ spent making these videos.
Hopefully some of the companies represented here see this video and make the much needed changes to their products.
Will you do one for sleep? Amazing list!
Hi John! Yes, I already wrote a draft script for the video! Thanks!!
I think fitbit charge 5 comes first
I was about to ask the same thing.
@@TheQuantifiedScientist amazing 🤩
This is an excellent video. I appreciate all your hard work on how informative it is and giving a non biased view.
I’ll be looking forward to future videos with other specific health measurements comparing different wearable device.
Thank you Rob.
Thanks so much Fauve! Happy to hear it helped :-D 😊
I've been waiting for this for a long time! TBH, you're the only reviewer everyone needs to refer to when it comes to buying Smart Watches for their features. 😂
Thanks so much H DB!
Great work 👏 I’m wondering if there’s any chance if you could test which one of them could be used for AFib/arrhythmia and battery life for 24/7 tracking ❤ and optional if they have Fall Detection ( towards fading not crashing/accident)
As always, awesome work to bring this info to your channel. As a recent purchaser of Garmin's new Epix 2, I feel that even though I'm loving the watch, it seems that at the 1K price tag that Garmin could have done a much better job at competing with the Apple product at a third of the cost. I know that we'll hopefully see huge improvement in upcoming software updates but at this price point and their reputation for their expertise in the health field, they should have hit the ground running....
Hi Bill, thanks so much! Happy to provide my two-cents 😊
Ha, I was kind of bummed seeing how low it is on this list! However I really want one for the color maps
Garmin epix destroys apple in many other things and their heart rate quality is debetable. Garmin tracks you every second. Apple does not. There is huge battery life difference. Aswell as many other stuff durability, navigation. I saw videos where apple watch didnt do better than garmin sportclocks when comared to medical devices
Yeah also epix has sleeptracking etc. Tbh epix is in a completely different league compared to apple watch
This video deserve more view. I rewatch over and over again before buy smartwatch. You need to make video like this for every year. Good job Rob.
Great video, Rob!! Waiting for a similar video on Sleep and HRV
Hi Ankit! Thanks so much! I am making one for sleep as we speak
@@TheQuantifiedScientist Are you planning one on HRV as well? Please?
The low position of the fenix 7 amazes!! Incredible
Great work Rob, such incredible effort! Your scientific approach and established methodology will pave the way to see how wearables increase accuracy over time! Outstanding value on this video.
Thanks so much Simon 👍😊
@@TheQuantifiedScientist Fitbit luxe is the best option for heart rate accuracy in fitbit family? Thank you.
Your dedication is amazing, and it is very much appreciated! I started (at a later age) to invest in my health again by joining a gym and working with a trainer. He told me to get a fitness tracker and I am glad I found your channel. He was recommending a Fitbit Charge 5 while I was leaning towards a Withings Scanwatch, but this review just helped me cut through a BUNCH of questions I had! I settled on the Garmin Venu 2 and feel it's going to work out fine for me. Again, what you do is much appreciated and thank you!
A all over testing Video about sleep trackers would also be fantastic!
Hi Matti! Yes, I am making that too, though of course some of that is already included on some other videos. However, these miss a lot of context, so I hope to provide a more complete overview.
Thank you so much for this video. I bought Fitbit Sense two weeks ago so i can track my heart rate during weight lifting. Result - it was never showing it above 109bpm no matter what, only on my cardio days i was able to see 117bpm which is still not reallistic, i should've watched this earlier. Short story is after watching this video the other day since i am not Apple guy, i bought GT Runner and that nailed it. I am able to get accurate heart rate readings again during weight lifting, average 130-150bpm during workout is completely different story. I wasn't aware threre are issues for most devices to get accurate readings during weight lifting. Thank you so much again. And thanks to my wife for taking the Sense so i can buy the Runner :). Keep up the good work !
Great comparison! It would be interesting to see a combined result and also accuracy vs price.
An issue i have with many is that they send data to a cloud (Huawei, probably Fitbit which is owned by Goolge now) and not to the smartphone directly. That has serious privacy implications! But i guess others can make a more complete review and you are the expert for biological stats.
Superventricular tachycardia with 210 pulse was also detected. before emergency was there...
Not directly by the clock itself but pretty true with 6/12 channel and long time monitoring
Love your data analysis.. having some of the better ones from your list I can concur that chest straps have been the gold standard for anything outside training. Tested it while playing tennis and rowing. Just really accurate results overall when there is a lot of movements. Now would love to see comparisons between difference chest straps ecg ones. Is the best sleep trackers coming out next? Haha that would be fun to see
Hi Irregular Tangent! Yes, I already wrote most of the script for the sleep tracking one 😊
@@TheQuantifiedScientist love your research and i hope many of us can fund your deep dive in this fun topics thank you so much for your hard work.
Brilliant! The data and the accompanying analysis clear up all the magic and mystery that marketing brings to the products. Being able to see raw data is always worthwhile and your presentation is exceptional.
Thanks for the awesome video! Have you found any differences in testing based on the material of the watch strap, perhaps due to slippage? Fabric vs rubber vs stainless steel?
I’ve watched just about every single Oura Ring video you’ve made and I finally made the purchase! I’ve got the try-on kit coming in tmrw. Thank you again for all of the details!
Great informative video, thanks! Also I noticed the Mi Band 6 wasn't included in the weight lifting test results. Did you simply not test it in this category for some reason or was it left out of the results by mistake?
The only reason I ask is I was considering it as a budget option but do some activities that would fall more in line with weight lifting. If you happen to have the data I'd be really interested to know!
Hi Jordan! I only wanted to include newer data for the Mi Band 6 that was measured on me, and I believe that did not include weightlifting. I did make a video about the heart rate of the Mi Band 6 which included some weight lifting results on other people
@@TheQuantifiedScientist Oh I see, makes sense! I'll have to check out that video. Thanks!
Your videos are the best reference when it comes to assessing which fitness tracker/smart watch to buy. Have you considered publishing these results as an academic paper?
Thank you Rob for the reference video. I still believe Huawei GT3 which I am also wearing performs on par with GT Runner since they use the same hardware and software. In my tests it had a better correlation with Polar 10 in weight lifting than yours.
Hi Yıldıray. Yes, they should be more or less the same, though the weight of the watch might have had some influence (or it was random chance). Thanks for commenting!
I was wondering that the watch anatomy can cause that effect too. The wrist size may have effect too.
I believe the weight of the watch does the trick here. The lighter the less it moves in your wrist
Huawei band 6 does the job me... I don't need it to make dinner just follow my heart, and footsteps. Good job explaining 😊 thanks 👍
wow thank for your video. i have AW7 , Coros vertix and polar H10 and from my experience aw7 have the nearest results with H10 too. you are doing really unbelievable job 🙏🏻👏🏻👍🏼
Hi Raven! Do you use both the Coros Vertix and AW7 at the same time?
@@TheQuantifiedScientist yes I do.
Great video. Really enjoyed the new intro. Always improving!
THanks Ryan!! Well, some of the intro is actually a return of something old🤓. I just try to experiment and combine to make something that improves step by step over time, with some slip-ups along the way ;-)
Thanks for your awesome content! It really helps a lot! However I got a question about the HUAWEI GT3 and Runner: Why these two watches have different performance though the sensors of them are the same?
I so glad i found your videos! They really are answering all the questions about accuracy I couldn't find anywhere else online and you cover so many more watches than other channels that do this. Can't wait to see the other large comparisons for other aspects liek sleep and steps in the future!
Hi Rob, many thanks for yet another awesome review! However, I don't think you've tested any of the garmin running/ tri watches in the Forerunner series: 55, 245, 745, 945 -- that would be very useful to see. There are rumors that Garmin is about to release two new forerunner watches, a 255 and 955 -- maybe that could be a good opportunity to test one of them and see if they perform better than the other garmin watches. Many thanks, Jan
😂😂😂
Can't wait for the sleep tracking equivalent. I just found this channel, but this is awesome and way more valuable that scrolling through reviews.
Great depth and scientific method as always, however, the most important factor (for me at least), price, was not given enough consideration
I just love how you mention "unbiased" , feel so calm and trustworthy
I got a Huawei Band 6 and I'm pretty surprised with how well it did, considering its price.
Hi Carolina! Yes, some watches did not do too bad given their price :-D
@@TheQuantifiedScientist its better than mi band 6 ?
@@alga76aneeeeeee Huawei sensors tend to be better. I had both Honor GS Pro and Amazfit T-Rex, the GS Pro performs much better in comparision to my Polar H10.
Absolutely the best analysis on TH-cam. I've been waiting for you to summarize your previous videos for some time, thanks for the great job! I'm making my purchase decision based on your summary
Thanks for all the great info. Just curious what happened to the Coros watch? It was included for the indoor cycling test, but disappeared after that. 🤷♂️ Still great overall though! Thanks!
Your way of analysing this stuff is excellent. Even though only a few videos are relevant to me personally, I’m a big fan of yours already. Thank you!
Great review, data speaks for itself. I would be interested to see a graph showing the correlation between battery life and HR accuracy and then conclude which watches are in the sweet spot
Thanks so much for this video! Could you do a review of the Huawei Watch Fit New & the Xiaomi Smart Band 7 Pro? I'm missing both these sub $100 options which would be perfect for me. I can't seem to find any heartrate info about them online, and am wondering if they can compete with the Huawei Watch Fit 2. Thanks!
Bravo Rob for your research on these products! You really made the science to the service of really life! I bought Fitbit charge 4 after watching all your videos! And I bought an extended garanti of 2 years ;) guess they are designed to be broken before 2 years.
THanks! Indeed, I don't know why Fitbits tend to break so often. Hopefully the google merger will fix some of these things!
Your channel and the work you put into it is much appreciated. It's *so hard* nowadays to find actual product reviews and tests like yours. Instead, the Internet is full of useless auto-generated product comparisons generated from scraped Amazon reviews.
Thanks Tobias! I really appreciate it 😇. Have a great day!
so between 0.9 and 1.0 is like 10 times difference in price. For me Mi Band 6 with 0.9 will be good enough. Thanks for video.
Love the way you present these things! So much enthusiasm!
Well, it seems Apple watches are the best smartwatches overall for heart rate accuracy. Some of the other companies can learn a thing or 2 from Apple about heart rate accuracy
There is a downside of worse battery life, although I had no issue lasting a whole day. Apple SHOULD look into battery life improvements in the future.
@@igor.vysoky Hi Igor! Hopefully the rumoured "rugged" Apple watch will do just that
Hi Seun! Indeed, Apple did something really right there
I’m 99% sure you guys are sheep. Next thing you know Apple will be the best in fitness tracking gps etc… over Garmin. This is the only video reviewing that say’s Apple is the best yet marathon triathlon all say Garmin all the reviews but yours is this a conspiracy theory. Lol it’s all good I respect your opinion it’s valid I just don’t know if it’s right like I said 99% sure and Apple only works well with Apple that’s how they make their money that’s why it’s still a lighting port instead of usb c, but I guess they make the best charging system as well. But again I respect your opinion I just don’t agree with it.
And yes I gave it a like because I’m no hater lol.
First time viewer, commenting for engagement to get more of your videos recommended
Excellent job thanks Bro 💯🎉🎯
No problem 👍. Thanks so much Yeni!!! Do you own one of the watches?
@@TheQuantifiedScientist ich habe amazfit GTR 2 e eingekauft aber meine nächste Uhr wird Garmin venu 2 sein
thank you for such a great video. this helped me decide what to buy.
Fantastic review. A subscriber of mine suggested I transition to correlation of coefficiency calculations like you did here, versus the analytical approach I take. I think these results do a much better job at how it truly approaches it analytically so I am going to shift future tests to that! It will help add a different type of sports training assessment to the optical tests alongside yours as I do all analytical tests while doing CrossFit. Thanks again - great work
What is you current method of calculating the accuracy?
I think the standard deviation of the error (sqrt(MSE)) could be a better indicator than correlation since the correlation neglects scalings and biases.
@@Qbyte248 hey! Mine is rudimentary- first I cut off the bottom half of the HR numbers of the chest strap and the same number of beats per minute of the test device, then run percentage of accuracy of the two numbers - inverting the percentage when the test unit is above the chest strap (ie 108% = 92% accurate for that one point). And then average the numbers. I’ll have to look up how you do what you are talking about. Thanks!
@@fitgearhunter Why do you cut off the bottom half of your measurements? Are there accuracy problems? You might want to look into en.wikipedia.org/wiki/Geometric_standard_deviation (and en.wikipedia.org/wiki/Geometric_mean) which is better for relative values and at the end "invert" the percentage.
As a cyclist, and what's more funny - data engineer - i just want to say thank You for this video. There are not so many videos with HR accuracy test during cycling, and Yours help me in decision, what watch i will buy!
And, i think, that one of the most important parameter which impacts accuracy is.. size, and how watch fits - if the watch is too big, while the arm is too small, i don't think that accuracy will be good.
These videos are really helpful and the efforts behind them are great. I'm just wondering how accurate the data analysis is when the source and sample of data is one person only and in most cases 1 or 2 test cycles per device per function. I think you should scale your project to include larger number of people and several tests per person per function to get statistically reliable results. Keep winning !
Do you have any info if Amazfit GTS 4 mini improved the accuracy?
I ordered it specifically for such metrics: bpm, stress level, sleep quality
So for Android users Huawei watch GT runner is the best option. This watch can replace now my polar m400 with chest strap H7 which I had many years. Thank you for such "scientific" data results.👍 LG
Does that have Google fit integration?
Nice video, I’m using the epix 2 as my daily driver , it doesn’t read the heart rate accordingly in gym
Great video, but would be great if you provided more criterias such as sleep tracking, GPS and heart rate tracking during running and swimming. Never to late to get the part 2 video out! Nevertheless, great job!
He does cover these topics in other videos…
Bedankt Rob... what an amazing data oriented video!!! Tot Zeins from Australia
Nice work! A suggestion for improving the representation of the data: Simply use bar graphs with the correlation on the y-axis. No need for an axis to be "ordered from worst to best".
hey, great videos you have!
I was wondering if you could do a video about best heart tracking/sleep tracking smart watches that dont have microphones...
Alot of places don't allow devices with microphones or cameras for security reasons and it would really be helpful to get to know all the watches out there or at least the best of them for that matter!
Thanks in advance!
Amazing video! Apple once again running away with it as expected. They have the best smartwatch by far that also doubles as the best fitness tracker. Only issue is the ~1 day battery life. That's too short for me. I also just use a my almost 5 year old polar h10 ecg strap for heartrate.
Looking forward to the sleep tracking analysis! I got used Fitbit charge 4 for about $40 about a year ago and haven't been disappointed. Still looking forward to the new Xiaomi S1 watch when that rolls around to western markets as it doesn't run a full blown os so it should be able to get ~1 week of battery life. Hope its fitness tracking is ok. That's pretty much my only concern. Otherwise I'll keep waiting for whatever google comes out with whenever they get around to it. It's been almost 2 years google! Come on!
I don't usually leave comments on videos I watch, however, this video is so good that I have to do it. I loved the way you are doing this review. Not just from personal experience or personal taste, but from actual test and comparison of all of them, different brands, qualities, prices, looks, etc. I also love the fact you provide the correlation with the baseline from an ECG chest strap, to provide a more scientific review with solid basis. Only brand I missed was skagen since I have been temped to buy an hybrid smartchat that looks classic but I also want to get good measurements. Withings was almost perfect, but I wanted to know if I can get something similar with NFC. Thanks for putting so much time and effort in providing this scientific reviews base on actual data!!!
Too bad the apple watches dont have good battery life.
If you have money to burn I’ve found Apple Watch Ultra 2 to last a good 48 hours with nothing turned off. Charging while showering often gives enough charge to mean it never runs out for me. Definitely stupid overkill, but if money is no object it’s nice :)
@@Sam-rx8wd yeah I used it for 1 Month and its good but for me not enough for that price tag. I dont want to charge it like my iPhone
Never cared about battery past a day; usually just throw it on a charger. I do the same for my Garmin even if it can last for like a month. If you’re staying within city limits near an outlet, I don’t see why you need something lasts a month.
Well yes... but some watches eg Garmin can pair with a Polar strap for better HR accuracy. Isn't that the best of both worlds?
I've been looking for a video like this for a long time! Thanks
This is the real way to compare smartwatches. Thanks for the effort you have put in to make this analysis
Wow, what a great video and editing. Thanks yt algorithm, first time watching your vids.
I’ve been struggling with replacing my Whoop 4.0 since getting the Apple Watch series 7…this video helped my decision immensely. Thank you!
Well done on a great comparison on the different brands. And yes I agree that a chest strap paired with any gps watch is the way to go.
Amazing Comparison-Review, amongst the best on TH-cam, and what a Genius move with programming a formula for the comparison !
What a great study!
It would be teally helpful If you made this kind of videos comparing other features!
Thank you! Could you please test other polar watches? Like the polar pacer pro which was just released? Thank you!
Thank you very much for your video. Your channel is the first source to go before every gadget purchases I make.
Awesome video thank you for all your efforts I have based my purchases on your tests and really enjoy the hauwei gt3 run
Sad to see that hybrid smartwatches are all pretty terrible. I would want the hardware of a Fitbit Inspire 2 in a regular watch housing.
You are a genius, man, thanks from Brazil
THIS IS AMAZING! I would really also like to see battery analysis. Not sure if possible, but would be awesome too!
Rob, your channel is severely underrated. I really hope people discover this channel soon!
Hi Rob. Thanks again for this comprehensive overview and all the work you put in. You said you were looking for suggestions? Well here are two. The new Garmin Vivosmart 5 and, as an exception to the rule, an new chest strap brand/model CooSpo H6M which got good but not in depth reviews, and whose price is less than half of the polar h10 (currently 33€ vs. 75€).
I have a condition called POTS which means I have a high resting heart rate and my heart rate can jump to 130+ just from walking up stairs in my own home. Having the best heart rate sensor is pretty essential to me because of that.
I had a Fitbit, I can’t remember which one but I think it was one of the Senses, and I thought it was pretty accurate overall but I really, really hate how it forced you to pay a subscription just to get the full benefits when you already pay a hefty price for it. Because of that, and that I use iPhone, I think the 8 is definitely for me and I’m glad you agree. Looking forward to receive it next week.
Great vid, I think I'll just get the H10. I've noticed HR data isent all that usable during a workout if it's not super accurate. For tracking fitness and progression 90% is fine but for HR zone training works best with accurate measurements plus I like lifting weights.
Is there a fitness tracker that can connect to my Polar chest strap and then beep at me when I hit both a high and low HR I program in?
Very informative video. Is there any difference in heart rate measurements between Huawei gt runner and gt watch 3?
Thumbs up and liked, I skipped to last chapter within seconds received in-depth recommendation of best options and why.
Thank you for the review. As you add to these tests, I am interested in:
- a few other chest strap HR monitors such as from Garmin and Wahoo
- Suunto watches
- performance with other skin tones (maybe through TH-cam channel collaboration)
- running
- Oura ring with the workout HR update.
For these original tests, why do you think the Oura rings performed poorly for indoor cycling and much better for outdoor cycling? Was there a firmware update between tests?
Real person, valuable info ... great content!
I have a cheap Spovan health band, and it is so far (after almost 2 years) very accurate reading my heart rate. U have tested with the cuff at home and in the doctor's office, and it's always accurate.
Gedegen informatie en dit heeft me een duidelijk idee gegeven in welke richting ik mijn volgende smartwatch ga zoeken. Bedankt.
Solid information, that has given me good ideas on what my next smartwatch will be. Thanks
Great video!! You should do sleep tracking comparison next, looking forward!
Thanks for the great work. I'd love to see tests for running and swimming!!
You did a fantastic job presenting and providing comprehensive technical information.
Excellent comparison. I've been using H10 for several years. Lately I've been having weird problems, the signal drops sporadically. I'm very disappointed with Polar tech support, contacted them about 2 weeks ago - no response at all
Awesome and informative video! Makes shopping for my next device so much easier!
Fantastic work! Did you publish/consider publishing these results?
Been eyeing the Ticwatch brand, how good is the accuracy on the Ticwatch Pro 3 ultra?
Thanks for this video.... Its amazing work. Its two years old but I can still derive good result based on it.