Sampling from a Distribution, Clearly Explained!!!
ฝัง
- เผยแพร่เมื่อ 7 พ.ค. 2017
- What does it mean to sample from a distribution and why would anyone ever do it? Find out by watching.
For a complete index of all the StatQuest videos, check out:
statquest.org/video-index/
If you'd like to support StatQuest, please consider...
Buying The StatQuest Illustrated Guide to Machine Learning!!!
PDF - statquest.gumroad.com/l/wvtmc
Paperback - www.amazon.com/dp/B09ZCKR4H6
Kindle eBook - www.amazon.com/dp/B09ZG79HXC
Patreon: / statquest
...or...
TH-cam Membership: / @statquest
...a cool StatQuest t-shirt or sweatshirt:
shop.spreadshirt.com/statques...
...buying one or two of my songs (or go large and get a whole album!)
joshuastarmer.bandcamp.com/
...or just donating to StatQuest!
www.paypal.me/statquest
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:
/ joshuastarmer
#statquest #statistics
Support StatQuest by buying my book The StatQuest Illustrated Guide to Machine Learning or a Study Guide or Merch!!! statquest.org/statquest-store/
I am a grad student taking Biostatistics this semester and this channel is saving my life. Truly CLEARLY explained. No click bait whatsoever
Thank you very much! :)
I appreciate the effort to simplify and will always give thumbs up when the concept is crystal-clearly explained. Otherwise, I'd rather request to explain what it means to "do a test on a sample" and why is a large p-value expected. There seems to be a disconnect between one condition and its effect as stated here. I appreciate all your other videos though! May I suggest a real-world example (like the ones to which you resort in most of your other videos)
I recently found about Stat Quest channel and I fell in love with the videos, watching everything from the basics. For this video, though I wanted to give feedback, too many new concepts were introduced for trying to give a broader explanation of sampling distributions. I'm confident with my AP studies but I got a bit confused with the video, Maybe if the focus were on sampling distributions for estimating a statistic that we don't have from the population it would've been more clear. This is at least the strategy followed by Khan Academy when introducing this part for their AP.
I think you could clearly explain this particular topic even better, so that it is on par with your other videos 😊 otherwise, I completely treasure your channel!
Noted
Thank You!!!! I love your videos, and how they explain things in simple terms. I am a social sciences student but have statistics for social sciences in uni. Your videos wake up my brain and help me understand.
Wow, thank you!
I like your examples and explantions! Easy to understand complex concepts!
Thanks!
Thank you very much Sir for this recommendation! Thank you for always singing prior starting the discussion! It helps students like me to be motivated! :D
I just bought 'The StatQuest Illustrated Guide to Machine Learning' and I'm loving it. Wonder if you would also do a book about the
'Statistics Fundamentals'.. would love it too
Great suggestion!
These are such awesome and helpful videos! I feel so much more interview ready. Thank you so much! :D
Awesome!!! Good luck with the interview. :)
how was the interview bro
Do we have to increase the sample size each time and calculate mean for each sample size ? In tat case mean of the sample sizes will form a normal curve irrespective of the type of curve of the original population
Am i right?
Nice... Thanks foe the video
This is your 9th video after Intro and you directly jumped to "large p-value", without explaining what is p-value and what is "large p-value", "t-test", etc in any of the previous 8 videos!
Sorry about that. You'll start learning about those in the next video.
What is meant by p-value? t-test?
Same question here.
they were explained in different videos, check this channel's playlist
You probably dont care but if you are stoned like me during the covid times you can stream pretty much all of the latest movies on instaflixxer. Have been binge watching with my brother for the last months =)
@Kaden Hunter Yup, have been watching on Instaflixxer for months myself :)
Hello @statquest, these are wonderful videos and a great contribution to us all. thank you. Is there a way we can get the slide decks as PDFs. It could help a direct import to OneNote so that we can then make notes on the slides.. thanks in advance for considering
I've made study guides for some of my StatQuest videos here: statquest.org/studyguides/
Give this guy a medal
bam! :)
So in summary random samples are taken from statistical distributions to perform statistical tests on the sample data in order to compare our expectations (of the results of those tests) with the actual results of those tests that could be different from our expectations (based on some already known facts about the original distribution from which those samples were taken). Is that right?
Yep, that's it. However, there are also other uses. For example, over the weekend I wanted to learn how Partial Least Squares worked, so I generated some data from a normal distribution and plugged it in. This was helpful because I knew a lot about this data and this made it easier to interpret the results.
Can you please point out some problem sets for practicing these concepts? otherwise retention is quite low.
I have a few "quizes" for topics, including this one, on this page: statquest.org/video-index/ Just look for "StatTest!"
Hey Josh! Can you please explain what are t-tests?
I have some videos that explain t-tests in a very unconventional way. If you are curious, check out: th-cam.com/play/PLblh5JKOoLUIzaEkCLIUxQFjPIlapw8nU.html
How does a computer make the selection based on probabilities described by the histogram. Do you have any papers or texts that talk about the algorithm?
Say like we have a histogram with three options along the x-axis, "a", "b" and "c". The probability associated with a = 0.5, the probability for b=0.3 and the probability for c = 0.2. (NOTE: if we add up those probabilities we will get 1). Now, have a computer generate a random value between 0 and 1. Since there is a probability of 0.5 that that number is between 0 and 0.5, select 'a', we will select 'a' if the value is between 0. and 0.5. Since there is 0.3 probability that that number is between 0.5 and 0.8, we will select select 'b' in that case. Lastly, since there is 0.2 probability that that number is > 0.8, we will select select 'c' in that case.
@@statquest Oh that's very simple, thank you
Josh, what is p value as mentioned in this video ? Is there a video on that ?
Yes, th-cam.com/video/5Z9OIYA8He8/w-d-xo.html
One thing I might not have put enough emphasis on in that video is that p-values are how statisticians decide if something they see is special or not.
@@statquest Josh, I understood the calculating the p value. Could you please upload a video on how p values are used by statisticians, how p values are significant?
@@nitin.cherian Yes! I will.
@ 2:27, what are statistical tests? Also, is the reality distribution sampling and our expectation the statistical distribution?
I guess this video assumes that you are already familiar with statistical tests. :(
Thank you, Sir
:)
Hi, any videos on X2, T-test, ANOVA and ANCOVA?
Interestingly, t-tests and ANOVA are just types of linear models (i.e. a form of linear regression). I would recommend watching my Linear Models play list (you can skip the videos where I explain how to do the work in R, which is a programming language): th-cam.com/play/PLblh5JKOoLUIzaEkCLIUxQFjPIlapw8nU.html Alternatively, you can just pick and choose the videos you want to see from my index: statquest.org/video-index/
you introduced new concept likr t test p value
True. I made this video a long time ago for my colleagues at work who already knew about those concepts.
May one use a t-test on such small samples (3-strong each)? Shouldn't one use smth like a Mann-Whitney test?
It is very common to use t-tests on small samples (n=3). How good an idea that is depends on how similar the underlying distribution is to a normal distribution. If the underlying distribution is very different from being normal, then n=3 is probably too small for a t-test. However, the underlying distribution is vaguely normal, then n=3 is fine.
thank you for your video
in fact what i didn't understand and was ambigue for me what that i didn't know what is P-test and t-test is and i did'nt really understand what is N
OK. Thanks for the feedback! I'll modify my playlist so that this topic comes after those. (By the way, all of my videos are here: statquest.org/video-index/ )
2:49 - Hey Josh, given that the distribution is the same, why is the P-Value high if we take a few different samples? Aren't the samples sort of related because they belong to the same distribution?
When the samples are taken from the same distribution (mean that there is not a fundamental difference in the samples) the p-value should be high. To learn more about this, see: th-cam.com/video/vemZtEM63GY/w-d-xo.html
@@statquest Ohh, because the closer the P-Value comes to 1, the more confident we are that the samples are NOT from a different distribution?
@@amnont8724 The wording associated with p-values is tricky and subtle. The closer the p-value is to 1, the less confidence we have that the data come from different distributions.
@@statquest Yes the wording regarding P-Values feels very tricky, especially when every other TH-camr and lecturer besides you uses a slightly different explanation. Thank you :D
Why an I seeing about p test before learning about p test in the playlist. Please make an ordered playlist
Which playlist are you looking at?
As far as I understand, sampling from a distribution versus sampling in signal processing is this: Instead of sampling a y based on x, we now sample x based on y.
Nice
AT 2:51, you said "since the distribution is same, T-test should be give a large p-value." I do not understand this point.
To understand p-values, see: th-cam.com/video/vemZtEM63GY/w-d-xo.html
Sir please cover spss in the same way...dying for it
I actually asked SPSS for a copy of their software so I could make videos about it and they said "no".
Hey Josh first of all thanks for such a wonderful job. I always recommend you channel to my colleagues. Also you can try trial version of IBM SPSS. Please do this. Thanks
Does "taking a sample from a distribution" as opposed to "taking a sample from the population" mean that you take a sample from a sample?
This is a really good question. The answer is, "it depends". If the distribution is based on a small sample of data (for example, if we measure how tall 20 people are and calculate the mean and standard deviation of the heights, and then create a distribution based on the estimated mean and standard deviation), then, in a way, we are using the distribution to give us new measurements that are related to the original sample. However, typically when we "sample from a distribution", the distribution isn't based on an existing sample - instead we just pick values for mean and standard deviation that suit our needs. For example, at 2:59 in this video, I could set the standard deviation to 1 for both distributions and the number of measurements from each distribution to 3, and then plug in different values for the means to determine how far apart they must be in order to consistently get a small p-value. Does that make sense?
@@statquest Yes, I think I understand -- and now I've realised that you actually give a definition-like description of "taking samples from a distribution" at the very end of the video. (I've posted my question as soon as I started to watch this video.) Thanks a lot for the explanation and thanks a lot for all your excellent tutorials on TH-cam. They give insights into aspects of some of the most important stats concepts I cannot easily find in other materials on the Internet.
@@pdkovacs Hooray! I'm glad I can help.
These videos really saved my life!! I hereby announce that Josh Starmer is the hottest guy alive!!!
bam! :)
Why my high school teachers and university professor can not teach it in this way.i think probably they both are confusing for what they are saying, so they chose to read all concepts from textbook.
bam!
What is p-value ?
Great question! To learn about p-values, check out this video: th-cam.com/video/vemZtEM63GY/w-d-xo.html and th-cam.com/video/JQc3yx0-Q9E/w-d-xo.html
So, when we have the population, why we need to sample data?
If you have the population, there is no need for sample data. However, you rarely have the population. For more details, see: th-cam.com/video/vikkiwjQqfU/w-d-xo.html
Now youtube shows PD curve for average watch time against video time
interesting
Not clearly explained.....what is t-test and p-value ?
Sorry. This is an old video - one of my first - and back then I thought that only my coworkers would watch my videos, and since we had been talking about p-values and t-tests, I thought they would understand. However, if you want to learn more about statistics, see: th-cam.com/video/oI3hZJqXJuc/w-d-xo.html th-cam.com/video/vikkiwjQqfU/w-d-xo.html th-cam.com/video/SzZ6GpcfoQY/w-d-xo.html th-cam.com/video/yQhTtdq_y9M/w-d-xo.html
What is the p-value? I watched it twice and I couldn't figure it out. Sorry if it's obvious to everyone, I'm a rookie.
To learn more about p-values, see: th-cam.com/video/vemZtEM63GY/w-d-xo.html and th-cam.com/video/JQc3yx0-Q9E/w-d-xo.html
@@statquest thank you, I will check that out
I took a p test once
:)
Hey plzzze i need help if possible can you help me plz
It really depends on what you need.
@@statquest wait i will send you the question
@@statquest thx u
@@statquest Question:
To examine the bone mineral density of women with ankle fractures, the investigators recruited 10 postmenopausal women with ankle fractures and 12 healthy postmenopausal women to serve as controls. The stiffness index of the lunar Achilles in each woman was obtained. The mean stiffness index for the ankle fracture group was 76.4 with a standard deviation of 5.83. In the control group, the mean was 82.3 with a standard deviation of 6.34. Assume that both samples are drawn from normal populations.
(i) Test at 5% level of significance, whether the variances of the stiffness
indices for the two groups are equal.
(ii) Using p-value approach, examine whether these data provide sufficient
evidence to conclude that, in general, the mean stiffness index is higher
in healthy postmenopausal women than in postmenopausal women
with ankle fractures? Take a=0.05
(iii) Obtain a 95% confidence interval for the difference of two population
mean stiffness indices. Does this interval confirm the conclusion derived
in part (ii).
@@statquest plz help me
One remark Josh: Please control terminology used. You are too loose when "speaking" probability or statistics language.
Noted!