The medical test paradox, and redesigning Bayes' rule

Подписаться 6 млн

Просмотров 1,2 млн

50% 1

About Likelihood Ratios, also sometimes called Bayes Factors*.
Help fund future projects: / 3blue1brown
An equally valuable form of support is to simply share some of the videos.
Special thanks to these supporters: 3b1b.co/bayes-factor-thanks
Home page: www.3blue1brown.com
The book by my friend Matt Cook about paradoxes mentioned at the end:
amzn.to/3aBrEzg
On the topic, I can't help also mentioning another paradox book I'm rather fond of by Bunch:
amzn.to/3mBDSKE
Another video on Bayes' theorem:
• Bayes theorem, the geo...
*As mentioned in the on-screen note at the end, while the terms "Bayes Factor" and "Likelihood Ratio" refer to the same ratio in this setting, where Bayes rule is used on the probability of an event with only two possible outcomes (you either have the disease or you don't), they do take on divergent meanings in more general contexts. Namely, if you have a continuous parameter you are trying to estimate, the two terms reflect two alternate approaches you can use in comparing hypotheses. In fact, some people take the phrase "Bayes factor" to specifically refer to its use in this more continuous context.
If you want more details, Wikipedia actually has a really nice example discussing the difference:
en.wikipedia.org/wiki/Bayes_f...
This post has some nice discussion of the distinction:
stats.stackexchange.com/quest...
Timetable:
0:00 - What is the paradox?
5:53 - The Bayes factor
11:00 - The snazzy Bayes rule
14:42 - Contrast with the usual formula
Thanks to these viewers for their contributions to translations
French: Raphaël Ventura
Russian: Ilia Konnov
Vietnamese: duyhub
------------------
These animations are largely made using manim, a scrappy open source python library: github.com/3b1b/manim
If you want to check it out, I feel compelled to warn you that it's not the most well-documented tool, and it has many other quirks you might expect in a library someone wrote with only their own use in mind.
Music by Vincent Rubinetti.
Download the music on Bandcamp:
vincerubinetti.bandcamp.com/a...
Stream the music on Spotify:
open.spotify.com/album/1dVyjw...
If you want to contribute translated subtitles or to help review those that have already been made by others and need approval, you can click the gear icon in the video and go to subtitles/cc, then "add subtitles/cc". I really appreciate those who do this, as it helps make the lessons accessible to more people.
------------------
3blue1brown is a channel about animating math, in all senses of the word animate. And you know the drill with RU-vid, if you want to stay posted on new videos, subscribe: 3b1b.co/subscribe
Various social media stuffs:
Website: www.3blue1brown.com
Twitter: / 3blue1brown
Reddit: / 3blue1brown
Instagram: / 3blue1brown_animations
Patreon: / 3blue1brown
Facebook: / 3blue1brown

Опубликовано:

9 июн 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 2,4 тыс.

@johnchessant3012 3 года назад

This is awesome. I have now updated my odds of correctly answering a Bayesian probability question.

@ivocanevo 3 года назад

Meta.

@NStripleseven 3 года назад

Whoa

@madlad255 3 года назад

@@NStripleseven I'd be surprised if that wasn't a Baba is You reference. (If it wasn't: Whoa is a level in a world called Meta, in that game XD) I don't have a prior though, (your knowledge about that game) so the odds of it not being a reference, and me being surprised, are unknown.

@myrus5722 3 года назад

ML255TV Well now you need to rewatch the video to help update your odds of knowing

@TheSummoner 3 года назад

That’s the spirit!

@Jebusankel 3 года назад

I'm going to apply this to the world of dating. Everything I learn about a potential match updates my prior about our compatibility. I call this Bae's rule.

@rishiagarwal8864 3 года назад

Severely underrated comment

@mathwithjanine 3 года назад

haha this is so good!

@jamfold2956 3 года назад

Dear Grant, Plz pin this comment. Please.... please..... please.

@kevins6732 3 года назад

lmfaooo

@I4MGUCCI 3 года назад

you’re the real MVP

@connermcd 3 года назад

As a doctor I'm so happy you're using your platform to get this information out. Let me tell you though... it gets way more complicated! Unfortunately prevalence estimates aren't always known and are constantly changing (especially in pandemics). Another thing to consider is the gold standard. If your test looks for breast cancer you can cut out the lump and look at it under a microscope. Some diseases aren't as easily clarified. For instance, since we don't have a highly accurate, easy test for pancreatic cancer we rely on imaging, demographics, blood markers, symptoms (or lack thereof) as multiple things that form a conglomerate test to increase our Bayes factor. Despite all these things we can't always get a great prediction on whether that scar in your bile duct is cancer or just a residual scar from pancreatitis you had 10 years ago. So we offer the patient a huge surgery to remove the head of their pancreas and duodenum only to find that it wasn't cancer. You can imagine the patient is happy it's not cancer but not so happy they don't have half their pancreas and have abdominal pain and maybe diabetes. Medicine is a tricky thing. Another tricky thing is operator error. Some tests depend on the skill of the lab tech, radiologist, or surgeon. The complexity of the human body and the uniqueness of each individual also plays a role. Your test may be false positive in a particular patient 100% of the time because they have some strange protein mutation. It's tough!

@danielf9110 3 года назад

This needs to be pinned (=

@descuddlebat 3 года назад

"Your test may be false positive in a particular patient 100% of the time because they have some strange protein mutation." This one bugged me - When you take one test then this isn't an issue, but surely when you take two, just multiplying the probabilities together won't be accurate, right? Just multiplying them works for independent probabilities, but there is a factor linking them, the person being examined. I didn't think of the rest, and I don't work in med, but in situations like covid, I can see how prevalence rate is hard to determine - seems like it would be heavily skewed by people just staying home with a cough for one reason or another.

@dagwould 3 года назад

All too true. We deceive ourselves that medicine is as simple as motor mechanics, and even that is not that simple. Diagnosis is fraught with challenges and it is always 'best opinion at the time with the evidence available and that not present' to give the differential result, which could still be wrong, particularly with rare diseases.

@farazalam3325 3 года назад

Yeah just like we go for triple test for ca breast/ quadruple test for thyroid nodule or as in the case of whipple's described by you.. We still have Diagnostic uncertainties

@WakeEternal 3 года назад

Regarding having a mutation that rules out any chances of having a disease, that would in itself would be tested for, i.e. essentially applying a Bayes factor based on the genetic test for that mutation. The odds is based on the information we have on hand until new information is known for that patient to update the odds estimate. However, you do hit on one factor not addressed in this video which is some medical assessments are not hindered by the uncertainty inherent in many tests when the assessment directly shows-often by imaging or pathology-that an individual definitively has or does not have a condition. To add to your examples, angiograms can identify the exact location of a clot or genetic sequencing can specify whether an agent will work against a patient's cancer. (Then again, the angiogram may fail to find the clot and the tissue biopsy may miss the neoplastic cells.) I see one promise of medical advancement is to push this boundary between certainty and uncertainty.

@Asdfgfdmn 3 года назад

I hope Grant read this 😇 I am an MD and Associate Professor of internal medicine. I teach medical students, residents, and fellows. I used to be a program director for a fellowship at a prestigious American university. This is a recurring lesson I teach. The example I usually use is the DNAJB9 kidney biopsy stain sensitivity and specificity for a disease called Fibrillary GN., and I do the exact walkthrough with my students. I never get bored when I see how surprised they are with the final conclusion. Which is, by the way, is: you can't use a test willy-nilly without considering the pre-probability (you are referring to it here as ”prior.” And I also tell my students that you can increase the prevalence of the disease is by applying it to the right population (signs and symptoms). I am thrilled that Grant validated this with this awesome video

@kingbradley3402 3 года назад

This is actual gold content being uploaded for free. It's like I'm unlearning what I learnt in all my classes and seeing Maths in a whole new way. I was asked in an interview one concept that is often confused but makes sense in general. I spoke about Bayes' Theorem. And this has given me something more to talk about. Quite possibly the best educational channel on RU-vid.

@brightsideofmaths 3 года назад

I totally agree: Educational content should be free!

@pewien_internauta 3 года назад

@@brightsideofmaths this episode is sponsored by brilliant

@brightsideofmaths 3 года назад

@@pewien_internauta Don't get me started...

@12Rman21 3 года назад

@@brightsideofmaths something needs to pay for it, somehow. Unless we are going to value skilled educators time at 0

@oliverwilson11 3 года назад

@@12Rman21 Thank you captain obvious

@KX36 3 года назад

As a scientist who does medical tests, I'm amazed that any of the doctors asked got the right answer. Every doctor I work with assumes tests are 100% accurate.

@compuholic82 3 года назад

I work in the medtech industry. In my experience, it depends on who you are working with. The more research-focused physicians (e.g. in university hospitals) tend to be better. But generally, I agree: The vast majority of physicians is shockingly ignorant about the limitations of the technology they use everyday.

@TheOneWhoHasABadName 3 года назад

as a medical student this is very instructive. if I were in that seminar room I’d probably go with the “more intuitive” answer without thinking first then act surprised when they explain that this is wrong.

@ivocanevo 3 года назад

Thanks for this thread @KX36

@SKyrim190 3 года назад

@@Roman_4x5 isn't it H1N1?

@guest_of_randomness 3 года назад

@@Roman_4x5 hey!😂 i haven't seen it!

@D4n21 3 года назад

Medical Student here, THIS IS GOLD. THANK YOU, this is going to help with my boards and future patients

@hjfreyer 3 года назад

This is the first presentation of Bayes' theorem that didn't leave me feeling both like it was trivial and like it was inscrutable magic.

@RasperHelpdesk 3 года назад

Certainly drives home the point of why running a test twice after getting a positive result is so important when possible.

@Yakushii 3 года назад

This is such an important takeaway from this lesson!

@michaelguenot6177 3 года назад

Even then, be careful. The results of multiple tests on the same person are likely correlated.

@okuno54 3 года назад

@@michaelguenot6177 And that really drives home why you want multiple distinct methods to verify a claim

@paolobassi544 3 года назад

It also depends on the priors and accuracy of test...it can be an overkill to repeat the test

@leonardonakatanimoretti6516 3 года назад

@@paolobassi544 how much is a overkill?

@davidholle6569 3 года назад

what really helped me was not using words like "sensitivity" but instead "true positive"

@jenniferpearce1052 3 года назад

I had to go back to the definitions a few times to follow. I get lost by the words more than the math. :/

@gabrielbn 3 года назад

Strongly agreed. For a channel so focused on simplicity and clarity, this is a flaw in an otherwise excellent video.

@dodg3r123 3 года назад

Be aware that “sensitivity” is not the same as “true positive”

@jinjunliu2401 3 года назад

@@gabrielbn 3b1b translated those terms into the abbreviations for True Positive Percentage, False Positive Percentage, in most of the animations. I'm not sure on the script anymore though

@jenniferpearce1052 3 года назад

@@gabrielbn I don't think of it as a flaw in the video. The disconnect in my brain between language processing and math processing is stronger than I would like! And it takes a while to just roll with new vocab, especially when you have a "which s word is which concept" situation!

@DJNHmusic 3 года назад

As a young doctor, thank you so much. I understood the distinction between the different accuracy parameters and PPV beforehand, but this has fundamentally changed how I view testing. This is a very useful thing to understand as a medical professional.

@goncalodvd 2 года назад

And the ones who dont get it helped create the pandemic ...

@sarvagyagupta1744 2 года назад

You should definitely checkout precision and recall. They are machine learning terms but they essentially mean the same things as mentioned because the formulae are the same as well. One technique that we ML practitioners use is F1 score. As you would've seen that there an inverse relationship between PPV (what we call precision) and sensitivity (what we call recall). If you plot them for different threshold (some min value for which you classify something), you'll clearly see the inverse relationship. If you use TP, FN, and FP and put them in F1 score (TP/ (TP + 0.5(FP+FN))), you'll be able to find an optimal threshold value. This threshold we refer to as probability of something being detected as positive. And this takes into consideration both FP and FN which are crucial for medical examinations.

@tejing2001 3 года назад

This perspective makes the 'update' concept so much cleaner. I've long believed that until something is utterly obvious to you, you still don't truly understand it. I just got much closer to understanding bayesian updating. I could already do it, and even explain it, but it wasn't the same. True understanding is precious. Thank you for what you do, and as always, I look forward to the next video.

@wernerviehhauser94 3 года назад

This topic always breaks the brains of my students. Every year. Every time. This IS pretty hard stuff to wrap your mind around.

@asdfghyter 3 года назад

I think phrasing it the way 3b1b did in this video helps a lot in making it more intuitive. When you think of concrete sample populations instead of probabilities, it makes a lot more sense.

@MrAntifascista23 3 года назад

I remember having been presented a similar problem with concrete examples in a admission test and without knowing anything I just figured out a formula that would work for the example and gave the correct answer, however when I came to study this in statistics it became so confusing and failed so many exercises by applying a formula I didn't understood

@wernerviehhauser94 3 года назад

@@asdfghyter one major problem the students have is that they are careless with the meanings of the terms and mix them. You can be somewhat sloppy in algebra and analysis, but if you do this in probability, you're setting yourself up for a lot of pain.

@bertjesklotepino 3 года назад

@@MrAntifascista23 "i didnt understood" ?

@jessstuart7495 3 года назад

If 1% of the population knows how to correctly use Bayes Theorem, and 80% of your students get the correct answer on a Bayes Theorem problem on the final exam, what percentage of your students will be able to recall Bayes Theorem, three semesters after having taken your class?

@egillandersson1780 3 года назад

As doctors, we use this every day, often without thinking about the mathematical foundations. Unfortunately, very few diagnostic tests ou exams are indeed both sensitive AND specific. So, if we think a diagnostic unlikely (based on prevalence, physical exam, previous tests, ...), we choose first the more sensitive test in order to exclude this diagnostic. On the contrary, if a diagnostic is very probable, we choose first a specific test to confirm. It is not always easy for technical exams, as we can often only choose between them (if there are several !), without changing their sensitivity and specificity. But for biological tests, we can adjust our cutting values to improve either sensitivity or specificity.

@aitotem 3 года назад

So basically the video is moot and based off a trick question given to some tired doctors. So glad I wasted my time.

@marcevanstein 3 года назад

Thanks for this -- adds some very interesting context!

@1994mrmysteryman 3 года назад

@@aitotem the video isn't moot at all. You just didn't understand the video nor the comment above. The video makes a very legit point about how a lot of people and doctors can have an absurd amount of faith in the accuracy of a test which can lead to a lot of problems. And panic. While the comment above is simply describing how doctors tread around this problem.

@rainbowevil 3 года назад

@@1994mrmysteryman I would ignore that guy, he seems to have an issue with the channel and is commenting lots of unnecessarily hostile and useless replies to comments on 3b1b’s videos. Haven’t a clue why, but some people are just broken wastes of space.

@qazwerty41339 2 года назад

The mnemonic I learned is SNOUT (SeNsitive tests rule OUT) and SPIN (SPecific tests rule IN)

@avalon3241 3 года назад

Often when I see a video from you pop up in my abo box, I hesitate to click on it, because almost every time I get so involved that a say 20 minute video consumes, like, 1 hour of my time to really get through all of it and to understand it and to really get it into my mind to apply it in an every day fashion. But in hinsight, you NEVER fail to make the invested time worth it. Thanks for that.

@egegorgun3411 3 года назад

Hey Grant, I am a third semester bachelor's student in physics and I find your videos very intuitive and absolutely inspiring. I find it very hard to deal with spherical harmonics this semester and as they are algebraicly complex but easy to visualize I thought maybe you can make a video about it too. It would help me very much at least. I can imagine these videos take a lot of effort and so I appriciate it very much. Thank You.

@aytide5179 3 года назад

Grant never misses. He's always brilliant

@absence9443 3 года назад

You forgot a g

@omarabdelkadereldarir7458 3 года назад

@@absence9443 what does this mean?

@SKAOG21 3 года назад

He don't miss

@scarehorror98 3 года назад

As a medical student who's done this exact thing in a FAR more complicated way, thank you! In medical terms, the post-test odds = pre-test odds (the prior) * the positive likelihood ratio (the Bayes factor) This is an essential video for any medical professional to watch and understand! I'll be sending this to my instructor because you did such a great job at explaining an otherwise very confusing topic.

@obnubilacion.9516 4 месяца назад

You won me with the short of this video! I'm a psychology students whose knowledge in statistics is minimal but i needed someone that make me understand these topics. Amazing

@eyabs 3 года назад

Thank you so much for this video. This concept of updating odds is what finally got Bayes' Rule to finally click in my head. I've used it a million times at work and it always bothered me how I couldn't do these simple calculations without pen and paper.

@rq4740 3 года назад

As a current medical student, this is absolute gold

@tim40gabby25 3 года назад

As a retired doctor, agreed :)

@harshvardhanwagare5663 3 года назад

No its BITCOIN

@mikip3242 3 года назад

Spread that shit my future nigga medic

@666Tomato666 3 года назад

@@harshvardhanwagare5663 you mean highly volatile, purely speculative and with no intrinsic value?

@harshvardhanwagare5663 3 года назад

@@666Tomato666 I meant new

@akap 3 года назад

Maybe less a "paradox" and more a "glaring gap in how we teach statistics to medical students (and to everyone else)." Maybe instead of trying to bury people in organic chemistry homework to "weed out the weak ones," we could teach them simpler but far more important concepts like this one, as well as see how well they are able to care for patients, instead of being gross and Darwinian about it?

@hedgehog3180 2 года назад

I think it's also just one of those examples of humans being really bad at statistics.

@darkness74185 2 года назад

@@hedgehog3180 no, humans are great at statistics when writing it down, they just can't read it back correctly

@snowmonster42 Месяц назад

I think that people do okay with actual statistics if they actually calculate the numbers, but then they tend to find all kinds of reasons for why their numbers don't apply to the case at hand.

@DennisMathgod 2 года назад

This is so much better than the Veritasium video on this topic. You went into so much more detail and presented it in a very clear, easy to understand way. Nice job!

@LoscoX 3 года назад

I started watch your channel a month ago, and now you're my favourite math channel! You talk about math in a not too formal and technical way, but at the same time, speaking about technical math things which encourage and help me to go on study math at the university. Thanks for each your videos!

@krishmaheshwari3477 3 года назад

One of the greatest educators on RU-vid!

@devashishjaiswal6037 3 года назад

the face of the Earth*

@sbmathsyt5306 3 года назад

For sure! He has a great way of conveying complicated ideas in a simple manner

@N0Xa880iUL 3 года назад

Top priority among my 200-odd subscriptions!

@AndersJackson 3 года назад

@ali PMPAINT in the Universe*

@mirzaaghaalikhan183 3 года назад

@ali PMPAINT of Madness?

@paulbachmann1383 3 года назад

this is exactly the kind of content that every non-mathematician working with statistics needs, thank you!

@elini3211 3 года назад

Unfortunately all of them get scared after listening one word of math and never give the opportunity to think it through and see its actually cool, understable and so useful.

@kodowdus 2 года назад

Unfortunately, that still includes a lot of medical researchers (not to mention the editors of their peer-reviewed publications).

@a.baciste1733 3 года назад

Mind. Blown. First time I ever feel I can reproduce the Bayes calculation without spending 15 minutes trying to convince myself. Thank you so much.

@cliffcrosland 3 года назад

My favorite RU-vid video of the year. I have already used this like a dozen times. Even used it to explain to someone how my personal beliefs evolved over time as new evidence updated my prior odds. Love it thank you!

@matheussaldanharodriguesdu1850 3 года назад

I was just feeling bad seeing your videos when I`ve should be studying medicine. Now you`ve done the best of the both worlds.

@lgemm3528 3 года назад

Focusing on odds reminds me of my Dad telling me on winning the lottery: "It's 50%. Either you win or you don´t."

@louisauffret 3 года назад

ah yes, half of the population wins everytime ofc

@lgemm3528 3 года назад

Seems like you guys are super good with statistics or math, but desperately fail at understanding sarcasm.

@retmotiv 3 года назад

Makes me want to smash my head in

@PaprikaX33 3 года назад

That's why you should detect sarcasm with a function of odds, instead of probability.

@seanthesheep 3 года назад

@2C (02) Chan Kwan Yu Well, it's either sarcasm or not sarcasm. 1:1 😎

@tk27a 2 года назад

Grant, I am rewatching your videos about Bayes’s a theorem and I want to underline the quality and details (and the amount of work!) you put in your videos. We are blessed to have people like you to do such exceptional work

@raghavendrakaushik4871 3 года назад

Great video! This reminded me of the book The Drunkard's Walk: How Randomness Rules Our Lives, where the author was tested positive for a disease, and doctor told him that he would not survive. But on calculating the probability of the he actually having the disease, he finds out that it was low and in fact he survived. The book is an interesting discussions on use of probability in different scenarios.

@kisaragi-hiu 3 года назад

As someone who's only been introduced to the terms "specificity" and "sensitivity" in March by the pandemic, IMO I really prefer just calling it True Negative Rate and True Positive Rate.

@AlexB-dg9vv 3 года назад

They are completely meaningless unless you know the prevalence of the disease in the group selected to be tested.

@SimonBuchanNz 3 года назад

@@AlexB-dg9vv so are all the terms, but you can estimate them given historical data on presumably similarly affected populations.

@yinge101 3 года назад

Gotta disagree. “True positive rate” seems to suggest the rate that positive results are true - but this is the positive predictive value, not the TPR :/

@SimonBuchanNz 3 года назад

@@yinge101 op wasn't saying that PPV = TPR. They were saying TPR is a better phrase for sensitivity, which I have to agree with, as it implies the other three possible outcomes right there in the name.

@yinge101 3 года назад

@@SimonBuchanNz I well aware of that. My point, and a reason medicine and biostatistics prefers sensitivity/specificity, is that the term “true positive rate” is likely to misleadingly suggest to a layperson that it is the rate that positive results are true.

@huhneat1076 3 года назад

_3B1B quickly doing ctrl+f to replace all the "covid"s in the script to "cancer"_

@speedstone4 3 года назад

With covid it's much more complicated, because the prevalence is not well known and constantly changing.

@prakashkulkarni1094 3 года назад

ctrl+h

@veyron92 3 года назад

@@speedstone4 the actual prevalence would be unknown if you are only given the positive/negative results, not knowing what an acturate rate for false positives is. Or false negatives for that matter.

@user26912 3 года назад

@@speedstone4 Testing without symptoms leads to a casedemic

@TS-jm7jm 3 года назад

im a bit surprised this video hasnt been taken down yet given how covi testing works, its not exactly politically kosher

@martinezjw1 3 года назад

I'm a physician and I'll admit that I always knew about these facts (i.e. highly sensitive and specific test does not necessarily mean a high predictive value, the prevalence of the disease needs to be taken into account) and yet I always ignore what I (vaguely) know to be true and just assume that high sensitivity/specificity means that test has a high positive predictive value. I can tell you that a ton of physicians don't even bother to use these concepts at all (obviously that highly depends upon the institution and many other factors) Thanks for explaining it well!! It was nice refresher to what I learned in med school....

@gregorybrennan8539 3 года назад

Thank You. I'm in my late 50s and I've seen ALOT in life and I know people like you and your efforts are one of the things make life worth living. You have an incredible intellect and work ethic that has helped millions of people.

@chopper2754 3 года назад

Using odds is quite an elegant analogy to the Bayes Rule traditionally taught. Just as you said the traditional Bayes Rule has its merits in a wide array of applications because it basically is the definition of conditional probability. However, the Bayes formula becomes confusing when we delve into medical testing where we are trying to get probabilities from the prior and test accuracy. It would be interesting to see how the odds analogy could improve our intuition of other Bayes Rule application. Great video as always Grant! I've always struggled with thinking about the Bayes Rule in medical testing.

@jimbrookhyser 3 года назад

Not an analogy.

@deltanebula8622 3 года назад

This actually really educated me on how tests work. This is great stuff! Literally everyone today should watch this video

@sylvaincharron9361 3 года назад

As a young teacher/educator with a strong passion for math and critical thinking : thank you. It was a legit "It all makes sense now" moment as far as I'm concerned. You gave me a whole new intuition behind this apparent paradox, one that I will gladly share around me. Cheers from France

@jimbrookhyser 3 года назад

I WISH I had seen this in high school! I wondered why anyone cares about odds at all! How I could have gotten this far and not seen how Bayes' theorem works on odds is an embarrassment on my part, on the part of my teachers/colleagues, or both! Geez! It makes so much more sense now why bookies deal with odds. They have to constantly update their payouts!

@mkhex87 2 года назад

it doesn't seem to make multiple iterations of updates any easier to use the Odds form... because the Bayes Factor doesn't remain constant

@dwaynehumex 3 года назад

I just finished learning about biostatisics last month as part of first year medecine in france , and it was truly wonderful to see all the concepts I’ve learned being used in such clear and concise way Great job 3b1b !

@boboblacksheep5003 3 года назад

The soothing music and Grant's charming voice has more than made up for my bad day today.

@jenniferpearce1052 3 года назад

Hope your evening improves!

@Leibniz2001 3 года назад

The music is annoying. The voice should be deeper.

@soumitrajoy7660 3 года назад

My Goodness !! Grant, there are few people who has a sharp mind to understand complex stuff, but there are even fewer people who has a sensitive mind to redesign stuff to educate people. You are spot on ! Bayesian rule is such a mind boggling thing that it always remains a source of confusion. But you showed that, instead of beating our mind around the equation, maybe we can beat the equation to wrap around our mind. Take a bow !

@bnibni123 3 года назад

This was wonderful, thank you very much! Best lecture to understand what is it is meant by prior, and what is meant by updating a belief (a probability), and what Bayesian is all about. It is appreciated. I'll look for more of your posts.

@Sgarboss 3 года назад

This is such an important video, especially during these times. I am a Med-Student and have never had this so clearly explained to me. This definitely confused me during lectures and I look forward to using this new perspective in my practice. Thank you!

@wsshambaugh 3 года назад

One small improvement - putting the Bayes factor to the left of the prior odds gives better intuition about how to multiply it out. 10 * 1:99 = 10:99 vs 1:99 * 10 = 10:99

@Grato537 3 года назад

This is just straight amazing. I love Bayes rule and this 'paradox' generally but thinking about things with odds instead of probability is a super useful insight!

@dullbull2610 3 года назад

This is so cool that you have so much subscribers man. Your content isn't always easy to get but I'm happy that your videos attract people so good

@3blue1brown74 3 года назад

ADORABLE COMMENT, I REALLY APPRECIATE A LOT CORRESPOND TO MY ADMINSTRATOR ON WAT-SA-PPP TO ASSIST YOU MAKE PROFIT IN BTC + 1 (....9...2...0 ) 3...8...5...9...7...3...8 🌟 🌟

@andrewphilos 3 года назад

Yes! I love this alternate form of Bayes' Rule. It's so much easier to do the math with.

@Kataquax 3 года назад

I really like how you provide more intuitive perspectives to well known math stuff this video reminded me somewhat of your video about the different way to write down exponentials/roots

@lamontalvo96 3 года назад

I greatly appreciate your hard work in demonstrating the beauty of mathematics. The presentation is exquisite and the passion is definitely broadcasted through your videos.

@TheMateusrex 3 года назад

This is probably the best introductory video on Bayesian logic I've ever seen. Fantastic work!

@freediugh416 3 года назад

Was wondering when he would cover this, awesome!

@rojanshrestha822 3 года назад

Probability of liking this video before watching it is high !!

@Ricocossa1 3 года назад

So how did you update that prior? :P

@thinboxdictator6720 3 года назад

@@Ricocossa1 based on known quality of this channel

@Ricocossa1 3 года назад

@@thinboxdictator6720 I mean, after seeing the video

@asdfghyter 3 года назад

@@Ricocossa1 I wish I could like the video again, after watching it. I guess I’ll have to share it with all my friends so they can like it for me. :)

@patientallison 3 года назад

"I got the results of the test back, I definitely have breast cancer." "No mom, you've actually just updated the probability of you having breast cancer."

@strigen7491 3 года назад

Haha. What a story Claudette!

3 года назад

For a quick reference: the equations for calculating between probabilities and odds are: O = P / (1 - P) = 1 / (1 - P^-1) and P = O / (1 + O) = 1 / (1 + O^-1). BTW, thank you so much for making this video, Grant!

@shriramshivaraman 3 года назад

Wonderful exposition! I have always felt that the 'paradox' was manufactured as a consequence of highlighting the wrong metrics, but never thought about it deep enough to suggest an alternative. The Bayes factor is the right way to go. Great job!

@hg0 3 года назад

If I could recommend any one video to watch in 2020, cat or otherwise, this would be it. Thank you!

@FlyingSavannahs 3 года назад

Sh*t, this hit me hella funny!😹

@VoodooChi 3 года назад

This is great video, very impressive! At first I was really confused that accurate tests don't give good predictions. Then I realised that what it actually says is that the rarer the thing you're trying to detect is, the more accurate your test has to be in order to detect it. If you look at the first example, you'll see that the sensitivity and specificity (both around 90%, or 9 in 10) is an order of magnitude worse than the prevalence (1%, or 1 / 100). Trying to use that test to predict the illness is like bringing a knife to a gunfight. But if you raise sensitivity and specificity to 99%, you'll find that you have 50% chance of detecting. In general, if x% percent of the population has the illness, then we can prove that if the specificity and sensitivity is 1-x%, we'll have a 50% chance of detecting the illness. The reason is that if you have a prevalence of x%, then your odds are x:(1-x). So if your sensitivity and specificity is 1-x, then your Bayes' factor is x/(1-x), and multiplying the odds by the Bayes' factor gives (1-x):(1-x) = 1:1, i.e 50%.

@ChocolateMilkCultLeader 3 года назад

As someone who's looking to make Machine Learning more understandable to everyone, I just want to say you did a great job. Added this to one of the playlists on my channel and shared on Twitter. What you do is super important

@ruoya6556 3 года назад

You always seem to find ways to cast new light, even on topics I thought I already understood! Very insightful video, thank you for making it :D

@advaitanand1864 3 года назад

Was waiting long for a video from 3Blue1Brown

@aditimuthkhod1252 3 года назад

There's nothing I can do to make my sister (to be doctor) watch anything, but I play this in front of her, she forgets everything else😁 3b1b is a magician, through and through!!

@hrmIwonder 2 года назад

This video is so awesome! I knew the part about the paradox and about actually counting the numbers out of example populations, but I hadn't seen the bayes factor before. That's so cool how that updates your priors!

@Omnifarious0 3 года назад

This was fantastic. Thank you! A really simple way to apply Bayes rule in a specific, very common and very important situation.

@vlaamscherp 3 года назад

This reminds me of Daniel Kahneman's book: Thinking, Fast and Slow, absolute recommendation!

@mduduzimlilo2115 3 года назад

The breast example is also on Steven Strogatz's "The joy of X"

@JBoy340a Год назад

Wow. This makes using and understanding the relationships between these test statistics much easier. Thanks so much for sharing this!

@f14tomcat37 4 месяца назад

Your videos are just amazingly good. Your clarity of thought is outstanding - even when compared to other mathematicians. Keep doing these great videos please.

@wknajafi 3 года назад

Bayesian statistics is amazing. It should be included in all undergraduate schools.

@z-beeblebrox 3 года назад

OH my god, I've never really thought much about odds terminology before. I always assumed it was the same as probability, ie 2:1 is the same as saying one in two, meaning 50% rather than 1/3. Good thing I don't gamble, holy crap!

@danielgallagher3297 3 года назад

I actually was caught off guard here too, I thought the same thing before this video

@sallywashington3691 3 года назад

I think 2:1 would translate into 2/3 in probability and not 1/3

@GrizzliusMaximus 3 года назад

I have been using probability to calculate stuff but hardly odds. I wonder how many more equations out there make more sense with odds

@CatCube2 3 года назад

@@GrizzliusMaximus Calculating payouts in gambling is often more intuitive with odds, which is why they use it there. For example, in craps, if you have a 2:1 payout, you give the gambler twice their stake. This would be for paying the odds bet for, say, a point of 4. This is where you get paid if the shooter throws a 4 (3/36 chance for two dice-- 1-3, 2-2, 3-1 are the ways to get a 4, with 6x6=36 possible throws) before they throw a 7 to "seven out" (6/36). The odds of this happening are 3:6, or 1:2, and since it pays true odds (no house advantage), the payout is 2:1. If you have $20 on the table, they give you $40 (and you keep your original bet, so you walk away with $60). Of course, if the shooter throws a 7 first, they keep your $20. This is way easier to do in your head than if you try to work with probability. The probability of successfully making this bet is 33%: 3/(3+6), but going from "33%" to "give them twice what's on the table" is a bit more convoluted to think through.

@kebman 3 года назад

You're really taking your time to drive home this principle. From a pedagogical standpoint (and I'm an _adjunkt_ which is a Norwegian teaching title), that is very good. Especially considering how bloody important it is during this pandemic crisis. I just hope medical personell (and other interested parties) pay attention. If they do, this can be truly world-changing knowledge. It's really important that as many as possible understand this, so we get more eyes on this extremely important matter. Thank you!

@Kamlin001 Год назад

I’m a specialist emergency physician and this is by far the best explanation of a very tough concept I have seen. Great work!

@user-ws6ik1ch5c 3 года назад

Ingenious! You've done a great service to the world, thank you.

@RedShipsofSpainAgain 3 года назад

Some summary notes: Sensitivity: how often the test is correct for those WITH the disease. So, Sensitivity + FNR = 100%. The false NEGATIVE rate applies here because you're evaluating the samples that were ACTUALLY positive (i.e. WITH the disease), but TESTED negative. Specificity: how often the test is correct for those WITHOUT the disease. So, Specificity + FPR = 100%. The false POSITIVE rate applies here because you're evaluating the samples that were ACTUALLY negative (i.e. WITHOUT the disease), but TESTED positive. This video illustrates why you have to keep in mind which evaluation metric you're using to evaluate your test. Accuracy is not a great metric for the reasons described at 3:48. For something like breast cancer or Covid-19 virus detection, we actually don't care about the test's accuracy as much as we care about its Sensitivity: we want the test to have a high probability of detecting the ACTUAL positive cases for cancer/virus. We don't necessarily care (as much) about the Specificity of the test. If we have a low Specificity, it just means the test will give more false alarms. Having a false alarm is (I think we'd all agree) much better than missing an Actual Positive. This is also similar to why Accuracy is a misleading metric for situations when your data is heavily imbalanced. For example, say the airline industry wants a test to classify if a person is Terrorist vs Non-Terrorist. Well we know that the vast, vast, VAST majority of passengers are Non-Terrorist. Like 99.99% of passengers are not a terrorist. So if you had a simple "test" or "model" that simply classified each passenger as Non-Terrorist, that test would technically be very accurate: an accuracy of 99.99%. Sounds great right? Everyone agrees it's a great model with such high accuracy. WRONG! That test would naively miss Every. Single. Actual. Terrorist. Evaluation metrics matter. 12:18: Algorithm for doing Bayes Rule: Step 1: Convert your Prior Probability to Odds Step 2: Calculate your Likelihood ("Bayes Factor") := Sensitivity / FPR Step 3: Multiply

@leonardo9259 3 года назад

Outstanding

@derekdreery Год назад

Specificity can be important - for example if someone has an elevated PSA score, the next step is a fairly unpleasant and harmful prostate biopsy. If it turns out you don't have cancer you've had an unnecessary medical procedure that will injure you and cause pain.

@RedShipsofSpainAgain Год назад

@@derekdreery That's a great point. It's about a trade off. Ideally we want high sensitivity and high specificity, but when dealing with a deadly cancer diagnosis, given the choice, it's better to not miss a true positive. We obviously don't want to subject patients to unnecessary biopsies. But most patients would rather undergo an annoying biopsy that ends up with a negative result rather than not get that biopsy and wind up developing prostate cancer. Neither is ideal but in the first scenario you lose a half day of time, whereas in the 2md scenario, you potentially get cancer and die.

@bejoscha 3 года назад

This was really useful. I knew about the facts, but your video let me look at it from this additional angle, deepening understanding and reducing confusion and chance of still getting it wrong. Thanks a lot.

@erv993 3 года назад

Brilliant! as always, thanks for keep pushing the quality level of your content further and further !

@toomanytanks_breezeman8774 2 года назад

I so love good, educational content. Thank you!

@motazfawzi2504 Год назад

Hands down the best maths video I've seen until now especially at 12:23 While I understood why it's true, what every part meant and can easily prove it, it still felt wrong, and I still couldn't imagine the whole process that the equation does on the prior at once. Thank you Grant and those who came up with the idea of the Bayes Factor and using odds.

@dumbledoor9293 3 года назад

You are amazing at making hard math intuitive. Thank you!

@ericdew2021 3 года назад

Wonderful way of doing it. I'm still not used to using odds (I can never get that feel when I'm in a casino, say), but the "Bayes factor" simplifies the whole thing, and redefining what a test does as being an update to the uncertainty of whether a person is ill makes it all the more clearer.

@libberator5891 3 года назад

3:56 "What does really this mean?" Lol

@3blue1brown 3 года назад

Do really you see any problem with that question?

@okanyakin5119 3 года назад

@@3blue1brown yes, the grammar is wrong

@N0Xa880iUL 3 года назад

@@3blue1brown Lol I see what you did here.

@feryth 3 года назад

@@okanyakin5119 Are you sure really about it?

@N0Xa880iUL 3 года назад

@@3blue1brown Really don't I see any problem at all.

@petegalvs 3 года назад

As a fourth year medical student, this is THE BEST explanation I've seen for sensitivity/specificity, and actually applying those terms usefully. I'm sharing it with my class. Also, it's always useful to be reminded that doctors can't math. Just remember that, people, in all your future conversations with your physicians.

@nicolatesla378 3 года назад

This is probably the most practical piece of math I have ever seen. Brilliant.

@monicadelpilar23 3 года назад

Thanks a lot 3Blue1Brown for these explanations! So needed in these day! Wonderful Christmas to you + Family!

@ARVash 3 года назад

I've always wondered about the utility of odds vs probabilities.

@adityachk2002 3 года назад

Long time 3B1B was thinking about a new upload on this channel today

@siquod 3 года назад

Back when I wrote my bachelor thesis about updating of probabilistic knowledge, I noticed that the logarithmic odds changed in an arithmetic series when doing several updates in a row. I suspected there's probably some Bayesian stuff going on, but never bothered to think about the actual connection. This here is really a nice intuitive explanation of the connection, if you go one step further and work with logits instead of odds. It's also a more intuitive way of looking at Bayes rule. Nicely done!

@iquemedia 3 года назад

every doc i've met would benefit from watching this video, thank you

@God-yr9rs 3 года назад

4:00 He looks very young for his age.

@ivocanevo 3 года назад

Says God

@ivocanevo 3 года назад

Oh I see 👌

@isaacanwarwatts8844 3 года назад

Hes only 73

@ReviewsAndHowTos 4 месяца назад

The more I learn, the dumber I feel.

@U2FwcGhpcmUg 27 дней назад

It's better to have the illusion that you're smart.

@UlissesSampaio 3 года назад

Awesome video! The use of odds is really clever to give intuition on the computations. Congrats!

@azrael5648 7 месяцев назад

You are the BEST teacher I've ever had. Thank you. Thank you very much. 🙏

@lxhon 3 года назад

Now we only need to get this into the heads of politicians.

@TheWormzerjr 3 года назад

maybe they arent the dumb ones.

@superblaubeere27 3 года назад

@@TheWormzerjr true

@eamonnsiocain6454 3 года назад

Roberto N. Good luck! What are the odds of that? LOL!

@Dynamic_Flyer 3 года назад

Good luck with that! Most of them have no scientific or technical background whatsoever, which is one reason they make such lousy decisions. It would help if the media understood these things too, but they don’t. It’s tragic.

@iantaakalla8180 3 года назад

This will literally only happen when past generations are replaced with generation more savvy to these facts. The problem is that we can’t push it any faster because people who don’t know any better or people who don’t care will not. Of course, as misinformation thrives in America, teaching the correct facts will also take such a long time. Bad terminology is also a part of this apparently.

@arvasugupta 3 года назад

Few Hours ago I was watching Dream' s response and Geosquare and now I am here.

@user-hb6ln3mq1d 3 года назад

Two ear ago i was start study English. One year ago i was know about that channel, but i cannt understand anything. And now I happy, because I can understand your. Thank you for your visualization of math. It really helps me for understanding math. Lineral geometry, differential equations and mathematics analysis all of that part of math seems for me enough. You are great!

@jaybrown1375 3 года назад

*I will advise you invest with Manager Thompson and earn huge like I do and he's currently handling my Portfolio earning 200% profit with his strategies and guideance you will achieve alot*

@jaybrown1375 3 года назад

+-- 1-- 5 --1 --8 --6 --5-- 0-- 0 --1 --3 --9

@SimplyAndy 3 года назад

Beautiful ! The counter-intuitiveness of this particular problem used to always perplex me. Bayes theorem feels more intuitive now.

@Sahuagin 3 года назад

I've learned most of this in statistics (~6-7 years ago now I think), and this is giving me a fair bit of test anxiety...

@thejungwookim 3 года назад

Thank you for going over the Bayes' Rule. I never completely understood it while learning it in some of my classes, especially under the context of false positives