Тёмный

Intro to Kernel Density Estimation 

Подписаться
Просмотров 152 тыс.
% 3 260

This video gives a brief, graphical introduction to kernel density estimation. Many plots are shown, all created using Python and the KDEpy library (github.com/tommyod/KDEpy). A .pdf of the presentation may be found here: github.com/tommyod/KDEpy/blob/master/docs/presentation/kde_presentation.pdf
Contents
00:22 - What is kernel density estimation?
01:27 - Kernel functions
03:27 - Bandwidth
04:30 - Silverman's rule of thumb
05:19 - Improved Sheather Jones
06:10 - Weighting the data
07:30 - Bounded domains and reflections
09:18 - Kernel density estimation in higher dimensions
10:02 - The choice of norm
11:11 - Example of 2D kernel density estimation
12:36 - A fast algorithm using linear binning and convolution
15:30 - 2D linear binning
16:18 - KDEpy - software for kernel density estimation in Python
16:51 - References

Опубликовано:

 

24 сен 2018

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 125   
@XY-yg1ci
@XY-yg1ci Месяц назад
so straightforward explanation. understand kernel in the first 2 mins
@n.sabriozturk6520
@n.sabriozturk6520 5 лет назад
Finally here I found a super video that explains briefly and clearly what Kernel Density Estimation is. Thank you so much.
@webelod4999
@webelod4999 5 лет назад
Thanks man. Glad the video was of help :)
@ali-kadar
@ali-kadar 4 года назад
Thank you a ton for the very clear and concise explanation. I like that you go into some algorithmic details nearing the end of the video.
@jasonhe6947
@jasonhe6947 4 года назад
I love this tutorial, the pace, example, and visualization are just so great
@rajanalexander4949
@rajanalexander4949 2 года назад
Clear visualisations, succinct and lucid explanations -- fantastic video. Thanks!
@zyflying
@zyflying 2 года назад
Really great intro, briefly and straight to the point
@tymothylim6550
@tymothylim6550 3 года назад
Thank you very much for this video! It was very easy to understand (although this topic is still quite new to me). The use of graphs helps a lot with the explanations!
@PianoMan333
@PianoMan333 2 года назад
Great video. I found this topic rather abstract but this makes it a lot clearer. Thank you!
@matematikce9490
@matematikce9490 3 месяца назад
Clean, on the the point, good theory/practice ratio. Very much appreciated, thanks.
@ummesalmamofficial7637
@ummesalmamofficial7637 3 года назад
Thank You Sir for explaining KDE in a simple way.
@nengjingding5942
@nengjingding5942 4 года назад
Finally found a video to get a rough but clear idea what KDE is. Highly recommend!
@carl416
@carl416 3 года назад
Relatively clear exp, good. Visuals really make the difference.
@aaronlin8785
@aaronlin8785 2 года назад
Amazing video Tommy. I couldn't understand KD in a week of Uchicago lectures and you did it in about 45 seconds.
@timuryalta
@timuryalta 5 лет назад
This deserves much more views!
@Scoutik997
@Scoutik997 2 года назад
This is a very clear explanation of KDE, good job
@ukvaishnav
@ukvaishnav 2 года назад
Thanks for making this video. Its concise and quick guide to KDEs.
@singlebinary
@singlebinary 4 года назад
Excellent video and clear explanation. Please keep making more!
@pcenxyz1838
@pcenxyz1838 4 года назад
Sir thanks for the explaination.Very well explained actually I came here with zero knowledge. Thanks for the explanation and I will definitely use KDEpy in my projects...thanks for saving the day
@tgwashdc
@tgwashdc 3 года назад
Short, sweet and perfect!
@luismisanmartin98
@luismisanmartin98 3 года назад
This video is absolutely precious! Thank you Tom for taking the time to create this
@webelod4999
@webelod4999 2 года назад
Glad you liked it. So happy to get positive feedback, since it took some time to create.
@snehagaikwad2655
@snehagaikwad2655 5 лет назад
Thank you so much for the video! It was easy to understand conceptually!
@RajeshSharma-bd5zo
@RajeshSharma-bd5zo 3 года назад
Beautifully explained!!
@samuelfischer5131
@samuelfischer5131 2 года назад
This is awesome. Thank you for this overview!
@yunfenghu3786
@yunfenghu3786 5 лет назад
Thanks Tommy for this amazing video. I am a visual person and this video gives me a clear view of how density kernel works in 1D and 2D using graphs. Your visualization for norms in higher dimension was fantastic. I will use recommend it to my students in the future!
@webelod4999
@webelod4999 5 лет назад
Thanks! I appreciate it!
@peterstanbridge3871
@peterstanbridge3871 2 года назад
Thank you so much for this presentation - first time I've been able to even begin to understand this at an overview level.
@webelod4999
@webelod4999 2 года назад
Awesome! Thanks for leaving the nice comment :)
@IroXtreme
@IroXtreme 3 месяца назад
Great video, clear and concise - thanks!
@bernardoamorim9182
@bernardoamorim9182 4 года назад
amazing tutorial, thank you very much for the video and the library :)
@alejozen3457
@alejozen3457 4 года назад
Great explanation. Thank you for the effort.
@lifestoriesfromearth6271
@lifestoriesfromearth6271 4 года назад
Thank You Tommy for this wonderful explanation. :-)
@michaeljagdharry
@michaeljagdharry 3 года назад
you are amazing, that was one the clearest explanations of a nonstandard statistical concept I have ever seen
@webelod4999
@webelod4999 3 года назад
Thanks!
@Colegial24
@Colegial24 4 года назад
Excellent video! Extremely helpful!
@himanshudalai1028
@himanshudalai1028 5 лет назад
Thank you so much for the video. Loved it.
@okokpk123123
@okokpk123123 Год назад
Thank you for your presentation.It is really briefly and clearly.It really helps a lots.Hopes you can share more presentation!
@webelod4999
@webelod4999 Год назад
Thanks! The success (in terms of views) on this video inspires me to create more.
@delinyahkoning6882
@delinyahkoning6882 Год назад
What a nice video this is! Super clear.
@barnabyinteractive
@barnabyinteractive Год назад
super well made couldnt ask for anything better lol
@makimakiwii
@makimakiwii 5 лет назад
Very helpful. Thank you so much!
@rajm3496
@rajm3496 5 лет назад
genius...happy that I found this :-)
@JayPatel-et4vi
@JayPatel-et4vi 5 лет назад
Best video for KDE
@khubaibraza8446
@khubaibraza8446 4 года назад
Thank you so much, Super clear explanation.
@ebrahimfeghhi1777
@ebrahimfeghhi1777 2 года назад
Thank you, great explanations!
@Ariel-px7hz
@Ariel-px7hz Год назад
Excellent video. Thank you!
@svendavidsson
@svendavidsson 2 года назад
Great explanation!
@h-hugo
@h-hugo 4 года назад
Very nice lecture!
@powerchucho007
@powerchucho007 3 года назад
Thanks a lot. Great explanation!
@marcelsa5191
@marcelsa5191 2 года назад
Extremely good video! Well explained and nice graphics. Thank you and greetings from Oxford :)
@webelod4999
@webelod4999 Год назад
Many thanks!
@aman.bansal
@aman.bansal Год назад
Thank you for making this helpful video.
@nassehk
@nassehk 5 лет назад
What a great video. Thank you.
@jaantollander
@jaantollander Год назад
Great tutorial. Thank you!
@juandavidcaicedoms7686
@juandavidcaicedoms7686 5 лет назад
Thnks for this video! It’s a really good explanation, super helpful!
@webelod4999
@webelod4999 5 лет назад
Thanks man, I appreciate it!
@raduiulia4034
@raduiulia4034 4 года назад
Amazing video!
@qwqsimonade3580
@qwqsimonade3580 2 года назад
thanks for the dedicated video
@Brumor
@Brumor 5 месяцев назад
Great video, thanks!
@michaelsongbai
@michaelsongbai 5 лет назад
Nice tutorial! Thanks!
@giuliofederico7638
@giuliofederico7638 3 года назад
Perfect explanation
@canmetan670
@canmetan670 4 года назад
Thanks man. Great video.
@mahadeibnsalam6735
@mahadeibnsalam6735 3 года назад
Great content!
@gekkejunior3262
@gekkejunior3262 2 года назад
Clear. Thank you a lot!
@martinwutke3386
@martinwutke3386 3 года назад
Thanks for this very good explanation. Will definitely look into your library. Best Wishes
@webelod4999
@webelod4999 3 года назад
Glad it was helpful!
@user-pq6ed3zs5k
@user-pq6ed3zs5k 10 месяцев назад
Great visualizations
@stephengargan3907
@stephengargan3907 Год назад
super informative, nice job!
@webelod4999
@webelod4999 6 месяцев назад
Thank you!
@chenghungchou9521
@chenghungchou9521 2 года назад
Amazing easy to understand!!!!!!!!
@nakko3017
@nakko3017 2 года назад
Thanks for the very clear explanation. ありがとうございます
@webelod4999
@webelod4999 2 года назад
どういたしまして ! (I used Google Translate)
@felipefavadelima
@felipefavadelima 3 года назад
Thanks for your video! Very well explained.
@webelod4999
@webelod4999 2 года назад
Glad it was helpful!
@lilaberkani4376
@lilaberkani4376 3 года назад
Thank you so much for your video, it helps me a looot
@realreactteseract6261
@realreactteseract6261 5 лет назад
Amazing, really!!!!
@laxmanbisht2638
@laxmanbisht2638 3 года назад
precisely explained
@juheesingh1157
@juheesingh1157 5 лет назад
Very hepful video 😊
@Abafoteq-Ltd
@Abafoteq-Ltd 3 года назад
Wow..... wonderful. thank you so much. this was indeed very helpful.
@webelod4999
@webelod4999 3 года назад
Glad it was helpful!
@LeeLeeCode
@LeeLeeCode 5 лет назад
Thank you!
@dayy14
@dayy14 5 лет назад
Thanks a lottttt!!!
@richardtarbell946
@richardtarbell946 3 года назад
This is king shit right here.
@thomasalderson368
@thomasalderson368 4 года назад
Liked!
@ZinzinsIA
@ZinzinsIA Год назад
Very nice, even if i did not get the part about the linear binning and what it is exactly
@ZinzinsIA
@ZinzinsIA Год назад
And very nice for the library btw !
@rhodesengr
@rhodesengr 7 месяцев назад
Thanks for this video. It makes the concept very clear. Other videos, not so much. I have an application where I would like to use 2D KDE on data sets that are set of point on an xy plane. My goal is to fit a 2D Gaussian to the data and then compare goodness of fit for different data sets. I believe I first need to generate a density function for the data and then fit the Gaussian to the density function. KDE looks like a good way to generate the density function. I would prefer to do this in Excel so an Excel plugin would be ideal. I am not really setup (or proficient) to do regular programming in Python, C, or whatever.
@jeffreychong3467
@jeffreychong3467 5 месяцев назад
Watched about 10 videos, only this one clicked for KDE.
@TheOfficialJeppezon
@TheOfficialJeppezon 5 лет назад
Please make more videos!
@NadavBenedek
@NadavBenedek Год назад
Great audio quality
@webelod4999
@webelod4999 6 месяцев назад
Thanks. For anyone curious, the microphone I use is Audio Technica AT2020 USB+
@capricacity
@capricacity 4 года назад
I wish I saw this before completing my PhD. This would have made the process "smoother" get what i mean? HAHA!!!
@zenchiassassin283
@zenchiassassin283 3 года назад
lol, congrats for your PhD too
@pranavkumar9782
@pranavkumar9782 3 года назад
Is it possible to sample from the KDE after fitting, either in sklearn or KDEpy, apart from the usual method of going to a point x_i and sampling from N(x_i, h) if the kernel is Gaussian in the KDE ?
@webelod4999
@webelod4999 2 года назад
Not that I know of. You could use the Inversion method and the CDF of the returned PDF, but "the usual method" that you mention is equivalent to sampling from the PDF.
@canernm
@canernm 4 года назад
Thanks for the video ! Quick question, are the kernel functions probability density functions? I know the fulfull their properties, but is that enough to make them PDFs? Thanks in advance.
@webelod4999
@webelod4999 3 года назад
They are, yes. If they fulfill the properties, they are PDFs by definition.
@diwakarns1600
@diwakarns1600 4 года назад
Thank you..I did not understand what a norm is, can you explain a bit more on that? Thank you!
@webelod4999
@webelod4999 3 года назад
It's basically a measure of distance. A generalization of abs(x) in one dimension. See Wikipedia :)
@nallakrishna8796
@nallakrishna8796 Год назад
finally, i found an amazing lecture on kernel density estimation thanks a lot . but i have one query how it can be used to find the anomaly detection. sir can u please make one lecture about this topic otherwise can u please recommand me some good references for KERENEL DENSITY ESTIMATION FOR ANOMALY DETECTION
@SLee-xj4jn
@SLee-xj4jn 5 лет назад
Best
@aparnamuralidhar5413
@aparnamuralidhar5413 Год назад
Hello there. I tried using your KDE package for my work. Used FFT KDE. When i was trying to evaluate the model with some data-i got an error-'Every data point must be inside the grid" . could you elaborate on this,please?
@webelod4999
@webelod4999 Год назад
If you have a data point at 0, say, and you grid ranges from 1 to 5, then you will get this error. The data point is outside of the grid. Best to let KDEpy create the grid for you. It automatically sets up a reasonable grid.
@shivshankarkeshari6604
@shivshankarkeshari6604 4 года назад
4.07- 4.14 how can I do similar in my py project?
3 года назад
Sorry for the dumb question but why in the first formula X is subtracting Xi? What it does mean?
@webelod4999
@webelod4999 2 года назад
If I have a function f(x), then subtracting 2 will shift the function. So f(x-2) shifts the function to the right by 2. When we subtract the data point x_i, we shift the kernel function so it lies "on top" of that data point.
2 года назад
@@webelod4999 Thank you very much 🙌🙌🙌
@justforsynchtc
@justforsynchtc 3 года назад
Having to implement this and don't understand the "discrete convolution (possibly by fourier transform)". Any pointers?
@webelod4999
@webelod4999 3 года назад
Look to wikipedia for information about discrete convolution.
@abdizinab7934
@abdizinab7934 3 года назад
Thanks you some much, please Can you sent me the programs of all those representations
@zahrahsharif8431
@zahrahsharif8431 4 года назад
Hi, how would you interpret a kde if the x axis is probability and the y axis is density?
@webelod4999
@webelod4999 3 года назад
As a prior distribution in Bayesian statistics.
@bean217
@bean217 3 месяца назад
9:50 why is the sum only normalized by 1/(h^d) and not 1/(N * h^d) ?
@teresaebernardo
@teresaebernardo 2 года назад
Does the size of the grid make a difference?
@webelod4999
@webelod4999 2 года назад
Yes. The finer the grid, the better the results. In KDEpy the default is 1024 grid points.
@Borzacchinni
@Borzacchinni 4 года назад
Do you happen to be from Norway?
@cendradevayanaputra7150
@cendradevayanaputra7150 2 года назад
do you have review of Density Estimation?
@webelod4999
@webelod4999 Год назад
kdepy.readthedocs.io/en/latest/literature.html
@cendradevayanaputra7150
@cendradevayanaputra7150 Год назад
@@webelod4999 thank you
@jg9193
@jg9193 4 года назад
Wow...
@jeanny2852
@jeanny2852 4 года назад
what is the difference between x and xi?
@webelod4999
@webelod4999 3 года назад
x is a continuous variable (the domain), while the x_i's are the observations in the sample.
@43SunSon
@43SunSon 4 года назад
pika pika
@zilezile4942
@zilezile4942 4 года назад
Good evening everyone, 🔵 Discover now our books and training that we have produced for you on our site. : www.amikour.wordpress.com 🔵 Click here to go directly to our books and training. : amikour.wordpress.com/nos-formations/