Тёмный

The Most Important Algorithm in Machine Learning 

Artem Kirsanov
Подписаться 156 тыс.
Просмотров 190 тыс.
50% 1

Shortform link:
shortform.com/artem
In this video we will talk about backpropagation - an algorithm powering the entire field of machine learning and try to derive it from first principles.
OUTLINE:
00:00 Introduction
01:28 Historical background
02:50 Curve Fitting problem
06:26 Random vs guided adjustments
09:43 Derivatives
14:34 Gradient Descent
16:23 Higher dimensions
21:36 Chain Rule Intuition
27:01 Computational Graph and Autodiff
36:24 Summary
38:16 Shortform
39:20 Outro
USEFUL RESOURCES:
Andrej Karpathy's playlist: • Neural Networks: Zero ...
Jürgen Schmidhuber's blog on the history of backprop:
people.idsia.ch/~juergen/who-...
CREDITS:
Icons by www.freepik.com/

Опубликовано:

 

16 май 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 270   
@ArtemKirsanov
@ArtemKirsanov Месяц назад
Join Shortform for awesome book guides and get 5 days of unlimited access! shortform.com/artem
@TNTsundar
@TNTsundar Месяц назад
Can you talk about liquid neural networks? I’m interested to know if that’s a revolutionary work that deserves more recognition and following. arxiv.org/pdf/2006.04439.pdf
@Mutual_Information
@Mutual_Information Месяц назад
Back prop is a hard, heavy thing to explain, and this video does it extremely well. I mean, that section 'Computational Graph and Autodiff' might be the best explanation of that subject on the internet. I'm very impressed - well done!
@33gbm
@33gbm Месяц назад
You two are the best channels I have found in the SoME episodes. It's great to see this interaction between you guys.
@dprophecyguy
@dprophecyguy Месяц назад
Love your videos
@michaelcharlesthearchangel
@michaelcharlesthearchangel Месяц назад
If there is no mention of sine waves in neural networks then it won't be total.
@CuriousLad
@CuriousLad Месяц назад
Funnily enough, the calculus portion of the video is probably one of the best explained I've seen
@George70220
@George70220 Месяц назад
Why would that be 'funnily enough'? What a diss lmao.
@balu6923
@balu6923 Месяц назад
@@George70220 I don't think CuriousLad meant it as a diss, it's just that when Artem made the video, he explained the Calculus section as a background information. The partial derivates and gradient descent wasn't the main topic of the vid, yet you could show this to Calculus I student and they would be thanking him for the explanation, even if they have not interest in learning back propagation! That's why funnily enough, while the intro Calc topics wasn't the main part of the video, that portion would be very helpful to anyone starting out int Calc!
@veritas7010
@veritas7010 Месяц назад
I dont agree for example the act of minimizing loss function and gradient descend were not properly linked there were just two pieces of information unprocessed dumped in series
@undertheshadow
@undertheshadow 23 дня назад
"Wait, It's all derivatives?" "Always has been" Great work pal. Provides excellent clarity. Looking forward to the second part.
@rad6626
@rad6626 4 дня назад
😂 Turns out back propagation isn’t just magic
@vastabyss6496
@vastabyss6496 Месяц назад
It makes sense that you would cover both computational neuroscience AND machine learning since they both play a significant role in AI research. The sort of content you're making is definitely 3Blue1Brown level. Keep up the good work!
@pradhumnkanase8381
@pradhumnkanase8381 Месяц назад
There could not have been a better explanation. Hats off to you
@f_pie
@f_pie Месяц назад
This is the best ML explanation I have seen on YT
@user-cm5fj8qz8k
@user-cm5fj8qz8k Месяц назад
this's by far the most clearer explaination and simplification of backpropagation i have watched
@moralboundaries1
@moralboundaries1 Месяц назад
So clear and concise! Thank you for creating this.
@Anonymous-fr2op
@Anonymous-fr2op Месяц назад
Damn, I was wondering where you've been since over half a year, whilst I was stuck in backpropagation😂 and here you came back like a true mind reader. Glad to see you back❤
@highchiller
@highchiller Месяц назад
He was calculating your backward step so you can make your next forward step (sorry, couldnt resist) XD
@ReighKnight
@ReighKnight Месяц назад
The visuals on this video is from another planet . So Good !!!!!!!!
@black_crest
@black_crest Месяц назад
This just might be the most underrated video on Back Propagation that I've ever seen! I hope more people come across this
@shikhargairola5815
@shikhargairola5815 Месяц назад
It’s probably the best explanation of backward propagation. Hats off to your hard work and saving this so valuable content.
@matheusmendonca1332
@matheusmendonca1332 Месяц назад
By far the best ML explanation I have seen on internet.
@AlexKelleyD
@AlexKelleyD Месяц назад
This is one of, if not the, best videos I’ve seen that throughly explains back propagation. It will definitely help me to be able to better explain the algorithm to others, so thank you for creating it.
@Master_of_Chess_Shorts
@Master_of_Chess_Shorts Месяц назад
This has to be the best explanation of the chain rule ever! Thanks
@Maverick99xx
@Maverick99xx Месяц назад
This is incredibly well done and helped me visualize derivatives comprehensively. Thank you.
@The-Martian73
@The-Martian73 21 час назад
If you couldn’t understand this explanation, visualization, clearness … there’s nothing else can work with you I swear
@aabiddd
@aabiddd Месяц назад
all these basic concepts such as derivatives, least square method, I'm learning it in my college. watching these kind of machine learning videos has made me understand the practical applications of these theoretical concepts a bit better now 😌
@cachegrk
@cachegrk Месяц назад
This is the best ever explanation I have seen. Thanks for taking the time and doing something extraordinary.
@K9Megahertz
@K9Megahertz Месяц назад
This is a visual masterpiece! Well done! Much of this was a review for me as I took the time to go through all this last year. I did an implementation of the MNIST handwritten number neural network and had to learn all the calculus covered here to work out the backpropagation math. You really do have to dig in to it to get a good handle on it but it's fun stuff.
@martonbalassa8128
@martonbalassa8128 Месяц назад
This is the best youtube channel in my feed, and I have many.
@chilledpepsi
@chilledpepsi 13 дней назад
Hands down the best explanation there is to backprop
@gianlucanordio7200
@gianlucanordio7200 27 дней назад
I just have to say this goes way beyond the quality of the many chainrule videos I've seen so far. Good job man, you've got some impressive skills to keep me watching a math video and take notes past my usual bedtime
@marc_frank
@marc_frank 18 дней назад
you take notes?
@tonsetz
@tonsetz Месяц назад
He is back! Greetings from Brazil, we've all been waiting for this release!
@naveen_malla
@naveen_malla 7 дней назад
Dude, this is the most beautiful ML video i've ever seen. Highly informative yes, but also beautifully made. Thank you for your work.
@user-yb2sx4zz4y
@user-yb2sx4zz4y 5 дней назад
The world needs more of you bro
@brahmatejachilumula2668
@brahmatejachilumula2668 26 дней назад
Beat graphical experience with a clear information, Really enjoyed throughout the video !!!
@user-dw8sz5mw3m
@user-dw8sz5mw3m Месяц назад
It's very very nice to see that are you updating.
@slk627
@slk627 Месяц назад
thank you so much! The most clear explanation of the topic i've seen so far, amazing job! I wish i had this kind of videos during school education.
@chakravarthyelumalai8408
@chakravarthyelumalai8408 Месяц назад
A million dollar explanation. Thank you @Artem
@TysonPower
@TysonPower Месяц назад
Always impressive! Looking forward to the second one.
@XxIgnirFirexX
@XxIgnirFirexX Месяц назад
I think I just found my favourite channel of all times. I've been on YT since 2011 and never had a crush for a YT channel before today é.è
@kentjordan4658
@kentjordan4658 Месяц назад
Excellent visualization! Keep posting like this! 😃😃
@RohitKumar-pu4nm
@RohitKumar-pu4nm 2 дня назад
Спасибо, это лучший канал связок, все работает, буду это пробовать.
@ChPonsard
@ChPonsard Месяц назад
Excellent video, thank you. I'm already looking forward to the synaptic plasticity video!
@Ant3_14
@Ant3_14 Месяц назад
You are the best source of understanding computation that is biological and organic (all ml stuff), thank you.
@ac695
@ac695 9 дней назад
Amazing video. Underrated channel.
@ahumanperson3649
@ahumanperson3649 Месяц назад
Great video! Very elegant explanation of back propagation, and I’m super excited to see the different mechanics of biological neural networks! Keep up the good work.
@shizzm1990
@shizzm1990 Месяц назад
Some people just want to see the world learning. Great Video Artem!
@DB-nl9xw
@DB-nl9xw Месяц назад
Make more videos like this. I learned so much. Thank you for making this great videos.
@gustavonaves6947
@gustavonaves6947 15 дней назад
I loved this content. You rock it! Congratulations! ❤
@pcwalid
@pcwalid Месяц назад
Thank you for this excellent explanations !
@qoobes
@qoobes Месяц назад
This is insane. I loved the video, keep it up!
@benmuller6103
@benmuller6103 Месяц назад
Excellent explanation - I already understood this conceptually but this video gives a very good intuition for the repeated chain rule application
@francescobranca653
@francescobranca653 Месяц назад
Very insightful video. Can't wait to see the second part. I would really love to see a video from you on spiking neural networks too!
@michalhomola6810
@michalhomola6810 15 дней назад
Absolutely brilliant
@ks0ni
@ks0ni Месяц назад
Wow, hats off to you! Can't even imagine how long it takes to make something like this
@asdasd-yr7wi
@asdasd-yr7wi Месяц назад
31 years now, had like 13 years of math in school and another 5 years at university, first time i really understood how derivatives work, bcs visualisation instead of "you calculate it this way and derive it that way, now memorize"
@winterknight1159
@winterknight1159 25 дней назад
I have been doing ML research for a few years now but somehow I was drawn to this video. I am glad to say that it did not disappoint! You have done an amazing job, putting things in perspective and showing respect to calculus where it is due. We forget how a simple derivatives powers all of ML. Thank you for reminding that!
@ArtemKirsanov
@ArtemKirsanov 14 дней назад
Thank you! That’s really nice to hear!
@gersonrodriguez9005
@gersonrodriguez9005 18 дней назад
Ya ví el video completo como 5 veces en estas semanas, este tema me fascina
@OscarGGL
@OscarGGL Месяц назад
Artem back with another masterclass!
@MaitreJedi19
@MaitreJedi19 Месяц назад
Animation is great, but more and more people are doing it now. What make this special is the story, the complexity build-up is perfect and efficient. One needs a deep understanding of the subject and strong teaching skills to produce this.
@arvindnanjundaswamy2442
@arvindnanjundaswamy2442 Месяц назад
Outstanding explanation. Thanks
@mohanbhosale5890
@mohanbhosale5890 Месяц назад
omg, what an explanation. You legend, more power to you !!!
@myelinsheathxd
@myelinsheathxd Месяц назад
Thank you for illustration!
@philipm3173
@philipm3173 Месяц назад
This is just superb, thank you Artem! Timing couldn't be any better as the gradient descent algorithm was mentioned in Grahaene's "How We Learn" which I'm currently reading.
@kltr007
@kltr007 Месяц назад
This video explains the mathematical base of neural networks in a way I understood it the frist time enough to be able to explain it to somebody else. Thank You for that. I can't even imagine how much work you put into the animations. A master piece!
@MissPiggyM976
@MissPiggyM976 Месяц назад
Wonderful video, many thanks!
@isaac10231
@isaac10231 Месяц назад
I cannot imagine just how much effort and work this took to make.
@mehranshafieecheyki156
@mehranshafieecheyki156 Месяц назад
I enjoy watching your videos, thank you .
@kamalacharya4608
@kamalacharya4608 23 дня назад
amazing video!!!! I am recently doing AI by Hand and was stuck on the back-propagation concept. It really help deepen my understanding of neural networks and back-propagation.
@-mwolf
@-mwolf Месяц назад
Amazing explanation!
@y5mgisi
@y5mgisi 28 дней назад
Man this is such a great channel.
@GGGG_3333
@GGGG_3333 18 дней назад
This was amazing and mind blowing 🤩
@jhutanda
@jhutanda Месяц назад
Thank you sir.
@EDM179
@EDM179 5 дней назад
Great job Artem
@fosowl
@fosowl Месяц назад
Glad to see ML related video from you ! As you have neuroscience background I would love to see some video that compare the current state of the art architecture work in ML with some of the inner working of the brain. For exemple if there are any structure in the brain with some ressemblance with GPT/transformers architecture, even thought the brain is light-years away I think that could be interesting :)
@kleytondacosta8228
@kleytondacosta8228 Месяц назад
Really nice work! Congrats.
@_1jay
@_1jay Месяц назад
criminally underrated
@AA-gl1dr
@AA-gl1dr Месяц назад
Thanks Artem
@persevere1052
@persevere1052 Месяц назад
Fantastic explanation and animations!
@atha5469
@atha5469 Месяц назад
Phenomenal video
@kaminenianirudh
@kaminenianirudh Месяц назад
Yo, I'm hyped for the next video
@GeoffryGifari
@GeoffryGifari Месяц назад
Top notch visuals man
@MultiMojo
@MultiMojo Месяц назад
Another gem of a video, well done Artem!! This channel deserves 1M+ subscribers, there's nothing else like it on RU-vid.
@TruthOfZ0
@TruthOfZ0 27 дней назад
i just made that in python for a simple quadratic equation.....THANK YOU !!!! i just learned python and machine learning !!!!!!!!!! Using desired y=0 i could also find one solution of the equation... wow i love this so much!! The only different i did was to make x the weight and not the coeficients which i wanted them to be fixed inputs What you helped me realise is that any system that can put in a computational graph like that 30:04 ...it can be embeded backpropagation regardles THANK YOU im out of words Also when the next loss is bigger or equal than the preview loss after one iteration... i divided the learning rate by a factor of 2 or 10 for more accuracy and if the next loss was smaller than the preview one i multiple the learning rate by a factor of 1.1 to 1.5 to speed up the proccess...thus having results in hundreds or even thousands less generations/iterations and less time consuming!!!!! I can use this for optimizing my desired outputs in any system !!! JUST WOW!!
@hackerbrinelam5381
@hackerbrinelam5381 Месяц назад
The legend is back!
@Sol-En
@Sol-En Месяц назад
Wow ! This is masterpiece
@mou8842
@mou8842 26 дней назад
I think this video alone made all my Calculus I and II classes make sense now
@smmblog
@smmblog Месяц назад
Как всегда великолепно!
@tobias3581
@tobias3581 Месяц назад
Aha! I get it now. Impressive effort to explain, thanks
@671021748
@671021748 24 дня назад
great explanation!
@MrMusk-it5nz
@MrMusk-it5nz Месяц назад
Amazing, enjoying very much!
@soniferous
@soniferous Месяц назад
Mindblowing. Just the video I was looking for. TBH, initially, I was a bit put off by your English as I am not a mothertongue myself. However, your knowledge, competence, hard work and research behind this video got me hooked. Liked and subscribed. And I will be watching this video many times.Well done!
@AaronNicholsonAI
@AaronNicholsonAI Месяц назад
Wow. Wow. Wow. Thank you so much. This is instrumental for my study. Makes AI math a lot more approachable.
@2412danton
@2412danton Месяц назад
Одно из лучших видео на данную тему. Спасибо!
@simonstrandgaard5503
@simonstrandgaard5503 Месяц назад
Excellent explanation
@karthikrajeshwaran1997
@karthikrajeshwaran1997 5 дней назад
Superb explanation.
@simaitools
@simaitools Месяц назад
Watching this video was like a breath of fresh air after some heavy math calculations! The visual explanations really helped solidify my understanding of backpropagation. I appreciate how clear and easy to follow the graphs were. Keep up the fantastic work! Can't wait for more graphic doses like this.
@stratfanstl
@stratfanstl Месяц назад
This is up there with 3Blue1Brown for mathematical explanation, animation quality and overall elegance. Well done.
@somethingness
@somethingness Месяц назад
This is beautiful!
@antonpashkov6366
@antonpashkov6366 Месяц назад
Great job, as always! I'm glad you don't forget about this channel and about us, your fans ^_^
@sukursukur3617
@sukursukur3617 29 дней назад
That is a very good explanation
@poweredbysergey
@poweredbysergey 12 дней назад
Nice explanation!
@ShpanMan
@ShpanMan Месяц назад
I need the next video yesterday please!
@user-fh7tg3gf5p
@user-fh7tg3gf5p Месяц назад
I have to subscribe to this great teacher.
@ram-my6fl
@ram-my6fl Месяц назад
Most Comprehensive Explanation EVER my opinion : better than 3b 1b, No offence to 3b 1b Hes great at it and one of the pioneers who did these kind kf visual explanations. But i like your explanation as it is slow paced & comprehensive
@jacopo710
@jacopo710 Месяц назад
mind blowing
@shis10
@shis10 Месяц назад
Amazing video ❤
Далее
Watching Neural Networks Learn
25:28
Просмотров 1,1 млн
ML Was Hard Until I Learned These 5 Secrets!
13:11
Просмотров 146 тыс.
МЕТ ГАЛА, что это было?
1:09:17
Просмотров 214 тыс.
НЕ ПОКУПАЙ iPad Pro
13:46
Просмотров 192 тыс.
Is the Future of Linear Algebra.. Random?
35:11
Просмотров 183 тыс.
Solve any equation using gradient descent
9:05
Просмотров 51 тыс.
This is what DeepMind just did to Football with AI...
19:11
The better way to do statistics
17:25
Просмотров 127 тыс.
Interstellar Expansion WITHOUT Faster Than Light Travel
21:14
What is Back Propagation
8:00
Просмотров 43 тыс.
МЕТ ГАЛА, что это было?
1:09:17
Просмотров 214 тыс.