Тёмный

01 - History and resources 

Alfredo Canziani
Подписаться 39 тыс.
Просмотров 97 тыс.
50% 1

Course website: bit.ly/DLSP21-web
Playlist: bit.ly/DLSP21-RU-vid
Speaker: Yann LeCun, Alfredo Canziani
Chapters
00:00 - Welcome to NYU Deep Learning, Spring 2021
00:43 - History of Deep Learning, 1943-1969
08:14 - The McCulloch-Pitts binary neuron
08:54 - History of Deep Learning, 1970s-2010
17:51 - History of Deep Learning, 2012-2016
21:15 - Q. How about the future?
25:20 - Q. What are limitation? How about quantum computing?
27:12 - Practicum starts
24:35 - NYU-DLSP20 and '21 websites
37:56 - Remote teaching and learning: Twitter and resources (William Strang, ‪@3blue1brown‬)
42:11 - Classification, decision boundaries, and warping the “space fabric” with a neural net

Опубликовано:

 

16 июл 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 145   
@sudiptoghosh5740
@sudiptoghosh5740 3 года назад
Thank you Alfredo. Words fall short to describe the amount of hard work and effort you've put into organizing the material and structuring it so well. Bless you. From India.
@alfcnz
@alfcnz 3 года назад
😇😇😇
@oguzhanercan4701
@oguzhanercan4701 2 года назад
While I was bored listening to the lectures at my own university, I did not experience this in this video series. I even feel like I'm taking the class interactively at NYU. It's great that Alfredo interrupts Lecun and asks questions in our minds, adds fun to the lesson, and continues the lesson in an unconventional way.
@alfcnz
@alfcnz 3 месяца назад
🥳🥳🥳
@anmolgautam9572
@anmolgautam9572 3 года назад
I wanted to thank you for the efforts Sir. The way you described that NN basically warps the space this concept has cleared so many things in my mind.
@alfcnz
@alfcnz 3 года назад
😇😇😇
@rindraramamonjison9704
@rindraramamonjison9704 3 года назад
I may not always like the jokes but I admire your caring for others to learn. Thanks for sharing the course!
@alfcnz
@alfcnz 3 года назад
🥳🥳🥳
@vaibhavsingh8715
@vaibhavsingh8715 3 года назад
Thank you so much!. This playlist is a gem.
@alfcnz
@alfcnz 3 года назад
💎💎💎
@user-co6pu8zv3v
@user-co6pu8zv3v 3 года назад
Cool. I hope I have time to watch all the videos of this course over the weekend.
@alfcnz
@alfcnz 3 года назад
And time is not there, you can always make it! 💪🏻💪🏻💪🏻
@bulkrivero
@bulkrivero 3 года назад
Great video, Alfredo. Thanks for sharing!
@alfcnz
@alfcnz 3 года назад
You're welcome 😊
@atharvaingle3567
@atharvaingle3567 2 года назад
Thank you, Alfredo. We can't thank you enough for providing these video lectures for free. I have one small query btw, I was going through the course websites of the 2020 and 2021 versions. Which version would you suggest to go through? 2020 one looks comprehensible. Just wanted to confirm if both of the versions (2020 and 2021) contents are the same ? Thanks again :)
@alfcnz
@alfcnz 2 года назад
They are not. The 2021 edition will be completely online in two weeks. Only the new lectures have been summarised with text, though.
@atharvaingle3567
@atharvaingle3567 2 года назад
@@alfcnz Thanks for the quick reply. So, which version would you suggest to go through end-to-end. Thanks.
@alfcnz
@alfcnz 2 года назад
The 2021's is fresher. I'll write on the 2021 homepage what lectures have not been included from the previous year.
@atharvaingle3567
@atharvaingle3567 2 года назад
@@alfcnz Thanks. It is very humble of you to respond even small queries :)
@alfcnz
@alfcnz 2 года назад
No worries ☺️☺️☺️
@songhualiu4813
@songhualiu4813 2 года назад
Thanks for your courses! It is awesome!
@snowflake5204
@snowflake5204 2 года назад
Coolest prof i have seen in a while! and the course seems extensive too.. Thank you so much for uploading 🙃
@alfcnz
@alfcnz 2 года назад
🥰🥰🥰
@dimitri30
@dimitri30 Месяц назад
Thank you for sharing this to everyone. I was bored by my university courses which are not very understood, passionate and advanced.
@alfcnz
@alfcnz Месяц назад
You’re welcome! 😉 Let me know if you have any questions about the course material! 🤓
@rishiganeshv840
@rishiganeshv840 2 года назад
Thank you Alfredo. Very Energetic and Informative..
@alfcnz
@alfcnz 2 года назад
Hahaha 😁😁😁
@alexandrevalente9994
@alexandrevalente9994 2 года назад
Thank you for sharing Grant Sanderson website. Really inspiring and finally propose a great way to link many views and applications of linear algbebra !
@alfcnz
@alfcnz 2 года назад
😀😀😀
@The-Daily-AI
@The-Daily-AI 2 года назад
Amazing that we are able to hear one of the people who developed deep learning.
@alfcnz
@alfcnz 2 года назад
😊😊😊
@all462
@all462 2 года назад
I was always interested in this subject. But was procrastinating. Today I finally decided to learn this.
@alfcnz
@alfcnz 2 года назад
Yay! 🥳🥳🥳
@cambridgebreaths3581
@cambridgebreaths3581 3 года назад
One of the most beautiful, interesting and joyful classes I ever came across. Can I join the entire module. Is there any specific steps I should follow prior to starting. I want to dedicate couple of weeks this summer to seriously absorb all the contents start to finish. Grateful for any recommendations. Thank you kindly Alf.
@alfcnz
@alfcnz 3 года назад
Just keep an eye on the class website, where I'm posting homework and schedule. For now the first theme is out. The second theme comes out this coming week.
@cambridgebreaths3581
@cambridgebreaths3581 3 года назад
@@alfcnz Thanks a million Alf. Looking forward to.
@alfcnz
@alfcnz 3 года назад
💜💜💜
@bernabesolideogloria
@bernabesolideogloria 2 года назад
Many thanks Alfredo!! Awesome Job!!
@alfcnz
@alfcnz 2 года назад
Of course, you're welcome 😊😊😊
@tiajennifer7691
@tiajennifer7691 2 года назад
Amazing lecture!! Thanks for sharing
@alfcnz
@alfcnz 2 года назад
Of course, anytime 😋😋😋
@MarkWitucke
@MarkWitucke 10 месяцев назад
Open Source Teaching. Beautiful stuff, Alfredo. Grazie amico!
@alfcnz
@alfcnz 10 месяцев назад
Prego 😇😇😇
@matthewevanusa8853
@matthewevanusa8853 2 года назад
Rosenblatt really started deep learning and I hope he continues to get more and more recognition. His devising the Perceptron and on top of that, manually building it is nothing short of genius. He died tragically and too young. But the Perceptron book by Minsky and Papert misconstrued his work I believe disingenuously, as it is known that Rosenblatt and Minsky were vocal rivals dating back years, what Rosenblatt was saying as only a linear network; in the original work Rosenblatt discussed multilayer architectures but had not yet devised backprop yet. He also laid the foundations for ideas about spiking networks and dynamical activity. The only reason he used a rate encoding sum + squashing function was in his words, due to the technological hardware limitations at the time.
@alfcnz
@alfcnz 2 года назад
Deep learning ≠ shallow learning. I'm not sure Rosenblatt can be considered to have started _deep_ learning. _Shallow_ learning, perhaps.
@matthewevanusa8853
@matthewevanusa8853 2 года назад
@@alfcnz I just mean, in his original paper he does discuss multilayered learning (with hidden units) contrary to popular perception that he only discusses single layer perceptrons - this misconception came about because of Minsky's characterization
@briancase6180
@briancase6180 2 года назад
Wow, so happy I found this. Yan's intro and historical survey was really interesting and useful. I remember being in grad school in the early 80s and feeling sorry for the guys studying AI: we all felt that they had no future. :) But, now, after most of the progress in basic processor design has been made, dnn and the rest of AI are looking like the best thing to investigate! The tables have turned.... :) Now, the AI guys can feel sorry for the rest of us. Ha! :)
@alfcnz
@alfcnz 2 года назад
😅😅😅
@alexandrevalente9994
@alexandrevalente9994 2 года назад
Great to hear the voice of the Father of new AI era !
@alfcnz
@alfcnz 2 года назад
🎙️🎙️🎙️
@wolfisraging
@wolfisraging 3 года назад
Great video!!!! waiting for more :)
@alfcnz
@alfcnz 3 года назад
Way too many are just waiting in my hard drive to get edited. This *is* a full-time job, LOL. Aaaaah!
@WilliamGacquer
@WilliamGacquer 3 года назад
Thanks! May you please list DOIs of cited articles in the description of the video, please ?
@alfcnz
@alfcnz 3 года назад
Right, that would make sense. I'll let Yann know.
@oseikofi4953
@oseikofi4953 3 месяца назад
what is the best way to use the vidoes together with the course website..... looks like theres a lot of information and I don't know where to begin and in what order..... I need help
@alfcnz
@alfcnz 3 месяца назад
My suggestion is checking out my website, where I explain how to begin and what order to follow. 😇😇😇
@helloworldcsofficial
@helloworldcsofficial 3 месяца назад
Awesome class. Keep them coming. Thanks!
@alfcnz
@alfcnz 3 месяца назад
🥳🥳🥳
@mubashirmufti5941
@mubashirmufti5941 2 года назад
Great work, thank you..
@alfcnz
@alfcnz 2 года назад
You're welcome 😊😊😊
@kemaleddinkara
@kemaleddinkara 3 года назад
Nice video Thank you.
@alfcnz
@alfcnz 3 года назад
You're welcome! 😇
@oyupanquiunalm
@oyupanquiunalm 2 года назад
Magnificent class! Thank you :) 13:00 was so funny btw haha
@alfcnz
@alfcnz 2 года назад
🤣🤣🤣
@dipeshshrestha7287
@dipeshshrestha7287 3 года назад
How to get into NYU ? These lectures are too good.
@alfcnz
@alfcnz 3 года назад
🤑🤑🤑
@mostafaatallah7001
@mostafaatallah7001 2 года назад
thank you very much for this awesome course, are there open-access exercises with solutions that I can use to test my understanding after each lecture?
@alfcnz
@alfcnz 2 года назад
See course website.
@mostafaatallah7001
@mostafaatallah7001 2 года назад
@@alfcnz .Thank you very much Sir
@alfcnz
@alfcnz 2 года назад
👍🏻👍🏻👍🏻
@beticuben
@beticuben 2 года назад
Hello Alf, I am so grateful for this course which I am watching and enjoy very much. I have an unrelated question for you. Could you please point me to a good book or tutorial on how to deploy a ML model. I have trained a decent classification model and need to deploy it to a website where users can upload their CSV input and get predictions also in a CSV file. Thank you so much in advance.
@alfcnz
@alfcnz Год назад
I've never deployed anything. Regardless, you may want to look into ML-ops and madewithml.com/#foundations
@beticuben
@beticuben Год назад
@@alfcnz Thank you so much!
@marco.r
@marco.r 2 года назад
Hello :) 48:55 are the arrows the basis vectors of the classes?
@alfcnz
@alfcnz 2 года назад
Yup, called class embeddings as well.
@nourinahmedeka9518
@nourinahmedeka9518 2 года назад
Not a content related question - I just became very curious - Was there any point in your life when you decided to be just the way you are? You know, making a conscious decision... Thanks for the education. Much appreciated.
@alfcnz
@alfcnz 2 года назад
Conscious decision about… being happy?
@nourinahmedeka9518
@nourinahmedeka9518 2 года назад
@@alfcnz being happy, being a bit silly, being yourself. although you recognise some may find you weirdly funny, but you are okay with that, but you are not imposing your characteristics upon anyone, you are just being yourself, and communicating that this is who you are. Did it come naturally to you or did you make a conscious effort somehow, to preserve yourself, your personality? Because too many of us loss themselves in order to, you know, to please other people, to maintain certain standard.
@alfcnz
@alfcnz 2 года назад
twitter.com/alfcnz/status/1251234277351739392
@ravikiranrao05
@ravikiranrao05 2 года назад
Beautiful framing. You look like a decision boundary for your background colours :)
@alfcnz
@alfcnz 2 года назад
😀😀😀
@mahdiamrollahi8456
@mahdiamrollahi8456 3 года назад
Great job...
@alfcnz
@alfcnz 3 года назад
🤓🤓🤓
@extrememike
@extrememike 2 года назад
Grazie. Bravo 👏🏻👏🏻
@alfcnz
@alfcnz 2 года назад
Prego 😊😊😊
@kanchankumar1519
@kanchankumar1519 3 года назад
Briallian animation at the end. Cheers ! Do interactive version of these animations exits??
@kanchankumar1519
@kanchankumar1519 3 года назад
Or the code ...
@alfcnz
@alfcnz 3 года назад
Sure, everything is on the course website and repo.
@ErfanKhodabakhsh
@ErfanKhodabakhsh 2 года назад
hey dear alfredo, as a Business student, Can i watch this course and do assignments? or i should choose another course ? :(
@alfcnz
@alfcnz 2 года назад
You can do as you please 🙂
@Anujkumar-my1wi
@Anujkumar-my1wi 3 года назад
Can you tell me why is it that neurons in a neural net uses this mathematical model i.e f(Ax+b) ,f is the activation function and inside is a affine transformation of inputs and not something else ?Is it just beacuse of the fact that they are inspired from biological neurons?
@alfcnz
@alfcnz 3 года назад
Yup, that's a very very very rough approximation of how a biological neutron work.
@Anujkumar-my1wi
@Anujkumar-my1wi 3 года назад
​@@alfcnz Just to be clear ,I am asking whether the method of using a affine transformation of inputs to have some control over the function phi(x), which is equal to affine transformation of inputs passed through some nonlinearity ,is completely inspired from biological neurons
@alfcnz
@alfcnz 3 года назад
Yes.
@Anujkumar-my1wi
@Anujkumar-my1wi 3 года назад
@@alfcnz Thanks ,does that mean that method of using affine transformation which is inspired from biological neurons just happens to be useful for having some control over phi(x)? It's my last question for today ,sir
@alexandrevalente9994
@alexandrevalente9994 2 года назад
First lesson... to non-french speaking people... Try to pronounce Lecun with a french accent ;-) "un" in french is like the number "1" ... so ... try to pronounce the number 1 in french will give you "un" ... then integrate it into Lecun... lot of english speaking people say "LeKoune" instead of Lecun which sounds weird from our side. So ask Google translate to select french, then type "un" and listen to it ;-) ... You tried ? You get it ? You are doing great ! ;-)
@alfcnz
@alfcnz 2 года назад
🤣🤣🤣
@bingbingsun6304
@bingbingsun6304 2 года назад
Like your channel, professor, subscribed.
@alfcnz
@alfcnz 2 года назад
🥳🥳🥳
@abhishekaiem
@abhishekaiem 3 года назад
Do we not have hands on in this series or I am missing something. Thanks for the upload sir!
@alfcnz
@alfcnz 3 года назад
I don't understand the question. All I've posted is PyTorch implementations.
@abhishekaiem
@abhishekaiem 3 года назад
@@alfcnz ohh my bad.... I was thinking that it's only theory as there is no ipynb file in git Repo.
@alfcnz
@alfcnz 3 года назад
@@abhishekaiem the notebooks covered so far are in last year's repo. I'll add the new ones to this year's repo.
@abhishekaiem
@abhishekaiem 3 года назад
@@alfcnz Thanks Professor!
@captainfrio4244
@captainfrio4244 3 года назад
I was waiting for the next video because this one was the first on your channel (sort by date) but today I have found that they were already the others videos :((((
@alfcnz
@alfcnz 3 года назад
Happy watching! 😀😀😀
@doyourealise
@doyourealise 3 года назад
lecun aged like fine wine :)
@alfcnz
@alfcnz 3 года назад
🍷🍷🍷
@aloklal99
@aloklal99 12 дней назад
How were the neural nets trained before 1985 ie before back prop was invented?
@alfcnz
@alfcnz 12 дней назад
I have a few videos on that on my most recent playlist, second chapter. There, I explain how the Perceptron (a binary neuron with an arbitrary number of inputs) used an error correction strategy for learning. Let me know if you have any other question. 😇😇😇 Chapter 2, video 4-6 ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-g4sSU6B99Ek.html
@aloklal99
@aloklal99 8 дней назад
@@alfcnz thanks! 🙏
@ianzhang8331
@ianzhang8331 3 года назад
Wow, my idol!
@alfcnz
@alfcnz 3 года назад
🥰🥰🥰
@anuraganand9675
@anuraganand9675 2 года назад
Thanks, Alfredo for being a nice Human Being. PS: I like the sarcasm, keep it coming :P
@alfcnz
@alfcnz 2 года назад
Sarcasm? 😮😮😮
@abhishekkumar-qi3is
@abhishekkumar-qi3is 2 года назад
Nice content 👍.please upload coding vedio as well Thanks.
@alfcnz
@alfcnz 2 года назад
About what?
@abhishekkumar-qi3is
@abhishekkumar-qi3is 2 года назад
@@alfcnz means how to implement architecture through code.like cnn
@Bobby-bz8bk
@Bobby-bz8bk 2 года назад
🙏
@alfcnz
@alfcnz 2 года назад
😇😇😇
@nenuRK
@nenuRK Год назад
I'm surprised as to why YoLo didn't make it to the list..
@alfcnz
@alfcnz Год назад
🤔🤔🤔 good point! We’ll keep it in mind! Thanks! ❤️
@TomChenyangJI
@TomChenyangJI 3 дня назад
only a few words on his own masterpiece work haha
@alfcnz
@alfcnz 3 дня назад
🤭🤭🤭
@alexandrevalente9994
@alexandrevalente9994 2 года назад
I like your food pictures ... but it looks you don't have a picture of "Arrosticini" ;-)
@alfcnz
@alfcnz 2 года назад
My… food pictures? 🙈🙈🙈
@WaiTingKuo0527
@WaiTingKuo0527 2 года назад
shame on me, i was eating ice cream while Alfredo just mentioned about it....
@zeeshanakhtar3786
@zeeshanakhtar3786 3 года назад
Isn't self-supervised learning has got the new fancy name of meta-learning these days?... correct me if I am wrong
@alfcnz
@alfcnz 3 года назад
You're wrong. «Meta learning [or learning to learn] is a subfield of machine learning where automatic learning algorithms are applied to metadata about machine learning experiments.» en.wikipedia.org/wiki/Meta_learning_(computer_science)
@DelipRao
@DelipRao 3 года назад
@@alfcnz He isn’t 100% wrong ;-) Self-supervised learning is a way to meta-learning (in a limited context, of course). A good way to look at the relationships between the two is if you were to plot the capabilities of meta-learning and self-supervised learning as a Venn diagram, there is an intersection.
@alfcnz
@alfcnz 3 года назад
I think the question asked is if self-sup is now called meta-learning. Although meta-learning is automated, I wouldn't call it self-sup learning. The two things are rather distinct, for what I understand. One is dealing with hyperparameter search while the other prelearns weights.
@DelipRao
@DelipRao 3 года назад
@@alfcnz yes, they are not equivalent for sure.
@capeandcode
@capeandcode 3 года назад
Why does Yann looks like some Star Lord.
@alfcnz
@alfcnz 3 года назад
Because he is one! ✴️🌟✨
@andres_pq
@andres_pq 3 года назад
Before 1986 neurons were binary?! Sounds like a nightmare
@alfcnz
@alfcnz 3 года назад
Yup, backprop was not and could not be a thing.
@sandipanhaldar8609
@sandipanhaldar8609 3 года назад
what's the teddy bear doing on the bed
@alfcnz
@alfcnz 3 года назад
His name is Vincenzo. He comes to class with me every week 😊😊😊
@antonispolykratis3283
@antonispolykratis3283 3 года назад
Yan started dyeing his hair like Alf's. It will take some time to reach his level. (joking).
@alfcnz
@alfcnz 3 года назад
Hahahaha! He started doing that _before_ me.
@Maeda_Toshiie
@Maeda_Toshiie 3 года назад
@@alfcnz Maybe, as an exercise, develop a machine learning based software to add the dye onto the hair of the person on the call...
@alfcnz
@alfcnz 3 года назад
😁😁😁
Далее
01L - Gradient descent and the backpropagation algorithm
1:51:04
MIT Introduction to Deep Learning | 6.S191
1:09:58
Просмотров 365 тыс.
13+ 2 серия
8:17
Просмотров 281 тыс.
Кто поёт хит Буратино🤔
0:11
Просмотров 121 тыс.
02L - Modules and architectures
1:42:27
Просмотров 22 тыс.
02 - Neural nets: rotation and squashing
1:01:54
Просмотров 30 тыс.
How Deep Neural Networks Work - Full Course for Beginners
3:50:57
Stuart Russell, "AI: What If We Succeed?" April 25, 2024
1:29:57
ChatGPT: 30 Year History | How AI Learned to Talk
26:55
13+ 2 серия
8:17
Просмотров 281 тыс.