Week 1 - Practicum: Classification, linear algebra, and visualisation

Подписаться 39 тыс.

Просмотров 60 тыс.

50% 1

Course website: bit.ly/DLSP20-web
Playlist: bit.ly/pDL-RU-vid
Speaker: Alfredo Canziani
Week 1: bit.ly/DLSP20-01
0:00:00 - Week 1 - Practicum
PRACTICUM: bit.ly/DLSP20-01-3
We discuss the motivation for applying transformations to data points visualized in space. We talk about Linear Algebra and the application of linear and non-linear transformations. We discuss the use of visualization to understand the function and effects of these transformations. We walk through examples in a Jupyter Notebook and conclude with a discussion of functions represented by Neural Networks.
0:03:53 - Problem Motivation and Linear Algebra
0:13:18 - Data Visualization - Separating Points by Color Using a Network
0:28:13 - Random Projections - Jupyter Notebook

Опубликовано:

16 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 108

@hamedgholami261 2 года назад

Hi, I am a student from a really poor country who really loves to learn about deep learning, and thanks to you it is now accessible to me. I am really grateful. thank you.

@alfcnz 2 года назад

💪🏻💪🏻💪🏻

@mohammaditani4135 4 года назад

I hope that you understand the great value you're giving! I'm truly pleased watching your videos. You are giving us exposure for a lot of cutting edge technology/information/Concepts that is not available at our universities (or at-least when i was at University). Thank you for the hard work! If I can send you a picture it would be me with a paper and a pen, taking notes and studying your material.

@alfcnz 4 года назад

Aww, that's adorable 😊 Yeah, I think I identified a gap in the current educational resources. Hopefully, I'll do justice to the task I've embarked and to the role I've taken.

@re1konn 3 года назад

So True😭

@tarinitanayamohapatra9665 4 года назад

Love it the way you explain and give hints visually. I never learned Neural networks this way ever.

@alfcnz 4 года назад

I try to share my “view”. That's how I “see” things 🧐😋

@jashdalvi7316 3 года назад

I feel this course is really great since this course is first one I have seen that binds the advanced theoretical content with practical implementation. Can't wait to get started. Thanks for the content!!

@alfcnz 3 года назад

Yeah, we tried to be comprehensive and get you started with zero DL coding knowledge. You're welcome 😉

@AmanSharma-kq4rb 3 года назад

A lot of concepts in each video. Down the study hole I go!!! By the way, like many others have mentioned before, this course is great. Giving me the exposure to the latest DL curriculum that unfortunately my university lags behind in. So on behalf of the entire DL community, thanks a lot!

@alfcnz 3 года назад

On behalf of Yann and myself, you're most welcome! 😁

@username42 3 года назад

this is the best intro i have ever heard from a teacher :D

@alfcnz 3 года назад

Yay! 😊😊😊

@JackSPk 4 года назад

Amazing material! Pretty cool and intuitive visualizations, and love your energy on class! Code "tricks" are also great! Have been tipying "jupyter notebook" for years D: , until now! :D

@alfcnz 4 года назад

Thanks 🤗

@aniketthomas6387 3 года назад

Starred the repository so you got one more star... Loved your teaching style.... Wish I had found it much sooner and yes followed on twitter as well..

@alfcnz 3 года назад

I'm glad you're enjoying it! I clearly am having fun, but it's great if you're having a good time as well!

@naimshant7129 4 года назад

You are so interesting. I like your style of teaching. Thanks

@alfcnz 4 года назад

Thank you! 😃 I try to entertain!

@st0ox 4 года назад

Oh this looks good. I am so excited. A new series :D

@alfcnz 4 года назад

Hehe 😁

@st0ox 4 года назад

I also like that you put the presentation digitally next to the presentation recording into another window.

@alfcnz 4 года назад

@@st0ox getting myself and Yann to be confined in our boxes is the most painful part. I need to click a few thousands times per video.

@sumanchaudhary8757 4 года назад

i havent wacthed it yet ,..but i already feel like this is great and fun lecture from your enthusiasm..!!! ma ma mia =D

@alfcnz 4 года назад

Hope you like it! Haha!

@indritnallbnai 4 года назад

Great course!

@alfcnz 4 года назад

Thanks!

@BiswajitGhosh-wg6qj 3 года назад

Great lecture series 👏👌

@alfcnz 3 года назад

Thank you ❤️

@Vikram-wx4hg 3 года назад

Simply super!

@alfcnz 3 года назад

😏😏😏

@MrGenbu 4 года назад

thank you

@alfcnz 4 года назад

Welcome!

@nithishkannen8083 3 года назад

Such a beautiful visual representation of what happens under the hood!!. Hats off Alfredo and Yann!

@alfcnz 3 года назад

😊😊😊

@andrewm4894 3 года назад

I appreciated the swirling graphic and went ooohhhh :)

@alfcnz 3 года назад

Yay! 🥳🥳🥳

@danieleventura2190 3 года назад

Sei un grande!

@alfcnz 3 года назад

Grazie! 😎😎😎

@hwanja5 4 года назад

I'm really happy..

@alfcnz 4 года назад

And so am I 😊

@julian78W 4 года назад

This is so cool that you published this course for free, thanks a million. Question: are the weights initialised in a particular way to to the animation of the beginning (identity)? If not, how is it that the shape of the cloud is preserved until the last layer ?

@alfcnz 3 года назад

You're welcome 😊 You need to add the minute:second of what you're referring to, otherwise I cannot understand your question.

@julian78W 3 года назад

@@alfcnz Oh yeah, I meant the animation at 15:00. If I understand correctly, what is ploted to the screen is from the two hidden nodes and with training the space wraps to make classification possible. So my question is, how do you make it so that at initialization, there is no transformation between the two input nodes and the hidden nodes. thanks :)

@atharvaingle3567 3 года назад

Thanks Alfredo for making this beautiful course publicly available!!! What a great lecture it was.. I had never seen such a beautiful visual representation of what's happening under the hood... Just a quick question, do the notes provided on the website capture the whole idea of the lecture or do I need to make my separate notes for this course.....

@alfcnz 3 года назад

Notes on the website were written by the students. Let me know if anything is missing. I'm slowly writing a textbook, though.

@MrFurano 4 года назад

Great lecture! Thank you so much! Is it possible to switch the big vs. small screens when appropriate? For example, when you write something on the whiteboard or try to explain something by gesture without the aid of animation or Twitter, make the classroom stream the big screen. Similarly, when you play the fabric animation or show the tweets, make the computer screen the big one. That would be fantastic!

@alfcnz 4 года назад

I'm no longer using the whiteboard. And yes, I'm going full screen when I deem it necessary. They took 8 and 4 hours each to produce. I think I'm on the limit of how much time I can put behind each of them. Also, the camera is recording the entire wall behind me, so the square crop is already a zoomed version of myself.

@lalitmrinki 3 года назад

eccellente, bellisimo

@alfcnz 3 года назад

Grazie 🥰🥰🥰

@ariG23498 3 года назад

"This link will show you how to move stuff around!" Thank you for this statement ^_^

@alfcnz 3 года назад

Uuuuh… without time stamp I have no idea what link you're referring to 😅😅😅

@kunalvshah 3 года назад

@@alfcnz he is talking about 7:46 - link to Grant's video on linear transformations.

@bossgd100 4 года назад

good content

@alfcnz 4 года назад

🙏🏻

@liadiavoletto 3 года назад

Quanto vorrei tornare studente e seguire il tuo corso :D Thank you for making this available for free.

@alfcnz 3 года назад

Puoi tornare a studiare quando vuoi. Il corso è qui per voi 😜

@liadiavoletto 3 года назад

@@alfcnz siii quando riesco mi ritaglio del tempo per seguirti :D

@alfcnz 3 года назад

@@liadiavoletto 🥳🥳🥳

@WilliamGacquer 3 года назад

Very good lectures ! May I suggest to the NYU technical team to work on the capture quality ? the sound is GSM like and saturated. The video resolution is very low. This would make this excellent course even better !

@alfcnz 3 года назад

Hahahahahahaha! There is no “technical team” behind this. It's all my work. Went a little crazy as well 😅😅😅

@WilliamGacquer 3 года назад

@@alfcnz I suggest renaming "NYU" to "NUY featuring A.Canziani & sponsored by A.Canziani" :) Thank you very much, this content is a gem.

@alfcnz 3 года назад

@@WilliamGacquer hahaha! It seems the entire 2021 edition is coming online as well. 😜 And it's fully remote, better quality, and redesigned and reorganised material.

@abdulbasit-te1mw 4 года назад

Hi Alfredo, Thanks alot for the wonderful lectures, I didnt learn NNs this way, its amazing (Although, It made me think that I dont know any DL :p),. Most of the book/courses I read didnt explain the concept of transformation (affine, source and target space, like whats relation of bias with rotation) . Apart from this course and its website, Can you please share any reference book/text or course which introduces in the similar way as you did (Neural networks as general nonlinear transformers and how layer corresponds to these transformations)? I would be very thankful

@alfcnz 4 года назад

I'm glad you like my lectures ❤️ It's okay, I believe I don't know much DL as well. Hmm, I haven't written a book about it just yet. This is stuff I came up mostly by my own, using some physics and intuition. I was planning on releasing a proper online course about some of the major intuitions. But again, no time and no money? Haha 😅 Maybe when I land my next job, if they pay me for this? Or I should put up a Patreon account.

@abdulbasit-te1mw 4 года назад

@@alfcnz Thanks for the reply, yes. Completely agree with time and money constraint, The type of slides and intuition you bring will definitely require both. Hope we would see something in coming future, I am putting that in my watch list :D

@naimshant7129 4 года назад

I haven't learned pytorch. Should it be a good idea going along with the course and learning pytorch? I know basic python and numpy though.

@alfcnz 4 года назад

This course *does* teach PyTorch, and it does it from scratch. You're supposed to spend a few hour per notebook covered in the videos, after you've watched it. If you have questions, post them right here. If anything is broken, you can open an issue on GitHub (I reply quite promptly), or fix it yourself and send a PR (which would be highly appreciated).

@naimshant7129 4 года назад

@@alfcnz I would love to contribute anyway. Thanks for the quick reply. It's motivating.

@dataaholic 3 года назад

I'm not able to reproduce the plot at 38:06 . I clone the Gihtub repo but my plot don't have red, Blue , green points. Can someone please help me with this !

@alfcnz 3 года назад

Yes, I haven't pushed the multi colour version. It's in my to-do list. (And it's been there for a year at least.)

@ahmadanis9930 2 года назад

How to get the animation/video shown at 14:00

@alfcnz 2 года назад

With a few lines of Matplotlib 😀😀😀

@ikejimenez3836 3 года назад

Where can I find the Random Projections notebook shown around minute 30? I couldn’t find it in the GitHub section pytorch-Deep-Learning

@ikejimenez3836 3 года назад

I guess it’s basically the same as the notebook called 02-space_streching. The code is a little different than what appears in the video but it seems to cover the same material.

@alfcnz 3 года назад

@@ikejimenez3836 yeah, I should push the newer version. I need an assistant, hahaha 😅

@NeilPathos 3 года назад

1_000 == 1000 I have been coding in python way too long to have not known that. How is that use not more common?

@alfcnz 3 года назад

Not sure. I get confused if I see too many digits 😅😅😅

@bossgd100 4 года назад

you are a funny prof

@alfcnz 4 года назад

Yay! 😋

@damnit258 3 года назад

hihihih can't see the whiteboard :'(

@alfcnz 3 года назад

This year everything is remote and I'm drawing on a iPad. I've also started using an iPad last year after noticing the unreadablility issue.

@gastonmazzei8087 3 года назад

Haha would like to be there and answer effusively each question **nerd**

@alfcnz 3 года назад

Hahaha! I had someone answering every question last year (Spring 2019) and I had to tell him “yes, I know you know the answer, just let others have fun too, okay?” hahaha! Answering my question because you're following is one thing, answering my questions because you already knew the answer is showing off 😛 Which one is you? 😏😏😏

@gastonmazzei8087 3 года назад

Hahaha 😂 in this case just a vigorous follower😊, but what you told the guy in 2019, ie “...just let others have fun too”, reminded me of how I *sometimes* did not share cookies in kindergarten (oops), so I guess I’m a LINEAL COMBINATION of both 🤣 🍪😋

@alfcnz 3 года назад

@@gastonmazzei8087 🤣🤣🤣

@adsick_ua Год назад

audio is bad

@alfcnz Год назад

Watch the new edition? 🤷🏼‍♂️🤷🏼‍♂️🤷🏼‍♂️

@rahuldeora5815 4 года назад

Why do you'll smart people keep giving lectures on basic material that we can already find so many tutorials on the web? Why don't you'll prepare accessible material for robust deep learning, adversarial training, bayesian deep learning, uncertainty estimation ...... such topics that actually require your expertise. We don't need PhDs and profs to tell us about how to use pytorch tensors.

@alfcnz 4 года назад

Don't get me started about what is the average quality of entry level tutorials on the web. Moreover, this is the first out of 14 (?) lectures I teach my students and spent my weekends editing. Anyhow, you're free to hire me for teaching what you may need.

@rahuldeora5815 4 года назад

@@alfcnz I'm just saying I would like more advanced content from the few people who know and are willing to teach it well. How can I hire you? Is it on a per hour basis or what are the details here?

@st0ox 4 года назад

Because his way to explain it is so good ^^

@alfcnz 4 года назад

@@rahuldeora5815 I was being partially sarcastic. I teach what my students need to learn. Yann and myself spent quite some time planning the course in advance. Therefore, there's a reason behind the choice of content we showcase. I'm working on a new course with other faculty members for the next semester, but I'm only human. So, give me some time. Finally, yes, I teach individuals too (from middle school to my PhD students) with a tailored program and set of notions.