Neural Networks from Scratch - P.3 The Dot Product

Подписаться 1,3 млн

Просмотров 335 тыс.

50% 1

Neural Networks from Scratch book: nnfs.io
NNFSiX Github: github.com/Sentdex/NNfSiX
Playlist for this series: • Neural Networks from S...
Neural Networks IN Scratch (the programming language): • Neural Networks in Scr...
Python 3 basics: pythonprogramming.net/introdu...
Intermediate Python (w/ OOP): pythonprogramming.net/introdu...
Mug link for fellow mug aficionados: amzn.to/3cKEokU
Channel membership: / @sentdex
Discord: / discord
Support the content: pythonprogramming.net/support...
Twitter: / sentdex
Instagram: / sentdex
Facebook: / pythonprogramming.net
Twitch: / sentdex
#nnfs #python #neuralnetworks

Опубликовано:

8 июн 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 917

@clementsiow176 4 года назад

When I search how to do machine learning from scratch: The videos: So you first do import tensor flow Me: closes video Me finds you tutorial series: I like this one

@farenhite4329 3 года назад

This is my main problem with virtually every ML tutorial on RU-vid that is not a basic introduction. They don’t explain how it works, they just tell you to import a library.

@clementsiow176 3 года назад

@@farenhite4329 yep exactly

@georgemunyoro 3 года назад

@@farenhite4329 Its because they themselves dont understand how it works

@zendr0 2 года назад

yes..so true. Now a days u will find tons of tutorials about DL and ML and all of them focuses on the importing and application of diff frameworks and libraries, rather than proper deep level intuitions.

@yoghurtgrinch1040 4 года назад

The animations are so helpful!

@sentdex 4 года назад

Glad you like em!

@Kawabolole 4 года назад

@@sentdex I was thinking the same thing, also they look pretty cool! What tool are you using to do them ? I have a friend who is a physics teacher and might be interested in that :) (edit) Maaaan every time I ask a question i have to remove it because you answer it later in the vid or in the next one, awesome ^_^

@ulissemini5492 3 года назад

@@Kawabolole he is using maim by 3b1b

@elimiNator345 3 года назад

This comment are so not helpful

@muhammadiqbalbazmi9275 3 года назад

@@sentdex How do you do this?

@samgdotson 4 года назад

The moment you mentioned the "shape" problem you became the MVP of youtube machine learning. You clearly remember what it was like to be a first time learner and it shows in your communication style, well done.

@trophieboi1820 4 года назад

i knew u would upload in 7 days. I kinda counted days left like a child.

@sentdex 4 года назад

We tried so hard to upload faster. Still trying xD

@IsfhanAhmed 4 года назад

@@sentdex i think its good so we can feel the value

@adjbutler 4 года назад

i second this. my only complaint is that these videos are comming out too slowly. pls help us!

@mab3431 4 года назад

@@sentdex 4 days break will be good for a video.

@leeschmalz6365 4 года назад

@@adjbutler I like the post rate right now. Really lets you mull over the new information, which will be especially helpful when we get to the more complicated parts of nn's. Especially considering Harrison is writing his book alongside making this, it's a great amount of content and builds anticipation for each release (something that lacks when I go back through his old playlists and binge them all at once) :D

@jacobroling2287 4 года назад

Please don't abandon this series! RU-vid is begging for a tutorial this clear and concise about neural networks! Thankyou!

@sentdex 4 года назад

Wouldnt think of it!

@aaaa1111muffin 11 месяцев назад

@@sentdex pls pls pls finish it

@slyperior8716 10 месяцев назад

@@sentdex you will make great contributions to society if you continue this series

@m1520n 9 месяцев назад

@@sentdex are you planning to add new episodes? 🙏

@Cecil_Augus 8 месяцев назад

@@sentdex you not only thought of it, you made it :'(

@jbelisario001 4 года назад

I, along with every other viewer following along with this series, want to thank you for making this series. Such a painless way to learn an intricate and exciting topic. The visuals are a great bonus.

@sentdex 4 года назад

My pleasure!

@reallyunsocial Год назад

Anyone who stumbled upon these lectures in 2023?

@MultiWarrr 5 месяцев назад

Entered the black hole of trying to do this in a programming language other than python.

@techdiyer5290 5 месяцев назад

Im in 2024 actuallly

@BetaTester704 4 месяца назад

Just found it myself

@toneking972 4 года назад

Sentdex drops a new vid. “Wife grab the kids I have a work emergency”

@parasjain3211 4 года назад

Never been so excited after seeing a RU-vid notification! P3 nnfs, BOOM!

@nihaldemast 4 года назад

Been there ! Done that ;)

@DiegoMarquesTV 3 года назад

Man, the animations are in my opinion fundamental for the full understanding of the content. Huge thanks to Daniel who's done them.

@TheCianJoseph 3 года назад

Dude this is legit one of the most helpful and intuitive coding tutorials I've ever seen! Some tutorials are really hard to watch but yours is very comprehensive thanks for that I appreciate it.

@DoomSkullYT 4 года назад

This is possibly one of the few times I'm glad I took further maths in sixth form, because without going to uni I have covered and understood matrices and vectors in 3D

@arturasdruteika2628 4 года назад

I wish game of thrones seasons 7 and especially 8 were as good as this tutorial

@detskysade2581 4 года назад

Watching this tutorial at the same time as I go through your pytorch tutorial. My head blows up of all the new things

@sentdex 4 года назад

Hah, good luck sir :D

@blackburn116 4 года назад

Never been so exited for a video to come out on RU-vid.

@firdovsihasanzada 2 года назад

So far these are the best video series about Neural Network. The great thing about these videos is that each time you do the same task but with a different and advanced code. For me it's the best way of teaching and I really enjoy watching your videos. Thanks!

@lahirulowe4752 4 года назад

Almost a 1000 views in 30 minutes, shows how much we love this🔥❤️

@gustavodemendoncafreire4005 4 года назад

*The answer is of course to use loops* Laughs in functional programming

@Zerksis79 3 года назад

This series has been amazing. Also, being a highly visual learner ... the animations really take things to the next level for me! Thank you both!

@illyshaieb 4 года назад

Never have I wanted the next episode more in a series. Thank you for these videos.

@iAmTheSquidThing 4 года назад

This might just confuse some people, but it helped me: The bias is essentially just another weight, for an imaginary input whose value is always 1.0

@MegaGutemusik 2 года назад

well in my mind 1.0 represents something in its full form where any 0.x number would be something partial. so 1.0 is like saying its a full neuron. bit i have no idea what i am talking haha

@Ruhrpottpatriot 2 года назад

@@MegaGutemusik The input is always 1 for the bias because 1 is the neutral element of multiplication. This means that you can put the bias into the weights array (usually at index 0) and therefore learn the bias alongside the weights.

@FPChris 2 года назад

The animation at the end is most helpful

@Zack_MD 4 года назад

21:00 - 22:00 the best minute I've watched on youtube since long time ago

@gregggo 2 года назад

The best neural network guides ever! Thank you! I always look at some videos and people are just so ignorant to explaining some 'basic' (as they think) stuff that may seem obvious to them... but if someone is starting from the scratch it is super helpful and saves TONS of time that would have to be spend to research all of it on a side. Again thanks, you're awesome

@christopherberg4778 4 года назад

I'm not normally a fan of animations, but yours are clean and not too colorful, it makes it very helpful to digest the concepts that you're explaining.

@JoeLopezNJ 4 года назад

How is anyone down voting these? These are fantastic and animations are so incredibly helpful.

@anonymouspyro2820 4 года назад

These are purely my understanding of weights and biases.... For Example, y = x1 * w1 + x2 * w2 + b x1, x2 => Inputs w1, w2 => Weights b => Biases w1 => Denotes the contribution of x1 to the output w2 => Denotes the contribution of x2 to the output b => Acts as an offset... This is just a Linear Equation, when activation functions are applied => Non Linearity is introduced Why we apply activation functions, Every data can't be just explained by a Linear equation, so we apply activation functions to make them non linear.

@taran7954 4 года назад

Dumb question what does non linearity mean

@sidesplitter9497 4 года назад

@@taran7954 something that can't be fit by a straight line

@puppergump4117 2 года назад

@@taran7954 non (not) linear (line) means it's not a line

@DMBalchemy 4 года назад

Super excited about these videos. You're excellent at explaining things, and I'm happy to preorder the book to support you creating these tutorials! Keep at it, we're all learning leaps and bounds because of you.

@sentdex 4 года назад

Thank you for the support!

@samkhanjar8486 Месяц назад

I have that much joy for a while learning something with that much CLARITY on RU-vid! thank you so much for all the efforts you guys have put in to this, its awsome!

@zog8482 4 года назад

this has been really helpful so far but i really need to wait until the series is done because i forget everything in-between episodes

@99Shahab 4 года назад

Man I just want to watch all the videos since i have so much free time during quarantine. Might have to go to the book

@sentdex 4 года назад

Wish we could make these videos faster, doing our best :D... but yes, book should keep you busy for a while!

@paltakis 3 года назад

Incredibly clear, amazing teacher, when you can simplify to that level means you have true mastery of your material, thank you!

@KanagawaMarcos 4 года назад

Those animation are being freaking awesome and truly helping me to understand what's happening in the code.

@MrDrjaay 4 года назад

these animations are awesome ive been thinking that the whole time.

4 года назад

Thank you

@kl11414 4 года назад

@ they are very helpful to visualize the concept. Keep it up. Kudos to both of you.

@mrahman09 4 года назад

@ what kind of software do you use for animation?

@coding1016 4 года назад

Will you implement some sort of autograd later on in the series? Loving the videos btw

@ulissemini5492 4 года назад

what you're making here will be the definitive ML from scratch guide in a few years, calling it now

@anirbansarkar6306 2 года назад

The way you highlighted the bias, weight and activation function through animation is just extraordinary, kind of enlightenment. Thank you so much. It was deeply helpful

@rokassl7024 4 года назад

video_value = True while (video_value): print("Finally! I bought the book also!")

@lajosfidy3785 Год назад

I think its worth mentioning how the calculus behind dot product works. If you have 2 matrices (in the shapes: n*p, p*m), then the resulting matrix will be the shape of n*m after the dot product (see how p = p), and the number of "columns" of the first matrix has be equal to the number of "rows" of the second matrix.

@alexandrelaine_ Год назад

Exactly what I was going to say

@luandasilva4639 Год назад

except that's not really calc lmfaoo but elementary linear algebra

@barbabillios6180 4 года назад

I am so hyped for the series. Indeed the animations are very helpful for understanding the concepts. Looking forward to watching the sexy part!

@sourabha05as73 4 года назад

Great work man! Seriously, became a huge fan of your work, your way of making things understandable is one which is the most admirable...ev'rything just gets clearer if one has the understanding of basic mathematics...and if not, that's what you're there for...you videos really are a treat👏.

@TrackLab 4 года назад

I would very much love the physical book, sadly my money situation is pretty much nothing at the moment, so I can't buy it...but even if I finish this series before buying the book, I still plan to purchase it at some point.

@sentdex 4 года назад

Hope your situation improves!

@mohuasikder1971 4 года назад

@@sentdex please share the link to the book

@industrialdonut7681 4 года назад

I've never heard that a "list of lists" is a "lol" before, lol!

@cristianpal93 3 года назад

Finally somebody is starting explaining how NN work so anybody can understand and start building there own Ai thank you very much! You are a good teacher!

@josephkarianjahi1467 2 года назад

You deserve a medal for the best complex-topic-synthesizer. You don't even have to be a high school graduate to grasp the content in these initial 3 videos so far. Kudos bro

@jessehe9286 4 года назад

I'm a bit confused -- here, weights is a 3x4 matrix, and inputs is a 1x4 matrix. Strictly speaking, wouldn't the dot product only work if inputs is an n-by-m matrix (4x1 in this case), where m is the number of samples, as opposed to what's shown here? Looks like NumPy is smart enough to perform the dot product to a rank 1 vector even when the shape mismatches.

@sentdex 4 года назад

Your confusion starts @ shape. First, the input shape is not 1x4, it's of shape (4,). Also, it's not a matrix. I think you might want to watch that shape section again. Also, you can always confirm shapes in numpy. You might want to tinker about until you feel solid at knowing something's shape. For example: >>> import numpy as np >>> x = np.array([1,2,3,4]) >>> x array([1, 2, 3, 4]) >>> x.shape (4,) >>> y = np.array([[1,2,3,4],[5,6,7,8]]) >>> y.shape (2, 4) >>>

@jessehe9286 4 года назад

@@sentdex Your explanation makes perfect sense!! The example really helps clarify. Thanks!

@mohitjain4943 4 года назад

I have the Same Question

@kevinvaishnav1672 4 года назад

Weights is (3, 4) and inputs is (4, ), so the product becomes (3, ).Hope it helps!

@theip7556 4 года назад

In numpy when you say a vector it by default takes column vector.So input vector shape is (4,1) as per numpy even we have declared it as a row vector whose shape is (1,4).

@benasin1724 4 года назад

The moment I have been waiting for: "Watching sentdex's latest video" .

@ryanvaught7612 4 года назад

the way you break things down is super useful, i cant retain info if i have to many questions about it, my brain just locks up so all the high level explanation videos of neural networks just got me excited but didn't teach me at all. your clear enough you could just call this series, The Understanding the "Understanding Neural Networks" Videos Series!

@sadhananarayanan1031 Год назад

The best videos on neural networks in youtube. Simple explanation and super easy to grasp. 'Enlightenment' is the word after watching this. Thank you so very much :)

@shrideepgaddad8721 4 года назад

smh, there is no spot for assembly in the github

@sentdex 4 года назад

Sounds like you need to make the assembly version! I'll wait for your PR :)

@shrideepgaddad8721 4 года назад

@@sentdex Lol, I would if I knew enough assembly. I'll stick to contributing in Kotlin for now. P.S: Jeez your fast at merging pull requests, I assumed it would take like a day cause you would be busy.

@shrideepgaddad8721 4 года назад

And just like that someone made a PR for assembly

@irgendeintypeiminternet781 3 года назад

to who ever wrote it in assembly on github: why, why you do dis to yourself?

@mrfrozen97-despicable 3 года назад

Xdxdxd ......

@ahmadtarawneh2990 4 года назад

I do not know why would anyone dislike this very nice video, The animation is very nice and makes the explanation clearer. Thank you so much

@tptshepo 4 года назад

Love the teaching approach with animations. I have been learning the same subject from different sources and your approach just made some concepts I was struggling with a lot clearer.

@hectorpereira2803 4 года назад

you are called "semtex" for me and i refuse to properly read your name ever again

@brunobmartim Год назад

By far one of the best videos that I have seen in ML. THANK YOU VERY MUCH.

@bradley1995 11 месяцев назад

I seriously cannot thank you enough. I'm a java programmer but you have made this so simple to understand I'm able to implement it and I'm not getting lost. Hats off to you good sir... thank you for these videos!! You are truly doing a great Public service!

@nabil.hamawi 4 года назад

You and Danial are the best, you are just putting the learning data inside my head omg

@RA-pi1lg 4 года назад

I am taking a machine learning class and my instructor didn't explain it the way you do and this course is what i want. Thank you for strengthening my weakness, i'll buy your E-book next week!!

@biuku 3 года назад

These videos are incredible. Working through Andrew Ng's older intro to ML Course, but in Python not Octave. Not much background in linear algebra, but stronger in Python. Building from the ground up -- learning math by coding -- this is the best way to learn.

@E_rich 2 года назад

Dude this series just makes me so happy. Thanks.

@kinwong6383 4 года назад

Have been visiting your channel every day since Part 2, was not disappointed today haha Thanks sentdex!

@sentdex 4 года назад

Glad you enjoy it!

@tobystupp2976 3 года назад

Love your videos. Find them really helpful and love the way you've divided each part into a digestible parts. Really enjoying them and will definitely share them, just as my son-in-law shared this one with me

@pavan64pavan 2 года назад

Awesome work on the Animations Daniel. Harrison, you got heart man. The way you explain by taking so much of time ensuring that every little things are conveyed, simply amazing. Respect and ton of Thanks with all my heart.

@CarlosRodriguez-fr7ro 4 года назад

Sentdex, you are awesome. I love this tutorials and im saving money to buy your book. I never tought that i could learn AI for myself but now im in love with this part of the programing world

@batumanav 10 месяцев назад

As someone with a non-engineering background, i can't decribe how i am enlightened from your videos. Thank you and please keep doing what you are doing!

@AnimeZone247 8 месяцев назад

you dont need an engineering background for this lol

@Cameron_Grey 4 года назад

These videos are so clear and easy to understand it's crazy. My CS professors should aspire to be this good at explaining things.

@BiranchiNarayanNayak 4 года назад

Excellent. Crystal clear explanation of Neural networks. Thanks

@vladi1475S 2 года назад

Best tutorials ever! Step by step explained and it is so clear! Thank you!

@abhrantapanigrahi3475 4 года назад

This series is lovely!! It feels so good to actually understand the basic mathematics along with some practical programming. There are so may other resources that either focus completely on the mathematics part (which after a certain point start to feel like jargon) or others that just focus of using the libraries like pytorch (which begin to feel like copying and pasting after a certain point). Thanks for doing this dude!

@sentdex 4 года назад

Glad to hear you like the style!

@taralsarvagod9099 4 года назад

Recently subscribed to 3b1b and you. Glad to see you appreciating each others work and its feeling proud to learn from amazing teachers like you.

@niepodam4847 4 года назад

I really appriciate you explaining the math behind this. I like to deeply understand what I do and why it works. Thank you for the video :D

@prettiestthing 3 года назад

This are the best series EVER, keep them coming please 👩‍💻🤓💪!!!!

@RaviKiran-qd1cl 4 года назад

Many thanks for the videos. You are the best tutor that I have come across for deep learning. The animations help us understand the concept even better. Looking forward for your upcoming videos.

@GabrielIchiro 4 года назад

I LOVE this series, This helps me hate college maths a little less

@michaelcarnevale5620 10 месяцев назад

i can't praise you enough, your visuals are great

@henryhsueh3553 4 года назад

The animation really helps with learning the concepts!

@carteri246 4 года назад

Been waiting for this all week. Thanks!

@talal90876 4 года назад

The animations are just perfect love the videos

@photorealm Год назад

You are helping a ton of people (like me) who can write working code but don't quite understand the granular workings. I will buy gladly your book to glean some more details. Thank you for sharing this amigo.🙂

@Sich97 4 года назад

The animations are really helpful! And this is some great educational stuff. Really appreciate it!

@tomkimdotnet650 4 года назад

This is the best series I've seen on this topic, thank you

@Levinsam 2 года назад

Thank you very much! Great visuals, especially the ReLU!

@julianodbz 4 года назад

I already know NN as I work with it every day, but it's awesome to see different aprouchs, loving the animations, loving the serie. Keep it coming man👌

@sentdex 4 года назад

Glad you like them!

@veronicanwabufo5905 3 года назад

Thanks for this. Your videos are really easy to follow. Thank you again.

@bnkiBirbz 4 года назад

Dude! Thank you so much for these videos. I have had such a hard time self learning machine learning and neural networks. I learn by seeing it applied. Thanks!

@Motivation-Discipline985 2 года назад

LOVE THIS it really taught me about python and ML I didnt know a lot about inputs and outputs until i watched these videos thx bro

@arnob2712 4 года назад

Was eagerly waiting for this video. I checked my RU-vid so many times since past 2 days.

@busek.1063 Год назад

Finally, I started to understand what is neural networkss!!!!!Thank you for the videos

@tanim980 11 месяцев назад

your animation ,explanation are best man!,thanks a lot for such content

@rohithsai7632 3 года назад

The animations are so helpful! Its really nice danial

@westonkomar3767 3 года назад

These videos are really helping me out with my understanding. Thank you

@FajriSiddiq 4 года назад

definitily the best neural network tutorial!

@winnumber101 4 года назад

One of the most direct explanations I've ever seen... before this, the whole time I was thinking this may be too esoteric of a predictive tool for me to learn well, wow

@attentiondeficitdisorder 4 года назад

That feeling when you actually understand this. Thanks for breaking this down so well.

@ssasdaftt3 4 года назад

The animation really clear concept especially of weight and biases! Thank You.

@koen5757 4 года назад

These tutorials actually help understand the need for math more because i hated it in highschool. But now that i can see how it is applied i understand how and why to use it which makes it so much more intresting to learn. Thanks a lot for these videos!

@claudieleung8815 Год назад

Dear Sentdex, You are prominent. You made us everything clear now. Thanks so so so so so much 💯👍👍👍👍👏👏👏👏

@MrGreen-bw7fs Год назад

Thankyou 3Blue1Brown and Daniel and especially to you sentdex. Really apreciatte work you are putting here!!!

@cassolmedia 4 года назад

Thanks so much for these series! I had so much trouble jumping into neural networks without understanding everything happening "under the hood" so to speak. I just always felt like I was just assembling one of those pre-designed lego sets without understanding the thought behind it.