Neural Networks from Scratch - P.2 Coding a Layer

Подписаться 1,4 млн

Просмотров 417 тыс.

50% 1

Expanding from a single neuron with 3 inputs to a layer of neurons with 4 inputs.
Neural Networks from Scratch book: nnfs.io
Playlist for this series: • Neural Networks from S...
Python 3 basics: pythonprogramming.net/introdu...
Intermediate Python (w/ OOP): pythonprogramming.net/introdu...
Mug link for fellow mug aficionados: amzn.to/2Vz9Hs0
Channel membership: / @sentdex
Discord: / discord
Support the content: pythonprogramming.net/support...
Twitter: / sentdex
Instagram: / sentdex
Facebook: / pythonprogramming.net
Twitch: / sentdex
#nnfs #python #neuralnetworks

Опубликовано:

16 апр 2020

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 773

@mankaransingh2599 4 года назад

Other People: Some Netflix Series Me: SENTDEX TUTORIAL SERIES !!

@SanataniAryavrat 4 года назад

hahaha... yeah, you're right!

@milanpandey8431 4 года назад

Nailed it!

@StarkPlayz 4 года назад

damn right!!

@USAIsrUKEUVngrdBLRckOccupiedUA 4 года назад

Very true! :))))))

@oludhe7 4 года назад

This would be funny if it wasn't true

@robertschumann6977 4 года назад

Again, I just want to thank you for this great series, especially those animations are amazing. Providing free education on such a high level is something what people nowadays more and more forget to value...

@sentdex 4 года назад

You're very welcome!

@danielstatler954 Год назад

Imagine people 400 years ago. This level of knowledge would only be available to the lord's and anyone who knows it would price it so high

@Joe_Zajac Год назад

Still extremely helpful 3 years later!

@meunomejaestavaemuso 4 года назад

I tried coding a NN from scratch a few years ago, feed-foward is pretty easy, the tricky bit is back-propagation, looking forward to that.

@zahhym 3 года назад

I know its a nightmare

@Foodius 3 года назад

@@zahhym If you haven't watched it yet, you might want to look at 3blue1brown's series on neural networks. It's relatively math heavy but it really helped me to understand backpropagation more intuitively

@zahhym 3 года назад

@@Foodius I have. Its now just less of a nightmare :)

@vaibhavkhobragade9773 2 года назад

@@zahhym I can't disagree.

@Jordan.... Год назад

Keep looking forward then.

@ahmadayazamin3313 4 года назад

"Neural Networks from Scratch" I expected a tutorial on building neural networks using x86 assembly...

@sevret313 4 года назад

It could be worse, it could be NN with Scratch.

@mobob7989 4 года назад

Red literal opposite level of abstraction haha

@ahbarahad3203 4 года назад

TFW Ben Eater posts a video

@tornadospin9 4 года назад

sentdex is so skilled at teaching that I bet he could make a course on that and it would be super easy to follow along

@whoisabishag3433 4 года назад

@@sevret313 ... ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-eJ1HdTZAcn4.html

@danielai7138 4 года назад

The way you explain plus the animations from manim makes it so pleasant to watch. Thanks for this awesome content, this is what we all have been waiting for.

@SanataniAryavrat 4 года назад

Agree... animation made the whole video more interesting and engaging one...

@godbennett 4 года назад

Truly godly, using 313b's manim tool :)

@godbennett 4 года назад

I also wrote a free neural network book, based on 313b's neural network series: www.researchgate.net/publication/321162382_Artificial_Neural_Nets_For_Kids I ended up making a nice large backprop slice image in paint, so I didn't end up using manim :) imgur.com/NjT9EDt

@jordivilahdl 4 года назад

Which tool can I use to generate similar animations?

@userre85 4 года назад

Manim

@adrianwuthrich982 4 года назад

This is the first time I activated notifications for a channel

@muhammadharis7581 4 года назад

same here

@JoeElliotSA 4 года назад

This is the course I have been waiting for. I have tried a few courses and learned so much BUT never fully understood what exactly I was doing 🤣. I always wanted to know what was behind the deep learning algorithms. Many thanks for this series of videos. 👍

@sentdex 4 года назад

Happy to make em!

@ekremdincel1505 4 года назад

@@sentdex Hi Sentdex! Please upload those videos fast :) I cant wait.

4 года назад

How did you put the python logo in your name lol

@AdityaPratapSingh-ss8wg 4 года назад

@ thats because he has join this sentdex channel...

@SanataniAryavrat 4 года назад

agree 100% ... he SentDex bro, looking forward to next video soon....

@parsafakhar 4 года назад

i'm so exited about this series, god knows how many years i wanted something like this, thx sentdex i really appreciate it

@sentdex 4 года назад

Happy to do it!

@astrolearnings2030 3 года назад

I am used to guys not knowing what they are blabbering about but I can understand the concepts you are talking about quite clearly so thanks for that Mann pure gold content.

@charimuvilla8693 4 года назад

Can't wait for the backprop part. Other youtubers confused me but I'm sure you will help me undrestand everything as always hehe

@italiandarthvader 11 месяцев назад

I have been searching for countless videos on RU-vid to start with deep learning and this is the first one I found where it is explained in a way I can understand. I'm two videos in but I just want to say you made me fall in love with deep learning. Thank you!

@johna30 2 года назад

I'm loving these videos! Cutting away to the smooth flow animations/diagrams is very helpful in understanding what's going on. Thank you!

@PatrickHoodDaniel 2 года назад

Your scaffolding approach to this topic is great. Thank you for making this series.

@danieloliveira9815 3 года назад

It is just incredible the amount of effort that he puts in these videos, omg, thank you soooo much for making such a quality content available for free. You are really making the difference, man

@dippy9119 3 года назад

Just dropping a comment to show my appreciation for this video series. You have a real gift for teaching. This is by miles the clearest explanation I have found on how to build an artificial neural network. Am definitely interested in the book now.

@khmsalhuas1 4 года назад

I am looking forward to finally really grasping the science behind deep learning. In the past, I just used libraries without understanding much. Great Series so far. Waiting for part 3.

@sentdex 4 года назад

Working on P3 as we speak!

@leonlysak4927 3 года назад

Dude the ability you have for breaking down the complex into simple is nothing short of amazing.

@vinamrakhoria1330 4 года назад

omg i have been waiting for part 2 ever since part 1 came out thank you so much for this much needed playlist sentdex :)

@sentdex 4 года назад

You're welcome!

@tranbao2799 4 года назад

Looking at the animation for each line, I know how much dedication this guy has on this topic. Respect ✊

@BizzNitzz 2 года назад

Love how easy to make this! After years of trying to learn this and taking a break then coming back I find it easier to learn thanks to you!

@RoboEvercool 4 года назад

This is such an amazing thing that you and Daniel are doing. I especially love that you make the draft available to the community to make inputs and ultimately improve the overall final product! Such an awesome idea.

@sentdex 4 года назад

Glad you enjoy it!

@soldour7597 3 года назад

no one would believe if I say neural network could be explained in such way...but there you go putting it out! stay cool :)

@KingDuken 4 года назад

Thank you making this super easy. This quite literally the best explanation I’ve ever seen. I have absolutely zero knowledge of how code a neural network before this point. Looking forward to getting into more in the series.

@Random-my5rv 4 года назад

Nothing but love for this guy! The tutorials we've all been waiting for!

@anshmishra143 4 года назад

This is a fantastic series. Great explanation and animations. Looking forward to release of further parts. Thanks a ton for such a great set of videos.

@dumbtex6107 4 года назад

your stuff is just so clear and concise i've done the whole keras tensorflow combo and theres just a huge gap in understanding behind this stuff and this dead basics stuff is just the perfect way to represent what's happening great stuff dood

@zakariaabdisalam1728 4 года назад

sentdex, there are many tutorials online on neural networks, and I swear I had the same problem which was to hardcode the process and visualize the process from neuron to neuron and from layer to layer. Non of the NN tuts that I've watched went over this. However, you started to make an amazing tut with detail visualization and hardcoded NN process, basically you filled up all the gaps for learning. And you definitely deserve more than me joining the membership. Love you So much continue doing your amazing tuts. Looking forward to buying your book. ❤❤❤❤

@navis_6383 2 года назад

This series is like premium quality.... It goes even further than paid ones.. You have my respect sir for making it free for us... I am just new to Neural network.. And I am so glad I found your video... A sub from me

@subhrangshuadhikary6115 4 года назад

Really appreciate your work. Please finish the series soon. Can't wait to learn all these soon.

@sam_sam_sam 4 года назад

I've tried other neural net and machine learning videos and pretty much all of them dive into a library and gloss over what the library is actually doing in the background. Thanks so much for explaining in this detail

@fernandomaluenda4226 3 года назад

Pretty incredible how simple you can make it. Thank you so much!

@snharish5981 4 года назад

Yeaaaa I've been waiting for this

@insected83 3 года назад

one of the best resources I've encountered for this subject. I have no computer science background and work in vfx. I am teaching myself python and machine learning to complement my market/equities trading and have been diving deep into this new path. This series (and channel) has really empowered my learning but more importantly my motivation and mindset. Instead of feeling overwhelmed I feel excited to keep learning. Thankyou sendtex, you are changing lives :)

@LunarMtnStudios 4 года назад

You're very inspiring! I just bought the book and I'm excited to get into it. I'm a beginner python programmer but I've spent a lot of hours watching your tutorials. Maybe one day I"ll get to work with you!

@alejandroalejandre3512 3 года назад

Yo. Your tutorials are legit man. Very easy to understand and you explain complex processes clearly

@mattymallz4207 4 года назад

Thanks for the best tutorial out there right now! Keep up the great work. The credits too, i loved it.

@sentdex 4 года назад

Thanks, will do!

@adenzu 4 года назад

The animation is flawless really makes it easy to track and understand the process

@farhadnasiri3329 Год назад

Your teaching style is so understandable and straight forward... I hope you continue to do so

@spencerpalladino2604 3 года назад

I am really loving this series. I feel like I am learning alot coding along with you.

@gokulrejithkumar9612 4 года назад

So far so good, I just hope you keep it this simple in the upcoming videos!

@thecathode 3 года назад

This is brilliant, the animations are awesome. I wish I had this when I studied neural networks back in 1993; at the time I quit and chose another very interesting topic (digital filters) and never finished my backpropagation implementation in C++ which I found the other day in a diskette., which I think will be fun to revisit.

@santanumahata3956 3 года назад

Such an awesome teacher who always thinks about the students getting the idea. Thanks a lot, sir.

@codetastic4749 Год назад

i have been trying to find a tutorial that actually teaches and doesnt just say DO THIS. this is really helpful. I actually understand this a bit better. thank you.

@bejgaonnischit9718 4 года назад

I am totally looking forward to this series

@NeuralxAi 4 года назад

This Series will be the best one eveeeer Created In Neural Network World !!! Love it man ❤😍

@shambhaviaggarwal9977 4 года назад

I had just started learning neural networks and watched first episode of this series few hours ago and i wished god that i want to see more of this. And MIRACLE happened!!

@luxaslolete 10 месяцев назад

Amazing editing! You can tell theres a lot detail and attention put into the animations, cheers.

@lucasfernando4655 2 года назад

The way you teach is so simple. Thank you so much!

@TrevorTheITGuy 4 года назад

cant wait for the book!!! so many projects that ill be able to custom build the nn for

@karimloberg6876 3 года назад

I am so eager to learn as fast as possible so I can understand everything that is being taught on this channel. Really nice content and personality.

@oludhe7 4 года назад

This is the best thing about quarantine. These videos can't come out fast enough!

@alishaik6029 Месяц назад

What a great explanation man, really appreciate the edit and teaching. Thanks for teaching this much clearly.

@jurkokubik6383 4 года назад

This is awesome, so thank you for making this series! It’s super easy to understand. I’m really hoping that you continue make more and as much as you can. Honestly it would be super cool if you cool make these more often.

@sentdex 4 года назад

If they could be made any faster, I would :P They take a very long time to make.

@jurkokubik6383 4 года назад

sentdex well then I will just thank you for putting so much work into these and for being a good teacher.

@8o8inSquares 4 года назад

Couldn't be more clear. Well done! TO THE NEXT ONE!

@craigrichards5472 10 месяцев назад

Great work mate, can't wait to get the book.

@re.liable 3 года назад

I really love those animations you do in the code.

@Tiashe0 4 года назад

You explain this so fluently that its really easy to follow through. cant wait for the next one. Also i preordered the book.

@sentdex 4 года назад

Awesome! thank you for your support!

@ginxiankok5045 4 года назад

This is how I tried to code a NN about maybe 11 years ago, lol. Great stuffs.

@haktwld 3 года назад

This is the most digestible beginning to networks. Thanks!

@clementsiow176 4 года назад

I watched the 1 ep and now I am so excited for the whole series

@kasiditauable 3 года назад

This is the best tutorial for implementing neural networks using python. I should've found this before going for master in data science.

@junealexissantos4341 3 года назад

This is the best tutorial ive watched so far. Thank you for this. This is very helpful to me who doesnt have any knowledge in coding and data science.

@sentdex 3 года назад

Glad it was helpful!

@ulissemini5492 4 года назад

the animations are on point! I was able to figure out the why there are N weights and 1 bias per neruon by slowing down the nerual network animation from last video, I'm so glad you addressed it for the people unable to figure it out, i'm sure you saved many other people a few hours of confusion :D

@sentdex 4 года назад

Glad I could help!

@David-xy4nw 4 года назад

you are the definition of a legend

@lerneninverschiedenenforme7513 2 года назад

I want more commercials on youtube like this! After watching, I have a strong voice in my head that tells me to buy the book... and that was even before 13:53; Just because you mentioned "as in the book" in the beginning of the video. In short: I really like that you go so slow on these basics, that other people / tutorials fail to explain properly! Also, I really liked, that you did not use a loop! All credits for that!

@maxxxy910 4 года назад

Really loving this series!Thanks a load :)

@sentdex 4 года назад

Glad you enjoy it!

@LuxurioMusic 4 года назад

Honestly, I've not been able to get far with learning python, in fact I'd given up many months ago. However these two videos have helped incredibly, the clarity in the way you teach in amazing.

4 года назад

Dude please keep making these video series and i promise you you'll always have my like and fav

@sentdex 4 года назад

I will keep going!

@CircuitroniX 4 года назад

Yes... Most awaited 🔥🔥

@jaken82 2 года назад

Amazing tutorial very easy to follow. Essential for anyone into ANNs.

@blackburn116 4 года назад

I love you sentdex! I've learn so much with your videos. Thank you so much for keeping up your awesome work!

@sentdex 4 года назад

Happy to do it!

@jeanjohnson9737 4 года назад

Nice content :) very much excited for this series.

@kubo-svk790 4 года назад

Can't wait for book to arrive 😄 Keep up the good work. You are MVP for many university students and hobiests 😄

@egorkostan2060 4 года назад

Finally starting to understand something. Please Keep going. Thanks you for your effort.

@John-xi2im 2 месяца назад

very awesome tutorial! explanation using both code and diagrams is the best part !

@He_Who_Could_be_Drunk 2 года назад

Thanks for this great tutorial. I've been trying to get started with neural networks and attempting to understand them. I've been following along in C++ but this has been a really great reference for this. Thanks again!!

@umersaeed809 4 года назад

I was waiting for this. Best thing that can happen during quarantine .

@Hoglah1 3 года назад

wowzer!!! to think i dont understand programming yet but i understand everything you explained. thanks

@Lleanlleawrg 4 года назад

Thanks for doing this low-level series, it's very easy to follow and it's so basic, it's easy to learn, because everything is already familiar, allowing me to connect the ideas into an understandable concept.

@sentdex 4 года назад

Glad you enjoy it!

@kristiyanivanov7414 4 года назад

Loved the patiently explaining!

@ninjahunter2199 4 года назад

i really like this visualization explaining the code of where the inputs and weights are coming from

@walidr 4 года назад

Hi Sentdex, thank you for starting and making this amazing course. It would be cool if you added a challenges of different difficulties at the end of each video. For example, for this one, you can challenge things like: 1) easy: write for 5 inputs to 3 outputs, 2) medium: rewrite using numpy (you will probably do this next video, but its still nice to think about before hand). This can help solidify the knowledge and also prepare us for the next video. Maybe the hardest challenge can be something to prepare for the next video. Keep up the amazing work!

@amrhelal991 4 года назад

i wounder why you don't have millions of subscribers , the best youtube channel so far............ keep up the good work greetings from Egypt

@shamanbhattacharyya9285 2 года назад

Love your videos. Your videos are far superior to what lecturers at universities can show

@mohitjain4943 4 года назад

No one can Teach with that ease and simplicity.....i really thank you man! this pace helps a lot Thanks Man!

@sentdex 4 года назад

Glad it helped!

@karanmishra8192 4 года назад

Your videos are always awesome and i have seen your all videos .Thanks for helping us by making videos on these topics..big fan of your work..

@pranavt1747 4 года назад

I was waiting for such a series for sometime... Thanks a lot.. :)

@sentdex 4 года назад

Most welcome 😊

@Narain346 4 года назад

Daunting work sensei...keep going...we need it.🙏

@terensedaman4608 3 года назад

Honestly, amazing teaching skills.

@tlmoller 3 года назад

Great stuff. Simple and usefull as it should be on this stage.

@mehdighorbani6008 8 месяцев назад

Explanation is AMAZING!!!! Thank you very much😍😍😍

@Mreoinpaul 3 года назад

Brilliant explanatory animation of using the inputs, weights, and bias at about 2.15

@atb0007 4 года назад

dayum..this good stuff! just when i was looking for a starter

@tayyabhussaintahir 4 года назад

You are amazing, only because of you i see myself achieving my dreams.

@captaincode4380 Месяц назад

Great! I love this course! Its simple and I can understand it.

@pratikmukherjee5914 4 года назад

Wow this is an amazing explanation Sentdex. Hope to master neural networks by the end of the series.

@jeffreybaboz8124 4 года назад

i have to say, 2:25 into the vid im amazed how fucking good the visualisation of the inputs etc is. Somehow my brain turned into a sponge the way its been put.. im sure plenty more lightbulbs will turn on while watching this. Really good job..