The Evolution of Gradient Descent 

hell yes great to hear

Luis He for sure optimize his video production with ADAM

thanks luis i optimize

glad u liked

Thank you for stating this, as I was confused about the gradient (slopes at the tangent of the cost function) values in relation to the graph. I was look for such a comment here and you provided it.

libai tony exactly my thoughts on this

mk17173n lmfaoooo

can't*

typical indian

Ron it is always recommend to use a library for deep learning, as most deep learning training needs lots of calculations that can be done best with GPU and distributed computing where the established libraries like tensorflow excels. But for beginner you can hand code everything from scratch to understand the concepts. Speaking for the market you asked, there are machine learning research labs and big software companies like google where you can join.

yes

woot!!

Adaptive Adam. We should call it as Eve.

We need to train a neural network to predict step.

I am not Siraj, but I can suggest another way of learning things, start by learning what you find interesting, (for you, probably something related to AI, you are awesome! ;) ) Learn that and when you encounter maths, only then learn the maths that you need this will prevent you from wasting your time with knowledge that you don't need. I laughed at myself when I first had to learn what a basic sigma does to understand softmax on an ML course on Udacity (yeah I wanted to learn ML without even knowing that! xD) but now I know far more than that and I am on my way to learn and create so much more and so can anyone!

Ah that's awesome! How far are you into the Udacity ML course and what do you think of it? I want to take the ML course by Andrew Ng on Stanford, but I need prior knowledge of linear algebra and calculus. I am learning both at the moment, but I'm not too sure how much of each I need. What would you recommend?

StyleTrick I am still a beginner as well in ml so I don't have the best opinion on that ^^ I stopped the intro to machine learning course at lesson three, it's not my first udacity class and as usual it's a little slow to go through all the videos and sometimes it really goes into every steps sometime, I wish there where more details. I was too impatient so I jumped right into tensorflow, this I recommend no matter what course you want to take! Try the "get started" on their website try to understand and run "MNIST for ML Beginners"and "Deep MNIST for Experts" you'll see how much deep learning reduces error rate and also you'll see how fast it is to make a model with this library compared to the way it's taught in the Stanford course! I saw the ml course you talked about and it really goes into the details. I am stating the obvious but when you build any code, you can do more and faster by using libraries. if you are more interested in research for AI my guess is that it's good, but is it better than the udacity class? that's for you to tell! It depends on how you want to use AI in the end. Whatever you do the only thing that matter is to keep trying at it as much as you can, seriously, I'm ditching calls and snaps from my friends, I know that's bad but it doesn't even bother me ^^ try to learn tensorflow on their official website if you didn't yet!

Thanks so much for the information! I've heard great things about TensorFlow. It's just I'm studying some Linear Algebra and Calculus to get some indepth knowledge on ML. Btw, Can I jump into tensorflow straight away, like no prereqs?

wait 5 days

*To singularity!*

i will