Тёмный

An intro to Probabilistic Programming with Ubers Pyro 

Siraj Raval
Подписаться 768 тыс.
Просмотров 52 тыс.
50% 1

Probabilistic programming languages are built to harness the predictive power of probability distributions. Instead of making them a feature, they use these distributions as primitives with their own set of operands that allow for the creation of stochastic control flows. Since the real world is full of uncertainty, this type of thinking is useful to help build better AI systems. I'll use Uber's newly released Pyro tool to demonstrate how they work.
Code for this video (with coding challenge):
github.com/llSourcell/an_intr...
Shannon's winning code:
github.com/DecentricCorp/Cova...
Please Subscribe! And like. And comment. That's what keeps me going.
Want more inspiration & education? Follow me:
Twitter: / sirajraval
Facebook: / sirajology
More learning resources:
media.nips.cc/Conferences/201...
probabilistic-programming.org/...
github.com/CamDavidsonPilon/P...
www.oreilly.com/ideas/probabi...
www.oreilly.com/learning/prob...
pyro.ai/
Join us in the Wizards Slack channel:
wizards.herokuapp.com/
And please support me on Patreon:
www.patreon.com/user?u=3191693 Instagram: / sirajraval Instagram: / sirajraval
Signup for my newsletter for exciting updates in the field of AI:
goo.gl/FZzJ5w
Hit the Join button above to sign up to become a member of my channel for access to exclusive content! Join my AI community: chatgptschool.io/ Sign up for my AI Sports betting Bot, WagerGPT! (500 spots available):
www.wagergpt.co

Опубликовано:

 

9 ноя 2017

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 123   
@phaser2679
@phaser2679 6 лет назад
Siraj sure manages to make a relatively complicated topic understandable in under 9 mins ... best explanation of PPL I've heard to-date!
@decreer4567
@decreer4567 6 лет назад
I would just like to thank you for all these tutorials. I always wanted to get into machine learning in a quick ,but efficient way without being spoon feed. I would normally have to wait until colledge ,but I can learn all that stuff before my junior year ends. Thank You
@Jacob011
@Jacob011 6 лет назад
It amazes my how fast you can process and understand all this new information.
@mustafaae35663
@mustafaae35663 6 лет назад
I get depressed when i watch ur videos man , i feel like my brain is a piece of shit lol
@SirajRaval
@SirajRaval 6 лет назад
nah dude i made this vid in 5 days i could've definitely explained better please keep watching
@matthewrice7590
@matthewrice7590 6 лет назад
Shouldn’t you at least credit Computerphile when using their clips?
@user-wd8wx5md5z
@user-wd8wx5md5z 4 года назад
Hahahaha THank you for the observation !
@vijayabhaskarj3095
@vijayabhaskarj3095 6 лет назад
Siraj Ravel=Khan Academy for Cutting edge Technologies.
@financewithsom485
@financewithsom485 6 лет назад
Vijayabhaskar j ya bro
@SirajRaval
@SirajRaval 6 лет назад
perfect analogy
@FranksWorldTV
@FranksWorldTV 6 лет назад
Siraj Academy?
@LuxioTheMan
@LuxioTheMan 6 лет назад
At a 15x speedup
@chiranjeebroychowdhury7759
@chiranjeebroychowdhury7759 6 лет назад
Man.. you are fast! Enjoyed the video. Didn't know about the existence of Uber Movement, let alone the fact that Uber has a dedicated AI wing capable of making a library!!! Keep up the good work!
@1imax111
@1imax111 6 лет назад
Siraj, love your explanations man. Not my field, but man I'm considering merging it with mine...
@rgrimoldi
@rgrimoldi 6 лет назад
what sort of NN would you recommend to build a e-commerce product recommendation system?
@nebimertaydin3187
@nebimertaydin3187 6 лет назад
you've made my day
@mjahangeerqureshi8698
@mjahangeerqureshi8698 6 лет назад
Always a pleasure to receive your great insights Siraj.
@WillTesler
@WillTesler 6 лет назад
Awesome intro describing evolution of programming languages.
@fischX
@fischX 6 лет назад
Yea cool, but why do I need that? And more importantly why does it need torch?
@gauravbhandup
@gauravbhandup 6 лет назад
This week's challenge - count how many time siraj has said probabilistic in this video...
@proximo08
@proximo08 6 лет назад
he follows zipf law religiously!
@SirajRaval
@SirajRaval 6 лет назад
hahah i did say it alot
@user-wd8wx5md5z
@user-wd8wx5md5z 4 года назад
Let put a Gaussian on it !
@MrPhirip
@MrPhirip 6 лет назад
Really love the format of these videos!
@thestophewatts6689
@thestophewatts6689 6 лет назад
I can tell you've incorporated some feedback. Instead of just blazing thru with some small print code, you have slowed down, but not too slow, and made some code text font size easier to see and follow, for those like me who aren't experts. A very well done video, more of an effective teaching approach than i've seen in prior videos. Cheers and thanks!
@Barnardrab
@Barnardrab 6 лет назад
Nice hitting on nostalgia with the Super Mario World map.
@ShannonCode
@ShannonCode 6 лет назад
W00t Thanks for the shout out!
@AdityaArdiya
@AdityaArdiya 6 лет назад
Thanks for the intro. Would love to know if it can be used for reinforcement learning
@tianzicai9964
@tianzicai9964 6 лет назад
Siraj must be one of the happiest people in the world!!
@proximo08
@proximo08 6 лет назад
Another great video Siraj! Keep them coming you're amazing, I hope you find ways to make enough money out of this...
@danielparry7643
@danielparry7643 6 лет назад
Just curious. How is this different than classical Monty Carlo simulation and stochastic optimization techniques?
@zvxcvxcz
@zvxcvxcz 6 лет назад
That's what I was wondering. Short answer is that it isn't, just everyone is getting on the hype train for no fucking reason. These techniques are fucking old, they're pretending doing a random walk of program executions and approximating the output distribution is something new. The only new thing is that they've introduced yet another stupid wrapper layer that is supposed to make it easier.
@alhmadvlogs7592
@alhmadvlogs7592 6 лет назад
Siraj hey im abrar from india i like ur videos so much .... nice i can get anything from this channel.
@sabrishgopalakrishnan5156
@sabrishgopalakrishnan5156 5 лет назад
how is this different from pyMC?
@adityapatil325
@adityapatil325 6 лет назад
For now, I watch your videos only to learn new stuff, but I'd like to code too. Unfortunately I'm too busy with my CSE UG. Ain't got no time after all those assignments, exams and project. Also need to study for Masters entrance exam(GATE).😢 I hate that when I had all this maths in my first and second year of engineering, it was all theory, with no hints given about where it's applied. So I eventually forgot all that maths. Now I need to relearn it. And also Python, ML libraries and then follow your video tutorials. I feel like I've been left behind 😞
@aditheunbeatable
@aditheunbeatable 6 лет назад
Aditya Patil hey I'm in the same boat. CSE 3rd year and trying to learn ML/AI. Wanna do it together?
@adityapatil325
@adityapatil325 6 лет назад
Aditya Sharma Sure. What is your plan though?
@SirajRaval
@SirajRaval 6 лет назад
just read the deep learning book by ian goodfellow, watch my intro to DL and math of intelligence playlist and you will become an AI god fast af
@aditheunbeatable
@aditheunbeatable 6 лет назад
Aditya Patil well, right now it's to work on some good projects. I don't want to sit this summer out, so I'm looking for some internships, preferably in ml/DL. Why don't you ping me on WhatsApp. My number is 8982483353
@AkashMishra23
@AkashMishra23 6 лет назад
Another new tool for me to play with........Will definitely discuss this at Nvidia's Dev Connect....
@devonk298
@devonk298 4 года назад
Are there any methods to use probabilistic programing on real time streaming data ?
@ShaunHusain
@ShaunHusain 6 лет назад
Would be nice to point back to computerphile or other sources if you decide to use their content. Love your vids just like to see credit where credit due.
@Ronnypetson
@Ronnypetson 6 лет назад
Probabilistic programming.. sounds awesome
@Schmuck
@Schmuck 6 лет назад
Can someone explain to me what automatic differentiation is? Is it just gradient descent?
@Murphyalex
@Murphyalex 6 лет назад
He says it in the video @5.15
@luck3949
@luck3949 6 лет назад
Schmuck afaik it is like, you build a fuction from primitive functions, ex. f=torch.sin(torch.tan(torch.variable)) and then you can just type f.derivative to get exact formula of its derivative.
@phanimatrix
@phanimatrix 6 лет назад
deep and detail explanation
@aienthusiast8540
@aienthusiast8540 6 лет назад
Do a series of probabilistic programming, like the one you did with deep learning. :D
@StillUp2Date
@StillUp2Date 6 лет назад
What do you think about IOTA and their tangle technology which seems superiour to the blockchain, due to infinite scalability and zero transaction fees? You can find info on iota.org
@SirajRaval
@SirajRaval 6 лет назад
BS, if they provided a consensus algo better than proof of work, devs would be tweeting like crazy
@ianmackay5621
@ianmackay5621 6 лет назад
Siraj, I would think that you would be all over iota. It uses a directed acyclic graph as opposed to a blockchain to record transactions. It's new technology and currently isn't fully implemented (the network is currently run by a "coordinator"), but it's super cool and has many benefits over proof of work and proof of stake.
@SirajRaval
@SirajRaval 6 лет назад
alright i'll read up more on it thanks Ian
@StillUp2Date
@StillUp2Date 6 лет назад
It would really be great if you could analyze it. I watched most of your videos and i think you are the type of person who can really understand and explain it to others as well. It is still in the early stages.
@abhinav.sharma
@abhinav.sharma 6 лет назад
This Channel is NetFlix for all of the New AI stuff and Machine Learning.
@SirajRaval
@SirajRaval 6 лет назад
good analogy!
@YoulooDingDongKenth
@YoulooDingDongKenth 6 лет назад
Ay Siraj! Can you recommend some books, that you have read, that i can put on my wishlist for Christmas? That would be great!
@SirajRaval
@SirajRaval 6 лет назад
waking up by sam harris
@Mirandorl
@Mirandorl 6 лет назад
Poor Siraj. Don't let them slow you down! Speed talk all you want my friend, we have the speed option in youtube :)
@AhmadM-on-Google
@AhmadM-on-Google 6 лет назад
more than just the instructional videos, this guy is even motivating yall in the comments about jobs, life...wth
@SirajRaval
@SirajRaval 6 лет назад
lots of effort
@whybotheraskable
@whybotheraskable 6 лет назад
I see the Bayesian network inference part, but where is the machine learning?
@zvxcvxcz
@zvxcvxcz 6 лет назад
There was never a difference.
@ajaytej27
@ajaytej27 6 лет назад
Pyro is basically like a machine learning model which has a machine learning model inside it, built up by high-level languages, which is a programming language?
@dnangelf
@dnangelf 6 лет назад
nope it's not like that. it's like swapping your variables for distributions of variables. here's a link: en.wikipedia.org/wiki/Probability_distribution
@boastliketoast
@boastliketoast 6 лет назад
but scikit learn does all this for you, unless I'm missing something obvious
@anselmoufc
@anselmoufc 6 лет назад
George Boast No, it does not. Probabilistic programming is based on Bayesian inference. It is a completely different way of treating uncertainty.
@boastliketoast
@boastliketoast 6 лет назад
Just a quick google search of "scikit learn Bayesian inference" shows you all the tools it provides, unless I'm still wrong
@anselmoufc
@anselmoufc 6 лет назад
George Boast Yes, there are some specifc Bayesian models in scikit-learn. But what probabilistic programming allows you is to define a custom Bayesian model and automaticlly solve it through Markov chain Monte Carlo. It is not possible to do this in scikit-learn. Raj failed to explain this in the video. Pyro seems to be similar to PyMC.
@shabeer821
@shabeer821 6 лет назад
Thanks Siraj for the awesome introduction to Pyro. One thing I would like to recommend is to avoid adding distracting funny memes. Distraction is so high for me that, concentration shifts to understanding the memes in context of the topic.
@financewithsom485
@financewithsom485 6 лет назад
Love from Canada
@MWorks08
@MWorks08 6 лет назад
...Brilliant !!
@jtekmmx
@jtekmmx 6 лет назад
Hello Siraj!!! It's the World
@rayc6556
@rayc6556 6 лет назад
I start watching you when you had a hundred subscribes => Now I have to x1.25 speed to get back my favorite speed :D
@ehfo
@ehfo 6 лет назад
thanks siraj!
@junweima
@junweima 6 лет назад
sorry I'm new here. How do I submit?
@pritomkm
@pritomkm 6 лет назад
Do you have or planning to make videos on HMM?
@DanielWeikert
@DanielWeikert 6 лет назад
could you teach pytorch Siraj?
@SaiTeja-go6lw
@SaiTeja-go6lw 6 лет назад
Nice !!
@VictorGarcia-si8wy
@VictorGarcia-si8wy 6 лет назад
What that white piece of clothing you are wearing? It looks so dope!
@grainfrizz
@grainfrizz 6 лет назад
I'm just wondering if it's really okay to grab snippets of videos from other RU-vid content creators. Hhhmmmnnn?
@dhruvpatel4948
@dhruvpatel4948 6 лет назад
Optimization for avoiding harrasememt lawsuit..😝 Now I know the actual reason behind development of Pyro
@tear728
@tear728 6 лет назад
Nice jacket!
@Winium
@Winium 6 лет назад
@2:14 I think you mean "stochastic" rather than "non-deterministic"
@SirajRaval
@SirajRaval 6 лет назад
yes thats more descriptive
@anshul123bisht
@anshul123bisht 6 лет назад
love from india
@sm11ax
@sm11ax 5 лет назад
I mean PyMc3 already does all this no ?
@olfmombach260
@olfmombach260 6 лет назад
Stochastic models is that one thing I will probably never understand
@zebcode
@zebcode 6 лет назад
a little grainy but great video!
@BeatSyncBytes
@BeatSyncBytes 6 лет назад
This is good
@hayeder
@hayeder 6 лет назад
That tensorflow comment is actually out of date by a week or so. You can now do computations dynamically, look up tensorflow eager execution.
@SirajRaval
@SirajRaval 6 лет назад
yes you're right thanks
@usptact
@usptact 6 лет назад
Pretty nice description but the Pyro language is pretty horrific to be explained in few minutes for uninitiated. I suggest to look at Stan (R, Python), PyMC3 (Python) or Infer.NET (C#) if you want to learn more. The last one is bit outdated (2014) but allows to build explicit factor graphs that show pretty clearly all assumptions being made.
@junaid1464
@junaid1464 6 лет назад
listen to siraj by changing speed to 1.25
@dynamicgecko1213
@dynamicgecko1213 6 лет назад
"Today we're going to talk about probabilistic learning. Soo everything started with an abacus....."
@dynamicgecko1213
@dynamicgecko1213 6 лет назад
Jk man i know this is an intro video :)
@zackmercurys
@zackmercurys 6 лет назад
Now we're making robots, in future robots will be making humans.
@tejasdevgekar1154
@tejasdevgekar1154 6 лет назад
1:59 lol
@naveedh27
@naveedh27 6 лет назад
after watching this video i can really say "I know nothing"
@srisankethu8913
@srisankethu8913 6 лет назад
Naveedh Ahamed same feeling here. We just need to break that barrier.
@SirajRaval
@SirajRaval 6 лет назад
this was hard next time will be easier
@temiwale88
@temiwale88 6 лет назад
Hey Siraj I just wanted to say I consider your channel to be a resource for machine and deep learning content. Thanks so much for your dedication and efforts. I pray that God rewards you for helping us!
@KoenigNord
@KoenigNord 6 лет назад
Adewale Adeoye Hey, you can also support him on patreon like many of us do. 💰💰💰
@temiwale88
@temiwale88 6 лет назад
KoenigNord good point. I'll consider this as I learn build my skills and expertise from the ground up. I'm on other platforms now to learn basics and then eventually move to Siraj's content and others. But thanks for that and there are very little if nothing I'll think to pay for but he's worth that investment. Thanks for that point again!
@SirajRaval
@SirajRaval 6 лет назад
thanks adewale~ i will continue
@adityapatil325
@adityapatil325 6 лет назад
He is an sentient AI
@McMurchie
@McMurchie 6 лет назад
Hehe nice little video clip from Computerphile, that dude coding in assembler built his own Genesis game - he is a hardcore virgin!
@SirajRaval
@SirajRaval 6 лет назад
thanks for noticing lol
@McMurchie
@McMurchie 6 лет назад
Also great vid as usual dude, I am working on doing a Pyro Basian model on Cancer rates in the UK. Fingers crossed I can make it before the 16th!
@kariuki6644
@kariuki6644 6 лет назад
i did a science
@Tenuki2
@Tenuki2 6 лет назад
Not even a hint about Fuzzy logic? Oh common...
@vladislavladenkov7710
@vladislavladenkov7710 6 лет назад
Love from Soviet Union
@ghostradar4220
@ghostradar4220 6 лет назад
please make a long video on reinforcement learning using tensorflow & gym (or without tensorflow :d), please Sirajjj
@manuelacosta2907
@manuelacosta2907 6 лет назад
Siraj Raval any help on building a back-end portfolio (git)?
@nebimertaydin3187
@nebimertaydin3187 6 лет назад
maan this is so extensive, you should be a professor
@dtkincaid
@dtkincaid Год назад
Glorious Soviet Union? Really?
@RiteshKumarMaurya
@RiteshKumarMaurya 6 лет назад
Hi Siraj, I'm one of your greatest fans. I watch all of your videos and also I've created my own RU-vid channel. I like your videos and also I want to make mine as you make your videos. So, can you please give me the name of the software which you use to edit your videos?
@SirajRaval
@SirajRaval 6 лет назад
awesome! i use final cut pro
@abdallahmahmoud8642
@abdallahmahmoud8642 6 лет назад
WHy are you so slow today xD
@JAGUARBURST
@JAGUARBURST 6 лет назад
Why are you speaking so slow??
@antonylawler3423
@antonylawler3423 6 лет назад
Not everyone's first language is English. Check out the comments.
Далее
Stuart Russell: "Probabilistic programming and AI"
54:31
Which Activation Function Should I Use?
8:59
Просмотров 262 тыс.
Сумерки сасага🧛
11:41
Просмотров 1,2 млн
Gặp 2 thánh troll | CHANG DORY | ometv
00:42
Просмотров 24 млн
Dimensionality Reduction - The Math of Intelligence #5
10:49
AI That Creates AI
9:58
Просмотров 106 тыс.
Bayes theorem, the geometry of changing beliefs
15:11
An Introduction to GPU Programming with CUDA
10:00
Просмотров 371 тыс.
Navigating a Virtual World Using Dynamic Programming
20:27
Сумерки сасага🧛
11:41
Просмотров 1,2 млн