Тёмный

Variational Autoencoders - EXPLAINED! 

CodeEmporium
Подписаться 128 тыс.
Просмотров 138 тыс.
50% 1

Опубликовано:

 

27 сен 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 121   
@benjaminbong
@benjaminbong 4 года назад
Awesome tutorial! I've been struggling to userstand VAEs, and this helped me finally get an idea how they work! Thank you!
@dt28469
@dt28469 3 года назад
Wow that dog barking noise tripped my brain out so hard. Because my neighbor's dog always barks, my brain tuned out the sound of the bark until I reasoned he was taking about the sound of dogs barking. Neural networks aren't intelligent enough to behave in these ways.
@Multibjarne
@Multibjarne 3 года назад
I needed someone to spoonfeed me this stuff. Thanks
@jinoopark6034
@jinoopark6034 5 лет назад
I love your explanation. Please make a more math-oriented video on VAE!
@rajpulapakura001
@rajpulapakura001 Год назад
Thanks for the vid, now I finally understand VAEs. I would also highly recommend watching the MIT Deep Generative Modelling video to better understand the technical details of VAEs.
@retime77
@retime77 5 лет назад
Thanks for intuitive explanation. I'm really looking forward to see more detailed exploration on the VAE and its variants as noted in the last of the video.
@DarshanSenTheComposer
@DarshanSenTheComposer 4 года назад
Brilliant explanation! I have watched many videos on this topic, but most of them either throw some weird and unknown mathematical equation at you, which they just assume that you'll understand without a proper explanation and the rest just throws lines of python code at you, where the functions and parameters have thicc statistical names. You explained this like it is just a piece of cake! Thank you. :D
@ParthivShah
@ParthivShah Месяц назад
Thank you very much. Love from India.
@mariolinovalencia7776
@mariolinovalencia7776 5 лет назад
Best video on vae. Finally I understand
@DB-in2mr
@DB-in2mr Год назад
whow ...you showed a great deal of expalanation capacity man! kudos to you. Daniele
@monil_soni
@monil_soni 11 месяцев назад
Thanks for this! Helped me understand the need for defining a region for these pools and consequently, having the K-L divergence in optimization. Up until now, I only looked at that regularization term as intentionally having information loss and now it makes sense that we need that to make the generator more useable for "varying" outputs.
@amr6859
@amr6859 2 года назад
Take home message: Variational Autoencoders can generate new data.
@saptakatha
@saptakatha 4 года назад
Please make a video on maths behind VAE. Your way of explaining things makes it easy to understand the hard concepts!
@yujisakabe4900
@yujisakabe4900 2 года назад
Thank you so much for the didactic explanation, it really helped me to understand the fundamental concepts before exploring the math behind it.
@xruan6582
@xruan6582 4 года назад
Good intuitive explanation. I need more details about how to train a VAE, which is die hard to understand by following stanford's introduction
@CodeEmporium
@CodeEmporium 4 года назад
Trying to make this as accessable as possible. It is a hard topic and sometimes I might hide behind that jargon. But I'll try to explain myself when I can
@joehaddad4945
@joehaddad4945 2 года назад
This video is pure gold. Thank you so much!
@CodeEmporium
@CodeEmporium 2 года назад
Super welcome :)
@ArchithaKishoreSings
@ArchithaKishoreSings 5 лет назад
Your channel is absolutely incredible. Keep em coming☺️
@asheeshmathur
@asheeshmathur 10 месяцев назад
Excellent explanation
@CodeEmporium
@CodeEmporium 10 месяцев назад
Thanks a ton!
@MartinWanckel
@MartinWanckel Год назад
Very nicely explained !
@CodeEmporium
@CodeEmporium Год назад
Thanks so much :)
@ЕгорАбросимов-л2о
@ЕгорАбросимов-л2о 2 года назад
This is some GREAT explanation here!
@tariqislam9388
@tariqislam9388 5 месяцев назад
Thank you for this fantastic tutorial.
@ssshukla26
@ssshukla26 4 года назад
A very good and clear explanation. Thanks.
@weilinfu1343
@weilinfu1343 5 лет назад
Great video! Looking forward for the math part!
@__goyal__
@__goyal__ 4 года назад
Glad that I came across this channel!!
@NaxAlpha
@NaxAlpha 5 лет назад
Love your channel. Looking forward to more research paper explanations!
@MayankKumar-nn7lk
@MayankKumar-nn7lk 5 лет назад
Awesome Video, Pls show mathematics part in the next video
@ambeshshekhar4043
@ambeshshekhar4043 3 года назад
+1 to the v.a.e video with lots of math!
@eduardoblas2315
@eduardoblas2315 5 лет назад
Gold content, simple and entertaining, keep it going.
@tobuslieven
@tobuslieven 2 года назад
6:17 If passing in a random vector outputs garbage, then there are excess degrees of freedom in the vector. The variational autoencoder seems to be limiting the set of input vectors, so when we choose one from the limited set, we're assured it won't output garbage.
@vandarkholme442
@vandarkholme442 2 года назад
So is that how the KL loss comes to play? by limiting input hidden vectors region?
@XecutionStyle
@XecutionStyle 3 года назад
I think the reason the latent code is important is because that layer, that middle layer, has far fewer neurons than the input. So anything that's produced from there - has to come from a compressed form of the input.
@joebastulli
@joebastulli 4 года назад
Thanks for the explanation, simple and clear!
@ArcticSilverFox1
@ArcticSilverFox1 3 года назад
Very nicely explained! Great job!
@zarlishattique4167
@zarlishattique4167 2 года назад
Where is coding it's not explained till you practice it.. 🥺
@Leibniz_28
@Leibniz_28 4 года назад
🙋🏻‍♂️ another video of variational autoencoders, please
@china_tours
@china_tours 2 года назад
Great explanation, but please make the slides (ppt) public.. thank you
@cptechno
@cptechno 2 года назад
QUESTION CONCERNING VAE! Using VAE with images, we currently start by compressing an image into the latent space and reconstructing from the latent space. QUESTION: What if we start with the photo of adult human, say a man or woman 25 years old (young adult) and we rebuild to an image of the same person but at a younger age, say man/woman at 14 years old (mid-teen). Do you see where I'm going with this? Can we create a VAE to make the face younger from 25 years (young adult) to 14 years (mid-teen)? In more general term, can VAE be used with non-identity function?
@niveyoga3242
@niveyoga3242 5 лет назад
Tells there is so much potential & then brings an example, where I can build a photobook of my favorite animal! xD
@CodeEmporium
@CodeEmporium 5 лет назад
Animal photo albums are all we need in this world.
@ruksharalam173
@ruksharalam173 8 месяцев назад
So, if GANs produce better-quality images, is there any use for VAEs in the industry?
@dreamliu6867
@dreamliu6867 2 года назад
Wonderful explanation. Could you please make a math tutorial on VAE? Thanks
@manuelkarner8746
@manuelkarner8746 4 года назад
Hy, that was the best var Autoencoder video I found on the internet, so thanks a lot, it realy helped ! I have 2 questions regarding min 10:22 continious region. 1: (if i understood it correctly this is a no): is the number of dog-verctors in the dog pool equal to the number of dog pics in the training-set ? 2: if you take the most average dog-verctor from the d-pool, to make it short lets say: [70, 10, 0.4] than could the whole pool be descirbed as each of the values has it´s range like: [70(+/-10), 10(+/- 2, 0.4(+/- 0.02) ] and as long as all values from a new latent space vector are in this range, I am in the dog pool and therfore generate an okey-looking dog ? (little bonus question so the number of values in the vector and the range of each determines how much different dogs the network is able to create ?) thank you in advance, i hope my question was understandable
@BlockOfRed
@BlockOfRed 4 года назад
Hi, 1: You understood that correctly, so no. As the region is continiuous, it contains an infinite amount of vectors. On the other hand, you know only as many vectors of that region as you have input images (as you generate one for each image). 2: Not every dog image leads to a vector withing this pool and not every vector within this pool generates a dog image. This is due to the fact that a) we don't really understand how NNs function internally and b) these "pools" are just an explanation of what's wrong with traditional AE. That is, they do not have to really exist in the "real world". 3: As traditional AE decoders are deterministic, yes. If your latent vector can only have one value, you can only generate one image. The "range" shown in the video is a slight simplification of what is really going on. That is, you do not set hard bounds for your latent variables, but you formulate this as minimizing the KL-divergence (Kullback-Leibler-divergence, i.e. the "distance" of two distributions), so that the latent distribution does not strive away too much from the standard distribution. I hope my answers were both understandable and correct :)
@SurajBorate-bx6hv
@SurajBorate-bx6hv Год назад
Thanks for the awesome explanation. How to choose between VAEs and diffusion models ?
@supnegi
@supnegi 3 года назад
That was incredible!
@fatemerezaei6898
@fatemerezaei6898 11 месяцев назад
Amazing!
@MLDawn
@MLDawn 3 года назад
really really good video. Could you tell me something about the Gaussian prior on the bottleneck. 1) Do we learn the parameters of this Gaussian? 2) Is it only 1 Gaussian, or as you said, it is really a mixture of Gaussians (mathematically speaking)? Thanks
@pavanms6924
@pavanms6924 3 года назад
can you please make a video on probabilistic U nets
@harshkumaragarwal8326
@harshkumaragarwal8326 3 года назад
you guys do a great job
@gordonlim2322
@gordonlim2322 3 года назад
At 7:12, you said that generative models need to learn these "pools" or distribution. Which part of the autoencoder is that? Or is it separate from that? To my understanding, the autoencoder alone just learns the weights for the encoder and decoder.
@nikitasinha8181
@nikitasinha8181 Год назад
Thank you so much
@CodeEmporium
@CodeEmporium Год назад
Thank you for watching :)
@artinbogdanov7229
@artinbogdanov7229 3 года назад
Thanks!
@avidreader100
@avidreader100 3 года назад
Good explanation. Perhaps after creating a blurry image, one can use another application for sharpening the features.
@Victor-he5hy
@Victor-he5hy 4 года назад
Very good video. Impressive
@tilu391
@tilu391 4 месяца назад
if u r just taking a vector from pool , then isn't it just mapping of image->vector->image
@thecurious926
@thecurious926 2 года назад
wait, then how is reconstruction done using an autoencoder?
@anandsharma16
@anandsharma16 3 дня назад
the dog bark messed me up man
@lihuil3115
@lihuil3115 2 года назад
very good.
@krishnagarg6870
@krishnagarg6870 4 года назад
Nice Video
@maxjt11
@maxjt11 5 лет назад
Thanks man, great vid
@sebastiaanvanbuisman1704
@sebastiaanvanbuisman1704 4 года назад
great vid! i appreciate this a lot
@thebrothershow5826
@thebrothershow5826 3 года назад
You are amazing
@baothach9259
@baothach9259 4 года назад
Amazing tutorial
@CodeEmporium
@CodeEmporium 4 года назад
Thanks for watching!
@programmingrush
@programmingrush 6 месяцев назад
Nice
@HimanshuSingh-ej2tc
@HimanshuSingh-ej2tc 2 года назад
Make more mathematical detailed video
@CodeEmporium
@CodeEmporium 2 года назад
Coming soon :)
@rockapedra1130
@rockapedra1130 2 года назад
Was going well but ended without explaining ☹️
@leosmi1
@leosmi1 5 лет назад
Thnx
@XecutionStyle
@XecutionStyle 3 года назад
$@#$ I thought there was a dog in the house
@fazilokuyanus3396
@fazilokuyanus3396 5 лет назад
you are great!
@CodeEmporium
@CodeEmporium 5 лет назад
You are too kind:)
@unnikrishnanms3431
@unnikrishnanms3431 5 лет назад
@@CodeEmporium could you give a code for GAN?...
@DocTheDirector
@DocTheDirector 5 лет назад
Need the mathy version of this video the explanation of the latent loss is awful
@Flinsyflonsy
@Flinsyflonsy 4 года назад
10/10 because doggos.
@pseudospectral2
@pseudospectral2 Год назад
I was here
@alexbarnadas
@alexbarnadas 4 года назад
My cat makes very different noises x'D
@SolathPrime
@SolathPrime 2 года назад
Kieet
@Lucas7Martins
@Lucas7Martins 4 года назад
Doggos!!!!!
@thejswaroop5230
@thejswaroop5230 3 года назад
ur neural network has a bias over dogs to cats lol
@tıbhendese
@tıbhendese 5 месяцев назад
Understood nothing about how this model works. Oversimplifications and storytelling makes it unpaired with the how the real thing work. Now I know : AE is reducing the input data into a smaller vector, VAE can generate blurry image. What I don't know : What is happening to input data and the dataset, what this pool intuition is for?
@juanpabloaguilar4982
@juanpabloaguilar4982 3 года назад
I think is a very big mistake to say that auto encoders cannot used to generate data. That is very wrong and there are multiple applications which use images as inputs to generate images like for example how the baby from two parents will look like.
@diato2993
@diato2993 Год назад
the best explanation for beginners, thank you so much!
@CodeEmporium
@CodeEmporium Год назад
You are super welcome :)
@hihellohowrumfine
@hihellohowrumfine 6 месяцев назад
Can you make a deep math video on variational auto encoders?
@FrankaBrou
@FrankaBrou 11 месяцев назад
bro I jumped, I thought there was a dog next to me 00:38
@bharathpreetham310
@bharathpreetham310 5 лет назад
can i know which mic u r using for making these videos???
@user-ju5uv2lk3e
@user-ju5uv2lk3e Год назад
Thanks for this video :)
@CodeEmporium
@CodeEmporium Год назад
You are very welcome. Thank you for the thoughtful words
@shivkrishnajaiswal8394
@shivkrishnajaiswal8394 Год назад
Interesting
@l.gunasekar832
@l.gunasekar832 2 года назад
Good
@emransaleh9535
@emransaleh9535 5 лет назад
Keep doing this nice work about deep learning concepts and papers. You will go far with this channel.
@threeMetreJim
@threeMetreJim 5 лет назад
What happens if you know how many vector elements are needed to accurately define what you want to reproduce, and then add a few more that aren't defined by the input image, but represent the class of the desired output. Will this force all of the vector elements into their own pool? So you can pick any random vector and add to it the representation of the class, to only pick from that pool. This strategy works for the 'image painting' network by Andrej Karpathy, and it's how I switched between images for a different kind of image tweening. I still wonder exactly what kind of network the 'image painter' actually is. I'm guessing that the same technique should also work for a generative auto encoder. I came up with the idea based on how a person learns something; you get more than one input - I.e a picture and description, that goes in (both presented at the input, rather than one at the input and the other at the output), and is then mapped to just the wanted description.
@caoshixing7954
@caoshixing7954 3 года назад
+1 to the v.a.e video with lots of math! thanks nice video!
@miracode7327
@miracode7327 2 года назад
Reference list is good, subbed
@sunti8893
@sunti8893 4 года назад
This is very useful video! Thank you :)
@internationalenglish7413
@internationalenglish7413 5 лет назад
Great work! Wish you a million subscribers.
@GoKotlinJava
@GoKotlinJava 4 года назад
awesome and simple explanation. I was confused and wondering about the sampling part that VAE's do because i didn't understand what was meant by sampling a latent vector from a distribution. But you made it so easy to understand. Thanks a lot. Keep up the good work
@CodeEmporium
@CodeEmporium 4 года назад
Thanks homie. I'm trying to not hid hide behind the jargon. But it can be hard at times. I'll explain myself when I can
@Wabadoum
@Wabadoum 5 лет назад
Nice video! I have two questions: You show that the pool of the VAE is continuous, but it also shows blanks, eg. all space isnt covered by the numbers. What does a sampling from these regions gives? Is it still close to a number? Second question, does the size of the pool affect the quality of an image generated? Like giving more space to the VAE allows it to learn with less constrains? Thanks!
@haralambiepapastathopoulos7876
Could you make a video for adaptive instance normalization (AdaIN)? It would be very useful, nobody on RU-vid did this before
@vinayreddy8683
@vinayreddy8683 4 года назад
Please make a video on Transformer and BERT architectures
@CodeEmporium
@CodeEmporium 4 года назад
Gonna talk about that in my next video in a few days. Stay tuned :)
@vinayreddy8683
@vinayreddy8683 4 года назад
@@CodeEmporium thanks for the reply AJ. I was really surprised the way you changed your accent in such a short span of time, at one point I couldn't believe the fact that you're Thamil. Your content is amazing, I don't want to be selfish here, but I'd be happy if you can do more video's on NLP.
@yacinek85
@yacinek85 4 года назад
Thanks
@hochmuch
@hochmuch 5 лет назад
Спасибо, твои видео веселые и очень полезные | Thank you, your videos are funny and so useful
@СергейКривенко-р6я
Чувак, веселый это fun, а funny это смешной, это два совсем разных слова.
@Vikram-wx4hg
@Vikram-wx4hg 3 года назад
Beautifully explained!
@CodeEmporium
@CodeEmporium 3 года назад
Much appreciated
@vladvladislav4335
@vladvladislav4335 5 лет назад
Well, that's actually a totally wrong conceptual explaination of a VAE. Moreover, in the video you didn't name some absolutely cruicial points about VAEs, that one would expect to hear. Moremoremoreover, there are plenty of statistical and mathematical things, that are not obvious at all and need to be explained when speaking about VAEs. So this is indeed an explaination, but quite a bad one I could be more specific if anybody is interested, so let's start some discussion in the comments :D
@jg9193
@jg9193 4 года назад
I'm interested. Be more specific.
@est9949
@est9949 4 года назад
Well, please explain more.
@CharlieYoutubing
@CharlieYoutubing 5 лет назад
Thanks
@CodeEmporium
@CodeEmporium 5 лет назад
Anytime :)
@bidishadas842
@bidishadas842 4 года назад
Kahi bhi nahi jaate. Hamesha call karke puchte hai drop location kya hai or fir cancel karte !
@justgay
@justgay Год назад
on the final slide, how did you find the latent vectors for the VAE that generate images similar to the images generated by GAN? or were the images on the right the result of encoding and decoding the images generated by the GAN using the VAE? then the VAE seems really bad at its original job
Далее
How to keep up with AI research?
12:20
Просмотров 14 тыс.
Variational Autoencoders
15:05
Просмотров 500 тыс.
Why Does Diffusion Work Better than Auto-Regression?
20:18
ML Was Hard Until I Learned These 5 Secrets!
13:11
Просмотров 306 тыс.
Autoencoders - EXPLAINED
10:53
Просмотров 56 тыс.
The Reparameterization Trick
17:35
Просмотров 20 тыс.
Simple Explanation of AutoEncoders
10:31
Просмотров 105 тыс.
BERT Neural Network - EXPLAINED!
11:37
Просмотров 396 тыс.