Тёмный

EfficientNet Explained: Rethinking Model Scaling for Convolutional Neural Networks 

Code With Aarohi
Подписаться 35 тыс.
Просмотров 25 тыс.
50% 1

EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
EfficientNet is a convolutional neural network architecture and scaling method that uniformly scales all dimensions of depth/width/resolution using a compound coefficient.
For queries: aarohisingla1987@gmail.com
The researchers used the compound scaling method to scale the dimensions of the network. The applied grid search strategy to find the relationship between the different scaling dimensions of the baseline network under a fixed resource constraint. Using this strategy, the could find the appropriate scaling coefficients for each of the dimensions to be scaled-up. Using these coefficients, the baseline network was scaled by the desired size.
What does scaling mean in the context of CNNs?
There are three scaling dimensions of a CNN: depth, width, and resolution.
Depth simply means how deep the networks is which is equivalent to the number of layers in it.
Width simply means how wide the network is. One measure of width, for example, is the number of channels in a Conv layer
Resolution is simply the image resolution that is being passed to a CNN.
Compound scaling:
Compound scaling method uses a compound co-efficient ø to scale width, depth, and resolution together
Learn Vanishing Gradients: • L-13 Vanishing Gradients
Learn ResNet: • ResNet Explained Step ...
#ai #artificialintelligence #computervision #deeplearning #artificialintelligence #efficientnet

Опубликовано:

 

18 авг 2021

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 120   
@nurbanuaksoy7170
@nurbanuaksoy7170 2 года назад
This is one of the clearest explanations I have seen. You are explaining everything in detail. Thank you!
@CodeWithAarohi
@CodeWithAarohi 2 года назад
Glad it was helpful!
@Aisha182
@Aisha182 Год назад
It helps me even in 2023 . Hats off to you
@CodeWithAarohi
@CodeWithAarohi Год назад
Glad it helped 🙂
@zheyeetan4048
@zheyeetan4048 Месяц назад
salutation from malaysia. BEST EfficientNet explanation ever!! TQ
@CodeWithAarohi
@CodeWithAarohi Месяц назад
Thank you!
@freya291
@freya291 2 года назад
You deserve more views and subscriptions! Thanks a lot for this wonderfull lecture
@CodeWithAarohi
@CodeWithAarohi 2 года назад
Glad my video is helpful 😊
@_ifly
@_ifly 4 месяца назад
It was straightforward and an amazing way of explaining the point.
@CodeWithAarohi
@CodeWithAarohi 4 месяца назад
Glad it was helpful!
@aneerimmco
@aneerimmco Месяц назад
Clear and non complicated. Thank you.
@CodeWithAarohi
@CodeWithAarohi Месяц назад
Glad it helped!
@modernfusions1981
@modernfusions1981 2 года назад
Very good and in detailed explanation. Highly recommended
@CodeWithAarohi
@CodeWithAarohi 2 года назад
Glad it was helpful!
@ayushkurlekar3302
@ayushkurlekar3302 2 года назад
You are explaining like a pro! Thanks mam!
@CodeWithAarohi
@CodeWithAarohi 2 года назад
My pleasure 😊
@mehrshad9
@mehrshad9 Год назад
Great explanation! keep the hard work! Thank you.
@CodeWithAarohi
@CodeWithAarohi Год назад
Glad it was helpful!
@Sunil-ez1hx
@Sunil-ez1hx Год назад
Very nice & clear video ma’am. Please keep posting👏👏👏
@CodeWithAarohi
@CodeWithAarohi Год назад
Sure 😊
@ShadiHazhir
@ShadiHazhir Месяц назад
Amazing! I appreciate you, thank you sooo much
@CodeWithAarohi
@CodeWithAarohi Месяц назад
Glad it was helpful!
@anshadpa9582
@anshadpa9582 7 месяцев назад
Thank you for this Well explanation of Compound scaling EfficientNet B0👍
@CodeWithAarohi
@CodeWithAarohi 7 месяцев назад
Glad it was helpful!
@annaperova7092
@annaperova7092 8 месяцев назад
Thank you! Helped me a lot!
@CodeWithAarohi
@CodeWithAarohi 8 месяцев назад
Glad it helped!
@takangoudadyavangoudra8761
@takangoudadyavangoudra8761 2 года назад
A great explanation by you, Thank You
@CodeWithAarohi
@CodeWithAarohi 2 года назад
Glad my video is helpful!
@samvandenelsaker9576
@samvandenelsaker9576 2 года назад
Thanks a lot!
@CodeWithAarohi
@CodeWithAarohi 2 года назад
You're welcome!
@rupakdey6753
@rupakdey6753 2 года назад
Easiest explanation ever . Thank you mam.
@CodeWithAarohi
@CodeWithAarohi 2 года назад
Welcome
@ahmedshmels8866
@ahmedshmels8866 2 года назад
Wow Ma'am amazing explanation with deap knowledge No word to say !
@CodeWithAarohi
@CodeWithAarohi 2 года назад
Glad you liked it
@mdyounusahamed6668
@mdyounusahamed6668 Год назад
Great explanation. Thank you.
@CodeWithAarohi
@CodeWithAarohi Год назад
Glad it was helpful!
@dickymr1878
@dickymr1878 Год назад
youre explanation is very clear!
@CodeWithAarohi
@CodeWithAarohi Год назад
Glad it was helpful!
@mitya7068
@mitya7068 2 года назад
Very useful, thanks a lot!
@CodeWithAarohi
@CodeWithAarohi 2 года назад
Glad it was helpful!
@yashrajwani2077
@yashrajwani2077 2 года назад
Thank you. Very helpful
@CodeWithAarohi
@CodeWithAarohi 2 года назад
Glad it was helpful!
@merv893
@merv893 Год назад
Ok you’ve convinced me EffientNet is the one for me
@CodeWithAarohi
@CodeWithAarohi Год назад
👍
@ariouathanane
@ariouathanane Год назад
Thank u very much for this explanations
@CodeWithAarohi
@CodeWithAarohi Год назад
Happy to help
@tiffin2358
@tiffin2358 4 месяца назад
Brilliant
@CodeWithAarohi
@CodeWithAarohi 4 месяца назад
Thank you!
@sajedehtalebi902
@sajedehtalebi902 Год назад
great.tnx
@CodeWithAarohi
@CodeWithAarohi Год назад
welcome
@rama_gpubhuyan9409
@rama_gpubhuyan9409 2 года назад
Hello, I am using pre trained EfficientNetB0 with ImageNet, I have costume 166 image set, I am using regularizations(drop out and batch normalization )/Augmentation technique. But Getting pretty bad result my val_loss increases and val_accuracy remain constant. could you please help.
@clydegriffiths6372
@clydegriffiths6372 2 года назад
Thanks for explanation. I have question. Can we add this ECA to YOLOv5(put somewhere inside YOLO architecture). Can it decrease Loss Function? Guess)
@muhammadsabir6527
@muhammadsabir6527 Год назад
wonderfully explained madam. I really liked this video.
@CodeWithAarohi
@CodeWithAarohi Год назад
Thank you so much 🙂
@csedepartment236
@csedepartment236 Год назад
Thank You Ma'am
@CodeWithAarohi
@CodeWithAarohi Год назад
Most welcome 😊
@sumitchhabra2419
@sumitchhabra2419 2 года назад
Hi, Thanks for the amazing explanation. I have a question and would request your answer: If alpha beta and gamma are fixed. φ is obtained using Grid search. Here I want to understand, that during grid search we have to consider different values of φ. Also, I want to understand what is f here. How does the value of f contribute to the Neural Network? Please Advise. Thank You Sumit
@pramodhbr4190
@pramodhbr4190 2 года назад
Thank you mam. Superb explanation
@CodeWithAarohi
@CodeWithAarohi 2 года назад
You are welcome 😊
@usamarajput6418
@usamarajput6418 Месяц назад
this video helped me a lot. thank you Aarohi
@CodeWithAarohi
@CodeWithAarohi Месяц назад
Glad it helped you :)
@YashSharma-le3mo
@YashSharma-le3mo 7 месяцев назад
Nice explanation mam ❤
@CodeWithAarohi
@CodeWithAarohi 7 месяцев назад
Glad you liked it
@RanjitSingh-rq1qx
@RanjitSingh-rq1qx Год назад
I can't explain in my word. Really mam you are best teacher😊 on the youtub. But i don't know why your subscribers is very less on RU-vid.😔😔, I will share you channel with my friends.👍😊
@CodeWithAarohi
@CodeWithAarohi Год назад
That's very kind of you 😊
@digioasis4832
@digioasis4832 2 года назад
Thank you mam, very clear and great explanation.
@CodeWithAarohi
@CodeWithAarohi 2 года назад
You are welcome 😊
@digioasis4832
@digioasis4832 2 года назад
Mam when will you post video for grid search.
@user-pc7ek6xj3y
@user-pc7ek6xj3y 5 месяцев назад
at 32:36 you said the authors already fixed the values of depth width resolution factors, and found phi value, but in that research paper they kept the value of phi as 1 and did a grid search for alpha beta gamma after they found the values they adjusted the phi to upscale different Efficientnets, correct if i am wrong it will be helpful? and the video is good
@hasanqadhi4280
@hasanqadhi4280 Год назад
❤❤
@pramaysimha8789
@pramaysimha8789 Год назад
Thanks so much for the clear explanation. Could you also please explain Dual Attention Network for segmentation
@CodeWithAarohi
@CodeWithAarohi Год назад
Will try to cover in my upcoming videos
@user-vr8xq7lw7v
@user-vr8xq7lw7v 6 месяцев назад
Good mam🎉🎉
@CodeWithAarohi
@CodeWithAarohi 5 месяцев назад
Thanks a lot
@madhurimasarkar5913
@madhurimasarkar5913 2 года назад
It is really good explanation and helpful enough. When implementation of this will be uploaded? Please make a video of DenseNet.
@CodeWithAarohi
@CodeWithAarohi 2 года назад
Implementation of EfficientNet will be available in next 2 days. Will do video on DenseNet after finishing my pipelined videos. Keep Watching 😊
@verma.prashant
@verma.prashant 2 года назад
Your videos are very informative but I have suggestion for you that your picture block covers half of ppt, can you reduce your picture block or you can use green screen. Thanks
@CodeWithAarohi
@CodeWithAarohi 2 года назад
Thankyou for this suggestion .. Will implement from next video
@swetajain7929
@swetajain7929 Год назад
What is mb6 layer
@MansaKundrapu
@MansaKundrapu 2 года назад
you have explained it very clearly. can we add skip connection in efficientNet ?
@CodeWithAarohi
@CodeWithAarohi 2 года назад
Yes you can modify the Network.
@dattatammisetti9324
@dattatammisetti9324 2 года назад
Thankyou Aarohi di 😊
@CodeWithAarohi
@CodeWithAarohi 2 года назад
Welcome :)
@dhanshreepajankar1570
@dhanshreepajankar1570 Год назад
Hello Ma'am, Can we perform Detection of Malware in windows system (output expected is only in YES/NO) using EfficientNet, or is it only meant for image classification?
@CodeWithAarohi
@CodeWithAarohi Год назад
EfficientNet is used Image Classification
@VipinSingh-he9yc
@VipinSingh-he9yc 8 месяцев назад
Moye moye
@muhammadsabir6527
@muhammadsabir6527 Год назад
Maam do you have accumulative explanation on all the CNN models so that a person can get idea of which CNN model has research gap and needs to be worked on it compare to other cnn models on PhD level research gap.
@CodeWithAarohi
@CodeWithAarohi Год назад
No
@nau7tico
@nau7tico 2 года назад
Wow, You are awesome. Great explanation. I didn´t understand the last part. How the grid search to obtain (phi) is done?
@CodeWithAarohi
@CodeWithAarohi 2 года назад
Will try to cover the grid search in separate video.
@santhoshkumarn8585
@santhoshkumarn8585 2 года назад
Grid search is Hyperparameter tuning technique, researcher would have have done investigation here by trying multiple values and finalized the best or optimized values as depth=1.20;width=1.10 and resolution=1.15
@sanatshirodkar2161
@sanatshirodkar2161 2 года назад
is it mandatory to use 600*600 dimensions for EfficientNet B7, or can we use smaller dimensions, like say 120*120?
@CodeWithAarohi
@CodeWithAarohi 2 года назад
The logic behind efficientnet is to work for high resolution images. If you want to wok for small image size you can use efficientnet B0
@sanatshirodkar2161
@sanatshirodkar2161 2 года назад
@@CodeWithAarohi Okay, got it! Thank you :)
@fghgffgvbgh
@fghgffgvbgh Год назад
Is width scaling means increasing the number of kernels/filters ?
@CodeWithAarohi
@CodeWithAarohi Год назад
yes, correct
@kritiohri558
@kritiohri558 2 года назад
Mam how to calculate phi?
@shahrinnakkhatra2857
@shahrinnakkhatra2857 2 года назад
Hi. actually I don't get that part with feature maps, are you referring to channels by feature maps? If yes, then I don't think this is the correct representation for that? (Which you've drawn like bounding boxes)
@CodeWithAarohi
@CodeWithAarohi 2 года назад
Hello, Yes I am referring to channels by feature maps. And I understand what do you mean by correct representation : Feature maps should be stacked one after the other. But why I have choose this image, because my intent is to show that different feature maps carry different part of information from image. And if we use more number of feature maps then we can collect more features from image . But again if we choose lots of feature map it will will work upto some extent but after that there is no use of those extra feature maps as those extra feature maps will degrade the training performance. I hope I made my point :)
@talha_anwar
@talha_anwar 2 года назад
@@CodeWithAarohi i think you are referring to increase number of filters in conv layers
@abhaypratap5311
@abhaypratap5311 2 года назад
Please make a video on 1-D CNN
@CodeWithAarohi
@CodeWithAarohi 2 года назад
Sure, will do soon
@sudharsanb9391
@sudharsanb9391 2 года назад
Mam can u update your playlists by adding the recent videos??so that it will be easy for us to follow.Thank you
@CodeWithAarohi
@CodeWithAarohi 2 года назад
Sure I will update today
@vinothsomasundaram9519
@vinothsomasundaram9519 2 года назад
Hi i am doing research in resnet in thermal image for face recognition , can you help me?
@CodeWithAarohi
@CodeWithAarohi 2 года назад
Hello, mail me your requirement at aarohisingla1987@gmail.com Will see if I can help you
@meghnadeshmukh4524
@meghnadeshmukh4524 Месяц назад
Thank you mam for teaching us sooo nicely.. I totally agree with @shahidulislamzahid... mam you are too good.
@CodeWithAarohi
@CodeWithAarohi Месяц назад
Glad my videos are helping you. keep learning :)
@100_abirhasan8
@100_abirhasan8 Год назад
Mam, alpha=1.2,beta=1.1& gamma=1.15 and fie=1 how this value came from f=alpha x beta^fie x gamma^fie. Will you please explain or give relevant resoureces. Thank you.😊😊
@CodeWithAarohi
@CodeWithAarohi Год назад
In EfficientNet, the scaling factors for the depth, width, and resolution are denoted as alpha, beta, and gamma. These scaling factors are typically determined through a systematic search on a predefined grid to find the optimal trade-off between accuracy and computational efficiency.
@daily-technology7269
@daily-technology7269 2 года назад
Reduce the size of your own window (at the bottom left), will make the PowerPoint presentation more visible. Otherwise its super annoying when your window is cutting off the text and you have not shared any other document as well. Nobody is here to see some enlarged version of the white space in your wall.
@CodeWithAarohi
@CodeWithAarohi 2 года назад
Thankyou for the feedback.
@pawanbhandarkar7647
@pawanbhandarkar7647 2 года назад
This is the WRONG way of giving feedback. Alternatively, you could have said: Great video! I appreciate the content you have provided. However, I suggest that you reduce the size of your video inset a bit so that it doesn't overlap with the powerpoint presentation, as it sometimes hides the text behind it. Additionally, it would be helpful if you share some documents (like the presentation you used in this video) so that we can refer to the unclear parts. Thanks
@aftabshaikh5352
@aftabshaikh5352 2 года назад
Mam, with all due respect. Please don't repeat too much !!!
@CodeWithAarohi
@CodeWithAarohi 2 года назад
Thankyou for the feedback and Yes I am already working on this.
@md.alamintalukder3261
@md.alamintalukder3261 2 года назад
Thank u so much
@CodeWithAarohi
@CodeWithAarohi 2 года назад
Most welcome 😊
@shahidulislamzahid
@shahidulislamzahid Месяц назад
This is one of the clearest explanations I have seen. You are explaining everything in detail. Thank you!
@CodeWithAarohi
@CodeWithAarohi Месяц назад
Glad it was helpful!
Далее
The U-Net (actually) explained in 10 minutes
10:31
Просмотров 92 тыс.
ЮТУБ ТОЧНО ВСЕ!
11:23
Просмотров 786 тыс.
Deep Learning - Computerphile
8:27
Просмотров 200 тыс.
Why Does Diffusion Work Better than Auto-Regression?
20:18
InceptionV3 | Inception Network
23:02
Просмотров 29 тыс.
ConvNeXt: A ConvNet for the 2020s | Paper Explained
40:08
What is Back Propagation
8:00
Просмотров 54 тыс.
EfficientNet! - Keras Code Examples
18:17
Просмотров 15 тыс.