Super hyped about this one! Kicking off a machine learning coding series! I'll be walking through the code behind many of the papers I've covered over the last few years - starting with OpenAI's CLIP! Do let me know how you find this one - feedback is very much welcome! Is the code too tiny? Too many details? You love/hate the format? Whatever do let me know!
Please do for topological graphs. Clip is easy but the hyperbolic convolution, neural sheaf diffusion and ricci flows went over my head. I only barely understood some high level concepts but like to make proper use. So if you can do coding series on that it will be uber helpful
This is great! With all the new fancy models I kind off felt left behind, but this is surely going to help me to learn how these models work under the hood. Thanks, and make more like this!
Can we have code implementation of neural sheaf diffusion, ricci flows and hyperbolic graph convolution. I was liking that flow of works…. So maybe some code demos will be very helpful to see how i can implement them
Good content! I actually want to work on something similar🤣 When it comes to feedback, I would suggest more high-level overview of functions(maybe like a list or visualisation) and overall model structure before you dive deep into the explanation of nitty-gritty details of the code. Nevertheless, great job bud!
Great stuff as always! A not necessarily related question (but came to my mind after seeing you using PyTorch here): Do you have the freedom of what framework to use at work, or is DM fixed on their JAX ecosystem? Looking forward to the next episode in the series 🥳
we fix the size to be 77, in order to be independent of the text lengths, so the token is going to look smth like [ # # # # 0 0 0 0 0 0 0 0 ... 0] where # correspond to text value and 0 to the empty. In short, think of texts encoded as [ word word word word word empty empty empty empty empty] --> [ # # # # # 0 0 0 0 0 0...]
@@TheAIEpiphany 😂😂I thought you were being like sarcastic or something and just trying to hide it 😂 Well I hope you enjoy it, it’s pretty good I think. Also thanks a lot for your videos, they are really helpful and inspiring , I too will soon want to make teaching videos and stuff once I get a grip on more concepts
Great Video I am not able to join the Discord Channel Actually my account was hacked by my frnd and he spammed some channel Did you block me for this? Plz un-block? Thanks
