Gemini 1.5 Flash is ~86x cheaper than gpt-4 of Mar 2023, it has 125x longer context window, it's many times (10x?) faster, and it's more (or similarly) capable, it has many-fold better retrieval than the 32k context original gpt-4 which was ever twice as expensive as the 8k I'm comparing Flash to. And Flash is nativaly multimodal. Those combined orders of magnitude improvement would be totally unbelievable in any other industry for 14 month progress. Congrats Google team. PS. Logan is the best! Thanks for sharing
Awesome stuff ❤ Could you at some point do a deep dive into the cutting edge of synthetic data generation? Or more broadly, what is being done and what is possible, in terms of designing new data and information structures? Perhaps also the role of simulations, generative human-AI dialogue over time and iterative development of new concepts and informational architectures, for possible flywheel effects of conversations with current LLMs > prompting strategies > new datasets > fine-tuned models or agents etc…over time? Perhaps what role open-source community driven LLM assisted data design might play in the near and far future? This seems like almost totally untapped territory considering the surface area of multimodal AI, and that the amount of possible data structures seems to be infinite.
It sounds like you did not speak to him even once about how AI is being used in Google search products, and how Google is using open web content in its AI development and AI product offerings. Is that right? Not a single word about "AI Overviews" quality, and the impact on search and the open web?
Google is big bro, Logan obviously not working on Search, he have no authority to talk about that. Even core engineer at Search rarely talk about Google also, since google Algo really lucrative for SEO hustler to gamify.
@@mriz @nathanlabenz @neom0nk Perhaps that is so... but besides search, there is no real discussion of application at all. And this is typical for this guy anyway. The convos are always a big AI circ1e jrk with him talking incessantly to inflate the guests. Never really pushing, or exploring new topics. I assume that is why they recently started doing clips.. bc the audience retention on 1.5 hours of this stuff must be terrible.
