🎥 Once a month, we'll meet, socialize, and hear speakers present topics on unstructured data and generative AI. This event was sponsored by Zilliz.
Timeline:
03:53 - An welcome from Charles Xie, Zilliz Founder & CEO
18:06 - Speaker Jiang Chen, Building RAG with self-deployed Milvus vector database and Snowpark Container Services
45:24 - Speaker Mike Del Balso, Full RAG: A Modern Architecture for Hyperpersonalization
01:15:30 - Speaker Chaoyu Yang, RAG as a service with BentoML
~~~~~~~~~~~~~~~ CONNECT ~~~~~~~~~~~~~~~
🎥 Playlist • Unstructured Data Meetup
🖥️ Website: www.meetup.com...
X Twitter - / milvusio
🔗 Linkedin: / zilliz
😺 GitHub: github.com/mil...
🦾 Invitation to join discord: / discord
~~~~~~~~~~~~~~ MEETUP VIDEO CONTENTS ~~~~~~~~~~~~~~
1. Host: Chris Churilo
LinkedIn: / chrischurilo
2. Speaker: Jiang Chen, Head of Ecosystem & AI Platform at Zilliz
Title: Building RAG with self-deployed Milvus vector database and Snowpark Container Services
Abstract: This talk will give hands-on advice on building RAG applications with an open-source Milvus database deployed as a docker container. We will also introduce the integration of Milvus with Snowpark Container Services.
Slides: www.slideshare...
3. Speaker: Mike Del Balso, CEO & Co-Founder, Tecton
Title: Full RAG: A Modern Architecture for Hyperpersonalization
Abstract: Mike Del Balso, CEO & Co-Founder at Tecton, presents "Full RAG," a novel approach to AI recommendation systems, aiming to push beyond the limitations of traditional models through a deep integration of contextual insights and real-time data, leveraging the Retrieval-Augmented Generation architecture. This talk will outline Full RAG's potential to significantly enhance personalization, address engineering challenges such as data management and model training, and introduce data enrichment with reranking as a key solution. Attendees will gain crucial insights into the importance of hyperpersonalization in AI, the capabilities of Full RAG for advanced personalization, and strategies for managing complex data integrations for deploying cutting-edge AI solutions.
Slides: www.slideshare...
4. Speaker Chaoyu Yang, CEO & Founder, BentoML
Title: Infrastructure Challenges in Scaling RAG with Custom AI models
Abstract: Building Retrieval-Augmented Generation (RAG) systems with open-source and custom AI models is a complex task. This talk explores the challenges in productionizing RAG systems, including retrieval performance, response synthesis, and evaluation. We’ll discuss how to leverage open-source models like text embeddings, language models, and custom fine-tuned models to enhance RAG performance. Additionally, we’ll cover how BentoML can help orchestrate and scale these AI components efficiently, ensuring seamless deployment and management of RAG systems in the cloud.
Slides: www.slideshare...
5. Lightning demo: Yi Zhang, Relari ai
Title: Using Synthetic Data to Test and Fine-Tune LLM applications
Abstract: In this talk, Yi will walk through a data-driven approach to test and improve LLM / RAG applications. In particular, he will cover how to use Relari's synthetic data platform and open-source evaluation framework "continuous-eval" to systematically harden and fine-tune LLM systems. Relari is backed by top investors including Y Combinator, Soma Capital and General Catalyst.
3 окт 2024
