CUDA Mode Keynote | Lily Liu | vLLM 

In the evening session, Lily (Xiaoxuan) Liu, presented vLLM, the most popular high-performance library for LLM inference, with a deep dive on speculative decoding.
More about the event:
The CUDA Mode server met for the first-time for an IRL hackathon: events.accel.c...
6 Keynotes from the First CUDA Mode IRL Hackathon: www.accel.com/...
Tri Dao: Together.ai: • CUDA Mode Keynote | Tr...
Supriya Rao: PyTorch Insights: • CUDA Mode Keynote | Su...
Andrej Karpathy: Eureka Labs and llm.c: • CUDA Mode Keynote | An...
Lily (Xiaoxuan) Liu: vLLM: • CUDA Mode Keynote | Li...
Tim Dettmers: The Power of Open Source: • CUDA Mode Keynote | Ti...
Wen-mei Hwu: How to Pick a Hard Problem: • CUDA Mode Keynote | We...
Accel:
Accel is a global venture capital firm that is the first partner to exceptional teams everywhere, from inception through all phases of private company growth. Atlassian, Bumble, CrowdStrike, Fiverr, Flipkart, Freshworks, Qualtrics, Scale, Segment, Slack, Spotify, Squarespace, Tenable, and UiPath are among the companies Accel has backed over the past 40+ years. We help ambitious entrepreneurs build iconic global businesses.
Connect With Us:
Website: www.accel.com/
Linkedin: / accel-vc
Twitter: / accel
#CUDAMode #GPUMode #hackathon #vllm #llm #opensource #opensourceai

Наука