Тёмный

Optimization of LLM Systems with DSPy and LangChain/LangSmith 

LangChain
Подписаться 49 тыс.
Просмотров 16 тыс.
50% 1

The most interesting LLM applications are less a single LLM call and more a complex system that relies on multiple LLM calls. Prompt engineering all these LLM calls explicitly can be painful and time consuming.
DSPy pioneered the idea of "optimization" of LLM systems; using automatic evaluation to optimize the instructions, few shot examples, and even the weights.
LangChain and LangSmith are starting to incorporate some of these in an *online* manner.
This video covers why you should think in terms of LLM systems, why optimization can be useful, what components make the most sense to optimize, and how to use DSPy and LangChain/LangSmith to do so.

Опубликовано:

 

5 апр 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 15   
@cm_dev
@cm_dev 3 месяца назад
I appreciate your commitment to posting relevant and informative content on a regular basis!
@istvandarvas3372
@istvandarvas3372 3 месяца назад
This was so awesome I cannot find the words to describe it. THANKS! Finally, I'm starting to feel like we're heading in the right direction with this DSPY ;) We're beginning to reach a point where AI, serving as an engine, can now be utilized alongside proven, well-developed software engineering principles. These principles are genuinely advanced, underpinned by 50 years of industry experience.
@diallo9149
@diallo9149 3 месяца назад
very informative , I'll definitely look into it ✌️✌️
@robboerman9378
@robboerman9378 2 месяца назад
Very informative, thanks for sharing. Is there anywhere I can watch the talk that the slides were originally used for?
@attilavass6935
@attilavass6935 3 месяца назад
This is great, but my pain is how to use DSPy without going bankrupt :)
@sammathew535
@sammathew535 16 дней назад
It does beautiful caching across the system, so it only calls the backend LLM, if you haven't done so, until then!
@ppbroAI
@ppbroAI 3 месяца назад
Can we use gemini as a bigger model to optimize lesser models?. I mean gemini API is free and its pretty capable
@fraternitas5117
@fraternitas5117 3 месяца назад
why would I use langchain if I had this?
@miguelovallevillamil4953
@miguelovallevillamil4953 3 месяца назад
IMO and from an application-building perspective, LangChain is necessary since you cant give the final user of your application a DSPy code as frontend. In the video they mention the idea of using DSPy with LangGraph, which I think resonates with what I said preivously ~ rather than seing them as a replacement for each other, they can be used together to build your apps.
@istvandarvas3372
@istvandarvas3372 3 месяца назад
I think you need both! The small discussion at the end about Keras which is on top of TensorFlow illustrates that the same idea can be integrated. We need 'glue' and we also need higher-level abstraction building blocks for 95% of applications out there. The mariage of LangChain and DSPy fall into this category, in my opinion. Therefore, I am looking forward to learning more about this and am excited to use these higher-level building blocks in a LangChain application. It will speed up development and testing, and at the end of the day, that is what matters most!
@Karl-Asger
@Karl-Asger 3 месяца назад
I'm wondering the same thing. I only briefly used LangChain, but have bounced around all the different frameworks since then and have been using DSPy for a while now. While I see what Miguel and Vandarvas are saying here, I don't understand what Langchain can do that DSPy can't. The DSPy abstractions are much more peaceful to work with and allow great flexibility. "LangChain is necessary since you cant give the final user of your application a DSPy code as frontend" - not sure if I'm misunderstanding, but when would you give LLM app code as a frontend? Interested to hear more on this. It sounded like Harrison was really pushing the idea of going between LangChain and DSPy, and of course pushing LangSmith as the product which looks very nice I have to say.
@waynehawley814
@waynehawley814 3 месяца назад
Normalize the Audio Next time please... i have to increase the volume by 500%...
@marcusandatlas844
@marcusandatlas844 2 месяца назад
DSPy is pretty cool but Omar *really* needs to work on his communication and presentation skills.
@ivant_true
@ivant_true 2 месяца назад
it is cool but naming is absolutely terrible!
@maksimhajiyev7857
@maksimhajiyev7857 3 месяца назад
LangChain and the overall GEN AI is a huge hype , people will get back on track soon. These technology is not stable with huge overhead. It should have been done in low level lang. The problem with AI "revolution" it is dominated with PHDs and data analysts who never did real enterprise soft
Далее
Flow Engineering with LangChain/LangGraph and CodiumAI
1:00:23
NEW TextGrad by Stanford: Better than DSPy
41:25
Просмотров 10 тыс.
Собираю Фигурку Из Лего! 🧩
0:52
DSPy Explained!
54:16
Просмотров 53 тыс.
Cognitive Architectures for Language Agents
57:16
Просмотров 10 тыс.
What is LangChain?
8:08
Просмотров 169 тыс.
GraphRAG: LLM-Derived Knowledge Graphs for RAG
15:40
Просмотров 92 тыс.
Pydantic is all you need: Jason Liu
17:55
Просмотров 171 тыс.
Easiest Tutorial to Learn DSPy with LLM Example
11:22
Просмотров 2,5 тыс.