AutoGen Advanced Tutorial - Build Incredible AI AGENT Teams

Подписаться 286 тыс.

Просмотров 111 тыс.

50% 1

In this video, I break down every topic you need to know to become an AutoGen master. Some topics include caching, best practices, enhanced inference, multi-agent setup, LLM daisy-chaining, a brand-new agent type called Teachable Agent, function calling, templating, and so much more.
Enjoy :)
Join My Newsletter for Regular AI Updates 👇🏼
www.matthewberman.com
Need AI Consulting? ✅
forwardfuture.ai/
Rent a GPU (MassedCompute) 🚀
bit.ly/matthew-berman-youtube
USE CODE "MatthewBerman" for 50% discount
My Links 🔗
👉🏻 Subscribe: / @matthew_berman
👉🏻 Twitter: / matthewberman
👉🏻 Discord: / discord
👉🏻 Patreon: / matthewberman
Media/Sponsorship Inquiries 📈
bit.ly/44TC45V
Links:
Use RunPod - bit.ly/3OtbnQx
AutoGen Beginner Tutorial - • AutoGen Tutorial 🚀 Cre...
AutoGen Intermediate Tutorial - • AutoGen FULL Tutorial ...
AutoGen Fully Local - • How To Use AutoGen Wit...
AutoGen 100% Open-Source - • Use AutoGen with ANY O...
AutoGen - microsoft.github.io/autogen
Chapters:
0:00 - Intro
0:56 - LLM Config
6:47 - Config List
10:54 - Caching
13:31 - Enhanced Inference
19:36 - Templating
21:20 - RAG Agents
26:20 - NEW Teachable Agent
31:35 - Using Docker
32:57 - Function Calling
36:07 - Agent Tool Learning

Наука

Опубликовано:

11 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 257

@matthew_berman 8 месяцев назад

What topics do you want to see me do an even deeper dive into in my AutoGen expert tutorial?

@jp00738 8 месяцев назад

Do some real life examples of what we can do with it! Maybe setting up a react project and edit by itself, data analysis, expert bots for social media, etc.

@JonathanPohlner 8 месяцев назад

you said you usually run it inside Docker, that's what I've been doing. I just found an Anaconda Image, but I'd be courious to see how you set yours up in case I missed something.

@GeandersonLenz 8 месяцев назад

Automation Process. RPA. Webscrapping

@marilynlucas5128 8 месяцев назад

Please the examine using mistral in LM studio for Autogen.

@paulramos5732 8 месяцев назад

I think a deep sewing it all together with a practical example of all the steps for solving a complex task with multiple agents? My pitch is for getting a 'team' of agents to generate a boilerplate webapp instantiation. It's a common task that happens, Setup X in a docker container that connects with Y in another docker container. Maybe utilize the RAG assistant to consume documentation? (Can RAG take more than a single link? An array of links? ) . Your videos have been an immense help in me getting things sorted in autogen. So I want to say much thanks for this and all your previous videos. Also, I'm attempting my own effort on my suggestion above. If I get there before you I will definitely share knowledge with you.

@christopherwilms 8 месяцев назад

I’d love to see content showing numerous different agents working together in their unique roles

@MrBiscuit696 8 месяцев назад

Well done! I really like that you are deep diving in to Autogen. Most of the other content creators re just scratching the surface. 🥇

@pink-doublethink 8 месяцев назад

Thank you for sharing such valuable information on Autogen and its advanced functionalities. I look forward to learning more from you in the future. Keep up the great work!

@kigas24 8 месяцев назад

Best tutorials on RU-vid, thanks for all your work.

@patman6586 8 месяцев назад

Thank you so much! I've been looking for instructions like this since AutoGen was released.

@JonathanPohlner 8 месяцев назад

I've been eagerly awaiting this. Excited to see what you've come up with.

@matthew_berman 8 месяцев назад

Feedback is always welcome!

@JonathanPohlner 8 месяцев назад

mixing config list is definately something I've been curious about, mainly because I want some local, but then outsource the heavier lifting.

@NetZeroEarth 8 месяцев назад

Thank you for walking us through this step by step . Please keep these videos going

@picklenickil 8 месяцев назад

I have watched this 5 times and still feel fascinated. Can't wait for expert level tutorial. Please make it really through. We can handle complex!😊

@jerbear7952 8 месяцев назад

When were you elected?

@mickelodiansurname9578 5 месяцев назад

@@jerbear7952 Techie President Election 2024... you can vote for me too... Vote for me! Free Tacos for all! In fairness though, when Matt says "Do you have any suggestions leave them in the comments," I don't think he was suggesting we all come to a consensus. And again just to remind you.... Vote for me... free Tacos for all. Message Ends

@MrGaborKukucska 8 месяцев назад

Thanks for another Awesome video Matthew 🙌🏼👏

@jacobsmith7877 8 месяцев назад

Been waiting for this!

@phillip_jacobs 8 месяцев назад

Beeeeeeen waiting for this! Thanks Matt!

@alfredodominguez373 8 месяцев назад

Excellent content, thanks for sharing!!!!

@leowalker07 8 месяцев назад

Thank you for putting these AutoGen Tutorials together! I'm excited for your "Expert" level tutorial.

@JayEggerPR 8 месяцев назад

This was awesome! Thanks for sharing!

@gregorykarsten7350 8 месяцев назад

Wowwow🎉 Huge potential! Definitely examples of function calling, teachable agent and reflect/learn, user feedback😀

@matthew_berman 8 месяцев назад

Yes! Thank you!

@user-pq3uz2zb9i 8 месяцев назад

Keep it coming my man!

@thiagoamorim9172 8 месяцев назад

great! tnks for this video!

@BunniesAI 8 месяцев назад

This is awesome!! I'm blown away by Autogen. So happy that you're doing all these videos on it. Let's create something usefull from start to finish (as an idea for a future expert video on Autogen) 😍

@purvislewies3118 8 месяцев назад

...IT SOUND GOOD

@FlyinEye 8 месяцев назад

These are great. I'm rewatching this again.

@nsshing 7 месяцев назад

Thank you for the great video! A 38-min video actually took me hours to digest the knowledge. This is amazing. It will certainly save us a lot of time to test things out! I'm looking for the expert tutorial!

@ricksavi5735 6 месяцев назад

this is crazy stuff, awesome videos

@yonathanadmasu2892 8 месяцев назад

Big fan of this channel. Great content. Would love to see these agents working together in practical small project

@Chris-yf2wo 8 месяцев назад

Fantastic overview of autogen, I'm really looking forward to the expert video

@BrianPotterProductions 8 месяцев назад

Killer killer KILLER content as always! Thanks!

@matthew_berman 8 месяцев назад

Thank you!

@__--JY-Moe--__ 8 месяцев назад

Matthew! U'r so helpful! this is changing my life!

@renierdelacruz4652 8 месяцев назад

Great job Matt, will explained, you are the best.

@matthew_berman 8 месяцев назад

I appreciate that!

@user-gx6ym6by2f 7 месяцев назад

Very clear explanation, thank you.

@alefalfa 8 месяцев назад

Amazing video. Thank you soo much!

@arkochakrabarty7158 8 месяцев назад

These videos are so informative and helpful.

@ALOHAPP 8 месяцев назад

Very informative!!

@user-fs8ve7uo1o 8 месяцев назад

Awesome job!

@hy3na-xyz 8 месяцев назад

Cant wait for that expert video!!!!!

@ckuffo 8 месяцев назад

Yes more AutoGen videos!🥳

@elierh442 8 месяцев назад

This is great content! More videos please, I'll watch all of them.

@alexjensen990 8 месяцев назад

Very excellent video!

@jonconnor6697 8 месяцев назад

!!!!!Congrats on the 100k Subs bromethieus.

@realCleanK Месяц назад

Appreciate you! 🙏

@unc_matteth 8 месяцев назад

i am going to be going through all your videos for autogen this weekend. i have a very specific use case that i want to automate a ton of creative work with this. took a while of manual work to get to the point i'm ready to automate the rest. I have watched each of these but still need to sit down and go through the motions. besides creative applications, there's a business use case then also that is kind of along the same lines, but will take a bit more tweaking. i'm going to try to plow through it, then might come discuss with you if i get stuck. as far as more videos on this, i would love to see a full start to finish, setting it up with everything you've learned through your growing pains, in a comprehensive step by step manner. don't give us choices :) tell us which is the best model for use for each type of usage. i bet a head to head, multi screen battle between the different models on different tasks with the exact same prompt would be a blast to watch. 4 or 6 models, sync the enter of the prompt for each and go! see what happens real time with all of them basically competing against each other.

@agenticmark 8 месяцев назад

almost 100k, great job!

@matthew_berman 8 месяцев назад

So close!

@forcanadaru 8 месяцев назад

Thanks!

@unc_matteth 8 месяцев назад

thanks! this was my plan for this weekend. i really need something that can handle long text with memory

@Ryan-yj4sd 8 месяцев назад

Real useful examples

@micbab-vg2mu 8 месяцев назад

Thank you - Autogen is great!!!

@justriseandgrind6910 8 месяцев назад

great video, it hurt my brain. so much to learn!!!!

@MushroomLamp 8 месяцев назад

Fantastic video, thank you. I would love to see an example of multiple function calling agents in a group chat, where each agent has its own set of functions it can call. I've only really gotten this to work when only the user proxy agent can function call

@synaesmedia 8 месяцев назад

Very useful.

@shroomi8941 8 месяцев назад

hey. I'm absolutely blown away. i would love to invest some time into autogen over the next few weekends. the whole topic is relatively new to me, and to a large degree daunting... but im curious. where do i start? a big thank you for openly sharing this tutorial. kinda excited

@grimtagnbag 8 месяцев назад

Can’t wait to try. I can run some of the things u talk about. I haven’t had the best of luck. ROCM is hard to get started for my scrubby ass.

@aladinmovies 8 месяцев назад

RAG it is interesting, needed tutorial about this, may be in expert level of Autogen. Thank you!

@MetaphoricMinds 8 месяцев назад

How many seeds of innovation shall sprout from this newfound zenith of intellectual mastery? The intellectual possibilities are endless!

@user-vx5wn6hy9r 8 месяцев назад

Great tutorials, thank you so much, and keep going! Could you please complete the last example of "storing" the recipe with the TeachableAgent and call it by other agents?

@irshadgirach2213 8 месяцев назад

Great video! I couldn't figure out a way to make agents follow the plan of a planner agent since any agent containing a function call is given first preference. It would be great if the agent can keep the function in its pocket but use it when it is actually required. Any details or information on that would be great!

@dolevmp 7 месяцев назад

Thanks for the video! When is the expert coming? I would love to learn how to control the conversation flow. Make sure some agents only talk with some agents or making the human talk only with a team lead.

@PPostbus 8 месяцев назад

THANKYOU

@gregmeldrum 8 месяцев назад

Amazing video Matthew!! I'd love to try some of this locally by running an OpenAI I/F server backed by a Mistral finetune.

@gregmeldrum 8 месяцев назад

Also, you should add a chapter around 21:20 for RAG Agents.

@matthew_berman 8 месяцев назад

Will do! thank you

@ladykilla85 8 месяцев назад

Thank you for easing into it. It does get a bit dry though. No real fault of your own or toooo much you could do. Only suggestion I could think of would be to show examples and differences with and without each of the paramaters/configs/settings. Obv it's already a 38m long video, so that would necessitate turning it into an even longer >>series

@adamrodriguez7598 8 месяцев назад

Epic!

@fbravoc9748 5 месяцев назад

Great Video!! It would be nice to be able to learn how agents could get data from a json file or database

@frankismartinez 8 месяцев назад

Functions with open LLMs; so that we can decouple the OpenAI dependency. Then, functions + tools.

@matthew_berman 8 месяцев назад

Fine-tuned OS models that are specific to a project 🚀

@marilynlucas5128 8 месяцев назад

You’re 100% right. I want to decouple from open AI so bad. There are so many great models out there!!

@kawalier1 8 месяцев назад

You're really rendered:)

@mosmo85 8 месяцев назад

Great Content, thx. Could you provide information on how the knowledge base (embeddings / knowledge of the teachable assistant) affects token usage. E.g. I want one assistant to answer questions based on one large pdf (ebook) with expert knowledge. I guess i have to pay for processing the pdf at least once. But how is the token usage calculated after the first processing. is it significant more expensive?

@gptOdyssey 8 месяцев назад

Another great video, thank you! Just wondering how can we make sure the agent will execute the code? I often get answers that “As an AI agent, I don’t have the ability to execute the code”.

@knotenvy9135 8 месяцев назад

pen-al-ity?! lol presence penalty... Thanks for the content! Keep them coming.

@Architek1 8 месяцев назад

Great video! I haven’t been able to get the OAI Config to work. Always returns, ‘it doesn’t exist’ even when I provide the PATH to it.

@chidera02 8 месяцев назад

Can you expand more on teachable agents please, particularly the limits

@chrisbraeuer9476 8 месяцев назад

A beginner tutorial. I feel like most of it is above my head.

@jorgerios4091 8 месяцев назад

Oh what a great video! Would you please create a vid showing how to use the RAG agents with haystack and weaviate? (I've seen langchain is too slow) BIG thanks!

@genericwannabe 8 месяцев назад

To vary the wait time you could just make a loop that redefines the wait time using the formula you’d prefer.

@borjarobles9538 8 месяцев назад

Its there a way to use autogen like an api endpoint with fastapi ? So you can call the endpoint, the agents do the work and return a json response ?

@Syphronix 8 месяцев назад

Would be excellent if there was a GUI associated with this!?

@clarencejones4717 8 месяцев назад

Challenge accepted

@clarencejones4717 8 месяцев назад

I may base it on textgen Web UI. Sharing a GL link and Notion to share ideas. To start, It'd be if: -Agent configs and knowledge bases could be stored and shared - There was a collective knowledge that agents can draw from as needed.

@KlausPilsl 8 месяцев назад

Hey Matthew, Your videos are a thrill! A Questions: How do Teachable Agents compare to finetuning?

@danieln7777 8 месяцев назад

Fine tuning means parameters are getting adjusted. The teachable agents have the same parameters but they have access to a vector database of information

@BibopGresta1 8 месяцев назад

Really a great guide! You're really amazing!! Can we have a link to the code?

@asatorftw 8 месяцев назад

One a quick glance it seems on a high level langchain can do all of this as well. Just do different endpoints per agent and make them work together. Or am I missing something?

@BruceOnder 8 месяцев назад

This is awesome. I just blocked out an entire day just to go through all of this. 😅

@matthew_berman 8 месяцев назад

haha enjoy!

@user-pq3uz2zb9i 8 месяцев назад

My top people - Obama, Ray Dalio, Matthew Berman!! Awesome job mman so much appreciated!!

@rudomeister 8 месяцев назад

How nice. Since it will be three tutorials for AutoGen I have to seriously include this framework into my project: AI-Town. Everyone should have an AI-town, GPT models doing the tasks you see they benefit yourself and themselves the most! It's tobad GPT models where born with Alzheimers.

@Tips-r-us 6 месяцев назад

i have llm Sudio running on my mac, but I cant seem to find how to install autogen. is there a video before this to explain how to get set up ready to do this?

@codescholar7345 8 месяцев назад

Great video! How did you get 2 instances of LL Studio working locally?

@iokinpardoitxaso8836 8 месяцев назад

Good question. Is it possible? Would love seen it. Thanks in advance.

@AI_In_The_wild 7 месяцев назад

When are you going to make this expert tutorial available

@noober09 8 месяцев назад

Oh yeahhh

@lucface 8 месяцев назад

Please do another vid on what is autogen and what agents can theoretically do for me or people like me? I’m creating a small skydiving business. Please elaborate creatively with your new understanding of expert settings and such.

@rushout09 8 месяцев назад

how is MemGPT different fro teachable agent? and when to use which one?

@antigravityinc 8 месяцев назад

Dude, dive! DIVE!

@qalyoube5750 7 месяцев назад

I saw a video about using memegpt with autogen, how is it relevant when you already have reterivalAgent and techableAgent in autogen, why would you use memgpt?

@ronpaynter7054 8 месяцев назад

I just plugged in TieFighterLR 13B and told them to code a game for me. The chat manager became an interviewer and started interviewing all the Agents for positions on the team. I hope they pass the interview.... LOL

@seppimweb5925 8 месяцев назад

Would like to see all the incredible things. 😆

@user-wr4yl7tx3w 8 месяцев назад

can you provide links to the articles you referenced in the video.

@jonolavabeland8042 5 месяцев назад

Can this be used together with Semantic Kernel?

@mercadolibreventas 8 месяцев назад

Great Job! How would we exted the memory for thse models, the idea, is to create a lmem for each agent as the continue to improve the models correctly utilizing Sparse Priming Representation (SPR) or MemGPT, can you also include such a setup so that you can add one of these memory solutions, and you train the models and the teachable agents., one last thing would be to load data, into the training models, with different data points that should be specific to those agents or models, the worst thing to do is train a model for the agents tasks that are to general and are reused across all models, Thanks!

@user-dw6wd1mn9z 5 месяцев назад

can i run dolphin-25-mixtral-8x7b on this? wihtout having to buy the VRAM?

@mickelodiansurname9578 5 месяцев назад

Yeah Matt maybe put a few bucks into it and ask us all to come up with a plan as to what you prompt it with, build the agents to do that thing... and see how far it gets... not something really complex, but complex enough that it give a good all round measure of Autogen' studios ability... maybe building some small app, or posting things using Zapier as you mentioned, or even using autogen studio to modify, wait for it, Autogen Studio! lol

@JosephCardwell 7 месяцев назад

100% Choice content.

@MagicIsReal 8 месяцев назад

🎯 Key Takeaways for quick navigation: 20:10 📝 Autogen allows you to create templates for solving problems and add step-by-step explanations to your solutions. 21:22 📚 Rag (Retrieval Augmented Generation) agents can pull information from external data sources, enhancing their knowledge and capabilities. 27:09 🧠 Teachable agents in Autogen can retain information beyond the current chat session, making them useful for long-term learning and knowledge retention. 32:04 🐳 Autogen recommends using Docker for code execution to ensure a secure and isolated environment. 33:13 🔄 Autogen allows you to define custom functions that the language model can execute, expanding its capabilities. 36:15 🛠️ Autogen can be taught to use new tools and methods, allowing it to adapt and learn from your interactions. Made with HARPA AI

@noober09 8 месяцев назад

Can we combine this with memGPT?

@sicksparrow7023 8 месяцев назад

@omkareshpali8486 3 месяца назад

What would you sufgest if we neeed to keep talking to user till the agents receive all the information they need to do the tasks?

@malikrumi1206 8 месяцев назад

Could an end user inject false information into the teachable agent? If so, could it then be learned, saved, and spread to others? What defenses are available to prevent that?

@robjdrum 8 месяцев назад

Are any of these agent scripts coming out able to do iterations after you get to your first terminate if you're building code/software? if not, it seems like a ton of work to not be able to iterate off your first run thru. As in creating an app or website code and then being able to go back and add or change a feature once you've been able to go hands-on with something created?

@muhammedkoroglu6544 8 месяцев назад

Yes, you can define the agents so that they ask for feedback at TERMINATE. When they do, just go check their implementation, and tell them what to change.