Merge LLMs to Make Best Performing AI Model 

i hope you find the video useful and don't forget to show (and brag about) your blended models!

Awesome video!! Been following your series on building AI agents and they're very good! Thanks for sharing!

This is destined to evolve into a meticulously curated, go-to channel of human reliability for years to come. Thank you very much for the exceptional quality you provide!

Its mindblowing to me how good your videos are yet you are still so unknown. Keep it up!

Blending LLMs is a fascinating idea. The idea left me wondering: Why hasn't anybody developed a system/app that takes the API's from the top LLMs, created agents for each, and then have these agents all work together to brainstorm, debate, review, and solve problems? I often get 4 different answers from 4 LLMs, so why not have them all setup as agents "in one room" working together to come up with the "best" solution. I can't find anybody that's tried this... why not? Wouldn't having the "top minds" (LLMs) working together produce better results?

Fantastic video, so well prepared, fool-proof explained, and a really cutting-edge topic. Best AI RU-vidr out there - thank you 🙏

Great video Maya! Keep em coming! 😎

Wow, what an incredible explaination of merge methods. Thank you.

Awesome, thanks for the gerat video. Very well explained, great diagrams! :)

Excellent walk through, thanks !

Maya, you are good at this stuff. you are averaging my internal mind vectors to make Ai easy. Keep doing so!

well articulated and educational video, thank you Maya!🙏🏼

Great video Maya. Keep it up ❕❕❕

wow, most sophisticated RU-vidr ever. New favorite channel.

Thanks Maya!

interesting, easy to follow, well researched and critically scrutinized the results. like your content!

lot of information about so many topics presented nicely.

Very insightful 👍

Very good explanation. I'm looking for such easy to understand video how to fine tune a model locally .

Great video and exactly what I need at the moment. Having a lot of specialized models for science, translation, coding, finance etc but no good way of combining them.

Thank you for the insights

thanks, great video!

great video, loved the explanation of all the technical stuff. Would love to know your process on how you read and understand these topics in-depth?

Love the props with storytelling! Great instructional video!

Great Video👏🏻

🎯 Key Takeaways for quick navigation, however this summary does not avoids you watch the complete video for a more in deep understanding:: Main Ideas: - 🌍 Model blending is an innovative approach to surpass the performance of high-cost models with limited resources. - 🤖 Non-experts can effectively blend models, demonstrating the technique's accessibility. - 💡 The blend allows for specialized functionality, combining models tuned for diverse tasks into a powerhouse model. - 🛠 The merging process involves selecting compatible models, defining parameters, and executing the blend with basic command line knowledge. - 🔄 Various blending methods like task vector arithmetic and SLURP offer unique advantages for custom model creation. - 📚 Proper selection and preparation of models are crucial, with a focus on architecture compatibility and avoiding common pitfalls. - 🏆 Blended models can achieve top rankings on leaderboards, though their position may fluctuate. - 🤔 The effectiveness of benchmarks in evaluating model intelligence is questioned, highlighting the issue of data contamination. Takeways: 00:00 *🤖 Introduction to Model Blending* - Introduction to the concepts of model blending, showcasing the power of combining models to overcome resource limitations and improve performance. - Highlights two models, Mixol and Ramonda, emphasizing the potential of model blending even with limited resources. 01:24 *📘 Basics of Model Blending* - Detailed explanation of model blending, its significance, and the methodology behind efficient blending. - Discusses the blending process, the importance of model selection, and the steps involved in creating a blended model. 02:05 *💡 The Promise of Blending* - Explores the potential of blending models to create top-performing LLMs without the need for extensive resources. - Focus on the accessibility of fine-tuning and blending for personalized model development. 03:33 *🛠️ How to Blend Models* - Provides a practical guide on blending models using MergeKit, including setup and execution steps. - Emphasizes the ease of blending models with basic knowledge and the right tools, offering an approachable method for enthusiasts and professionals alike. 05:33 *🧪 Detailed Blending Methods* - Deep dive into various blending techniques such as task vector arithmetic, SLURP, TIES, and DARE, explaining their unique applications and benefits. - Discusses the technical aspects of model blending, offering insights into choosing the right method for specific goals. 08:17 *🖥️ Preparing for Blending* - Guidelines on selecting compatible models for blending, emphasizing the importance of architecture and layer compatibility. - Instructions for downloading models from Hugging Face and preparing for the blending process. 10:33 *📝 Configuring YAML for Blending* - Step-by-step instructions on setting up YAML files for blending, highlighting the importance of specifying base models, merge methods, and parameters. - Offers practical tips for configuring blending parameters to optimize the blending process. 13:42 *🚀 Executing the Blend and Evaluation* - Detailed walkthrough of the blending execution using MergeKit and subsequent evaluation through a text generation interface. - Encourages testing and fine-tuning of the blended model before submission to benchmarks or public use. 15:45 *📊 Performance Testing and Data Contamination* - Discusses the significance of performance testing on open LLM leaderboards and addresses the issue of data contamination in model training. - Highlights the importance of careful model selection and blending strategy to avoid overfitting and ensure genuine improvements in model performance. I hope this helps everybody!

¡Gracias!

Excellent video! The development outlook seems open to so many possibilities. I'm curious if anyone will find advantages in networks built via diffusions(similar to image generation) or if there will be more real time dynamics implemented as the model responds to a query.

Nice Video! Do we have the ability to fine tune the model on own codebase?

You are amazing… thank you

Very good lesson and explanation ! So far the best on this subject .. as the main problem I have was running the models after . I could not find the definitive method to work ... Despite one of the models scoring high it could not run in the HF Inference plugin on the model card ..

Can we blend multimodal models like llavaa and mistral and gemini vision? Can u make a video on it pls..❤❤

Great content.

Amazing video! I didn’t know it could be done. I am definitely going to make my own uncensored blended model for coding. I am tired of openai telling me that I should not modify/hack code without owner permission even if I am the owner, and I am trying to test how solid the code is…

Great video. How does this differ from the Mixture of Experts (MOE)?

Very underrated channel!! This is enlightening. How a person can be so smart and beautiful too at the same time 😭😭

The combination of spending time messing w ai along with your videos are inspiring me to build my own workstation. Not sure if that's smart considering I don't know how to code. So far I have ordered: super micro x12dai mobo 2 platinum 8352s 2 rtx 3090s 2 sata 12 tb 2 optane nvmes for os and quick retrieval stuff 128 gb lrdimm ddr4 E-ATX case, cables & ps Do you do any consulting work via zoom? I may need some direction soon.

Nice video

We thank you for all the amazing content and as such , being a great content creator , i dont wanna sound nitpicky , but since you are already attracting and leaning towards the DIY crowd you may as well be using the open source tools as well { vs Codium} etc. Just a small critique because i love the content.

What happens if you merge two models of the same family but they each have different context lengths? Does the model with the larger token window take precedence?

Genius

Thanks! What software are you running for loading and inferencing your merged LLM using localhost in browser?

Maya, a great video, thank you. Quick question, where are you based? The reason I ask is I'm looking for an AI speak in the UK, you came to mind so was just wondering. Again, excellent video, amazing depth.

Is Combining tools like SWE-Agent, Crew AI, and OS-Copilot into a cohesive agentic workflow possible

Stacked and Cascading ensembling have been around for awhile

Since we don't have access to the training data, it is simply impossible/unfeasible to choose models based on whether they have or don't have contaminated data.

after that i could use my customized model from hugging face or locally on my app's?

can you test agent frameworks like CrewAi with Claude 3 opus?

Maya.. you are the girl!!!

🎉

Bach wtc 1 prelude 21 😍

How can I fine-tune the LLAMA 3 8B model for free on my local hardware, specifically a ThinkStation P620 Tower Workstation with an AMD Ryzen Threadripper PRO 5945WX processor, 128 GB DDR4 RAM, and two NVIDIA RTX A4000 16GB GPUs in SLI? I am new to this and have prepared a dataset for training. Is this feasible?

👍

3:40 and now add robots 🤖 cheers🥂

LLMs catching up to something Stable Diffusion users have been doing for awhile. Open source is the way.

LLM: Tokenization vs MAMBA, please make video about this

Why does Slerp only support two models? Can’t you just slerp between pairs, then slerp the slerps, etc until you have 1?

My only question while watching was. Why should I make a model? I figure there is going to a be a infinite number of models being created by people and soon to be ai models created by ai models. So my question is, what is the point of making a custom model aside from fine tuning on data. I use autogen, would creating a model like your doing. empower a local model to let's say.. chat on my data, and be good at function calling? maybe this would be an experimental way to possibly make my own model specifically for autogen? Like Ik someone out there is already working on that specifically and even you showed those models specifically used for function calling in one of your other vids.

Good soup

So it's like mixing colors, back in kindergarten, you'd always blend everything together hoping to create this amazing hue, but it always just ended up this muddy, ugly brown

Wanna get “addicted”.

At first - I was excited to see a new video with useful info - but when it got to that crime scene mapping thing you do - well... sorta creepy, no? What is that method called? Conspiracy mapping? Good visuals but wow... I lost track of what was going on with it... maybe it was more of a "Why are you putting holes in you walls? Some poor guy is gonna be like "...where's the spackle and putty knife? Some tenant/wife/daughter/kid poked a bunch of holes in my wall"... I never understood how so many holes got poked into my daughters walls or even our living room walls (ahem... the wife) but maybe this is just something that is fun to do? Now, do a video on how to patch all those little holes and get a paint roller with medium nap to repaint and cover everything up - but don't just paint a small area... no.. gonna probably have to paint the whole wall so there's no more streaks and visible coverups.. or at least learn how to feather out the edges so they blend better with the existing paint on the walls.. ugh... can't plug those holes and paint with an ai agent (yet)... so at least some skills are still worthy of known and learning... go get a guy or gal with some handy work skills - mechanical skills or something useful that AI can't do well any never will (likely for a long time) and you at least know your guy/gal will be useful given that AI will be putting lots of other people out of work (and is already doing so). I need to hire some people to help me get this working for our company - but I can't afford to keep paying drywall contractors every time we get a new idea... lol

Stop saying it's so simple... yes, for you it is.

Monoltic LLMs < MulitAgents

why not just use autogen?

your timing is scary

so a claude haha

It's not about collecting links with information and adding below the video... The important information is: which models are compatible and how to write the configuration file, which you barely mention! I can find all these links myself.

problem with making vids that require prior knowledge and experience, is those who would find the information most useful, cannot make use of that information due requiring that prior knowledge and experience, yet at the same time the information provided in the vid is at the level to service a novice who had no prior interest, so who is the audience being catered to?

Too many video of AI nerds on TouTube... for AI nerds, hardly anyone makes videos for the average John and Jane, resulting in a large group people detached from AI.

@maya-akim blending would be the best word for this right, merging I think is the word people are using for it don't you think

¡Gracias!