No, You DON'T NEED OpenAI Function Calling!!!!

Подписаться 78 тыс.

Просмотров 14 тыс.

50% 1

OpenFunctions is designed to extend Large Language Model (LLM) Chat Completion feature to formulate executable APIs call given natural language instructions and API context. Imagine if the LLM could fill in parameters for a variety of services, ranging from Instagram and DoorDash to tools like Google Calendar and Stripe. Even users who are less familiar with API calling procedures and programming can use the model to generate API calls to the desired function. OpenFunctions is an LLM that we train using a curated set of API documentation, and Question-Answer pairs generated from the API documentations.
🔗 Link 🔗
🦍 Gorilla: Large Language Model Connected with Massive APIs
Gorilla OpenFunctions
gorilla.cs.berkeley.edu/blogs...
Function Calling
Gorilla Openfunctions github.com/ShishirPatil/goril...
Gorilla openfunctions v1 model huggingface.co/gorilla-llm/go...
Google Colab - colab.research.google.com/dri...
❤️ If you want to support the channel ❤️
Support here:
Patreon - / 1littlecoder
Ko-Fi - ko-fi.com/1littlecoder
🧭 Follow me on 🧭
Twitter - / 1littlecoder
Linkedin - / amrrs

Наука

Опубликовано:

23 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 53

@1littlecoder 8 месяцев назад

Learn more about OpenAI Function Calling (hands-on) ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-PPsptBoHIiE.html

@kenyeung128 8 месяцев назад

Would it be possible to ask for follow up questions for required parameters?

@stevefox7469 8 месяцев назад

Thanks, this is the video I have been looking for, for ages! Great explaination!

@1littlecoder 8 месяцев назад

Thank you very much, the model got released yesterday :)

@williamx0 8 месяцев назад

Is this similar to pydantic but for functions? How does it differ from pydantic

@d_b_ 8 месяцев назад

Why do you think theres no other open source model trying this? Since its a tone output difference, is it more than a fine tuned model? Run in to any limits on the number of functions?

@fernandofernandesneto7238 8 месяцев назад

How to serve this model locally? There is no documentation on it...

@qAidleX 8 месяцев назад

They fired Sam Altman. I am uncomfortable.

@artificial-ryan 8 месяцев назад

me too, he was the one holding back how crazy things can get lol

@qAidleX 8 месяцев назад

@@artificial-ryan I don't really know if that is true, but it still makes me uncomfortable

@christopherchilton-smith6482 8 месяцев назад

Same

@vedarutvija 3 месяца назад

This json outputs we can directly get from api as well right, whats the use of llm if it doesn't generate human like responses? Can u please make the llm generate human like response using the weather api?

@giridharreddy7011 8 месяцев назад

Please make a detailed video showing how to use this and all

@SamuelJunghenn 8 месяцев назад

I’m glad you clarified the definition of a human “like you and me” 😂

@Ram_Mandir 8 месяцев назад

.. '''

@israeabdelbar8994 5 месяцев назад

Thank you very much for this interesting video. However, I'm wondering if it's normal that the run of the function took a lot of time?

@Hypersniper05 8 месяцев назад

Airoboros model does well with function calling , you can get the dataset and extract the function calling data and fine-tune your model. Easy

@IAAM9 8 месяцев назад

can function calling work in software's like AFTER EFFETCS? Thank you

@itsmeagain0 8 месяцев назад

hi may i know the software you use in this video as canvas? thank you

@TzaraDuchamp 3 месяца назад

Can you show how to run this with Autogen?

@SimonMariusGalyan 5 месяцев назад

Thank you!

@rajasekar4991 8 месяцев назад

Why there is a sound of goat in intro?

@BrianHockenmaier 5 месяцев назад

I tried the Google Collab and the model works great for pure function calling, but unlike the openAI models it cannot respond with anything BUT a function call making it much less practical for a lot of use cases. Am I missing something? The strange thing is that the examples have function calling set to "auto" yet they always respond as if function calling is set to always.

@filipewnunes 3 месяца назад

That is a thing I was thinking about also. Because many products still need the full power of "understanding" larger contexts that OpenAI and other paid models provide. Of course, I could see many uses for this model in "simpler" and more direct user interactions, what could potentially lower the costs of the product as a whole.

@devanshdoshi2389 8 месяцев назад

How is function calling different from "tools" we give to agents?

@alchemication 8 месяцев назад

It similar, but just returns to you a definition for function, and whether you call it or not - you decide, agents typically fire functions automatically and in my experience are less reliable.

@user-md2fk3jj1e 8 месяцев назад

interesting, review my bookmarks few days ago, saw that project in it and it was looking dead. Didn't expect a new release

@TheRealNickG 8 месяцев назад

What in the world is there a model on huggingface for if I need to call Berkley and get their permission every time I use it?

@1littlecoder 8 месяцев назад

You don't need to call the Berkley thing, they're using it as an API. You could very well host the model wherever you want and use it!

@TheRealNickG 8 месяцев назад

@@1littlecoder Oh okay. I am just getting used to colab, so I was confused when I looked through the notebook at first. Thanks a bunch for clarifying!

@joehenri1 5 месяцев назад

Nice video. What if I have 1000s of functions ? It is not really efficient to give the descriptions to the LLM for every queries… how would you proceed in that case ?

@filipewnunes 3 месяца назад

Forget about using the context. Fine tune a model with the functions documentation. Or maybe not, cause sometimes I have no idea what I am talking about, I am an padawan in this field still. 😅

@mohamedhatem325 8 месяцев назад

very good video

@luigitech3169 8 месяцев назад

Is the a GGUF version avail? Is it possible to use with ollama?

@1littlecoder 8 месяцев назад

As of the recording time it wasn't, I'll wait for a couple of days to check the same

@luigitech3169 8 месяцев назад

@@1littlecoder I tested Zephyr 7B and it is quite good to get structured data from LLM

@KevinKreger 8 месяцев назад

Did they ask GPT-4's advice to fire Sam you think? 🙂

@CapnSnackbeard 8 месяцев назад

Help us escape OpenAI!

@CelestialCharisma 7 месяцев назад

Can we connect to MongoDB using function calling? Thanks

@1littlecoder 7 месяцев назад

Do you mean query MongoDb?

@CelestialCharisma 7 месяцев назад

yes, thats what I meant sorry@@1littlecoder

@michabbb 5 месяцев назад

I know Indian people struggle with "r" but you hearing speaking "parallel" is next level 😅

@1littlecoder 5 месяцев назад

Was it that bad ?

@gue2212 5 месяцев назад

The examples are cheesy (don't need yet another way to ask for the weather), mail didn't work on Gradio playground,...

@1littlecoder 5 месяцев назад

Sorry, will try to do better next time!

@zyxwvutsrqponmlkh 8 месяцев назад

Rather presumptive of you to presume I am a human.

@learn.ai99 8 месяцев назад

Sam altman wtfffff

@cowid 5 месяцев назад

3:18 "..it can call a weather API and then get the API response back and give it to you" That's not how function calling work. YOU and solely YOU make the API call. openAI does not make any API calls. It generates a JSON object that contains information YOU can use to call the weather API. As a matter of fact the page you have opened and you highlight text on says: "The Chat Completions API does not call the function; instead, the model generates JSON that you can use to call the function in your code". That'd be nice if you pay attention to what you're saying, this is misleading and factually wrong. Thank you.

@1littlecoder 5 месяцев назад

Thanks