Hands on with the Vercel AI SDK 3.1

Подписаться 84 тыс.

Просмотров 25 тыс.

50% 1

Learn how you can use the Vercel AI SDK as your Typescript Framework for building AI applications.
0:00 - Introduction
0:28 - Generate Text
1:31 - Stream Text
2:18 - Generate Object
3:15 - Stream Object
3:55 - Tools
6:05 - Building a chatbot with AI SDK UI
7:31 - Generative UI chatbot with AI SDK RSC
12:22 - Conclusion
◆ Repo with examples: github.com/nicoalbanese/ai-sd...
◆ Docs: sdk.vercel.ai/docs
◆ Blog: vercel.com/blog/vercel-ai-sdk...
◆ Demo: chat.vercel.ai/
◆ v0: v0.dev

Наука

Опубликовано:

19 июн 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 86

@TomAsh519 Месяц назад

Could you please do a tutorial on the combined use of ai ask with long chain adapter that utilizes eg. simple RAG? From your documentation it is not clear how to implement it properly.

@MilindMishra Месяц назад

Thanks for the walkthough! Looking fwd to build generative ui stuff :)

@whovivekshukla Месяц назад

I tried out their streaming ui a few months ago! that was pretty dope!

@syndg Месяц назад

Was just about to send you this video for our reference. Glad to see you already watched it!

@michaelo4u 29 дней назад

Thanks! Great job simplifying it.

@DS-ow2ge Месяц назад

Each new generative UI example from you guys is implemented in a different pattern. From manually intercepting response types to the latest streamui+tools. Does the team feel this present pattern is mature or are they unhappy with it and will be redoing it next month?

@fagnersales532 Месяц назад

Nice observation

@carloslfu Месяц назад

Yeah, but this is why it experimental. Use at your own risk!

@shuding 29 дней назад

Hey, AI SDK maintainer here! I'm not sure what you're referring to regarding "intercepting response types", but `streamUI` is pretty stable. It's the same as the previous experimental `render` function, but with a more consistent name as other APIs like `streamText` and `streamObject`. Also worth mentioning that the Generative UI APIs are designed to be general enough and fit into any UI patterns and AI pipelines, which means that there isn't only one way to do Generative UI. For example, you can just use `streamUI` + tools to handle LLM + UI, or combine low-level utilities like `createStreamableUI`/`createStreamableValue` and your existing pipeline for flexibility. Happy to answer any questions!

@wshewm 29 дней назад

@@shuding What are your recommendations for maintaining type-safety in the application, especially surrounding the server actions and use of the `useActions` hook? Unless I'm missing something, it seems like the required use of the hook defeats one of the major benefits of server actions: end to end type safety. Is there maybe a lower-level approach that I could take to bypass the hook?

@itszachhan 29 дней назад

@@shuding Can you use libraries like shadcn and nextui for the streamed components? Last time I tried, it wasnt working

@ahmadbilalfarooqi5731 Месяц назад

great explain by AI SDK of Vercel its really helpful and easiest for building application with the use of predefined function and method

@NityanandaDeGaneshpuri 28 дней назад

Thank you guys!

@yaseerokino Месяц назад

Vercel always coming through for developers

@TheJuava 29 дней назад

Great Overview! A Video incorporating RAG with Vercel AI SDK would be awesome!

@nicoalbanese10 25 дней назад

Thanks for the suggestion - this is on our list!

@0xOmzi 4 дня назад

Hyped! 🥳

@usagisan79 Месяц назад

ilove ai sdk and kirimase both!

@raphauy Месяц назад

Awesome!

@asimalqasmi7316 Месяц назад

Let me recall the kirimase dream I had

@0xOmzi 28 дней назад

Thanks for this great video! Looking forward to trying my hands out on the latest release! Kudos to the Vercel AI team too!

@journeyofc6200 Месяц назад

dope!!

@daniloitj 18 дней назад

Very good explanation. If possible, could you connect streamUI with assistants? I also had a lot of difficulty separating the tools into other files.

@remiib18 Месяц назад

Is it still not possible to use both the regular tools to fetch data and the tools to return components ?

@jrmumm 25 дней назад

how does it stream a structured object? doesn't the stream come back as JSON? how can it parse it if it's not fully complete?

@andru5054 5 дней назад

Hey, awesome demo - thanks. We're using llamaindex in Python for our LLM backend that uses RAG. I want to use tools that pass react components to the frontend - how would I accomplish this? Thank you

@rhyscampbell4178 23 дня назад

NICO!!!!!

@xberna8156 29 дней назад

I could not find an example in the Docs where the model can use Tools and return RSC while also being able to Stream a response when no Tool is used. All the example I could find use generateText() or streamUi() so the text response Is not a Stream. Should I use a combination of streamText() + Tools + createStreamableUi() to Stream text and have Tools that can return RSC?

@hakarsheikh7853 28 дней назад

Great question im interested to know too

@nicoalbanese10 25 дней назад

Hey! With `streamUI`, if no tool is used, the text response is streamed via the component returned from the `text` function. Is that what you're looking to do?

@xberna8156 25 дней назад

@@nicoalbanese10 Yes, that's correct. I would like to stream the text token by token when the model does not use a tool. Can I achieve that using streamUI?

@ShaneCrenshaw 15 дней назад

Is there an example with streamUI and error handling for things like finishReason and usage?

@JustOmmShah Месяц назад

Where do you keep the API Key?

@andreschou9560 Месяц назад

sick

@Samuelsward96 2 дня назад

Hey i'm struggling a bit with the useChat for multiple conversations. How can i keep multiple conversations active at once? Any tips?

@jrmumm 25 дней назад

when you stream an object, you get a partial. how do you get the final/full response (not partial)?

@nenadbanjeglav2081 Месяц назад

Can I use this in next.js out of the box?

25 дней назад

Someone knows how to Improve the response using the API of openAI? Seems like the chat-gtp web app the results are a lot better. Using the API returns very similar responses, in this case, asking "tell me a joke" answer the same thing over and over again. Another great API btw

@TomAsh519 29 дней назад

it is me only or this tutorial and the repo does not work? I got Error: `useUIState` must be used inside an provider. to resolve it add import { AI } from "./action"; to root layout: export default function RootLayout({ children, }: Readonly) { return ( {children} ); }

@ShaneCrenshaw 15 дней назад

If you are calling getAiState or useUIState, it has to happen inside of So you could create a new component and do something like and inside of Chat, that's where you would use uiUIState

@FelixWaigner 28 дней назад

When will i be able to use this with langchain?

@yogeshrathod953 Месяц назад

Can it work with ollama

@malaytiwari3207 11 дней назад

How do I pass the API key?

@Jake-bh1hm Месяц назад

is this compatible with sveltekit 5?

@mustofa_id Месяц назад

yes

@ShouryanNikam Месяц назад

how do you make the code animations?

@dawidwraga Месяц назад

I'm just gonna leave a comment here so I'm notified if someone responds 👀

@mishal_legit Месяц назад

@ahmoin Месяц назад

/free

@rude_people_die_young Месяц назад

Great use of zod ❤

@zivtamary Месяц назад

@rutvijdoshi9664 26 дней назад

Can we fine tune this model ?

@mymorningjacket_ 28 дней назад

Anyone have a great example on how to get the user's actual location here?

@nicoalbanese10 25 дней назад

You can run any asynchronous javascript code within a tools' execute function. So you would first want to find the exact location based on the search query (eg. openstreetmap). Then pass that to a weather api (eg. open-meteo) and return the resulting temperature 😊

@mymorningjacket_ 22 дня назад

@@nicoalbanese10 thanks for the suggestion, nico!

@JeomonGeorge 7 дней назад

can I use ai vercel in vue.js

@simpingsyndrome Месяц назад

will it work for React Native?, i wanna build my ai chatbot mobile app.

@jeanysergeimezarodriguez8629 Месяц назад

i have the same question hehe

@wshewm 29 дней назад

This is cool and all, but it seems that around every corner in this SDK (especially with the rsc stuff) all the types are just 'any'. In my opinion, you can't really call your library "The AI Framework for TypeScript" and then not have strong types. This is especially annoying because in my eyes it defeats one of the major benefits of server actions: end-to-end type safety. Is there a way to bypass some of the abstractions, like the useActions hook?

@CarlottaRiganti 27 дней назад

But how do you npm?

@smitty7326 16 дней назад

god i wish i knew about vercel ai like 6 months ago lol

@aneesmanzoor7340 Месяц назад

how to create these coding videos with animations like this kindly create a video on that as well @vercel

@sanukjoseph Месяц назад

🤩❣...

@GAllium14 24 дня назад

Vercel ai sdk + RAG tutorial

@maharshiguin7813 Месяц назад

New version of ai package has too much abstractions

@wshewm 29 дней назад

Agreed. It destroys the type-safety, especially with RSC and the useActions hook.

@LutherDePapier Месяц назад

Where's Lee?

@leerob 29 дней назад

I'm here :)

@andriisukhariev Месяц назад

train without stops

@RoccoGhielmini 28 дней назад

I can't concentrate because they keep saying next

@nicoalbanese10 25 дней назад

Sorry about that, will work on it for the next one!

@The.Explorer849 28 дней назад

I made 8 subscribers 😊

@yarapolana Месяц назад

I added $10 to test open ai and ai sdk and I had 100% of “unknown error” calls and $8 used?! What in the world it wasnt like this before. Loads of retries in the background (should be opted out from the start)