Тёмный

Explained: AI Tokens & Optimizing AI Costs 

Voiceflow
Подписаться 15 тыс.
Просмотров 13 тыс.
50% 1

Опубликовано:

 

5 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 32   
@gags730
@gags730 4 месяца назад
It's AMAZING when you get a video that actually explains the topic in a clear and concise way. I found your video from a search on YT - "What is an AI Token?" Excellent job explaining the topic. Keep up the great work
@cheese22
@cheese22 5 месяцев назад
thank you for getting straight to the point and being clear and concise. very informational video. rare to find nowadays! thank you!
@lisagrace4114
@lisagrace4114 5 месяцев назад
Thanks so much! My response kept getting cut off and it was as simple as adjusting the max tokens.
@ליאורחונדיאשוילי
@ליאורחונדיאשוילי 10 месяцев назад
One question from this video. If I follow your tutorial video to insert openAI's assistant api and use Voiceflow as UI mainly, in short I connect openAI's assistant with API. Is my price calculated by Voiceflow's or openAI's rate? I couldn't figure it out from the video. please answer Thanks for the video it's excellent.
@Voiceflow
@Voiceflow 9 месяцев назад
If you’re using the Voiceflow AI features, then you’d be using Voiceflow AI tokens. If you’re connecting directly to OpenAI via the API step then you are using OpenAIs tokens directly.
@FeanorCC
@FeanorCC 6 месяцев назад
Can you tell me exactly how you did this step by step with the direct API? Are there detailed instructions somewhere? I would also like to get the tokens directly from OpenAI. Thank you very much, that would help me a lot.
@RolandoLopezNieto
@RolandoLopezNieto 10 месяцев назад
I was just wondering about this yesterday, thanks.
@Voiceflow
@Voiceflow 10 месяцев назад
No problem!
@RolandoLopezNieto
@RolandoLopezNieto 10 месяцев назад
@@Voiceflow btw, is it possible to save the token consumption to the likes of google sheets or airtable? I'm planning to have a log that'll help me make pricing decisions.
@UpheavalGames
@UpheavalGames 5 месяцев назад
At 8:47, you say in your gpt-4-turbo model you use 24,096 tokens, which only cost a couple of cents? Wouldn't that cost 24 cents? about 1 cent per 1000 tokens
@SamuelNickolas-yf7wh
@SamuelNickolas-yf7wh 10 месяцев назад
Hey @Voiceflow, can you please make tutorial on what response and set AI blocks does???
@Voiceflow
@Voiceflow 9 месяцев назад
You can find docs on both of then at learn.voiceflow.com. Is there anything specific that would help?
@SamuelNickolas-yf7wh
@SamuelNickolas-yf7wh 9 месяцев назад
@Voiceflow Thanks for the response! I want the AI to be able to access the knowledge base (e.g. files and URLs that I uploaded) because when I use the AI model it says: "It doesn't have access to the knowledge base"
@gabrielchow
@gabrielchow 10 месяцев назад
Thanka for this! if we use the same model, is token price the same with directly using API?
@Voiceflow
@Voiceflow 10 месяцев назад
Depending on your query, you'll find that the cost in Voiceflow is higher since we cover related costs like embeddings and hosting the Vector DB. If you're on the teams plan we do have volume discounts available that get it closer to cost when you do higher volumes. But if you prefer to use AI services directly you can also do so via. the API step in Voiceflow
@gabrielchow
@gabrielchow 10 месяцев назад
Thanks and good to hear! @@Voiceflow
@hackeatutiempo
@hackeatutiempo 10 месяцев назад
Why don't you allow us to put the openAI API and consume from the platform itself?
@Voiceflow
@Voiceflow 10 месяцев назад
The API step can be used to connect directly with the openAI API or any other back end service
@marcozirrera
@marcozirrera 10 месяцев назад
because they wanna make money lol, They are charging 10x more than the original price of tokens
@hackeatutiempo
@hackeatutiempo 10 месяцев назад
@@marcozirrera They could continue making money by having the best chatgpt integration and charging more for the subscription... but, it has been a risky move.
@gabrielchow
@gabrielchow 9 месяцев назад
yeah but the response speed is much faster than using the API, I think it's because their model using their own memory system which makes it really faster than using API.@@marcozirrera
@srinivasmankala9364
@srinivasmankala9364 9 месяцев назад
Is there a way of making voice flow VOICE bots work on firefox and safari from a custom web page? WOrks well in IE/Chrome but can't record voice on FF/Safari
@MaliRasko
@MaliRasko 10 месяцев назад
Its probably just ..psychological perception... but I feel like I'm burning tokens much faster when using Voiceflow Response AI step compared to my own openAI API key. ...dontknow
@Voiceflow
@Voiceflow 10 месяцев назад
All the token information can be seen in the debug mode. The tracker in the app updates around every 30 seconds. Also be sure to keep an eye on what model you're using since they have different multipliers. One token in VF is not the same as one token in openAI since different models have different costs.
@MaliRasko
@MaliRasko 10 месяцев назад
Is it fair to say then, that purchasing additional tokens through Voiceflow is kind of exactly the same as paying for OpenAI API tokens (in their Playground thing)...given the same model, and all else being the same? @@Voiceflow
@moo487
@moo487 10 месяцев назад
I've been experiment with voiceflow, can VF introduce a function that link up different response AI block to different knowledgebase? let say i have text, doc, URL knowledgebase, can i just hook up differrent block with specific knowledgebase?
@Voiceflow
@Voiceflow 9 месяцев назад
Were releasing a feature than can help with this in February:)
@teyiowuawi7758
@teyiowuawi7758 5 дней назад
nice vid☺
@xomoneybag
@xomoneybag 5 месяцев назад
$TAO
@billdrumming
@billdrumming 7 месяцев назад
How irrelevant is this at the current rate of change in AI. Gemini is 1 million tokens
@xomoneybag
@xomoneybag 5 месяцев назад
$TAO
Далее
Women’s Celebrations + Men’s 😮‍💨
00:20
What are AI Agents?
12:29
Просмотров 507 тыс.
How to Use NotebookLM (Google's New AI Tool)
25:50
Просмотров 658 тыс.
Uncovering the Secrets of ChatGPT: What is Token?
11:56
How To Price Chatbots For Business Clients
31:44
Просмотров 8 тыс.
These Two AI Apps Just Took Over My Job
12:02
Просмотров 22 тыс.
Earn $1,350/Day with ChatGPT & Google Drive for FREE
17:03