ChatGPT to Voice: AI Voices Are Getting CRAZY Good!!

Подписаться 161 тыс.

Просмотров 113 тыс.

50% 1

ChatGPT API into Voice: AI Voices Are Getting CRAZY Good!
Become a member:
/ allaboutai
Join the newsletter:
www.allabtai.com/newsletter/
OpenAI just released their highly anticipated ChatGPT API, and the possibilities are endless! In this video, we're going to show you how to take advantage of this new tool by combining it with Python and the AI Voice API from Eleven Labs. With this powerful combination, you'll be able to turn all of your text outputs into human-like voices!
Imagine being able to turn those large, tedious PDFs into engaging audiobooks or summaries, or even being able to automatically summarize meetings into concise voice summaries - all with the power of AI!
www.allabtai.com

Наука

Опубликовано:

1 мар 2023

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 245

@verence333 Год назад

Oh my goodness. WinAmp is still alive???

@phill_ai Год назад

Thats what I saw!!!

@AllAboutAI Год назад

Haha 😅 Winamp ♥️

@Joytrix Год назад

I still use it, it's the best

@SaidThaher Год назад

Ohh yeah .. i also noticed that 😂😂

@illuriouz Год назад

Omg! I bet he have mRIC too...

@tonydavis3326 Год назад

Outstanding. There is a lot to digest here and you've made the framework as easy as can be! Thanks Kris, I'm going to do a deep dive into this later tonight and test it out. I'd love to see a video on the Eleven Labs API.

@AllAboutAI Год назад

Thanks Tony :) yes i will do that soon!

@CreativePunk5555 Год назад

I feel the next phase in this is the ability to have multiple voices for one render. Can really have fun with creating audio stories that can have dialogue between characters. Put some sound effects in there - and you have an audio book with a punch.

@AllAboutAI Год назад

Yeah:) the ideas and use cases are just to many to think of atm 😅

@DuckLife89 Год назад

This would be amazing! Yes, the stories would be much more engaging and as an English Second Language teacher, I know my students would love imitating the dialogue used by their characters. Please please please

@JohnVanderbeck Год назад

Voice Actors enter chat in 3..2..1..

@brendanmclennan5021 Год назад

You could break up your story dialog into an array, assigning each items key as the relevant characters ‘voice id’. then run through the array submitting each key/value pair to function returning each file and naming it in order of playback. This would take Some of the manual labour out of the process 😊 but I’m not aware of any SFX apis available yet 🤷‍♂️ maybe next week there will be at this rate 😂

@degenplanet Год назад

need some tone and emotion in the voice too

@DamagedGoblin Год назад

I LOVE all your videos man. Very informative, I've got the bell turned on! PLEASE have the next video be on the ElevenLabs API!!

@AllAboutAI Год назад

Thnx a lot Justin :) Yeah that will happen

@denvernaidoo Год назад

Great video and the Winamp makes me feel all warm and fuzzy.

@JamesManjackalMSFS Год назад

I have just discovered your channel! congratulations for your work! I would like to have my youtube videos with the voice in different languages. I've got the subtitle file with Whisper and I translated the srt file the Google's API. I would ask you an advice. Is there any Text (srt file) to speech free tool that you recommend? Thank you very much in advance!

@drhilm Год назад

Thank you for sharing this video about turning AI-generated text into voice! It's incredible to see how far technology has come and how it can make a positive impact on people's lives. This has the potential to open up so many opportunities for individuals who may have difficulty speaking or communicating, and it's heartwarming to see technology being used to make a positive impact in the world. Keep up the great work!

@AllAboutAI Год назад

No problem :) yes!! This has so many positive use cases i think!

@johnnybloem1 Год назад

Well for jumping into Chat GPT API so quickly!!!! Your video is awesome and use cases you demonstrated just shows your wonderful curiosity, creativity and imagination! Being shown how to change the voices will be awesome and of course how to use the voice providers API. I assume the API has a daily or monthly character cap?

@AllAboutAI Год назад

Thanks a lot Johnny :) hmm, i have not checked the cap yet, will do tho!

@greysonwagner Год назад

It would be great to implement this and use the AI's ability to detect when a different character is speaking and use a different AI voice to match that character's description or, if it's been trained on it, YOUR OWN voice as the character. Or your child's voice as the character in the story.

@AllAboutAI Год назад

Yes!! That is a great idea:)

@nuvotion-live Год назад

Super possible with the new ChatGPT prompt prefix

@conidigianluca Год назад

What do you find interesting in using your own/your kid voice as the character? I'm really curious!

@Hazardteam Год назад

That was my first thought as well, when i watched the video. Would be great!

@voiceintheopen345 Год назад

@@AllAboutAI Question for you, how or where did you get from the black page with commands to input text and generate audio? thanks

@1Chitus Год назад

Excellent video!

@gho0osting Год назад

Amazing stuff Kris! That Winamp skin is so relatable lol Napster era mate!

@AllAboutAI Год назад

Thnx:) haha, that skin brings back a lot of memories yes:)

@kyleparkin2428 Год назад

Amazing work. I was looking at the repo and dont see all the code you are working with in the video. Where might I find that? I was only seeing the first example you gave.

@AllAboutAI Год назад

Thnx Kyle :) i have not had time to upload all to the GitHub repo yet. Soon tho :)

@brianclarke3243 Год назад

Thanks for the great video! Question for you. Do you think Eleven Labs API (or any other company) is currently able to generate either text to speech or speech to speech that is good enough for comedic performances? For example could it generate usable voices/performances on a show like the Simpsons or Family Guy?

@learndoenjoy2023 Год назад

Liked and Subscribed. Wish shared growth.

@cryptorich614 Год назад

Great video... I didn't find links to google collabs you presented. I liked PDF summary in 2 minutes

@AllAboutAI Год назад

Thnx :) I have tutorials and step-by-step videos on this on my Membership page if you are interested :) ru-vid.comjoin

@mup1537 Год назад

Do you have any references for how to set this up initially? Anything would be appreciated!

@marcushiro1595 Год назад

One quick question. Videos like this, adventure and sci fi stories and backstories, using generated AI images and voiceovers are monetized ?

@AItenOskar Год назад

AI, new technologies and Winamp ❤

@SaidThaher Год назад

As alwayes Kris nailed the how to use those tools in such a good way .. i wanna see video about whisper too and use cases for that .. thanx

@AllAboutAI Год назад

Thnx mate:) for sure! Got something planned already!

@MILKMILKMANGO Год назад

Wow! I'm really impressed that you were able to generate a summary from a 117-page PDF. I've been hoping to use CHATGPT to read long reports like this. Can you tell me how you did it? I don't know anything about coding, but I was wondering if you could develop this summary function into a standalone software?

@AllAboutAI Год назад

Hello :) i cant explain that in comments, but check out my membership if you wanna know how:) and thank you for tuning in!

@andrewsnavely Год назад

@@AllAboutAI Where is info about your membership?

@DJPapzin Год назад

@@andrewsnavely join his RU-vid channel membership

@micbab-vg2mu Год назад

Great as always:)

@AllAboutAI Год назад

Thnx as always micbab:) appreciate your support:)

@lightbringer4352 Год назад

Great tutorial, thank you for sharing

@rafaelfigueroa2479 Год назад

Excellent video! Questions, I've being use the new Bing to summarize PDFs, specially Edge side bar. I wonder if there is any advantages on using the Chatgpt API versus Bing. This API calls you made are linked to your account and have an associated cost correct? Also since Bing uses a new version of GPT I believe the answers are better, although limited in characters. Does the API already have parameters to return more characters or to have a large memory to store more context? Thanks!

@AllAboutAI Год назад

Hello! Since Bing is so limited to ppl yet i have not botherd testing it. Yes the API is 0.002$ per 750 words. Kinda cheap tho. With a Python script you can work around the character limit, so that is the big advantage:) tutorials on my membership if you wanna know more

@rafaelfigueroa2479 Год назад

@@AllAboutAI thanks for the quick answer. A follow up question about memory, I notice that chatgpt plus have a memory limit of about 4000 characters before starting to loose context. Your demonstration of summarizing Ex Machina script goes way beyond that limit, would you say that the API have a larger memory compared to the Chat? My main use case with this tech is summarize multiple scientific papers and then compare the summaries.

@rafaelfigueroa2479 Год назад

@@AllAboutAI reading the documentation for the API looks like there is 8000 token memory limit for context

@devbites77 Год назад

Incredibly interesting, and so many use cases ;-)

@AllAboutAI Год назад

Yes!! Thanks for tuning in :)

@dmitrylabetsky5278 Год назад

Thanks for inspiration! Did you share Google colabs shown in the video somewhere? They may be quite helpful.

@AllAboutAI Год назад

Thnx for tuning in :) They are a part of my membership, check out link below:)

@v1nigra3 Год назад

Damn that sounded really good

@mohammadafaneh3481 Год назад

I’m curious. How many tokens/words/cost did the 117-page PDF use up to summarize using the new API?

@AllAboutAI Год назад

Hello! its was around $0.35

@cocoandteddi6855 9 месяцев назад

Thank you very much for this amazing video! May I know where can I get the code you used?

@CptDangernoodle Год назад

Cool program you built. And btw, the movie Frost is actually called Frozen in English :)

@AllAboutAI Год назад

tnx :) haha damn

@fynnjackson2298 Год назад

Question: Many very good books are available in PDF format, from the early 1900's. Normally I just use a TTS app to listen while at work, but it read everything in a monotone manor. Would it be possible to input an entire book and get chatGPT to remove all the extra spaces, dots and all, correct the grammar and then convert that into a easiy to listen AI voiced MP3 file? This would mean that books from 1800-2000's suddenly can be listened to, would love to hear your input on this. Thanks for the great content.

@AllAboutAI Год назад

Hello :) Yes that is possible for sure. But i will be a bit expensive tho. I would test it out with a small sample first :) If you contact me on mail i might help you

@michaellevi1474 Год назад

This is the same problem I'm having. For years, I've been using Balabolka with Zira voice option to convert old books into audiobooks. But, I'm looking for something new, with Natural Language Processing. Is there any open-source project/library that I can use? I'm proficient with coding too, but I just can't find anything that wouldn't cost me a thousand dollars just to listen to a simple audiobook.

@e-Course Год назад

Love this video

@cgtinc4868 Год назад

Love the video. Requesting video on how to use "Eleven" API as well. thanks!

@AllAboutAI Год назад

Noted :)

@PhilosophAI.- Год назад

Are you using the chatgpt api to summarize the whole ex machinima script? Is there no token limit here like on the davinchi model?

@AllAboutAI Год назад

Yes :) yeah but i use a trick with python that works around it :)

@HealthHacks94 Год назад

5:50 is like someone from BBC who talk about animal...😄

@simonraj Год назад

Thanks

@Waldo-Manfred Год назад

interesting so by using the API you can feed more text to chatGPT. what is the maximum number of words by API?

@AllAboutAI Год назад

Not exactly, but with the API you can work around the limit:)

@billfreeman9202 Год назад

Can the app make phone calls with the summary recorded ?

@friendlyvimana Год назад

There are just 3 youtubers who are making ai videos to this intensity, and you are one of them.

@AllAboutAI Год назад

Is that a good or a bad thing?:)

@friendlyvimana Год назад

@@AllAboutAI damn bro, that's an amazing thing for us ai enthusiasts

@ylohnitram Год назад

Did you take any specific approach to address the copyright issue, or did you simply use the TechCrunch article as is, without any concerns?

@AllAboutAI Год назад

Well it was just an example here. But if i was goona to something commercial i would a credited Techcrunch :)

@Ruan-mh7tb Год назад

It'd be awesome about ChatGPT and software development

@mup1537 Год назад

I need to do this, that you so much for showing a peak

@alr2157 Год назад

ahhh the good old winamp which i'm still using too :)

@AllAboutAI Год назад

Yes, love it 🤩🤩

@_gabiroto 3 месяца назад

Amazing content mate! It would be great to have a video covering how to use the Elevenlabs API! Do you think it is possible to run chatgpt in real time with Elevenlabs, generating voice on the spot?

@AshrafulIslam-kj8st Год назад

As usual amazing. Constantly learning something new and getting smarter day by day. By the by some videos can't access. How to access, is it paid?

@AllAboutAI Год назад

Cool :) You can find the membership in the links below if you are interested in learning more!

@machireddyshyamsunder987 Год назад

Greatly explained, could you please do detailed video on Eleven Labs how to use etc.., and could you please share the python code repo to go thru and learn and implement same kind of stuff . Thank you very very much. 🙏🙏

@AllAboutAI Год назад

Hello! I have tutorials and step-by-step videos on this on my Membership page if you are interested :) ru-vid.comjoin

@victorvaltchev42 Год назад

What did you use for voice-to-lip sync? It looks good :)

@AllAboutAI Год назад

The Girl?:) that was from D-ID video

@victorvaltchev42 Год назад

@@AllAboutAI I did not expect such a fast response. Are you sure you haven't plugged in ChatGPT to answer people haha. Just kidding, keep up the good work!

@hfycentral Год назад

how do i set this up in colabs and the coding? If you could leave the code in the description that would have been nice.

@AllAboutAI Год назад

Hello! I have tutorials and step-by-step videos on this on my Membership page if you are interested :) ru-vid.comjoin

@hfycentral Год назад

@@AllAboutAI will the digital generalist be enough?

@74Gee Год назад

That really whips the llama's ass!! - and the Lamda's ass too :p

@AllAboutAI Год назад

haha love the refrence😅 tnx for tuning in:)

@AP-hv5dh Год назад

Kris for some reason I am not hearing the 11 Labs voice after running the script, but I clearly see the text output and that the confirmation that the text had been converted to speech but I hear nada?😎

@AllAboutAI Год назад

Its is saved in a .mp3 file

@shotelco Год назад

I am trying to write an API script (code) to have multiple ChatGPT personas interact simultaneously with each other. Basically, have 3 distinct ChatGPT personas (like prompt #1: "You're a 30 year expert in engineering" - Prompt #2: "Acting as a experienced social worker" - Prompt #3: "assume the role of a 18 year old college student") I want these 3 chatGPT personas to have a *verbal conversation between themselves* on a particular subject. This is very tricky, as I need to inject questions based on their responses in real-time, and also need to automate the ChatGPT text to each voice. 11Labs doesn't seem to support this kind of "streaming" input. Any ideas?

@AllAboutAI Год назад

Very Interesting. Can you contact me on Discord?

@conidigianluca Год назад

I believe 11Labs just released the streaming input endpoint. Hit me up if you wanna work on it together!

@showmealldblueprints Год назад

I got puzzled by the instruction to ignore previous instructions. I believe that in the API there are never previous instructions. You either include the whole thing in the request or you don’t. Anyway, incredible work you are doing here!

@AllAboutAI Год назад

Thnx Roberto :) I guess it is just an old habit haha, i think you are right tho

@showmealldblueprints Год назад

@@AllAboutAI it’s an irrelevant detail but might increase the use of tokens if integrating on a large scale. P.S.: You are sure on the way up and this channel will blow anytime now, so probably my last chances of an interaction XD

@AiGuru Год назад

Well what do you say about mine videos using this method

@phelper4554 Год назад

do I need a membership to learn this from you or will you upload more videos on how to make this?

@AllAboutAI Год назад

Hello :) I do have detailed instructions up now on my membership yes, with access to the script. So for now its a members feature

@phelper4554 Год назад

@@AllAboutAI i really hope you will do a video before someone else does I’m not a fan of subscription based things. But I have subscribed to you and hope you share it in the near future ❤️

@devopsinvent Год назад

can you send link for python script ?

@Xaddre Год назад

how do i access the google colab notebook? do you have a link somewhere?

@AllAboutAI Год назад

I am putting all script to the community repo this weekend :)

@yanli1283 7 месяцев назад

Do you have the github code about it?

@thelastshaneperson Год назад

Much respect for using WinAmp...it really kicks the Llamas ass. :-)

@shahidamin9142 Год назад

Membership is not available in my country, is there a way to get access from your website.

@AllAboutAI Год назад

Send me a e-mail and we can talk there:)

@user-qg3wx8hr6k Год назад

@allaboutai is their any Offline models which is free of cost also I am looking solution without using any third party API because it is costing too much

@MarkWilder68 Год назад

The only way I have ever edited my stories is with audio. How can I try what you have created?

@AllAboutAI Год назад

It is a members feature for now :) So if you really wanna try you can join here ru-vid.comjoin

@keyndomingos1171 Год назад

Wow Amazing video. Please do share how to implement the Eleven Labs API

@ParkerAndreoli Год назад

Please make a video about ElevenLab’s API. And you can clone your voice as well as a demo in your next video

@AllAboutAI Год назад

Thnx for tuning in :) yeah i will have to do that

@sachithmw Год назад

How can I make calm and composed voice?

@villagesinger8306 Год назад

Can you please provide that code in description

@killerqueen2549 Год назад

link to the google share?

@BetatestBanned Год назад

Hi, can you add in your API that everytime a new character talks (in a dialogue) it calls a new voice? ;)

@AllAboutAI Год назад

I think that can be dont with Python yes! Splitting the text outputs

@BetatestBanned Год назад

@@AllAboutAI # Read input text from file with open('input.txt', 'r') as f: input_text = f.read() # Split input text by character name dialogue = input_text.split(' ') dialogue = [d.strip() for d in dialogue if d.strip()] Does it sounds about right?

@tevjagg Год назад

Will ai create phone calls,animated,cgi from movies like they did in fat albert 2004 and green screen to put yourself in movies and shows and meet young people from old movies and shows like they want flashback back like 50s 60s 70s 80s 90s 00s 10s 20s and stuff like that? I want ai to bring it back to hear old voices from elevenlabs.

@ValicsLehel Год назад

The scripts are not yet on Github? When will be available?

@AllAboutAI Год назад

Tomorrow or this weekend :) to busy today with other stuff!

@edwardtheodore1427 Год назад

So hey mate, how can I do all this? Your video shows off what can be done and how can i now do it? I already subscribed to your newsletter. Do I have to pay to join? tell me sir.

@AllAboutAI Год назад

Helloe mate :) it is a members feature! Send me a mail if you wanna know more :)

@edwardtheodore1427 Год назад

Ok so i guess i need to just join. Thanks

@edwardtheodore1427 Год назад

@@AllAboutAI Which one of you memeber should i join to et access to this info for this video?

@waldnerinc Год назад

Id just like to say you're a OG for using Winamp.

@liviu8603 Год назад

Sorry for the comment off topic... WinAmp, You're Cool Man!😂

@michaelinzo Год назад

Where can we access this google collab codes?

@AllAboutAI Год назад

Hello! I have tutorials and step-by-step videos on this on my Membership page if you are interested :) ru-vid.comjoin

@braydensurvivez 7 месяцев назад

I've followed the links why do they lead no where?

@scottgust9709 Год назад

why is there no real time audio voice?

@VIDEOGRAFIKO Год назад

For someone who doesn’t know code how would I build a similar application?

@AllAboutAI Год назад

Hello! I have beginner friendly tutorials and step-by-step videos on this on my Membership page if you are interested :) ru-vid.comjoin

@giri_LearningAI_homegarden Год назад

@@AllAboutAI Thank You. I need that badly

@Mysticzen6 Год назад

Can you use this app to turn a book into audible?

@AllAboutAI Год назад

You can of course, but i think I would check the price for that first with Eleven Labs:)

@Gl0we22 Год назад

I just wanna shout out still using winamp I've not seen anyone else use that in years.

@AllAboutAI Год назад

haha, it reminds me of this AI era, so i wanted to use it :)

@kojotv3461 Год назад

Is there a character limit in ChatGPT Api ?

@AllAboutAI Год назад

Yes, 4K :S

@GrantdeGraf Год назад

How about a video that shows how to use AI Voice to table read a screenplay, with different characters. You could also add images (from Mid-Journey) to run with the dialogue, so that it runs as a full on film production.

@AllAboutAI Год назад

Cool idea:) noted:) and thnx for tuning in!

@whocareswhoiam2day Год назад

cool things, but where the copy colab link to play with?

@AllAboutAI Год назад

It will be for my members now first :) ru-vid.comjoin

@whocareswhoiam2day Год назад

@@AllAboutAI there any page or video with explanation what i will get with be a member? i did not found anything.

@Black-Re4per Год назад

You can finally turn Books into Audiobooks if you prefer listening over reading.

@AllAboutAI Год назад

Yes:) might be a bit expensive with a whole book, but doable yes:)

@SW-fh7he Год назад

@@AllAboutAI why is it expensive?

@Belioyt Год назад

@@SW-fh7he Eleven Labs voice API is not free

@motivational_journey__ Год назад

can i have python notebook code ???

@daveaced6657 Год назад

Thanks for the great video btw I'm wondering, is eleven labs voice API actually free?

@AllAboutAI Год назад

It has a free version with 10K characters yes :)

@GaijinGamerGirl 9 месяцев назад

You can tell this guy has never been on VRChat or he would get more accurate feedback on how people actually perceive "AI" voices 🤣 This will be amazing for people with learning disabilities, dyslexia or hearing aids and are in need of assisted reads during tests and exams etc though ☺

@DuckLife89 Год назад

Would the Rookie membership get me access to the code used in this video?

@AllAboutAI Год назад

Hello:) The script is for Tier 3 members, but all tutorials is for Tier 2. T1 is more of a support tier:)

@hobonomad1928 Год назад

Got all excited and the web site doesn't work, won't let me create an account. Hey AI, how can I improve this website? LOL

@eh_eye Год назад

I'd love to see a tutorial using the 11labs api

@AllAboutAI Год назад

It is up on my membership now

@steffenhaldrupandersen2391 Год назад

@@AllAboutAI I am also very curios here. Being new to colab as well. What membership do you refer to? The RU-vid?

@Stockholm_Syndrome Год назад

Whooot? Someone is still using Winamp? I thought that software was old, out dated and dead long time ago. Amazin! 😆

@StefanSilver3 10 месяцев назад

Great, but where is the code?

@arknight8794 Год назад

What about the cost for the use of the API's ?

@AllAboutAI Год назад

Its well documented on their website. OpenAI is very cheap, Eleven Labs is a bit more exp

@arknight8794 Год назад

@@AllAboutAI i thought it would be a nice addition to at least include something like a screenshot of the piercing in the video but that's just a suggestion. I love your content keep up the great work ❤️

@faisalkaimkhani3184 Год назад

How much Python scripting is necessary for a non-programing background person aged over 40 to learn advanced level prompt engineering. Basic,Intermediate and Advance?

@whackoization Год назад

Hello my Winamp brother.

@akashsingha8283 Год назад

How to use eleven labs api please make a video

@efficiencydna897 Год назад

great

@AllAboutAI Год назад

thnx for tuning in :)

@acidplasticine Год назад

its 117 pages because movie scripts are formatted in a such a way that 1 page represents 1 minute of the movie.

@gaelpiratelife1941 Год назад

Hello can you share this google Colab? Thanks

@AllAboutAI Год назад

Hello! I have tutorials and step-by-step videos on this on my Membership page if you are interested :) ru-vid.comjoin

@sevaletoto Год назад

Share the Google colab please!

@JohnDlugosz Год назад

*machina* is pronounced like _mechanism_ , not like _machine_ . It is stressed on the middle syllable: muh-KAI-nu. See if the voice generator gets it right if it sees the entire idiom: "deus ex machina".

@JohnDlugosz Год назад

The best voice to use for ChatGPT would be that of Optimus Prime. (and it got the joke with a little prodding)