Тёмный

2. OpenAI Whisper - Fed Speech Recognition 

Part Time Larry
Подписаться 110 тыс.
Просмотров 118 тыс.
50% 1

I will be starting a spinoff channel on AI in music, art, and gaming in 2023. Subscribe at: / @parttimeai
In this video, we learn how to use OpenAI Whisper for speech recognition. We write Python code to transcribe Fed Chairman Powell's November 2nd speech.
Source Code:
colab.research...
gist.github.co...

Опубликовано:

 

29 авг 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 117   
@parttimelarry
@parttimelarry Год назад
Like the video? Support my content by checking out Interactive Brokers using the link below: www.interactivebrokers.com/mkt/?src=ptlPY1&url=%2Fen%2Findex.php%3Ff%3D1338 I will be starting a spinoff channel on AI in music, art, and gaming in 2023. Subscribe at: youtube.com/@parttimeai Source Code: colab.research.google.com/drive/1vJj6EW0nKi3olLb5nOccA4ypkKx-x4Hr#scrollTo=xUot3GYB64tv gist.github.com/hackingthemarkets/c6ca7834d2af4932e3ab0d847679c14e
@sriramkrishna6853
@sriramkrishna6853 Год назад
Hi Larry, what’s the cost of using GPU’s with Google colab? Is there a reason you picked that? Will be great if you share some thoughts around it.
@tejakur
@tejakur Год назад
hello, can you tell me how AtheneWins (youtube name) make his AI streamers ?
@justtohost3431
@justtohost3431 Год назад
Makes my blood pressure go crazy - so many great possibilities! This is insane, unique! One-time chance to contribute to this world in a unique way!
@LindsayHiebert
@LindsayHiebert Год назад
Outstanding OpenAI Whisper demonstration! Well done! Great job! Thank you.
@jerrywang3225
@jerrywang3225 Год назад
The implication of this application is beyond our imagination. Thanks for this great content.
@buffaloBean
@buffaloBean Год назад
Another great job Larry. Love the enthusiasm, curiosity and display if patience in your content. A natural teacher!
@buffaloBean
@buffaloBean Год назад
Has anyone tried using chatgpt to enhance their programming?
@danielattard
@danielattard Год назад
Larry - A sincere thank you for teaching us all about how to use machine learning models like OpenAI Whisper. In particular, I also learned a lot from the Google Colab which was incredibly helpful. 👍 Can't wait to see what you build next.
@akzorz9197
@akzorz9197 Год назад
Was just about to say, you could now wire this into a MetaTrader EA for making decisions on its positions, etc. As 2 minute papers would say - "What a time to be alive!"
@breakoutgaffe4027
@breakoutgaffe4027 Год назад
incredible stuff mate! thanks
@MrEvansjethro
@MrEvansjethro Год назад
Thank you so much, Larry.
@asbjrnthorsen7457
@asbjrnthorsen7457 Год назад
I got really inspired watching your videos! Great job!
@jayhu6075
@jayhu6075 Год назад
What a amazing tutor. I like your style to make it understandable for everyone. Many Thanks.
@loryo80
@loryo80 Год назад
thank you Larry for all informations and for your pedagogy, i love your videos
@gljames24
@gljames24 Год назад
I was looking to transcibe some of my audio for script writing. This looks great.
@NeferLopez
@NeferLopez Год назад
I'm learning so much from you, Larry. Thank you so much!
@phil.d6449
@phil.d6449 Год назад
Larry, thank you for all your hard work. I'm really looking forward to seeing the next videos!
@jma5474
@jma5474 Год назад
sweeeet! gonna be auto-trading futes by the next fomc!!!
@GrizzCodes
@GrizzCodes Год назад
Thank you Larry for the priceless information you provide everytime!
@user-qx8wv2zi1x
@user-qx8wv2zi1x Год назад
Fantastic, Larry👌💯 TYVM bro. 🤝
@ronaldronald8819
@ronaldronald8819 Год назад
Thats interesting. I am not into finance but what you showed is applicable to a ton of stuff. Wish i had more time.. So many interesting things going on.
@sriramkrishna6853
@sriramkrishna6853 Год назад
Looking forward to more OpenAI videos from you, Larry. Gonna spend sometime watching and learning. Cheers!
@bakari007
@bakari007 Год назад
Excellent approach ❣ ! Thank you for sharing ! More interesting could be scanning if there's any speech available and live stream interacting :D !! Thank you for the video !
@trsch5384
@trsch5384 Год назад
Incredible work! Thanks a lot
@blender_wiki
@blender_wiki Год назад
Impressive and scary 😜. Very nice approach.
@krissn8111
@krissn8111 Год назад
Very impressive
@sealt00th
@sealt00th Год назад
that was really interesting to watch! thank youu
@andydataguy
@andydataguy Год назад
Excited for the series!! Would love to see something that writes in depth research reports from a mix of DaVinci, web scrapers for non-intuitive data, and ChatGPT for output and language finesse
@blakesamic
@blakesamic Год назад
Great video. Thanks Larry!
@BA-ve7xp
@BA-ve7xp Год назад
larry, when discord? so we can all digitally hangout in and hack the markets ;)
@SutboxSutty
@SutboxSutty Год назад
Go Larry your a badass....Respect
@Robay146
@Robay146 Год назад
Thanks for this!
@pietrusso
@pietrusso Год назад
This is phenomenal, thank you!
@davidbarth80
@davidbarth80 Год назад
Interesting! Well done. I believe you could take keywords from the speach and if these keywords appear in upcoming speaches you could open positions based on that.
@TradingLaboratory
@TradingLaboratory Год назад
Love the content Larry
@quangdinhdota2388
@quangdinhdota2388 Год назад
thank you so much. This video is amazing
@tak68tak
@tak68tak Год назад
amazing. can't wait for the next tutorial.
@WallStreetPapi-nx8he
@WallStreetPapi-nx8he Год назад
Thank you Larry!
@trainspotting02
@trainspotting02 Год назад
Great work! 🤗
@ControlTheGuh
@ControlTheGuh Год назад
Great content again mate!
@maxiperelli8570
@maxiperelli8570 Год назад
Great video
@michakupis6198
@michakupis6198 Год назад
If anyone is getting an issue retrieving the YT video data using pytube, you will need to authenticate by using this code: youtube_video = RU-vid(youtube_video_url, use_oauth=True, allow_oauth_cache=True) it will ask you to enter a code visible in the terminal, log in to YT and then you should be good to go.
@SneyDeag
@SneyDeag Год назад
In which part of the code does it go? Could you help me? I have this same problem
@LeveragedFinance
@LeveragedFinance Год назад
make more cool videos like this I learned a lot
@aiautoglasscrm
@aiautoglasscrm Год назад
Awesome video, even though I am not into finance. Subscribed
@HenriqueSardinha
@HenriqueSardinha Год назад
Great content! Would be great if you could follow up in another video with action taken from your analysis. I.e run the models to decide what to do with that information and compare it with what really happened
@ShadedWarrior
@ShadedWarrior Год назад
You're awesome. Thank you!
@evyborov
@evyborov Год назад
Beautiful work, thank you!
@cnaccio
@cnaccio Год назад
This is super aweome!
@skeletonmasterkiller
@skeletonmasterkiller Год назад
Really love your commitment to building in public for all of us. Thanks for all of your efforts do you have a patreon so I can support you for your efforts.
@parttimelarry
@parttimelarry Год назад
Hey thanks! I don't have a patreon, but there is a buymeacoffee link on my channel page buymeacoffee.com/parttimelarry
@shephusted2714
@shephusted2714 Год назад
it will be so good to see significant forks - models will get better and the tech keeps advancing so they will try to go more for profit but the masses may be able to spawn competitors - things happen
@code-grammardude5974
@code-grammardude5974 Год назад
Very clear tutorial ty
@machdragon
@machdragon Год назад
Been using OpenAI a bunch lately as well. Pretty useful for figuring out regex or sql queries with human language or for writing some template/boilerplate code. An efficient search engine rather than combing through stack overflow, or instead of reading through the docs for integrating between Snowflake and Python 😅
@bertobertoberto3
@bertobertoberto3 Год назад
Which api are you using? ChatGPT?
@machdragon
@machdragon Год назад
@@bertobertoberto3 yes ChatGPT and also GPT3 for parsing earnings calls
@Scuffy
@Scuffy Год назад
@@bertobertoberto3 do they have an api
@Scuffy
@Scuffy Год назад
@@machdragon does chatgpt have an api
@mohsensafi7778
@mohsensafi7778 Год назад
AMAZING!!!
@prodatalab9055
@prodatalab9055 Год назад
Larry, please host any reference documents in open environements.. Google will not let me access your colab and I prefer to stay away from evil oligopolies as much as I can. ;-) .. you provide great instruction videos! Thank you
@parttimelarry
@parttimelarry Год назад
You can copy the Python code to your local machine and run there if you prefer. I just put it on Colab for people that don't want to set up their own Python environment locally.
@TheThreatenedSwan
@TheThreatenedSwan Год назад
Now to correlate this with actual actions and things like IQ, moral foundations, etc, and predicting people's actions, at least in specific instances, can't be too hard, right?
@dPointe
@dPointe Год назад
This is just amazing, thanks for sharing! If I wanted a more complete TL;DR, how many would you say.. 4000?
@boogiman007
@boogiman007 Год назад
wow quickest pivot ever
@BluePanda-io
@BluePanda-io Год назад
Wow❤
@sychrov81
@sychrov81 Год назад
Holly shit, cant believe I understand all of it 😂
@deltacodealpha
@deltacodealpha Год назад
my company did this with fed minutes in 2016, this has been done
@parttimelarry
@parttimelarry Год назад
Sounds good. The benefit of this tutorial is that it demonstrates Whisper, which only came out at the end of 2022. Since it is open source, many people will use it for applications that you or I haven't thought of.
@LeveragedFinance
@LeveragedFinance Год назад
Very good comments Larry Page
@yannik9341
@yannik9341 Год назад
I would be more impressed if you had a bot trading off the speech, which is possible, and tricky. But nice intro. I have an incident management background and I always wanted to have a bot write an hourly update based on a conference call.
@ControlTheGuh
@ControlTheGuh Год назад
This is amazing content as you can save yourself a huge ammount of time (earnings script screening). Is it possible to apply this to streaming data? Powell speech live?
@parttimelarry
@parttimelarry Год назад
Hey, I'll show how to do this on a live stream later this week since a few people have asked. I turned on my microphone during the November 30 speech live stream when he was more dovish and fed the audio to Whisper in chunks, and it works pretty well. If the calls don't print, you'll have to control the guh though.
@ControlTheGuh
@ControlTheGuh Год назад
@@parttimelarry hahaha. Great to hear that's possible too. Looking forward to seeing the video. Keep up the great work
@chessdad182
@chessdad182 Год назад
When the Fed has an AI talking to us... look out. Or is one already talking to us.... oh oh...
@leonvanpersi8044
@leonvanpersi8044 Год назад
Great Video! Would be awesome if you could make a video how to do a text analysis with python an AI.
@esra_erimez
@esra_erimez Год назад
Great video!
@Alexthatsnottaken
@Alexthatsnottaken Год назад
This is so fuckin epic lmao
@dintal-_-4121
@dintal-_-4121 Год назад
I like the idea you provided, will you do another with live data? Because all these calls are mostly affecting the live stock price.
@parttimelarry
@parttimelarry Год назад
Yes others have asked so I will share this
@edrodven
@edrodven Год назад
Great job and application of speech has the limitation of understanding humans are not exactly transparent therefore speech values have to be discounted for such fact?
@jayshay7416
@jayshay7416 Год назад
dude.. awesome. how difficult you think it would be to find a way to do this live.. think it would be advised to find a way to do as much in say, C++ in order to get the job done optimally?
@parttimelarry
@parttimelarry Год назад
I have tested running this on a live stream of Powell and having it place a trade based on what type of sentence is spoken. It's a bit speculative and I took it out of this video, but happy to demo it on one of the next ones if people want to see a more real time version that interacts with a broker.
@jayshay7416
@jayshay7416 Год назад
@@parttimelarry man hopefully more people request it!. did you have to use any other specific python libraries to do it? anything you would do to make it better the next time around?
@bakari007
@bakari007 Год назад
@@parttimelarry That would be awesome !! 🙂
@sriramkrishna6853
@sriramkrishna6853 Год назад
Firstttt!! ❤
@TreeLuvBurdpu
@TreeLuvBurdpu Год назад
Is there a reason you didn't just fetch the RU-vid transcript using, I think you used PyTube. That can fetch the "Captions", which is the transcript. It's got no sentences, and poor punctuation. Is Whisper better?
@antrikshkandhari3641
@antrikshkandhari3641 Год назад
This is amazing! Is there a way to transcribe a conversation using Open AI Whisper and also diarization it?
@soesevenonesix
@soesevenonesix Год назад
Great tutorial Larry! Could you explain how to get the second int object into a DataFrame without looping into the S&P data? Basically just turning the second object into a DataFrame by itself. I believe the part is at 17:45ish.
@leochan8669
@leochan8669 Год назад
I have a small project I like to use your codes in this video. Please let me know how to credit you. Thanks!
@negadan77
@negadan77 Год назад
Would be amazing to use this with ICT's content
@wealthofmind145
@wealthofmind145 Год назад
slay
@sippy_cups
@sippy_cups Год назад
would pytube work on a live stream? it'd be cool to embed as the stream is released. then we could just periodically ping a bunch of channels of interest for going live and start listening when they do
@parttimelarry
@parttimelarry Год назад
Hey since I've received this comment a few times already, I will demo how you can do transcription from a live stream fed to a microphone. I have tested this already, but didn't include it since it made the video too long. Will make that part 4.
@hj5413
@hj5413 Год назад
Hi Larry, I have a big question. I just ran the code in the colab link you provided. But seems we don't have to provide the OPENAI-API-KEY, so it's free? I am confused.
@parttimelarry
@parttimelarry Год назад
Whisper is open source and can be run on your own device for free.
@jamestkirk3396
@jamestkirk3396 Год назад
Do you happen to know of an open source framework that extracts emotion from audio? The audio to speech processing loses it completely beyond usage of “sentiment words”. Especially in application to earnings announcements, where significant amount of text has been prepared, such quintessentially audio aspect might be of interest in evaluating, say, the difference in confidence between different speakers or during reading different parts of the presentation.
@wangjueliang
@wangjueliang Год назад
Thanks for this amazing tutorial, Larry! How do I replace the input to a Podcast URL? Thanks.
@parttimelarry
@parttimelarry Год назад
With a podcast, you would skip the PyTube. You should be able to use the Python requests library to download the audio file. I may bring this up in this weekends video.
@wangjueliang
@wangjueliang Год назад
@@parttimelarry Hi Larry, I followed your method and uploaded a transcript of a Podcast to the ChatGPT to summarize it. The transcript is too long and the ChatGPT rejected it. Any suggestions how to work around this? Thanks.
@wangjueliang
@wangjueliang Год назад
This is solved by watching No.3 video. Thanks Larry. You are amazing!
@RexxorDDG
@RexxorDDG Год назад
Screw Powell
@sippy_cups
@sippy_cups Год назад
also make a discord!
@varuns00
@varuns00 Год назад
If you're in the advanced AI training or inference space, and you're working on OpenAI APIs, you're already dead...
@arturKrzyzak
@arturKrzyzak Год назад
Hi, how to enable GPU while running code on local PC? Mine is using CPU by default (I see it on task manager, also I get prompt: warnings.warn("FP16 is not supported on CPU; using FP32 instead"). I have already made some research- (os.environ['CUDA_VISIBLE_DEVICES'] = '0') but it does not make any difference. Its still running on CPU.
@mikhail5002
@mikhail5002 Год назад
please use dark mode if you have full white screen - otherwise it's not watchable for anyone who isn't watching in broad daylight
@Qushaak
@Qushaak Год назад
Would you share that part of code where realtime transcription is in action (how to properly break and send audio data pieces to whisper so that transcription is not far behind)? Thank you.
@parttimelarry
@parttimelarry Год назад
Shared on the community section
@xs6819
@xs6819 Год назад
I followed you all the way to the csv file and I couldnt get the next line to accept the format 😵
@breakitdown4346
@breakitdown4346 Год назад
Too bad both the feds press announcement and stock earnings calls are already transcribed. Not really a necessary application of this, but interesting nonetheless.
@PhilipDenys
@PhilipDenys Год назад
english only?
@Stopinvadingmyhardware
@Stopinvadingmyhardware Год назад
All I can hear is your cop talking over my cellular network As if I were a moron. As if I cared what he thought of my medical records. Which makes me wonder how he has a copy of my medical records.
@financialsolutions3431
@financialsolutions3431 Год назад
I received an error at "spy['percent'] = ((spy['close'] - spy['open']) / spy['open']) * 100" how can this be fixed
@parttimelarry
@parttimelarry Год назад
Did you upload the csv file with price data?
@xs6819
@xs6819 Год назад
@@parttimelarry I think my issue is similar, I am just learning the ropes of coding. When I saved the price data from txt to csv I believe it may not be translating correctly.
@gridplan
@gridplan Год назад
This fails for me in colab notebook at the point where it tries to run youtube_video.streams: "AttributeError: 'NoneType' object has no attribute 'span'".
Далее
3. OpenAI API Python - Earnings Call Summarization
20:54
4. OpenAI GPT-3 - Prompt Engineering For Financial NLP
27:54
БАБУШКА УМЕЕТ ВОДИТЬ?? #shorts
00:32
Просмотров 474 тыс.
娜美这是在浪费食物 #路飞#海贼王
00:20
The True Story of How GPT-2 Became Maximally Lewd
13:54
The Truth About Learning Python in 2024
9:38
Просмотров 182 тыс.
Stock Chart Analysis with GPT4o Omni (Python Tutorial)
8:41
Simple, Non-Commercial, Open Source Notes
30:25
Просмотров 807 тыс.
Open AI’s Whisper is Amazing!
25:51
Просмотров 480 тыс.
БАБУШКА УМЕЕТ ВОДИТЬ?? #shorts
00:32
Просмотров 474 тыс.