OpenAI Whisper Demo: Convert Speech to Text in Python 

Such an awesome video. I've been looking for a little while now and this is exactly what i'm looking for. Additionally, the way you presented everything was super quick and easy to understand (which i appreciate since I'm currently running a fever lol). Either way, you're a life saver, and I want to thank you so much for all your hard work.

Thanks for making this helpful video. I really enjoyed watching it. Whisper is a huge step forward to local speech recognition.

Great video, thanks Rob! ... I tried the model in German a few times and it worked quite well but not without errors. One time I took an audio example from Hermann Hesse's wonderful book: Narcissus and Goldmund and the model translated 'Narciss' (German for Narcissus) with 'Nazi'. ... so, I will still read and correct the future results before sending them to my boss. ;-)

Really nice explanation and demonstration, You sir have a new subscriber (me)

Thanks for this valuable video. You deserve more views and likes

Seriously, such an awesome project!!!

Hello all ! nice first impression! I ran a 8mins mp3 file and it worked perfectly. I am pretty surprised. q=)

Thx for your kind detail explanation!. Could you explain to me how the improvement of a Whisper model works? Do I need text or audio or both?? I would like to improve for the recognition of new words in the specific field I targeted.

Cool video! I want to get this working for live speech-to-text since it is fast enough to run real-time but it seems like since you can't pass in continuous audio you would run into issues where the model would not have the previous output as context and could easily get cut off mid word. Any ideas for how to tackle that issue?

Great video 👍, just wanted to know in detail how to use this, and i now seen u r video, i 100% understanded. Btw which software or the thing.. In which you r writing the code ?

Thanks for this! I'm fairly new to NLP but already amazed by Whisper. Any idea what the *max_initial_timestamp* argument is used for in the DescribeOptions()? I'm curious to know what the smallest timestamp window is possible to achieve. Anyone know if it's possible to pull timestamps for each word's onset? I'm seeing ranges of 2-5 seconds for defaults on my samples (which are kinda verbose).

Thanks for providing details. Does it support live streaming audio? Instead of using pre-recorded audio clip can it transcribe the live speech

Hi Rob, thanks for sharing this video, I am looking for a linrary/ Api that can convert speech to text from a youtube video and then I would combine the video with the translation of the text in another language. Do you have any idea how I can do it? Is Wissem a good library for that. Ps: the video may last more than an hour. Thanks in advance for your help🙏🏼

Great video, thanks for sharing!

Hi Medallion! thank you very much. I was expecting that since your last one on Audio data processing in python. Is there a possibility to add a new language? I am currently working on a large audio data set in my mother tongue Fon in West Africa and would like to have some guidance. Best!

Hey Medallion! What’s the best way/library to perform text to speech, speech to text and speech to speech translations between languages. I’m from India, so a model that’s capable of a lot of indigenous languages is necessary. And if possible could you make a video about this?

Sir ive a questionI want to make a program in python such that first it recognize the text from 20 images one by one and, store the last word from the image text and at the same time it should also recognize the audio from a file(which is currently running at its normal pase) through speech recognition and if it found the last from the image text in the audio at 36 seconds from the start . Then it should press a specific key on the keyboard. This thing continues utill the audio finishes. Can this be possible by using whisper?

Hi Medallion, Thanks for the video. I've followed both of your processes, but when I run I get a FileNotFoundError: [WinError 2] The system cannot find the file specified. I've got my test file in the same folder as my main.py. Any ideas what I need to do to get it to work?

Thanks for making this video. I was wondering if you can say the steps to follow to execute these 4 lines of code in GPU. I installed CUDATOOLKIT, NUMBA( I good Graphic card GTX 3050) and followed some examples online, but I failed. Ty and have a great day!

If I load a video in my Python code, and I store it's audio line in a variable, how can I give that variable to the Whisper's transcribe function without saving the audio in a wav or mp3 file?

Do you have any advice for how to fix the 'ModuleNotFoundError: no module named 'torch._C'? I looks around the internet for answers but there's none that works, i even tried different python versions.

Hello! What's the best way to bulk upload mp3 files and convert them to SRT files? I'm assuming whisper does not do srt and does vtt instead.

Hi Rob, thank you for taking the time to share out of the wealth of your knowledge. I tried running the model, and it keeps telling me Numpy not available. I used Pip Install numpy, and I realized that numpy is available. Please, what could the problem be? Thank you. I want to use this for qualitative research. Thank you once again, and I hope to hear from you.

Da Vinci Resolve needs to use this to generate subtitles 👌

Hi buddy, can you help with a detail video on Speech to text conversion using python

Noob question, but does this work offline, or is it an API call to OpenAI?

So, Is Whisper used only for Speech to Text and also only in Python?? Any JS support?

Hey guys please can anyone help me with this issue. I am trying to run whisper on my machine and I am getting this error in cmd. UserWarning: FP16 is not supported on CPU; using FP32 instead warnings.warn("FP16 is not supported on CPU; using FP32 instead"). I use a windows 10 with gpu RTX2060. Also it seems it runs on my cpu instead of NVIDIA GPU. I created a python virtual environment and pip installed whisper in that virtual environment just for more details.

Hello sir, I am trying to transcribe large audio files then it takes more time, I want to transcribe in minimum time, can this possible sir?

How is it with respect to data privacy?Does it store our data?

Can you give it more than 30 seconds of audio or are you forced to break up the source file?

Can whisper analyze voice? Like screen and score dialect etc?

Thanks!

how big is that model? It has to be huge right?

YO Whats up , can you then translate it to another lang like print(Result) but from Englisch to german or other language

it is working with logn files like 2 hours ?

thanks man

is this also realisable in realtime?

best teacher ever!

Github repo?

Can this be made into .srt files?

can it be realtime??

I am using MacBook M1 and visual studio, I keep getting "no module named torch". Switch to Jupiter, but then get FP16 is not supported on CPU; using FP32 instead

Traceback (most recent call last): File "/data/user/0/ru.iiec.pydroid3/files/arm-linux-androideabi/lib/python3.9/site-packages/pyttsx3/__init__.py", line 20, in init eng = _activeEngines[driverName] File "/data/user/0/ru.iiec.pydroid3/files/arm-linux-androideabi/lib/python3.9/weakref.py", line 137, in __getitem__ o = self.data[key]() KeyError: 'sapi5' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/data/user/0/ru.iiec.pydroid3/files/accomp_files/iiec_run/iiec_run.py", line 31, in start(fakepyfile,mainpyfile) File "/data/user/0/ru.iiec.pydroid3/files/accomp_files/iiec_run/iiec_run.py", line 30, in start exec(open(mainpyfile).read(), __main__.__dict__) File "", line 2, in File "/data/user/0/ru.iiec.pydroid3/files/arm-linux-androideabi/lib/python3.9/site-packages/pyttsx3/__init__.py", line 22, in init eng = Engine(driverName, debug) File "/data/user/0/ru.iiec.pydroid3/files/arm-linux-androideabi/lib/python3.9/site-packages/pyttsx3/engine.py", line 30, in __init__ self.proxy = driver.DriverProxy(weakref.proxy(self), driverName, debug) File "/data/user/0/ru.iiec.pydroid3/files/arm-linux-androideabi/lib/python3.9/site-packages/pyttsx3/driver.py", line 50, in __init__ self._module = importlib.import_module(name) File "/data/user/0/ru.iiec.pydroid3/files/arm-linux-androideabi/lib/python3.9/importlib/__init__.py", line 127, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "", line 1030, in _gcd_import File "", line 1007, in _find_and_load File "", line 986, in _find_and_load_unlocked File "", line 680, in _load_unlocked File "", line 850, in exec_module File "", line 228, in _call_with_frames_removed File "/data/user/0/ru.iiec.pydroid3/files/arm-linux-androideabi/lib/python3.9/site-packages/pyttsx3/drivers/sapi5.py", line 1, in import comtypes.client # Importing comtypes.client will make the gen subpackage ModuleNotFoundError: No module named 'comtypes' [Program finished] Plz help me with this error

first video seen and subscribed