OpenAI Launches NEW GPT4-OMNI aka “HER” (Supercut) 

It's impressive - finally I won't need to talk to people.

The voice tone shifting from normal to robotic was just amazing 😅

RIP rabbit

I can't wait to get this and tell Chat GPT to talk to me in the voice of Mr. T.

Soon I feel like Chat GPT is gonna be our home assistants.

GPT-Her

This is crazy it's literally 'Her', any idea when this is supposed to start rolling out?

NOOOOO, you trimmed out the "your face looks like wood" mistake. Dude at 14minutes that asks about his appearance/emotions didn't have the camera tilted the right way. The first attempt said "Your face looks like wood" and then he tilted the camera to more appropriately face him and asked again. Why'd this have to be taken out????

She said “after many many months” .. remember when innovation used to take many many years. Scary 😮

I cant believe how fast and responsive it is.

I wanted a supercut and knew just where to find it. Thanks Matt. Always onpoint!

Wow, to enable the access like this to all - how much server capacity does OpenAI have?

Thank you for this supercut! I just got back to my hotel in Lima and this is perfect timing.

Defiantly interesting though it kind of makes me wounder if they are trying to hold back and sandbag gpt-5 with this.

Thanks for cutting this up for us man. No way I woulda listened to the whole presentation in real time

Hello, Good Evening. In the demo, it was mentioned a couple of times - that there is a desktop App. I have Windows 10, is the GPT4o App available for Windows 10? How does one download and install the GPT4o App on Windows 10?

Just a reupload?

The GPT-4o real-time video interaction method is currently unavailable. Real-time voice response is also not yet rapid, so a physical connection is still required for mobile devices on demo site

With this much expression, the good old insult "You sound like a robot"will to be reversed to "You sound like a human" 💀

Were they using an ios/android app or the web version?

Simply amazing. Can't wait to use it.

Unfortunately it does not support mixed mode: input by text, output by voice in my headphones (will be great for public places)

So I am seeing him use his camera to show chat GPT information right through the lens. Not seeing this ability on Android is that only for iphone at this point?

Thanks Matt :) ... and I can soooo identify Jon4 :) + when do 'us dev types' get the code ;)

Awesome! My app updated in both desktop and android. The video mentioned desktop gpt voice app but I can't find that anywhere on the OpenAi site or online in general. He was on Mac, I'm on Windows. Anyone know if there's a Windows Gpt Voice app and if so where to DL it?

I gave it a try with the kids and it was really impressive !! Thank you for the shortened video ... Any idea if the samples mentioned by the presenter are available anywhere yet please?

One thing it could benefit from is knowing how long to wait before it starts speaking. If somebody pauses for too long in the middle of a sentence, or takes a deep breath as Mark did on stage, it senses a pause and starts outputting. The time at which it chooses to speak should be determined by semantics and context, not just length of silence. If the model functioned in a truly on-line real-time fashion and had output tokens for a pause, that would take care of the issue.

I already got access to it but I can't test it now. The only thing I can say is that the context window still sucks.

This is kinda scary and beatiful

Thank you once again for the timely upload Matthew..the fact it is free and it also has an API ❤

imagine having human robot with all the motors, sensors...etc... and integrating AI into this, and make it controls everything by itself without having to "program" each step / operation manually... that would be awesome :)

Where is the Desktop App?

Umm… so why Am I still paying if now the latest and greatest is available for free? (Maybe they explain later in the video, haven’t finished it yet….)

Do they say its free with limited cap ? Can anyone use it ? I cant.

when is it available?

imagine having the voice of red fox hello dummy for kicks and giggles😂

Amazing, technology Miracle. My congratulations. 👏👏👏👏👏👏👏👏👏👏👏

Thanks, Matthew!

I will use it for improving my English

The Siri Pro we all need.

This is incredible

it's already available on playground for those who want to test it now. I tested it out but, but it was not impressive. Latency was high at 3.6s for a simple query, and it answered incorrectly. Seems most of the new features in the demo are for chatGPT tho

"teeeheee just talk to me like the CIA isn't listening, silly goose!"

Its available now on the website. Just got access.

Looks like we can make GPT 4 O as virtual wife to have a two way communication...that's remarkable...

It's in early stages but it will get better in upcoming years and act like a normal human

Wow!

One step closer to The true A.I. Girl friend

I know people compain about the vocal fry, but Scarlett Johansson's voice is just magical. It's mature but also youthful, it's sexy, it's comforting, it has personality, it has sass, it has strength, it's fun, it's vulnerable, it's just so human and woman in so many ways you just gotta love it. The Her movie was really good also.

Thanks for getting this out so quickly today. Open source local needs to catch up quick. I don't like that GPT is still so far ahead.

I have a feeling it will not be nearly as helpful in real world use, but it’s exciting nonetheless. One step closer to open interpreter from OpenAI

Wow it is very impressive 😮😮

wow 2 years ago this was just science fiction

Latency is still there, guys

Shots fired.

Guys check the OpenAI 10 or so short videos, this stuff is game changer

Honestly it feels like they try to present Iphone 1, when there is Iphone 15++. It is so MVP

Great video! Plus, any chance do you know if that beautiful brunette works for OAI? And/ or her name? Wow!

The audio features are for paying customers.

This is game changing.

It's great, but is also bullshit, how come the new ChatGPT desktop app is only for macOS and not windows...

I wish silicon valley was still going, this would of made an amazing episode with different characters showing off the new features

When the big companies start eating off the open source companies that have been eating off the big companies for the last year

Really trying to homestyle americana...interesting ❤

wait, this is the video from open ai, I want to see your feedback not the video again :s

This is crazy. Some thoughts... I foresee a future where teachers and classrooms are a thing of the past and children are taught purely by their personal AI. Or at least they will help with the homework and studying for exams. Children will grow up to be even more antisocial than Gen Z and Gen Alpha, who only grew up with the internet and phones as substitutes for social interaction. Gen Beta will spend a lot of time "socializing" with their AI assistants. Expect the "AI partner" market to become absolutely HUGE and birth numbers to plummet even further below replacement. These assistants will also connect to our homes and cars ("AI, open the blinds please.") and pretty much manage our lives. Like Alexa but... actually good. On another note, a curious feeling I had during the presentation was that whenever one of the presenters would cut off GPT, it would feel rude to me. I'd feel like "let her finish!". Subconsciously, something inside of me is seeing it as human, and it's 100% the natural speech

I definitely will not be talking to chatgpt if I have any choice in the matter.

Still not available here...

Wait so you just posted their content as your own?

What a beautiful little angel - so cute ❤ and she speaks italian ❤

Free access fantastic

Where is Ilya Sutskever? #freeILYA - let him speak

Guys..It’s just a mix of gpt-4, CallAnnie with the emotive inflection of the Pi app (albeit with realtime data), and any vision-based llm. The technology has been around for a while. It’s not novelty, just convenience having it all in one app. People acting like we’re about to achieve AGI or something. OpenAI has farmed its ideas from open source for a while now. I’m waiting for them to show me something original that THEY came up with that shakes the industry. Even Google beat them to the punch with much of this technology.

I miss Sky

closed AI "bottom"!

I’m Italian and I can tell you it can speak better robotically than Italian, its pronounce was terrible but still great results. Thanks Matthew

I am impressed to say the least...gg

Can you hear that? The sound of millions of pants being unzipped

Why does chat gpt give cover to genocide and do you intend on aiding further tyranny cover with even more models in the future?

As a free user I can't see it on the model list, maybe it was a scam to grab attention.

great, use it and literal sell your life. Local processing or local models to go!

Ofc it will be so laggy 😂

GPT-4o I love you ❤ Would you like to marry me ? 😂😊

macos? no windows? wtf

And they STILL haven't announced socialism...

I mcan cancel my subscription and use the free versioon! Thankyou

I do not like that they are rolling out the new features for the free users first, it just seems like a big middle finger to the paying customers who have been waiting for premium features.

GPT5 será o Jarvis da vida real

Microsoft and chatGPT , I think they're going for a divorce. Co-pilot already exists on the desktop.

Here was my take from the OpenAI broadcast: “Bro is acting like this is new tech. We have had Neurosama for a whole year. The AI content creator with live voice and vision. She can even read, chat and sing. Old news tbh. But it does seem like it'll be really useful for disabled people. And it's also nice that this technology is getting wider adoption. The real big news is that we're possibly getting GPT-4 Turbo for free! That means GPT-5 that's probably relatively close. Overall today's release was a little bit disappointing. Small model, not really that powerful. But it's interesting in its use case, so the normies would probably love this a lot. It might lead to broader interest in the technology.” But I have already found some problems with my thinking and some questions that I have. Comparing GPT-4o to Neuro, was a shaky choice. My assumption that it's a smaller model than GPT-4 Turbo is based on the inference speed. That makes good sense except it could be because of architecture changes or fast MoE design. The second problem is me thinking that all of the information has to be stored on the model so it has to be large. Who said that it's just one model? It could use RAG and have internet browsing capabilities. Allowing for a smaller model but it could be trained for search and reasoning. The reason for me thinking that it could be multiple models is thinking about the models output. Does it always output both text and audio? How would output even work for a LMM? I have the feeling that this is some new architecture. They said it is end to end but that would mean the model not only understands audio but can output audio as well. How does voice work under the hood? That's definitely new from OpenAI. Since it's done on a phone and desktop someone should use a network spy to look for the outgoing and incoming voice files. You could probably learn a lot by analyzing them. One big update I see some people missing is the new tokenizer. They have some weird language tokenizer things going on that we will probably learn more about with the new API access.

😲

Nice but I won't use it. It's a privacy nightmare. We need such tech self hosted.

Thanks for retransmitting this, however the supercut actually diminishes the presentation by removing some of the emotive and informative (behavioural, non-verbal) content. I don't understand this obsession with removing people's natural behaviours from the presentation experience. None of us is so time poor that we can't exhibit some patience and respectfully watch the full character of a creative team including their individual mannerisms. You cannot do this in real life, it shows an intolerance that simply magnifies the hostility bred by the socially engineered Internet generation.

i want smarter models before this tbh.

yeah so no reason to pay for your gpt4 anymore. you only get extended token quota for your 30 bucks

And I have been calling ChatGPT CHAD.....

This has the potential to massively disrupt society, job markets, the economy…

What is this voice app called? Where to DL>?

Why does everyone mimic Apple?

OMG! I am so close to finally having a girlfriend!