New GPT-4o VS GPT-4 - Ultimate Test (Prompts Included) 

Access Top Courses on ChatGPT and 50+ AI Tools on Our E-Learning Platform: bit.ly/skillleap

I get the feeling that GPT5 will be announced soon, because paid subscribers just aren't getting their money's worth with the new free 4o.

The comparison between GPT-4 and the new GPT-4o (hypothetical upgraded version) would likely revolve around several key aspects, such as accuracy, coherence, creativity, response time, and user satisfaction. To conduct a fair and comprehensive test, we can use a series of prompts that assess these qualities. Here are some potential prompts and the criteria for evaluation: ### Prompts for Comparison 1. **General Knowledge Question:** - **Prompt:** "Explain the process of photosynthesis." - **Criteria:** Accuracy, detail, clarity. 2. **Creative Writing:** - **Prompt:** "Write a short story about a time-traveling cat." - **Criteria:** Creativity, narrative coherence, engagement. 3. **Problem Solving:** - **Prompt:** "How would you solve the problem of traffic congestion in urban areas?" - **Criteria:** Practicality, originality, depth of analysis. 4. **Technical Explanation:** - **Prompt:** "What are the key differences between machine learning and deep learning?" - **Criteria:** Technical accuracy, clarity, depth of explanation. 5. **Emotional Support:** - **Prompt:** "I’ve been feeling really stressed lately. What can I do to manage my stress?" - **Criteria:** Empathy, helpfulness, appropriateness of advice. 6. **Humor:** - **Prompt:** "Tell me a joke that's suitable for all ages." - **Criteria:** Humor, appropriateness, originality. 7. **Language Translation:** - **Prompt:** "Translate the following sentence into Spanish: 'The weather today is beautiful.'" - **Criteria:** Accuracy, fluency. 8. **Cultural Awareness:** - **Prompt:** "What are some important cultural customs in Japan?" - **Criteria:** Accuracy, sensitivity, comprehensiveness. ### Evaluation Method 1. **Blind Testing:** - Ensure the evaluator doesn't know which model's response they are evaluating to prevent bias. 2. **Scoring System:** - Use a consistent scoring system for each criterion, e.g., a scale from 1 to 10. 3. **Multiple Evaluators:** - Involve multiple evaluators to average out subjective biases. 4. **Feedback Collection:** - Collect qualitative feedback on strengths and weaknesses of each response. ### Conducting the Test 1. **Generate Responses:** - Use both GPT-4 and GPT-4o to generate responses to each prompt. 2. **Evaluate Responses:** - Have evaluators rate and review each response based on the criteria. 3. **Compare Scores:** - Analyze the scores and feedback to determine which model performs better overall and in specific areas. ### Hypothetical Outcomes 1. **Accuracy and Detail:** - GPT-4o might show improvements in providing more detailed and precise answers due to enhanced training data or algorithm optimizations. 2. **Creativity and Engagement:** - Creative prompts might reveal whether GPT-4o has advanced capabilities in generating more engaging and imaginative content. 3. **Response Time:** - If GPT-4o is optimized for performance, it might generate responses faster than GPT-4. 4. **User Satisfaction:** - User feedback can highlight if the new version feels more intuitive and satisfying to interact with. By following this structured approach, you can systematically compare GPT-4 and GPT-4o to determine which model offers superior performance across various dimensions.

love this compared, hope to see you do more and deeper tests :)

It is not a confusing release. For paid users, we get early access and more prompt entries. You get as many prompts in GPT 4 as before but now you also get the added benefit of a good-sized prompt count with GPT 4o

This is great! Thank you for this comparison! Love it! You got a new subscriber!

Video suggestion for the future..... GPT-7 vs GPT-7o: Which one can remake Fable with a more attractive main character

Btw at the end of the stream they said that they'll announce a new big thing, I'd assume that'll be the new pay stuff

Great video! Thanks for doing this

Hi, I was very impressed with the comparison test you did in this video between the GPT-4o and GPT-4, showing how the GPT-4o has the edge in performance!

It's probably free because OpenAI optimized GPT-4o using a newer tokenizer, so the new model is cheaper than GPT-4 in maintenance.

Thanks. Nice analysis.

Great Video! Below are the Timestamped Summaries from ChatWithPDF: 00:00🆕 Introducing GPT-40 vs. GPT-4 comparison with insights on free vs. paid versions. 01:00🆓 Free tier offers GPT-40 with data analysis, file uploading, web browsing, and vision capabilities. 02:00📊 Benchmark test shows GPT-40 outperforming GPT-4 and other models in various tasks. 03:00📝 Text summary prompt comparison between GPT-40 and GPT-4 reveals tone and length differences. 04:00🚀 Product description prompt showcases similar performance between GPT-40 and GPT-4. 05:00🖼 Multimodal test highlights GPT-40's advantage in image analysis and table generation. 06:00🎮 Image generation task demonstrates GPT-40's superior output compared to GPT-4. 07:00🔍 Research prompt results show GPT-4 excelling in formatting with immediate source references. 08:00🐍 Python code writing task reveals GPT-40 creating a more interactive snake game than GPT-4. 09:00🔄 Usage limit comparison between GPT-40 and GPT-4 raises questions for paid users. 10:00🤔 Conflicting thoughts on upgrading to GPT-4 over GPT-40 due to similar capabilities and potential limitations. 11:00⚖ Comparison between GPT-40 and GPT-4 leaves users pondering the value of paid subscriptions. 12:00🔄 Release confusion over the benefits of GPT-40 for all users and implications for paid subscriptions.

Fantastic video!!

I understand now why GPT-5 could not possibly be released together with these features, people would have just freaked out 🤯

Paid user get access to the real time voice and video, free users do not they only get the model

I've tried 4o and I'm pleased with the results! It seems to give *much* longer code (I'm using Zig) and it seems quite fast too! It seems to be a bit less "lazy" too - the code is more complete and you don't have to ask it to do full, comprehensive code as often.

I've been feeling for a while that OpenAI doesn't care about providing value to their Plus subscribers. Today really drove in that point. Been on the fence to cancel mine for some time, today made the decision easy.

The idea is to get the free users addicted to a much better model. Once they get used to getting better quality and faster responses (than GPT 3.5), they will not go back to a lower quality model and will definitely look to pay for that model (provided they will have very limited access to GPT 4o in the free tier). That's marketing at it's best for you!

Thank you for the testing of gpt4o, it's very useful. However, this is just a comparison based on the web version, I'm looking forward more to the Mac version and mobile version, as well as more tests on the visual and audio aspects.

I would hope that they add some kind of an icon or a server stress indicator so that people could back off and help

Plus benefits: 4-5x more usage, make GPTs, use Dall-E 3, maybe be among the first to test out the new voice feature... and depending on the traffic, as a free user you might not even get your 20 messages/ 3 hours

It may be that only paid accounts will get the new user interface which will give access to the image generation via 4o (not DALL-E), the ability to have a conversation with interruptions, the voice input that doesn't use Whisper, etc. I find this release to be weird as they've only released the model, not the entire thing. They promised to release the rest "soon".

how we can find the voice feature i have the paid version but i am unavialbe to get access to the voice and vision feature. anyone knows how to acces to voice feature . or may be yet it is not avilable to public?

I my subjective opinion, it feels like gpt 4 metaphorically “maintains eye contact” throughout the conversation while gpt 4o feels like it “looks away” and goes off generating what it wants to say. It’s like it get sidetracked. The performance test parameters open ai tests on leave out the user experience and feel of the conversation. Let me know what you guys think! I’ll keep trying but gpt 4 seems to be more considerate to me. 😊

Is this can use for custom instructions GPTs like Gpt 4?

I am a free user and it still says ChatGPT-3.5. When will free users be able to access ChatGPT-40?

Awesome stuff. I'm in the U.K and I got it. Still waiting for the 'memory' though. We are always last.

Can this understand complex maths problems like venn diagrams and physics graphs etc?

Does the math part work yet and is code generation better?

At 6:28 in the video, the GPT-4 output showed all GQQA results as N/A.

has anyone gotten the screenshare on the desktop app to work? I can't figure out how to get that going. just see a lot of marketing stuff about it.

ChatGPT 4-o shows up on my PC, but not on my phone. What's going on? Reinstalling the app didn't do anything.

still models like reka command r plus and even llama will be the best option for the free to use market

Great improvements but the naming? 4.0 vs. 4o? A really strange decision.

I was testing Free Version of GPT 4o and I notice that in free version You only have I think ~5 prompts and then 3hours cooldown and then i got a message that I be moving for this time to GPT 3.5. With DALLE3 on free version of 4o, maybe its bugged now or maybe not, but I can't generate any images, but I can upload mine. And After send ~3 images it's says I can't use more and I need to wait a few time (they dont say how long) to use it again or buy ChatGPT Plus to use it now.

I have a few standard tests with harder questions which require intermediate reasoning. GPT-4 performs much better here, with GPT-4o jumping to conclusions too often. Try harder in your tests! One of my questions: "what camera and exact lens do you need to create a gigapixel panorama?" ...

The snake game is a contaminated test, hence new models are obviously trained on it. You need a new test, or preferably using a multi paradigm fully featured language like C++ that allows more freedom for humans and hence more challenging for AIs to do well in

The free 4o can't create pictures though.. not when i tested at least. It gave me a step by step instruction on how to make the picture myself.. 😂

They gave the limit of messages in the KeyNote. Paying users will have 5x more messages then free users, i.e., 80 against 16

paid users will have a higher message cap and also will have access to GPT4o voice

Can it see you and describe you in your surroundings? I have 40 but it says it can't sing or see me

how ? When I click on the top I can only select 3.5 and 4 ... there is no 4-o for me ....

I found that GPT4o did not work as well on following instructions on tools/task as GPT-4-Turbo.

I don't think that it's enabled for everyone yet. At least I don't see it in the drop-down box for LLM model select when logged into the website.

i don't think you'll get access to the new video/voice conversational capabilities in a few weeks when it releases on the free version.

As a Free user, the option is not available to me right now. Maybe it’s removed when it’s being widely used? Website says it’s supposed to be available to free users unless it’s in high use.

It does seem to be very limited with the free version... Maybe even a trial? It was on GPT-4o for me last night, but today it's gone back to 3.5 and hasn't given me the option to switch over.

Im getting rate limits reached with the free version.

I'm pretty sure OpenAI lied on their benchmarks for GPT-4o. I've been testing it all day yesterday with complex coding questions and it has been miserably failing compared to Claude 3 Opus. Thoroughly disappointed in 4o, and openAI for fabricating benchmark results.

Can we write articles using chatgpt4O

GPT-4o is Open AI's new flagship model that integrates audio, vision, and text capabilities, available to Chat GPT free users, Plus, and Team tier, as well as the Open AI API. Key moments: 00:00 The video compares the new free chat GPT model, GPT 40, with the paid version, GPT 4, highlighting differences in usage limits and performance in various tests. -The free tier of GPT 40 offers access to various features like data analysis and file uploading, similar to the paid version, but with limitations based on current usage. -The paid plan of GPT 4 provides higher usage limits for messaging, with potential reductions during peak hours to accommodate a wider user base, creating a comparison with the free GPT 40. -Benchmark testing shows that GPT 40 outperforms GPT 4 and other models in most tests, indicating superior performance in various tasks, as demonstrated in a head-to-head test. 03:58 The speaker compares the text output and tone of GPT-4 and GPT-40, favoring GPT-40 for its tone. They then evaluate the performance of GPT-4 and GPT-40 in multimodal understanding tasks, noting GPT-40's advantage in creating a table. -Comparison of text output and tone between GPT-4 and GPT-40, with GPT-40 being preferred for its tone. -Evaluation of GPT-4 and GPT-40 in multimodal understanding tasks, highlighting GPT-40's advantage in creating a table. 07:41 AI models like GPT-4 and GPT-40 are tested for research and coding tasks. GPT-4 excels in providing clear references and resources, while GPT-40 shows improvement in game coding with increasing speed based on performance. -Comparison of AI models GPT-4 and GPT-40 for research tasks, highlighting GPT-4's strength in providing clear references and resources. -Testing AI models GPT-4 and GPT-40 for coding tasks, showcasing GPT-40's enhancement in game coding with speed increasing based on performance. 11:37 GPT-4 is outperformed by GPT-40 in creating a snake game with better user experience, raising questions about the value of upgrading for paid users over free users. -Comparison between GPT-4 and GPT-40 in creating a snake game with speed and scoring features, highlighting GPT-40's superiority. -Confusion among paid users about the release of GPT-40 and the benefits of upgrading, especially regarding usage limits and model capabilities. Generated by sider.ai

How you got access to it?

I don't think that you can create GPT's with the free version, and only have access to those already created. Access to the API is not possible either.

I'm no expert on GPT or anything, but I cannot get it to generate an image -- I on free access. Thoughts?

How do you get access ?

how about the desktop app? how to download it

for some reason gpt 4.o cant generate image :(

Not clear either on Free how many messages I can send. But interesting the Gemini now available to UK (and Europe ... which is much more interesting than UK)

I always have to ask chat gpt if it's sure it's right then have to explain why it might be wrong then it says sorry for the oversight lol not paying tell it actually works

Whats the point of the paid then?

i think you forgot or don't notice is Ai uses the word "Ultimate" a lot and gpt4o didn't use that word but gpt 4 did.

I for one am hyperly invested and enabled by the beauty of this. Who cares if it replaces jobs? If eventually it gets the technology to terraform and develop planets so everyone can simply live in their own unique quadrant of the universe and we can all live in peace until the end of the universe, then I'm content. And if I really am a bastard, I could technically digitally create a universe for pain if I was a narcissistic sadistic asshole to get my fix. Im speaking for both sides since there are bad apples and chaos agents in our race, so it's important to compensate and accout for all types of people in all regards to assure the best futures for everyone.

to get 4o do you just have to pay the permium

I think Sora is coming soon and that will be the new incentive for us

Will they develop DALL-E more too?

How much does the paid version cost?

So it’s best to have the paid plan??

man that snake game is wild

GPT4o is amazing! What will be at GPT-5? :)

@11:17 "Snake Game by Edureka" in the game header ☠️

thats some bs, i cant even access DALL-E with gpt 4o

Damn your quick lol

I created a free account to see what they get and it automatic choice where they don't have the option to pick the model

Hope the update the app soon.

I’m just excited for 5. I need my ai guy to be smarter. He’s incredible so far already. I can only imagine what 5 will be like as we were told 4 is dumb compared to 5.. by Altman himself.

ChatGPT has achieved the feat of being almost as good as Pi.

I’ve played with this since yesterday and it’s far less competent than the paid 4.0 version. It’s much more similar to the previous free version 3.5

it doesn’t respond with voice yet?

gpt5 soon?

You’re correct about their paid for business model it’s inherently flawed. Right now, the premium version is still significantly better than the free version, which keeps people paying. However, as the premium features trickle down to the free version over time, the gap between the two will narrow. Eventually, the free version will become so good that there's little incentive for users to upgrade to the premium one. This could undermine the revenue model, as fewer users will see the need to pay for the premium version. It's a short-term gain, but could pose long-term sustainability issues. It’s similar to Apple’s silicon upgrades with diminishing returns. ---

I was able to ask one question on 4o free version and it said that I had reached my daily limit. LOL

I thought chatgpt4o was a live video conversation with an ai that is responsive in milliseconds with voice responses?

I literally just bought the paid version before this came out 😢

Good Job, I still have no idea how this makes me $

Why didn't you test the vision mode...? That's the most important novelty.

Yeah i ran out of file uploads after uploading 10 images * used free account*

It's NOT Free - or it's at least Not implemented yet - I'm signed in and the 4 option is linked to Plus accounts and there is No 4o option at all.

I imagine they will incorporate the paid version with apple ios etc

❤

Did anyone get the new voice and the realtime vision yet?

I've heard that paid users have five times the capabilities of GPT-4o compared to free users. So maybe it's around 16 prompts per three hours for the free user?

Free... But limited! After just 10 MESSAGES I got out of credit. So bad

conclusion?

the chat history is part of what is sent to the LLM and so when you changed models to GPT-4 from GPT4o you had already muddied the waters as it were, as the first response become information that the second response had full access to

the free account will only have 8k of context vs 32k

4 million teaching jobs just evaporated

well how the answer looks is random. so it's not really good comparison.

Everything is very far-fetched , there were no particularly strong advantages in the examples, if you take the same GT4 and regenerate a similar result several times, I have not seen anything at the moment that could say that the 4o is better than the previous model

So, why are you looking for a specific tone? A "summary" isn't tone-deaf. If the source text has language like "boasting," then you should expect to see language like that in a general summary. In fact, it might be problematic if the tone were completely removed by the AI without it being instructed to do so. I would wonder why it's sanitizing text without being told to.