Google’s NEW Open-Source Model Is SHOCKINGLY BAD 

I should have used this title

Lol we all should have!!

@@matthew_bermanI thought at one stage you were literally going to start slapping your forehead off the keyboard!

Why does most Ai tech channels use that title 😂I just don’t pay attention to titles like that lmao 😂😊

its a meme at this point

histerical

@@laviniag8269 but true . .

Maybe a cat could see the image and do the same

@@MilkGlue-xg5vj haha yeah that would be a real nuisance. But then again, that’s one smart cat. What other potential could that cat have?? 🧐

@@Lukebussnick Maybe it could become an ai dev at Google

sorry you had to learn this way

welcome to real life. Can't wait for you to leave the fantasyland bubble all these tech aibros have built around you.

LMFAO

So true. Uncensored models are just more fun.

@@markjones2349 you're talking as if the point of uncensored llms is fun rofl lmfao xd you're just makin' it funnier 🤣

To the point they took the lobotomy fragment and used it in place of the brain, and trashed the actual brain. Not only on models, but on personnel probably

That's inclusive, alright.

and diversive@@AlexanderBukh

These are not open models, these are woke models, appropriately liberal.

To a point, I agree.

The nature of the errors here seem irrelevant to being censored or not.

@@madimakes No, the censorship sucks up so much of it's thinking there's little left to actually answer. You can ask the most banal question but it sits there thinking long and hard about if there's any way that could possibly be offensive to the woke? Considered the woke are offended by everything, that's a yes, so it has to work its way around that, then it needs to figure out if it's own reply is offensive (yes, everything is), so it has to find a way around that as well. Often it will fail and say "I'm afraid I can't do that... Dave." Other times it will try, but the answer so gimped and pathetic you'd have been better off asking your cat.

Exactly Model network design is gimped from the creator developers itself when head of Google AI is literally have biased ideological, anti white and very censorship values all proven with their online records that's why those biases reflect onto the model

They have tarnished their brand. It will be interesting to see what happens in the next few years with regard to Google. (I do not have any financial interest in google).

Yeah, they are the wrong kind of hacks now

Or engineering team knows this will be killed off regardless of quality or popularity so why bother.

@@chriscarr9852 we're watching the end of Google smh

No, Left. They are all one viewpoint at Google and have been so for decades. The PR folks represent the programmers and their programmer-managers and Sr. management.

Don't worry, Llama 3 will set the Open Source community 31 minutes ahead lol

google is so far behind these days, I love Google's design language tho, but their tech ? meh

"too cautious" is an understatement.

@@CruelCrusader90 Genuinely. If it's not a question about software development there's a wildly high chance that it'll start quizzing you on why you have the right to know things. I do hobby electronics and wanted to see how it would fare on helping make a charging circuit. It basically refused. Same is true for rectifiers. Too dangerous for me apparently lol. Ask it questions on infosec and it'll answer fine though. It's wild.

@@veqv lmao it refused, all anyone has to do is release a competely uncensored model and they literally take over the industry from their house. I dont know why google is such a fail at every product launch.

@@veqv yea i had a similar experience. i asked it to generate a top front and side view of a vehicle chassis to create a 3d model in blender. (for a project im working on) it said the same thing, its to dangerous to generate the image. i didnt expect it to make a good/consistent vehicle chassis across all the angles but i was curious to see how far it was from making it possible. and i dont even know how to scale its potential with that kind of a developer behind its programming. even a one would represent progression at its slowest form, but that would be generous.

Bad doesn't begin to cut it. At this rate, Google will become irrelevant in most of it's services. It makes no difference how much money they have, their policy is wrong and the AI models show it. They are so scared of offending someone or being made liable that their AI actually dictates what happens in the interactions with the users. That doesn't just make it annoying and time wasteful, it means that it cannot learn.Even worse than not learning, it's becoming dumber by the day. I cannot believe i'm saying this, but i miss bard. Gemini doesn't cut it in away way, shape or form. It's probably good for philosophy exercises, but so far I don't see any decent use for it aside from that. Give it enough space to go off in wild tangents and you may get a potentially interesting conversation, but don't expect anything productive from it. I'm done with trying out Google's crap for some time. Maybe in a month or two I will allow myself the luxury of wasting time again to see how they are doing, but not for now. Their free trial is costing me money, that's how bad it is.

Deepmind has done some pretty amazing work in the machine learning space. My bet is that they created a fantastic model and that's what was benchmarked. Then the Google execs came along and "fixed" the model for "safety" and this is the result.

Let's call it Matthew Benchmark

@@MM3SoapgoblinDeepmind should spinoff from Google. It's a shame that they still run under the now Google giving their amazing works in the past

and that student was highly political and was easy offended to anything

He was already recording, so he didn't want to check the setup LOL

But... they did? At least for inference, they uploaded both python and cpp implementations of the inference engine for Gemma to github. Which I suspect have bugs since I can't otherwise understand how they can release a model that performs this poorly..

Yeah they did release code.

- by a person on RU-vid :P

truuuu but you know what he meant lol@@Alistone4512

Me: I send Pikachu GO! Use STUN attack on Greenthum6 NOW! Pikachu: Pika Pika Pika!!! BBBZZZZZZZZZ ⚡️⚡️⚡️⚡️⚡️ Me: Greenthum6 seems to be in some form of paralysis. Quick Pikachu follow that up with a STUN attack on Greenthum6 NOW! Give him everything you got!!! Pikachu: PIKA…. PIKAAAAAAAAAAA……. CHUUUUUUUUUUUUUUUU!!!!!!! BBBBBBBBBBZZZZZZZZZZZZZZZZ ⚡️⚡️⚡️⚡️⚡️⚡️⚡️⚡️ Greenthum6 = ☠️ ☠️☠️ Me: Aaaahhh that was nice, I’m sure Greenthum6 will make a nice pokimon to my collection 🙂. **I throw my pokiball to Greenthum6 and it captures him as my new pokimon to my collection**

can we not have acronyms 😭

@@user-qr4jf4tv2x I believe DPO in this context stands for "Direct Preference Optimization" which is a recent alternative technique to RLHF, but with less steps and thus more efficient. I'm actually not 100% sure, but I believe the joke here is that if you try employing this model for DPO to "align" any other base-model, what you get is another model which only ever refuses to respond to anything.

😂

I found the same, the 2B model is much better than the 7B for my set of tasks.

State of brain fart it is.

They switched to gpt4 turbo. The old gpt4 via API is better

I am actually disappointed that you did not address the multiple comments pointing out the the flaws in your. testing. I thought you would retest the model and set the records straight.

the spelling mistakes seem to imply that. Maybe it can only work at low temperature.

I have

He seems to expect a 7B model to compete with GPT4 out of the box

​@@darshank8748No, but it should should at least compete with llama 2 7b, as was claimed by google. As we can see here, it does not.

You should use quantized versions. I doubt that there's much difference of quality between 32bit and 8bit (or even 4b).

At this point just use GPT 3.5 or Mixtral why bother with their idiotic model

@@h.hdr4563 Techniques such as that can help improve responses from any LLM.

have you seen the 26 principles of prompt engineering paper... ?? Its very interesting... works across LLM's too... although the better the LLM I think the less of an improvement there is, compared to the base model without a system message.

Gemma wasn't trained with any system prompt role.

Do you understand that it's a 7b model and not 180b one?​@@h.hdr4563