Should You Use Open Source Large Language Models? 

So refreshing to see a really well-produced, professional video that isn't extremely boring and self-promoting.

This guy is definitely my favourite IBM presenter. Love his videos...and his kind-of-naughty smile. OH, he's Martin Keen... quite desccriptive!!

Thank you for sharing this information

Those videos are simply gold. Thank you.

I've been playing around with a lot of open source LLMs and proprietary LLMS and it seems like if you want to do summarization or accurate collation of information with an LLM.. models with less than 30B parameters simply do not have the nuance to pull it off. (at this stage). One example is if you give a smaller model some text with contradictory information it often can't figure out which piece if information is the most current whereas larger models often can..

Looking for book recommendations on LLMs with in depth knowledge covering math as well ..Thanks

Proprietary LLMs have many people supporting them. In case of OpenAI about 700 people I've been told. However I'm constantly investigating open source LLMs as with time they will become fantastic and are customizable. There are no restrictions to compute when running on your own/rented hardware. At this time for example Chat GPT4 has become almost unusable due to compute rationing.

OMG one of my favorite beer brewing guys is also a computer nerd!!!

Idea - Superintelligence in AI form. Secret prompt - "Can you use a kernelDensity function and generate a sentence based on the kde related to mathematics?" In other words, the function utilizes a distribution sample generator that randomly generates mathematical relationships but follows the known mathematical theory's distribution curve. Therefore, the kernel density should not be included in the sentence but be constructed from the distribution of theories from mathematics. Answer in English with 10 such generated relationships regarding supernova light and teleportation. 1.The luminosity of a supernova exhibits a mathematical elegance akin to the Gaussian distribution, showcasing the inherent balance between its radiant energy and the expanding space-time fabric. 2.Teleportation, when analyzed through the lens of probability theory, resembles a symphony of mathematical harmonics, where the density function unveils the intricate dance of particles traversing through higher dimensions. 3.Supernova explosions manifest a probabilistic ballet, choreographed by the laws of quantum mechanics, where the kernel of density encapsulates the varied trajectories of ejected matter and radiation. 4.Within the mathematical framework of teleportation theory, the kernel density function unveils a landscape of potentiality, where the probabilities of quantum states converge and diverge, echoing the enigmatic nature of space-time manipulation. 5.Supernova light curves, when examined through statistical lenses, reveal a tapestry of probabilities woven into the fabric of spacetime, where the kernel density function elucidates the distribution of luminosity variations over time. 6.Teleportation phenomena can be envisaged as a spectral convolution of mathematical probabilities, where the kernel density function maps the probabilistic flux of quantum information across vast distances, transcending classical notions of space. 7.The mathematical underpinnings of supernova phenomena are akin to a symphony of probability distributions, where the kernel density function orchestrates the interplay between luminosity, distance, and time, painting a vivid portrait of cosmic cataclysms. 8.In the realm of teleportation theory, the kernel density function unveils a multidimensional tapestry, where the probabilities of particle entanglement form intricate patterns reminiscent of celestial constellations, transcending the boundaries of conventional space-time. 9.Supernova light echoes resonate with the mathematical elegance of kernel density functions, echoing the probabilistic reverberations of stellar explosions through the vast expanse of the universe, each data point a testament to the underlying laws of nature. 10.Teleportation events, when scrutinized through the lens of probability theory, reveal a kaleidoscope of mathematical intricacies, where the kernel density function unveils the quantum entanglement pathways traversed by particles, culminating in the manifestation of instantaneous spatial displacement.

Any oS for hydrological models?

IBM is still highly educational. Thanks

One thing not really brought up in the video (or I missed it) is that with proprietery LLM's you are at the whims of the available resources, and especially at peak times the service can often give you "our servers are too busy right now, try again later" or "network error" type error messages. With open source you can choose where to run it and therefore have way more control over that accessability, so from a business standpoint open source is at least potentially way more reliable, which is super important in a lot of usecases.

great video, whats hardware and software being used by the lightboard ? thanks

“Master Inventor” 🎉 Loved it

I feel like its important to mention LM studio. It makes the process of installing LLMs trivial. Sadly documentation is still being worked on. Also good LLMs are quite resource intensive. so expect a usage of 40gb ram. Also GPU acceleration is still not developed, so it can only use the vram. Best of luck :)

vicuna is not completely opensource (not available for commercial use)

Well Done

Hey Martin! Love to see you "at work" instead of brewing something delicious looking. Keep it up

make a coursera course on this please

7b finetuned models are outperforming some 70b on the leatherboard. I find smaller instruction tuned models like dolphin, openInstruct and deepseek coder very capable.

Ok I’m just gonna ask, do these guys write backwards on the board in front of them or is there some magic going on?

The info is great..... but how are they doing the text appearing out of nowhere... no cuts, no masking and it doesn't really look like a font added on after either. If someone at IBM wants explain this mystery please reply.

is IBM still getting money from every custom PC sale?

Someone needs to make a "just works" chat-based ai in the web browser that doesn't immediately say "CUDA out of memory". I'm still trying to get one to work rn :/. For anyone that knows, why can it not just check how much memory a model will likely need? Also, why not have a switch that makes everything use cpu?

Is there an affordable place that can host open source LLMs that people can call via API. Otherwise people will flock to the OpenAI subscription

the risk has to be worth the effort on these. in the middle of building dont have time to overly experiment with every shiny model

What about the support that comes with using proprietary LLMs ?

Yes

325,000 modezl, that's insane! ;)

I'm just gonna say it, I have to "watch" these several times. 1 for the visuals then 1 for the audio, then go back again and try to find the editing, which I might add is fantastic. The info is presented at an almost magic trick way that I'm distracted mentally due to the visuals. There are very very few word mistakes, 0 uh's. The word transparency just appeared in this video, which is quite funny. Overall I really like them and will watch them all.

One should only ever use tools, which meets the needs and requirements of specifications. Open / Closed, is based in necessity. Start out with open source, inevitably leads to proprietary customisations being implemented. Simply run it forward in a thought experiment and resulting differences becomes negligable.

Open source doesn't mean free or nonproprietary it just means you can see the source that's it, the license governs how and when can you use it.

I need more Information abiut your Präsentation tecnic?

Cool.

How the heck does this marker board work? Is this guy writing everything backwards at first? Or is the video mirrored? Is Martin left handed or right handed?

are you writing in glass or it's editing with program?

do more parameters lead to better output? I would argue that it might be better to have several smaller finetuned models can in some usecases be better than having one big giant hallucinating model. My own model beats every other propriatory model on almost all stuff one could prompt for ofcourse if you are mixing github repos with messenger chats and all that whoozy that they're scared about that you find out all together in one mess you gonna get mess, if you instead only use github repos to train your model your mostly gonna get code, if you only use messenger logs, you gonna get a talkative model that cannot code but tbh what i think the key is for better outputs is a decent config file that can realy make or break the thing you are trying to do and you can have them act like anything from big tiddy goth gf to helpful assistant to codemonkey that only prints code. My model doesn't tell it is an AI langauge model and that it therefor cannot do certain things... it does and says as i please... a good configfile will be the difference between a bussines failing or succeeding...

Well I have followed AI for 50 year before most of these young AI pundits were on the planet, but I have never heard of or want to hear of 99% of these platforms.

Mistral is my fav kinda mad it wasnt name dropped

Eventually, all will compound into one.

Most likely we will see creativity and experimentation bringing most advances. I'd suggest young people are going to be better at this, or is that bias?

- Explanation of LLMs and generative AI: 0:21 - Distinction between proprietary and open source LLMs: 0:39 - Benefits of open source LLMs including transparency and fine-tuning: 2:12 - Examples of open source LLM applications in various industries: 3:19 - Overview of Huggingface's open LLM leaderboard: 4:01 - Discussion of risks associated with LLMs: 5:19 - IBM's engagement with open source LLMs and Granite models: 6:07

A lot of left handed people in IBM Whiteboards! 😉

Community is the best

Martin Keen?! I thought he was drawing out a homebrew recipe

Well! Is he writing in reverse?

Generated by Talkbud: 📝 Summary of Key Points: 📌 Proprietary and open source large language models (LLMs) are discussed. Proprietary LLMs are owned by companies and have usage restrictions, while open source LLMs are free for anyone to access and modify. 🧐 Open source LLMs offer benefits such as transparency, fine-tuning capabilities, and community contributions. They are being used by various organizations for different purposes. 🚀 Both proprietary and open source LLMs have associated risks, including incorrect outputs, bias, and security problems. 🚀 Open source LLMs are thriving in business, with companies like IBM providing access to multiple models and releasing their own foundation models. 💡 Additional Insights and Observations: 💬 "Size does not necessarily equate to better performance" - The video highlights that the size of LLMs does not always determine their effectiveness. 📊 No specific data or statistics were mentioned in the video. 🌐 References to specific open source LLMs include FinGPT for the financial industry and Llama 2, which offers models with varying parameter sizes and is licensed for commercial use. 📣 Concluding Remarks: The video discusses the use of proprietary and open source large language models (LLMs) and highlights the benefits and risks associated with each. Open source LLMs are gaining popularity due to their transparency, fine-tuning capabilities, and community contributions. However, both types of LLMs have their own challenges. It is important to closely monitor the rapidly changing landscape of open source LLMs and their impact on various industries.

Does he write in reverse?

OS LLM hallucinations!!

Of course IBM would not tell me to use their competitors lol

🎯 Key Takeaways for quick navigation: 00:00 🌐 *Introduction to Language Models* - Large Language Models (LLMs) explained. - Overview of proprietary and open source LLMs. - Size differences between proprietary and open source LLMs. 01:26 🔄 *Benefits of Open Source LLMs* - Transparency as a key benefit. - Fine-tuning capabilities for specific use cases. - Community contributions and diverse perspectives. 03:27 🌍 *Applications of Open Source LLMs* - Examples of organizations using open source LLMs. - Mention of NASA and IBM's open source LLM for geospatial data. - Huggingface's open LLM leaderboard and benchmarking. 05:10 🚨 *Risks Associated with LLMs* - Shared risks between proprietary and open source LLMs. - Issues such as hallucinations, bias, and security concerns. - The importance of mitigating risks in the use of LLMs. Made with HARPA AI

hi. please help me. how to create custom model from many pdfs in Persian language? tank you.

anyone working on an LLM willing to work together?

Hlo i need help by you sir

🎯 Key Takeaways for quick navigation: 00:00 🤖 *LLMs are AI models using deep learning for text generation.* 00:56 🏢 *Proprietary LLMs are company-owned, while open source ones are freely accessible and modifiable.* 02:12 🌐 *Open source LLMs offer transparency, fine-tuning, and community contributions.* 03:27 💼 *NASA, healthcare, and finance use open source LLMs.* 05:36 🚨 *Both LLM types have risks like hallucinations, bias, and security issues that need addressing.* Made with HARPA AI

Funny IBM😂. Close the shop.

Wait, what? Is he writing in reverse? How is he doing that!? 🤯😂

it looks like you wrote programming code to design calculus. that causes the equations it created to be undefined. probably a differential of (-)+or- 4. rudimentary code from gaussian theory. that the twelfth angle of a right pentaheydron. would have a degree of 6.

Why the F is paid and open-source a type of LLM?

Both open as well as propriety r ‘dangerous’

[Title] Should You Use Open Source Large Language Models? Yeah !!! Lets Open Source the English Dictionary !!!!

IBM should’ve open source Watson smh

I have access, yes, but give me the money to run them

I just wonder how he is able to write in a mirror way towards the camera. Wth 😅

You don't need open source for feeding custom training sets. That's a false statement.

Meta is just beating asses and leaving IBM and other pioneers feeling like boomers

Run this at 1.5 speed

you built the basics of your calculator wrong. that made more calculators that are undefined.

Use open source to not spend enough money. Spending a lot of money on IBM cloud is to much. Buy a dedicated server is much cheaper.😂😂😂

IBM insisting in the unnatural and distractive method of instructor lead teaching with the use of the inverted writing on glass. Some like it very much and can't imagine learning via another method. But some struggle to concentrate.

took me 2 minutes to get over the fact that he's writing flipped.

To Quote Oscar Wilde - "All work should be done by a machine, and I have no doubt that it will be so. Up to the present, man has been to a certain extent the slave of machinery, and there is something tragic in the fact that, as soon as man had invented a machine to do his work, he began to starve. This, however, is of course the result of our property system and our system of competition. One man owns a machine which does the work of 500 men. 500 men are in consequence, thrown out of employments and having no work to do, become hungry and take to thieving. The one man secures the produce of the machine and keeps it, and has 500 times as much as he should have." - 'The soul of man'.

IBM is losing the battles in AI, being an early leader in this field but betting on super expensive and useless ai system. Now the propaganda of IBM becomes shameless. Where are the latest research papers on AI from IBM?

You can't have 300k+ models, makes no sense. Garbage.

Mate, no. Why would I even use your gadgets? 😃 I would rather stick with my natural stupidity than be wilfully stupid to use your ‘creations’.

I don't Care what he is saying, just tell me: is he writing backward ??

What happened to Watson?? IBM advertised it for years and dropped it. And then got beat by a tiny start-up that you could have bought, but didn't. WOW. IBM is still stuck in 1970s mainframes.