On 10 October I gave a talk at the EABPM Conference Europe 2023, making clear what ChatGPT and friends actually do - addressing the technology in a non-technical but correct way - , and what that means. At the end, one attendee remarked "You made my head explode a bit. Why isn't this story everywhere?" Luckily, a video registration was made and this is the end result. Presentation, and a single exchange from the Q&A are included.
There are many explanations of Large Language Models like GPT out there. Some go in deep and explain the transformer architecture to you, but that is completely irrelevant for most of us. Many talk about the results, good, bad, or imagined. But this talk fills the gap between the tech and the results. At the end you will understand what these models really do in a practical sense (so not the technical how) when they handle language, see not only how impressive they are, but also how the errors come to be (with a practical example), and what that means what we may expect from this technology in the future.
Note: almost everything I have created (mostly blogs) about AI can be found here: ea.rna.nl/the-...
• The Truth about ChatGP... Presentation start
• The Truth about ChatGP... The Lie to Children concept (Pratchett)
• The Truth about ChatGP... The Wager
• The Truth about ChatGP... Neural nets work on numbers (section start)
• The Truth about ChatGP... Text has a variable length (sequence)
• The Truth about ChatGP... One word at a time (RNN)
• The Truth about ChatGP... Context and Long Context
• The Truth about ChatGP... Transformers enable very large models
• The Truth about ChatGP... GPT (section start)
• The Truth about ChatGP... How GPT produces text (autoregression)
• The Truth about ChatGP... How GPT calculates (attention to context)
• The Truth about ChatGP... There is no 'prompt and reply'
• The Truth about ChatGP... Increasing creativity (temperature)
• The Truth about ChatGP... The Biggest 'Lie-to-Children' (section start)
• The Truth about ChatGP... Representing words (embedding)
• The Truth about ChatGP... Playing dictionary
• The Truth about ChatGP... Handling text. Not words, but...
• The Truth about ChatGP... Handling numbers
• The Truth about ChatGP... Reasoning and logic
• The Truth about ChatGP... Prompt engineering and plugins
• The Truth about ChatGP... Being harmless (safety concerns)
• The Truth about ChatGP... Alchemy
• The Truth about ChatGP... Will growing more help?
• The Truth about ChatGP... Useful, provided...
• The Truth about ChatGP... GPT-fever
• The Truth about ChatGP... Understanding
• The Truth about ChatGP... It's the context, stupid!
• The Truth about ChatGP... Expectations (section start)
• The Truth about ChatGP... Code generation
• The Truth about ChatGP... Issues (section start)
• The Truth about ChatGP... "Bewitchment by language"
• The Truth about ChatGP... GPT quality overview
• The Truth about ChatGP... Why isn't this story everywhere?
If you want to find more of my 'realistic insights' see the other videos or visit ea.rna.nl/ for more written content.
Yes, I know, the Transformer encoder-decoder depiction/explanation around 12:24 is erroneous. This is not very important for the story and conclusions. Bugs me, though.
11 сен 2024