00:00 🌡 Turning up the temperature in GPT increases variability in output, but keeping it at zero makes the output deterministic. 01:22 🔄 Algorithmic entropy involves using lists of variables to generate a wide range of combinations, resulting in high variability in model outputs. 05:05 📝 Providing specific instructions, context, and a diverse set of variables helps generate creative and varied story synopses using GPT models. 07:55 🎲 Injecting variables from external sources (e.g., random characters, names from dictionaries) enhances entropy and leads to more diverse model outputs.
Youre so smart to intuitively detect it was somewhere between factorial and exponential even not being a probability expert. Multiply the percentage chance liklihood of each one diligently against each other by mulitplying the whole existing "count" (starting with the percent chance of the first unit or unit unit.... as percent by the probability count total times the % of the next one added in. Im only 3 or 4 minutes in but im so happy to see this video to just fire up some sections of my brain for today. Thank you David. You're really the best machine instructor in the world to me.
unfortunately, it doesnt scale directly decoupled from the whole "count" without... predictive improprieties. here is the same message but with commas for readability: Youre so smart to intuitively detect it was somewhere between factorial and exponential, even not being a probability expert. Multiply the percentage chance liklihood of each one diligently against each other, by mulitplying the whole existing "count (starting with the percent chance of the first unit or unit unit.... as percent by the probability count total, times the % of the next one added in. Im only 3 or 4 minutes in but im so happy to see this video to just fire up some sections of my brain for today. Thank you David. You're really the best machine instructor in the world to me.
This is great! I did something similar in ChatGPT with DALL-E 3, but I never thought to use it for text. This is what I was giving it. And I was telling it to pick one option from each category to create prompts for DALL-E 3, and the results were insane. I would have never even thought of asking a lot of them on my own. Setting Environment: Forest, Desert, Ocean, Cityscape, Mountains, Plains, Swamp, Cave, Island, Tundra, Ruins, Suburbs, Industrial area, Rooftops, Underground, Virtual realm, Floating islands Time Period: Medieval, Futuristic, Victorian, Prehistoric, Modern, Renaissance, Post-apocalyptic, Ancient, Steampunk, Roaring '20s, Colonial era, Space age, Digital age Time of Day: Dawn, Dusk, Noon, Midnight, Golden hour, Twilight, Morning, Evening, Blue hour, Afternoon, Late morning Mood Atmosphere: Serene, Chaotic, Mysterious, Lively, Gloomy, Festive, Tranquil, Eerie, Whimsical, Oppressive, Dreamy, Vibrant, Stark, Nostalgic Weather: Stormy, Sunny, Foggy, Snowy, Rainy, Windy, Overcast, Clear, Blizzard, Hail, Sleet, Misty, Heatwave Lighting: Soft, Harsh, Diffused, Backlit, Sidelit, Warm, Cool, Dynamic, Ambient, Neon, Monochromatic, Silhouetted, Stroboscopic, Two-tone Elements Materials: Stone, Wood, Metal, Glass, Fabric, Leather, Crystal, Porcelain, Rubber, Platinum, Plastic, Ceramics, Carbon fiber Flora: Moss, Vines, Flowers, Trees, Shrubs, Grass, Ferns, Cacti, Seaweed, Overgrowth, Lilies, Orchids, Bonsai Fauna: Birds, Fish, Mammals, Insects, Mythical creatures, Beasts, Spirits, Reptiles, Aquatic creatures, Rodents, Small animals (dog, cat, rat, etc.) Style Art Styles: Realistic, Abstract, Minimalist, Baroque, Impressionist, Surreal, Cubist, Art Nouveau, Gothic, Expressionist, Fantasy, Anime Technique: CGI, Hand-drawn, Watercolor, Oil painting, Sketch, Vector, Pixel art, Digital painting, Charcoal, Airbrushing, Mosaic, Collage Composition Perspective: Bird's-eye view, Worm's-eye view, First-person, Third-person, Panoramic, Close-up, Wide-angle, Fish-eye, Over-the-shoulder, Split-level (part underwater, part above), Tilted, Isometric Focus: Foreground, Background, Depth of field, Focal point, Blurred, Sharp, Bokeh, Rack focus, Split focus, Layered, Reflective surfaces Themes Conceptual Themes: Freedom, Decay, Rebirth, Conflict, Peace, Love, Isolation, Unity, Discovery, Evolution, Transformation, Duality, Escape, Pursuit Cultural Themes: Festival, Ritual, Ceremony, Tradition, Folklore, Mythology, Carnival, Pilgrimage, Siesta, Rite of passage, Legends Characters Type/Gender: Man, Woman, Boy, Girl, Old Man, Old Woman. Amount: Single, Small Group, Large Group. I also created a visual style (with its help) for images trying to mimic a custom SD model that I trained, it then generated the prompts based on that style, and most of the time the results were extremely close to what I wanted. Of course I was not using the custom style description with the Styles from above when I wanted completely random images.
Ok I gave it a try and it is pretty fun. Will play a bit more tomorrow maybe. The man is walking on water... Prompt : Setting: A futuristic ocean during the golden hour. Mood: A serene atmosphere with clear weather and warm lighting. Elements: Featuring metal structures, seaweed, and various fish. Style: Surreal digital painting. Composition: Split-level perspective showing both underwater and above water scenes, with a focus on depth of field. Themes: Embodying the themes of discovery and a festival. Characters: A man with a small group, depicted in a surreal, futuristic ocean environment.
4:04 Is that a Bernie Sanders impersonation? Pretty convincing if so, especially the call to donate. Also RU-vid auto-subtitles are pretty good nowadays, for those who want or need subtitles. Many thanks
At first glance I thought you were researching entropy with ChatGPT like I've been for the past 3 months, great video David, I wish there was a way to visually and make sense of what it knew in its own context window of each conversation, like there was a side scroll of highlighted terms of Interest as it goes
Great vid! I just wonder, if you re-run the exact same query with the exact same temperature, aren't you getting the exact same results just because there is some caching involved? I find that even with temperature=0, the responses aren't at all deterministic
Interesting way to think about doping the probability in early instead of just rerolls or epoch again type refinement. It's color-coded though too if you wanna see the probabilities in those settings but i dont use that platform interface much lately with plus being fair for limits now.
I really love this but entropy doesn't mean randomness. Was sad because I was hoping this would be about actual entropy and was wondering how that'd tie into an LLM.
@@DaveShap From what ive read, the best is Yellow/offwhite background, with dyslexia specialised font which has bold lettering for first few letters of each word. But thats purely up to you if you like that accessibility. I know you really like trying to cater to all types of people of neurodivergence's etc.
@@DaveShap .i was wondering.Speaking of wonder,look at Altmans comment at the conference today.He said todays event will be quaint compared to the event next year.Thats code for we have GPT5 ready to go😐😂
