In recent years, I have prided myself on my ability to recognize AI images and sounds, but this is almost unrecognizable from reality. I am both amazed, and terrified.
You can make them right now for 20$ per month. That super realistic one gives you like 70 seconds so like 6 videos per month though.(others are much much cheaper) So I'll wait for the price to go down a bit lmao
@@mertaliyigit3288 Runway Gen-3 Alpha seems to hold up (looks as good as SORA), but you only get 120 seconds of generation for $20/month If you plan on doing a lot of text-video generation, it might be worth getting a home-build desktop with two RTX3090s, and using one of the Chinese open-source programs.
@@mertaliyigit3288 What I've seen from Runway Gen3 isn't as good as DreamMachine, and then Sora looks slightly better than dream machine (although it's all about which output is selected for the demos.
@@нужнонемногопотерпеть ...media has been manipulating the truth since the invention of video, probably before then. As always, the only way to discover the truth is to follow the science, and that won't change. If you've ever relied on media to determine the truth... you've never really known the truth about anything important.
The people saying that AI is "over" need to get their heads checked. Where AI is now is where computers were in the 70s or 80s. We are still just scraping the surface, and every single year results in an unbelievable leap forward from where we were.
Right? That's what actually shocks me the most in all this. That in the midst of AI models emerging with capabilities of generating life-like videos, music, and all the rest, and all that just in the time scales of months, some people ACTUALLY think AI is plateauing... ARE YOU FOR REAL?
@@2CSST2 the image based AI still have a lot of improvement, text based however kinda started to slow down, when ppl say plateauing they typically mean text based LLM and basically other type which will have their own up and down cycle.
What i'm really waiting for is to be able to play a game where you're inside of an AI's dream, so the AI has to generate a 3D environment and update it in real-time as the player moves/interacts with things
Or generate a photo of a place you d love to explore( or take an alrrady existing photo or image), then feed that into another AI that makes it into a 3D world you can explore.
We're close to this, practically there already, in fact, but it won't be coherent, for the same reason dreams aren't coherent. Moving around and interacting with things in a way that actually makes sense isn't a matter of architecture or training, it's a matter of maintaining multiple threads of logic and self-consistency at different scales, and nothing about generative AI has demonstrated any ability to grapple well with those things.
As a video professional who's been studying AI for the past few years, SORA and other video AI's caught me by surprise. They must have been pouring R&D into them quietly for a while. So impressive.
particularly interesting, is the way the techno music was also linked to the car in the city scene. this is of course due to the many videos that already have such sounds in them in that theme. So the question is, will our past style choices continue to inform what an AI considers appropriate and will it become good at doing what we would expect rather than what would be more creative?
Next year, ai generated media will be virtually indistinguishable from real life, from the image, sound, motion, and story telling. This is actually scary
@@nigelcrasto openai alredy showed voice modality, so training models with sound+videos so they can generate what sound goes with what image seemed achievable. And it seems it is.
An insane breakthrough! Synthetic data is going to be crazy! Finding ways to keep track of these synthetic data and whats real is gonna be a trouble in the future!
Indeed, keeping all the data from real video will automatically embed natural features of physics, however, as synthetic data mixes in, it will only deviate from reality in unpredictable ways.
I think its cool, however my future on producing music might just go down the drain. I will always love producing though! but i cant deny that music AI like Suno is making me a little worried
Very interesting! It’s kind of odd that AI generated videos were used for the audio samples, especially the drums and guitar. It would’ve been nice to have real video with audio to compare it to, and the video generator isn’t quite generating hand movements that make sense.
This is actually real-time growth and deformation via videos as an early iteration. The key is noise outside the object in the environment which can be manipulated to give a plethora of effects like gravity, wind, viscosity, light effects, sound, etc. Cool video.
Two minutes down the road ... AI will recognize my mood and feelings from my micro expressions and synthesize me endless engaging addictive video/audio stream so I don't ever have to leave my VR.... what a time to be alive. Wish I wasn't.
There is time/motion/video data in all photographs with motion blur. It would be cool if an AI was trained to pull an approximation of motion/video out of really old photographs, which tend to have a lot of motion blur due to the long exposure times needed.
Image generators with image input can already remove motion blur. And if you mean "turn this motion blurred picture into a video" that also exists already, though the ones that are free are of questionable quality.
@@DefaultFlame which ones can remove motion blur? Photoshop does an ok job (doesn't use AI). Also I haven't seen anything that turns motion blur data into video, only ones like Runway and DreamMachine that create video whole-cloth from an image.
Very cool. In future it could be used to visualize a dream you had instead of just telling it to someone. Or use it to describe a memory of something you saw.
Goldman Sachs on Generative AI: It's too expensive, it doesn't solve the complex problems that would justify its costs, killer app "yet to emerge," "limited economic upside" in next decade.
Goldman Sachs in 3 years: Thank you for this two-hundred thousand dollar retainer, our analysts worked very hard and decided you should be using generative ai.
It's true though, it does not solve problems. There's no AI that *solves* a problem. Because well, by definition they are prone to get things wrong, very wrong.
@@TragicGFuel ...I'm not sure you know what 'by definition' means. The definition of AI is just an artificial system that does 'things that require humanlike intelligence'.
@@somdudewillson oh im sorry, I forgot to include that I was talking about the word used by the hyped folk. The word that actually means "generative AI"
@TwoMinutePapers You are approaching your 10 years channel anniversary. Is love to see a video revisiting the time line, showing how the cutting edge evolved over this time... Maybe we would also see your focus shift in different time periods
Personally, I think that's a really cool idea, and we seem to have tiny puzzle pieces already leading towards the dream of 'VR generative AI. ' Imagine combining VR with the latest advancements in generative AI, like gaussian splatting and procedural generation. With these technologies, we could create immersive, ever-changing environments in real-time. On top of that, incorporating AI-driven NPCs using large language models (LLMs) could add a layer of depth and interaction that makes the virtual world feel alive. Each NPC could have dynamic, context-aware conversations and actions based on player input and environmental factors. This blend of procedural generation and intelligent NPCs could really change how we experience virtual worlds, making them more like on-demand lucid dreaming where the possibilities are endless. It's going to be very interesting. AI brings such incredible good and bad.
i have been working with Luma Dream Machine since noted on channel. It is quite clear that such systems need a controller with specialised subs to make this work well. Luma is good on the general video, okay at lighting, not very good on camera control and not at all good on multiple main subjects (a common issue with image generators as well). being able to separately write the prompts for each sub, such as a camera specialist, a per main actor sub, a lighting sub and then an overall combiner that is good at motion etc, will be transformative. Unrelated, but we need to domain train such specialists in the same way we do humans, by running them through a proper cumulative education process. I could go into more detail but I wait for a video that relates.
"ChatGPT make a TV sci-fi fantasy series where genetically improved frogs play the main role, animated, cute and funny" and you can start watching your new favorite show Is probably literally just weeks away because the steps are a solved problem mostly.
Come on not weeks away but I could see it a year or two years. One limitation is that the text most LLMs write is not very compelling. So even if then images/sounds are decent I would still not watch a 5/10 show haha
The most sad part is the "safety" restrictions that will be put in place on these AI. It wont truly allow you to be infinitely creative, only within the boundaries that the ownership conpany sets.
@@HughJanus9999 yea man its a double edged sword. i would love the opportunity to create whatever i want but tools like this have the capability to be so so destructive. tbh its already gna be used to hurt ppl whether the company puts blocks or not. still crossing my fingers for an efficient local version
The sounds of pixels paper is super cool! For the visuals of these text-to-video tools, surely they will properly credit the millions of artists' whose work made these models possible in the first place and won't be used by executives to replace actual artists.
As a mechanical engineer all I want to know is one thing - will we have soon a reliable simulation software, that can surpass the existing options on the market, namely ANSYS, NASTRAN and all of it's variations like ABAQUS? Can we skip the useless videos and dumb clips and concentrate on the real deal, that will make us money and bring some real progress. Videos are fun, but we are relying that this technology can really save us time and effort.
@@tkzsfen These image and video generating AI are what's driving the progress of AI, just like video games with their ultra-fast graphics cards are what enabled modern AI to exist. It's all about how many people are interested in it. Since so many people are interested in cool flashy stuff like video generation, money is flowing into the development of it. Since the nature of today's AI is that it's basically universal in application, it's not a big leap to get it doing accurate simulations. I know that there are already physics simulation AIs, and I'm sure more mathematically accurate and reliable simulation AI networks are being made or already exist. I know that the field of cosmology has been using neural networks for at least a decade.
My humble guess is by the time that AI be able to do let called 'experimentally sound' physical simulations, we also won't need mechanical engineers anymore (it will turn everybody obsolete, little by little given enough time of course). The reason being that in order to simulate you need to accurately predict what the parts of the whole will do given the environment, constraints, laws of nature, etc. And to do it, you need to really understand the phenomena, it's the same thing in other fields, for instance, for you to accurately predict what the best chess player in the world would do next you need to be at as good as the best chess player in the world.
The current AI architectures just aren't designed to reliably do precise work that demands the result be correct every time. Video and image generation works great because you can generate 10 or 50 variations relatively quickly and cheaply and one of them will be acceptable in a way that a human can easily assess just from watching the video. A transformer-based physics simulation might be accurate 1 in 10 times you run it but that doesn't do you much good if the only way you can assess which is correct is by running the simulation.
I still get like grossed out and feel like im looking at spiders or something whenever I watch an ai generated video, like uncanny valley but with movement somehow
i keep telling people we are getting closer and closer to being able to be a one man anime studio where you can use ai to make jjk level anime with the click of a button for a fraction of the cost. the future with be saturated, but at least it wont be lacking :P
I tried out Gen-3 and was disappointed. Results must be heavily cherry-picked here. You only get credits for about a dozen videos, and almost all of mine were defective in one way or another. Not following prompt well, things morphing and transforming weirdly, especially hands. The technology is still interesting and impressive, but not worth paying for yet imo.
Everytime I watch one of these and think to myself that this is it, Its the pinnacle and I have seen it all, Nothing can amaze me more. And everytime I am proven wrong. This field blows my mind away every couple of months...
The feeling on AI is shifting very quickly. So much so that creators with AI like styles are being shunned. I would not be surprised if feelings against AI generated material becomes so strong that the progress of the tech might even stall as demand drops.
@@ThreeChe People who refuse to accept AI will slowly isolate themselves and create bubbles which will slowly shrink and die off as the tech becomes better and more normalized. It's sad that some people have to go through that until they can accept and enjoy the improvements AI brings us, but it is what it is...
You know what though? Shine up your badge of honor for being alive before AI started doing all of this. When you tell people 30 years from now, that you use to make amazing 3D special effects, and you did it all with zero AI, peoples jaws will fall off. Like watching a guy from 1850 use nothing but hand tools and he builds a piano. Back in my day... we didn't have AI... (queue the old timey music).
So now we know what a stratocaster-like guitar sounds like. It is actually correct, but it picked the wrong octave. Harder to check whether or not the melody would match.
imagine in 10 years from now! you can create any movie you love and make it custom as fuuukk with you even being in the movie and the AI reacting to you in real time crazy! Then i can live in my own star wars universe and be the villain! lol
Cool to add audio after the fact but it must just be much better to have the video generator be an AV generator instead when it knows the original intent. The audio side should be computationally much easier. They will also need characters to act which include exact dialogue so it's an obvious requirement. When they have that AI can start making the first showbiz productions. Not good enough for commercial but without too many content policy idiocies fan art can make something amazing. Star trek TNG derivatives and other nerdy stuff are likely first candidates. Animated star wars shows are trash so AI generated stuff might surpass that relatively soon.
There are some out there that are doubting the power of AI because of the glitches it has! I do admit that there needs some tweaking to be employed to bring AI up to snuff. Everyone needs to be patient and just admire the progress that has been made so far.😅😊
Combine these techniques to make your own games. The only problem with AI currently is coherence. Given enough time, artifacts arise and it strays further away from the original creation (in style, tone, or whatever else).
I use to write software back in the 90s that did 3D rendering and object conversion. I mean I actually wrote the code that calculated the position of polygons, and calculated the reflective properties and rendered the pictures, no such thing as Direct3d or OpenGL back then. Of course all 3d libs and cards came soon after, and made it pointless to try to actually program your own 3D rendering tech, all of that is so buried now, it's just part of some library. I had to give up on that stuff. I would imagine that all the 3D animators and developers, of products like Lightwave and 3D Studio Max, and whatever is the latest, must be waking up in the middle of the night with cold sweats. I know I would. The game is done. Why would anyone try to build all of this in actual 3D geometry, when its faster and better to use AI. All of those 3D special effects houses, and super expensive software suites, useless. It's a new day boys, and rendering 3D photo-realistic graphics is not on the menu. Drinks on me in the back.
The video will good for music videos, Im a Musician and use AI as part of my writting process, I can however, perform the songs live, I reckon within 3 years you will be able to simulate a video of a real musician onstage, similar to the ABBA and Elvis type show.
Can you supplement text prompt for a video generation with other media? Like images and video. I'm trying to ascertain how far away are we from dumping existing designs and art, a script, in some cases even storyboards for a movie that was never made or completed, in the "AI pot" and get the actual movie. Think Jodorowsky's Dune.
Every time I think we have to be hitting a ceiling with AI... I am shocked to see what comes out 1 week later. I am constantly having to remind myself; this is as bad as it will ever be.
It's amazing but also so depressing to realize how this will very soon eliminate SO many jobs, we can't even count it. Sure there was always new tools that made previously available skills redundant, but this now just hits like a meteor, like all the cool special FX etc, all soon down the toilet and maybe even actors are gone soon? Why not, if you can create perfect digital ones etc. Have the AI write the script, render it, score it, make the sounds. Hell no more movies or series, you just enter a prompt and you get a full series, with awesome pictures, sound, storylines, etc. How about you just enter a few "vibe keys" and the AI detects what you are in the mood for and creates a whole endlessly running series for you to milk that dopamine until your brain is fried. No seriously, this is dystopia, there is almost nothing amazing about this AI invasion into the arts and music. And no, I am literally an engineer myself, and I still feel empty thinking about the future of what the AI flood is going to do to us...
Think about AI as a whole, it's not just replacing creative aspects. Basically every job at some point will be automated. AI is incredibly good and bad.
Impressive as always, but this creates a trillion problems while barely solving any. That corporations want to make things on the cheap without people is not a problem that needed solving. Let's not pretend that creators will be the ones to primarily benefit. I think it's good many don't find it acceptable that gen AI content be used commercially, and that's the way I'm leaning. Putting my excitement over the tech itself aside.
