ControlNet Revolutionized How We Use AI To Generate Images 

Surely they won't lose their marbles, *surely*

I'll die before I ever use AI in any work I do. AI is a crutch for people with no passion, talent, or new ideas.

@@imsonoided ok boomer

As a comic book artist, I can say it'll make my life way easier. Usually, my gigs are interior art (line art) and colors. If this ControlNet with Anime Line Drawing can preserve the lines and color the thing, I'll be more than happy with it!

Stable Diffusion is quickly becoming the 'Blender' of ML image creation.

do it

I had an old graphic novel I was working on ages ago, where I'd just laid out all the sketches of the scenes and how I wanted the characters moving, but never actually did any fine work myself (though I'm not that great an artist). I'd be really curious to see how something like this would generate my scenes.

@@wumpusrat totally. then you could easily publish it on amazon.

ControlNet ain't an artist yet, don't call it as such.

My hope is that this increases interest in making line-art AI; it seems relatively obvious that outputting high-quality line art, then colorizing that line-art would allow for a very easy way to maintain coherency By extension, high-quality text-to-2D animation can finally be realized

If you like doing line art publish line art

Or, get this, you are too lazy to learn color theory and don't actually care about making art.

@@averesenso bruh?

Really. Imagine new seasons of Anime being released in a shorter time.

So true - I am having ton of sketchbooks waiting to go throught this lol

I love coloring and shading, and I love using this extension. It's great for everyone! had no trouble installing it too, runs fine on my 1060GTX w/6GB vram. (faster without the 'lowvram' option)

@Kozzie Tea I watch tons of videos like that. Of course I will still continue to develop my own skills, but that doesn't mean I can't appreciate new art techology like this.

Same. I can do basic line art, but I suck at proper shading. It would be really fun to see how an ai would "finish up" my sketches and line art.

It wasn't ever just words in a box, there's img2img and as an artist it should be way easier to use, make a rough sketch, feed it into img2img for adding details and select parts you like from multiple generations and composite them in your image redactor. You can work on some nuances while it generates, like fixing hands or paint over artifacts to fend off picky reddit mods.

It's been really hard getting people to realize it wasn't just a few words to generate good images lol. Actual artists had to wade through comments like yours as they dealt with threats and hate helping test and helping design and develop these types of tools in a way that artists could use. lol... I mean... they always did cater to artists and were being trained by artists and used by artists and innovated by artists... how do you think these tools keep coming about? The artists have been making requests and pitching ideas. While non artists... well pretty much spewed hate everywhere to the point the word "Artists" has become derogatory in a lot of circles lol.

@@grayghost7926 😳 why are you so offended by my comment? I don't think there was anything offensive in it. You said "Actual artists had to wade through comments like yours as they dealt with threats and hate." I didn't say anything hateful, threatening, or negative about artists or anyone else. I was saying I'm happy that they're catering to artists more. Most of these AIs only had txt2img at the beginning. They added img2img later. So no they were not catering to artists. They were catering to the general public. And that's fine, but an illustrator doesn't want to trade drawing for typing. But now they are creating more tools for us artists and I'm happy about that.

@@xn4pl Almost all these powerful art AIs (SD, Midjourney, Dall-E, etc) started as only txt2img. So yes, originally it was only typing words in a box. No illustrator wants to just type. Img2img is a more recent development and it makes these AIs more useful to experienced artists. Img2img is part of what I mean by it catering to artists now.

@@grayghost7926 Discovery isn't art

Exactly.

Artists can also feed their own best works into the machine to replicate their style and completely avoid some ethical concerns

@@nickchua5772 Nope, you need to use an already made model to train on top of it. A model that has been trained in art 'unethically'. Regardless most people don't give a fuck. :^)

It is literally nothing more than a tool to illegally plagiarize art with extreme lossy compression in multi gig "models".

I think an artist who has AI knowledge is better than one who doesn't

H

Imagine every frame of an anime looking like the high quality cover art.

@@diowoh I know. It's not quite there yet. I've seen animations done with AIs. I'm guessing you have too. You get flickering and noise. But I'm sure they'll figure it out sooner or later.

@@cybermollusk It would have to color 5000-30000* or more frames per episode, it probably wouldn't be realistic. Everything would have to be uniform and that's not even mentioning the backgrounds.

@@cybermollusk Corridor Crew figured it out already. They made a video using Stable diffusion to make there anime using their live action as reference. Apparently they use a an antiflickering Plugin to fix it.

I don't think they will; DALL-E 2 hasn't had any improvement since the beginning.

Autodesk never learned from Blender.

Watching out what the CEO of OpenAI says about when it will come out the source code of ChatGPT, it's kinda hopeless.

@@peterbelanger4094 An comparison i didnt expect but that i totally agree with, autodesk sucks ass lol

@@peterbelanger4094 Problem us that Autodesk is industry stand so your Blender skills are likely non transferable in the Industry sadly.

@Singularity There were many people in history who said that to many things.

@Singularity Who only knows the hammer will see everything as a nail. So what do people know who call everything virtue signalling? Lies and desception?

Why even bother making the line art? Just push a button and you could get the line art too, right? You'll get to call yourself an artist and not actually pick up a pencil or even move your mouse.

@@imsonoided See, that's the interesting part. One of my friends who has many years of experience in the creative industry, said this: In the near future regular artists will be able to do what a creative director does with the help of AI tools, creating works of art that are designed by us artists. The barrier of entrance to create comprehensive artworks will drop. If this AI development doesn't slow down, it really will be like what u say. Everyone will be able to make their of animated show or comic with one push of a button or some mind reading tech. But that's just the craftsmanship part of art. The artistic intent will still come from us human artists. The definition of what is art is currently changing. But it will take some time to define rules for ethical and legal usage of AI art. But think about it. This very same thing happened when 3D/CGI was new. Many people called it cheating, no real art, etc. I mean some still say that to today's artists doing digital paintings etc. History repeats itself everytime a new technology appears. It all comes down to why do I make art? To tell a story? Share my story? Self expression? That's different for every artist.

@@imsonoided Because it allows you to make exactly what you want, words are a lossy medium. Like sometimes you just want that control to exactly create your vision. Like sure, for a consumer of art, the end result of art done by hand vs art done by ai may seem the same, but I wouldn't say the same is true for the artist. However for an artist to exactly create their vision they'll probably have to toil for half a decade or more years to reach that level. And unfortunately, with the advent of ai I can see a lot less people reaching that level simply because pursing art is an even worse investment now.

@@imsonoided whats the point of that, though? Theres no real effort or inner emotion to express unless you make your hand dirty.

@@YVZSTUDIOS it is as if we will be able to make all types of interactive media in one place and share it with each other, now if we could only come up with a name for such a place...hmmm...

I didn’t understand good how it works, but it seems you still need a text as a prompt even with the line art ? No?

I suggest not to mention to anyone you used AI else you'll be branded for Heresy.

​@@arnowisp6244 nah fuck that, imma let everyone know how AI art can empower individuals to make things that used to require entire studios. more and more ambitious passion projects are becoming possible.

It doesn't work very well.

How about images to 3d scenes?

@@Thesamurai1999 that already exist

Tracing other people's work, probably.

@@BlueSatoshi You mean tracing via edge-detection followed by using the AI to plagiarize the artwork?

@@1dgram I dunno the specific methods that would be involved, but essentially tracing and otherwise straight up plagiarizing other people's work. Something well beyond simply generating a random image with a model that was trained off a million or so different pieces of artwork.

Honestly, the canny control already do that (kinda), so im a little confused too.

AI making Manga Colorful has been a thing for a while now before Dtable Diffusion.

I've tried it all recently. You aren't missing out on anything.

Creativity is inherent in humans, not in a group of "artists". Believing that bringing more people ways to experience their ideas is reducing creativity is as arrogant as it is discriminatory.

Thanks for trying to be fair in your opinion. I don't think there is easy answers about any of this, and there is a lot of be uncomfortable about. On the good side, I've definitely seen people getting in touch with creativity and artistic sensibility through AI ironically enough. Speaking just for myself, I didn't put a lot of time into drawing/painting partly because I didn't even know what I would want to make. Experimenting with AI, I quickly got bored with making random funny things or generic images that you see constantly. So I kept experimenting and curating the results and found things that personally interested me to be brought into the world, vs just images from other people I like to see. I actually feel more inspired now to go more traditional with art skills, to get that additional involvement and control. This can also be quite helpful for things like art therapy. A lot of people use art to get through difficult emotions and experiences and you can have some of those benefits even using AI, seeing images appear that start to express what you're feeling. On the bad side, even putting aside artists' work used in training, job security, etc there is various other issues. If you go into any space that lets you browse the profiles of people who are using the system and it is a space that allows adult content, you'll pretty quickly realize that anyone can create horrible stuff like cp by just typing a couple of words, using the normal models everyone uses. And Dreambooth and Lora allow you to train someone's face easily, with just a few photos. As the photo-realism of the models increases, the idea of "deep fake" as a separate concept starts to break down and anyone can show anyone doing anything else they want, at the drop of a hat. This kind of power has the potential to be very corrosive IMO.

@@cesar4729 Childrens are extremly creative. even more so than adults in fact. why are childrens not leading the entire art industry ? Because it's not controlled and doesn't mean anything at all. It's not refined. Refining your imagination takes years of hard work and patience. Something only artist, architect and engineer have.

@@cesar4729 you are right about the "humans" part. Wrong about the rest . AI isnt an artist or a human . Its an automation bot , that just guesses the best output depending on the input without having any awareness on what even the input means . So no , doesnt deserve the same rights for "creativity" that us humans have .

@@nikki-zeero3122 It would be interesting to know what the "wrong" part is, because nothing you said has anything to do with what I said. Have you even read?

Yeah it'll run there just as well as anybody else.

@@tellu5493 can I just drag the stable diffusion folder into my external or do I need to do any calibrations to the program? Or anything extra besides just moving it?

Yep

@@AubreyWatt You can't just copy the folder, you have to Install it in a folder on the external drive. Then you can copy or move only the models from your old folder.

you can use symlinks

Webtoons have generic Colorong anyways.

I'd recommend looking for videos explaining copyright ai stuff if that's what you're talking about

That's why artist are still needed. To get the parts AI cant figure out. Don't be a luddite and accept Progress.

@@arnowisp6244 yall dont even KNOW what the term luddite means and its funny really . In history , the "luddite" people werent mad because of "oh no technological advances!!!'' They were mad because of what people and their bosses did with those advances : fired them without a second thought, saw them as objects to be replaced , and underpayed+mistreated the still employed ones horribly . Much like what you guys are doing really - half of the "ai bros" advocate : You "artists" are done for! You have no power and you are nothing agaisnt this new fart generic thing we have now ! Your skills dont matter and every single one of you will die unemployed! ( and some going as far as to tell artists to k1ll themselves for it, haha .) Please do your research before deciding on a view ,as you tell artists' to do when they spill some logic to your ears about this ethical issue. Because it seems like you guys have already hit the "the ai will make us forget how to learn and think" step . Its embarrasing for everyone.

You will never be able to draw...

You will never be able to draw... (2)

@@feardietester5507 okay believe,what you want to believe. But that never stop me because I have faith within myself, have a loving day 💝💘 ✨ I forgive you both of you✨

Bro me too

Lack of knowledge does not equate to stupidity. You simply gotta learn, read more and familiarize yourself with the subject.

Temporal coherence is a giant roadblock and researchers have been trying to tackle it for years, that still won't be solved for some time

​@@nocturne6320 Yea I agree, even audio and video models nowadays have a very hard time with that, but still, I think if the frames are very similar, and you just pass the previous frame plus the exact draw of the next frame with its shadows and so on, it's going to be possible to get the next frame colorized more precisely though it's not easy at least I think it cannot be done without re-training a completely different model just for that.

Ever thought that animators actually enjoy the process and don't want to automate the fuck out of it?

@@imsonoided > people enjoy in-betweening t. room temperature in celcius iq

@@imsonoided not in japan where they're overworked for little pay.

I want to draw more Husbandos. As A Guy, I like women but too much and it feels like the Winx club.

Nah really . The world needs more ethically sourced AIs instead of stealing around the whole world's worth of art and turning them into generic automations that people mistake for art due to the way it is advertised . If any AI is sourced by artists' legit and legal consent , knowing what it will be used for - I am more than happy to see it being used by whoever the fuck ! Could even use it myself to GUIDE myself on ACTUALLY drawing and painting . People cant have copyright over the generated pngs that AI makes after all , so it would be super cool to see actual artists use them to learn rather than sad pathethic waste of people that call themselves "prompt writers" that sell those pics by marketing them as "human art" and keep throwing around the word 'luddites" without even properly knowing what it means ,lololol .

@@nikki-zeero3122 Disagree. There's not any stealing happening. A person, looks at art and then uses that art as reference to theirs...is that stealing? No. The A.I. uses the art uploaded to it as reference and creates its own thing using those references. Even if the picture looks like a blatant copy, it's not.....humans do this as well. A.I. and humans are not too far off from each other in how they function. The only difference is that humans have emotions that go with their programming. If you look at what the A.I. is doing compared to what humans do, you would see that there is some DEEP hypocrisy happening in this argument.

@@kukukachu also please stop using cheap words such as "hypocrites" and "luddites" or whatever . The real hypocrisy is the ai bros guys calling themselves an artist without even being willing to put blood and sweat into it . And the luddites- you guys dont even know what that word actually means . You look like a child that has learned a swear word and is sticking it to everything it sees -mature up please . And the real meanning of the word is also explained in the video, so i highly advise you and many others look at it .

@@kukukachu I linked it , but it appears youtube didnt let the comment go through due to the link. The video is named "AI art will have consequences" . Please look it up . It really clearly states legit arguments and facts at everything you guys have been blinded about by the advertisement of these png generators .

@@nikki-zeero3122 I didn't ever use the word "luddites".

You can use Colab, if you don't have a good enough graphics card.

Can you imagine, export the frames of, let's say, Kamui, Kimba or the first Sanctuary saga of Saint Seiya, run gimp batch scripts to get the line art and then re-colorize them to a Katsuihiro Otomo/Masamune Shirow style? Keeping the original line art style *¬*

Check out stable horde

Did you... watch the video at all?

@@Noah-ws8ho yes and as an artist i still see an automated process that give you a final result instead of a suggestion. It's already hard enough backtracking my own work and changing things around once i settled for something. If this keep on going we wont ever see any innovative idea for centuries to come. art is a process.

You can already do that with NovelAI, Anythingv3 and WaifuDiffusion.

@@sourcerror There is Anything v4.5, and many other anime models that are far better than waifu diffusion, like OrangeMix models.

@@maestro3676 p.s anything v4.5 was a troll mix by andite consisting of anything v3.0 and aom2 it produces OKAY results but it doesn't take away from the fact that andite didn't put any care into it which is funny but yknow (it wasn't supposed to be good)

@@davidscann Actually a mf from UD told him about a very good mix of AOM2 and his finetuned model. He tested it and found out that is true. So he decided to make some small changes to the recipe and then called the new model as AnythingV4. Even the man who uploaded Anything V3 to HuggingFace and make it popular on there encouraged him. Tbh, Anything V4 looks good and I don’t really mind about whatever it is a troll model or not. And Anything V3 is a mix anyways

@@taihuynhuc3135 I mean, my source is andite himself, so do with that as you will

It's the result of university research, not a company. So as of now just freely available, nothing you can invest into, would have to ask the researchers that made the improvements if they want to start a company lmao.

Well, there is a lot of videos on RU-vid and various discords to watch and ask questions. And Leonardo and Mage (and MidJourney, though not Stable Diffusion based) let you browse what other people have made and see the prompts and image masks and stuff. It sounds like the sponsor of this video even made a course. So there's a lot of resources out there if you look around.

Lmao

if the meaning comes from scarcity, did it really have a meaning in the first place?

@@dibbidydoo4318 Meaning and value come from quality. Imagine there is a game, a book or a movie you like. There maybe many thing you like or dislike, many thing that could have been done better, but overall it is a good and original work. Now do you like watching or playing blatant copycats of said work ? Do you play one game and then endlessly consume clones of it? Do you recommend your friend the original work or the copycat ? Now imagine an AI endless create derivatives work, each one changing a little but overall it just putting on a different coat of paints. The name may change, the graphic may look HD, but something still turn you off from them. And it took no effort whatsoever to create those derivative. Now, do the copycat still have the same value as the original ? Nowadays there is no shortage of anything on the Internet. Even before AI, people create OCs and write fanfiction and derivative works. Still we hold some work to be of higher quality and value than other. And we especially look down on plagiarism and copycat. Why ? I think the question answer itself.

@@marverickmercer1968 if it's all a derivative, how will art lose meaning then? It will just increase the value of unique works.

@@dibbidydoo4318 I think the point is more towards analysis paralysis and how over saturating the creative market (More than it already is) will make it harder for quality works to actually come above the trillions of mediocre pieces.

@@dibbidydoo4318 except it's not "unique" work. it's derivative meaningless big tiddy goth girl nonsense.

From what I know, many AIs will use the style of a specific artist if you name it, but I didn't try with this one.

@@boomleon7224 both of those artists and a lot of others don't allow their art to be used for AI learning, I don't think it will be ethically possible to generate from those artist

@@Harsh1650 idk, probably since it's posted on internet, they give the authorization of anyone to see it and take inspiration from it, AI included. That's my very best guess.

@@Harsh1650 The problem is that it is super easy to download that artist's images from the Internet then train on them

​@@boomleon7224 if the artist does not want it trained, it is impossible to ethically sidestep it by blaming the AI for your own actions.

It doesn't matter how many millions it benefits as long as it's not good for them individually. They like to call themselves artists, but "average human" suits them better.

then make ur own manga.....

Just imagine a handful of people competing with big name studios, pushing out content with a 1000 times more creativity like what we see with indie games. AI is a force multiplier and I'm excited to see the kinds of visions people have when grunt work and crazy costs are removed. An explosion in creativity is comming.

@Arno Wisp yall dont even KNOW what the term luddite means and its funny really . In history , the "luddite" people werent mad because of "oh no technological advances!!!'' They were mad because of what people and their bosses did with those advances : fired them without a second thought, saw them as objects to be replaced , and underpayed+mistreated the still employed ones horribly . Much like what you guys are doing really - half of the "ai bros" advocate : You "artists" are done for! You have no power and you are nothing agaisnt this new fart generic thing we have now ! Your skills dont matter and every single one of you will die unemployed! ( and some going as far as to tell artists to k1ll themselves for it, haha .) Please do your research before deciding on a view ,as you tell artists' to do when they spill some logic to your ears about this ethical issue. Because it seems like you guys have already hit the "the ai will make us forget how to learn and think" step . Its embarrasing for everyone.

@@tonynugget7223 and that all that ties to your unrealistically optimistic view . What do you think will happen when greedy corporations and bosses get their hands on this tool ? The only thing that will be exploding is the unemployment of their workers , after that moment. Just sacrificing the poor workers , to get a little bit richer , a little bit faster . This isnt a tool for creativity just because it makes things zero effort for non-artists . An artist paints and draws because they want to , the process of art isnt a hustle or a " meanningless waste of time wish someone else could do for them" . It IS for someone else though . Someone that isnt really an artist- just needs the results. Not the proccess , not the experience , not the learning , not the creativty. And that "someone" is capitalism addict , selfish bosses that try to blur the line of ethical work rules and pay , all the time . This is automation , and we all know, artist or not , that when companies get a hold of automation, things get ugly and not so creative nor passionate , very *VERY* fast . It wont be ending good for ANYONE but the rich corporate bosses .

ya was thinking of doing that, will add when i have time, thanks for the suggestion