someone made a deepfake of my cousin committing sexual acts on a minor and it almost completely ruined his life, it was sent from his facebook to all of his friends it was awful
Deep fakes in general are a very scary concept because they have gotten so realistic. Even getting away from the sexual stuff, deep fakes can still ruin someone’s mental and reputation with how real they have gotten. What is extra scary is how good some private tts companies have gotten at copying peoples voices
It shouldn't be illegal to publish it as long as it is very clearly marked as deepfaked and not real. If everyone knows its just an edited image then it's no different than creepy fanart, it's when everyone's convinced it's real that it's a problem.
@@Raptorworld22 No, it's currently classified as revenge porn in the areas it's currently banned, and I think this is a fair classification. There's a few reasons this is the case: 1.) Well-made deepfakes are indistinguishable from real photographs, and this is being further solidified by Dreambooth technology. It's worth noting that CP "art" gets charged as actual possession if it's modeled after real children or is too realistic. 2.) "If everyone knows it's just an edited image" requires every single point on the distribution pipeline to clearly mark the image/video as deepfake. This origin can wind up obscured or lost, either accidentally or intentionally, resulting in people believing it's real. 3.) The intent of deepfake porn is to obtain sexual content of someone who hasn't produced that content. You are bypassing their willingness to take naked photos or record videos of them having sex 4.) This is a thing men don't really understand, but most women are straight up HORRIFIED by the prospect of being seen nude by people they aren't intimate with. I for one had an incident where an ex landlord put a camera in my bathroom, and 6 years later I still have severe anxiety and trust issues from it. 5.) A common victim-blaming tactic men have towards women who have their nudes leaked is "You shouldn't have taken them." With deepfake porn, a person's choice to have nude photos exist of them is completely removed. 6.) Women have to deal with constant sexism and sexual harassment in their lives. Our ability to choose who can see us at our most intimate is one of the ONLY things we can control in that regard, and it's being taken from us.
@@cargyllion 1) Didn't know that, but if this stuff really is so accurate to real life now, then I am changing my stance and agree it should be illegal. 2) I never said my idea was practical, but in a perfect world that is what would be done. 3) This point doesn't make sense to me, as it's no different than creepy fan art in that case. Do you also think we should make drawing people without consent in explicit context illegal? Actually curious what your stance is there. 4) I don't know what men you're talking to, but every man I know would be equally horrified in this context, where everyone knows/thinks it's their body and it's without their consent. 5) Isn't applicable since my original point was if *everyone knows it's fake* 6) Having been a woman for more than half of my life, I know you are talking complete BS in that first half, unless you live in Saudi Arabia. Overall, I am changing my mind and agree that this very convincing deepfake stuff should be illegal. Different opinion on fanart and terrible photoshop jobs.
@@Raptorworld22 The current situation with Dreambooth deepfaking is that anyone with an Nvidia gpu made in the past 6 years and 20 or so images of a target individual can generate a model capable of replicating that person's appearance. It can generate you nude, in an SS uniform, wearing a Jace Beleren cosplay, whatever you want as long as you fed it reference images. And it's scary accurate. Literally the only saving grace right now is the current training models can't parse complicated tattoos and facial piercings. However, there's a large community of people working to fix these issues for the expressed purpose of generating AI porn.
Aside from the tremendously creepy aspect, it's good that you brought up how deepfake porn could potentially be damaging to the careers of the people being deepfaked. Think about it; the wrong people see something like that, like advertisers or investors, they might get fooled by it and decide to cut business ties with the people getting deepfaked. In short, just imagine your favorite content creators getting blacklisted due to sexual content that they never even produced; that's horrible.
This is a good concern, but I'm actually annoyed that companies even care so much about people having sexual content. As long as it's somewhere children won't accidentally stumble across it, there really shouldn't be a problem.
@@impishlyit9780 100% agree with ya. Just because someone's made or performed in pornographic content/media doesn't mean they should be blacklisted. It's a paycheck. Nothing more, nothing less. So long as all the people viewing the adult content are of-age themselves, everything's fine. Man, I got sidetracked on this one xD, but it's an important topic too.
Even if they aren't tricked by it personally a brand could probably be convinced to drop someone just because it exists at all especially if it gets popular enough. Real or not a brand that's promoting say kids content or trying to have a "family friendly" image may not want to be associated with that. I don't understand how it's legal anywhere given these companies should have no right to monetize your likeness anyway. Really gross situation and technology keeps advancing faster than we can plan for the ramifications of it.
@@josephschultz3301 agreed. Here where i live, a female teacher broke up with her husband and he, as revenge, shared online some porn videos they made together (that were private, they never posted them anywhere before, it was private videos for themselves and pics he took of her naked). Turns out she got fired from working as a teacher and blacklisted from every teaching career in our country, while he only got like 5 months of picking up trash as community service for doing something illegal. AFter those 5 months he can get back with his life (of course HE isnt getting fired nor blacklisted from any working job even if he was in those videos too, only women gotta be slandered for sexual things) meanwhile her life is ruined. Some idiots still insist on defending him and blaming her. Our country had a lot of protests about this.
I was very innocent in high school. I never taken a nude or even made out with anyone. Never sexted. Yet, there were multiple people that were convinced I sent someone a nude. Turns out, it was some other girl that looked similar to me. The guy lied about who sent it. I have no idea why. It is an awful feeling to be judged for sending out sexual content when you never have. It is such a violation. I couldn't imagine being in the situation as the streamers. What they are going through is in a much larger scale. Truly horrific.
It's not just not understanding consent- it's wanting to actively go against it. You'll have commenters screaming abuse at a woman that promotes her OF, but have a site like this that promises a leaked video, or accidental nip slip etc, and people will flock to it for the express purpose of seeing her in a situation she didn't want to be in.
You prob don't know the difference between public and private property. Who are you that we other humans require your blessing for us to do as we freely please with our property?
the biggest shock for me with this whole situation is that this wasn’t already illegal. there’s already laws and defamation lawsuits surrounding using someone’s likeness in anything without their consent, but for this kind of material is sickening.
Exactly! And then you have guys like d*stiny frying their brains out to try to understand why deepfakes are bad 🤦🏼♀️ when is just another form of defamation!
@@lacuna3693 it should be, lol. There have been cases in which celebrities sue companies because they use their image without their consent and/or against their will 🤷🏼♀️ but idk, the internet has normalized trasspassing personal boundaries to an extent where people are just mere objects...
@@lacuna3693 current law, sort of? Best example is with the old man “hide the pain Harold” or whatever that meme’s name is. His image, especially for those photos, are under copyright like any other stock image. So we do know that memes can be under copyright and can’t be used for profit or undermine other’s work. There’s also celebrities suing games, animated shows, etc. for using their likeness without their knowledge. However those are higher profiles figures, and common streamers would have a harder time fighting that in court. There’s also AI involved in deepfakes, which we still have no laws governing, and other issues of giving streamers protection from these websites. Honestly, one of the better things to combat it might be a libel/defamation lawsuit, since this basically is faking a porn tape for someone. And that’s outright stated under defamation as an injury of character and easily would at least have a trial for it.
It’s because the laws have to consistently adapt to technology so they will always be behind. We unfortunately won’t be able to experience a society we’re the laws will be ahead.
Even if he found the website randomly which is very unlikely, the fact that he didn't notify his fellow coworkers and kept it to himself is pretty stupid of an excuse.
@knockout Well in order for him to know it was a deepfake site, it would have to be advertised as such, and presumably it would also advertise being able to fake his coworkers. Also I'm pretty sure the hub doesn't allow deepfake content so it makes no sense they would allow those kinds of ads.
To his credit, that’s a pretty awkward convo to have. “Yo bro, just letting u know I found this online service where it deepfaked you onto porn.” “How did you find it” “yeah, I was down bad and clicked on some ads, paid for some website, and beat my meat to it. Sorry for not telling you sooner.” “Bro wtf” that’s only one possibility of course, but ya see where I’m going with this? After the action is done, kinda hard to bring it up casually.
it’s sad that it has to be pointed out that this type of technology can be also used to frame people for sexual assault or other heinous crimes for people to actually see an issue with AI being used in such a way.
Fun fact this won't happen since the ai that creates the deep fake is also able to detect deep fake as it trains two ai one for creating fake ai and one for detecting fake ai to improve it. So no it's not going to be possible that it would be used for blackmail
i think the crazy shit no one else or charlie touched on, is the idea that they can use deepfakes of minors and young celebrities or actors. theres probably already some floating around on telegram i bet. dont doubt it one bit. smh
@@justasmltwngir1732 get the fuck outa here. You're gonna tell me you never flicked the bean to anyone besides the pornstar you're watching? Oh what you don't watch porn? Naw let's not even stop there you don't even tug em out right? Do you hear yourself. Everyone that masterbates has their "inspiration" cause you sure as hell ain't jerking it to literally nothing, regardless of whether or not you watch porn. And my reply to op, I would know it's not someone I loved, so no it wouldn't bother me one bit. That said in my opinion deepfakes should be labeled as a deepfake and not tried to be passed off as real.
@Edward Deepfake porn has gotten so advanced that it's quite hard to distinguish real from fake. Without proper evidence to disprove the deepfake, it can easily be used to slander. Although I do agree that deep fake porn of celebrities and social media personalities will always exist, that's just the price of fame. But what is disgusting is that it was of his friends and even his friends girlfriend.
@Edward everybody has fantasized if even a little about somebody attractive in their life but not everyone seeks deepfake porn of them. That shit is definitely weird man
This been around for decades bruh.. back in the 00's it was photoshopped celebs. They've always found ways around it & unless actual federal laws are made, this ridiculous stuff won't stop
What scares me the most is the potential for cyber bullying and the fact that I can predict with great certainty, that this will be used by school students to bully other kids
Only for this generation, the next generation of kids will grow up not trusting video / audio. Out of all the dangers AI will bring, this is one of the things you should be least worried about.
I mean… the idea of even having those kinda of tabs open while streaming is mind blowing, it’s like going to a public bathroom without locking the door.
It's like going into a public bathroom stall to pull down your pants , insert a banana, then bend over and leave the door open expecting no one is gonna see that goofy shit.
When I do stream (rarely), I make sure every bit of software that isnt related to streaming is closed, not minimized. I'm not ashamed or into anything illegal, just like, even accidentally flashing OBS bothers me. then after stream I do a full restart to make sure obs itself is off. Too safe? maybe, but better than this guy
The ethics of AI technology and deep faking are very concerning, and not just this particular situation. Not being able to distinguish reality versus fake reality is a slippery and dangerous slope.
yall never had a hot friend that u wanted to sleep with but couldnt? idk why everyone is freaking out over this. everyone has their own private fantasies or curiosities. ive looked at some really really crazy stuff online just because. its not like atrioc was personally creeping over them, it was a solo curiosity that he accidentally showed.
It's scary because anyone could suffer from this, imagine you have a crazy ex who wants to ruin your life and deepfakes you in that type of scenario and sends It to everyone who knows you
@@llamarelish4701 cool it with the misandry, being a man or not has nothing to do with it, im a man and i dont agree with him lets not generalize a gender
Remember back in high school when rumors would spread about people? This is the ungodly, coked-out, and roided-up evolution of that concept. This is fucking terrifying beyond comprehension.
The depressing truth to all of this AI deepfaking is that there’s creeps on the internet that can easily make porn of popular minor celebrities and that alone sends chills down my spine
This comment section is making me both enraged and dissapointed by the second. There’s plenty of sane people here, sure, but why can’t everyone understand that other people don’t want to be depicted in sexual situations? These kinds of disgusting slime are better off dead, along with pedophiles and other kinds of non-human filth that think consent is just a suggestion.
@@jerome1lm It's no longer a "fantasy" if you choose to make that fantasy into a material entity (deepfaked video) which can be seen by anyone, not just the fantasizer. Seek help.
I discovered I was deepfaked from this whole situation, and honestly even though I'm hurt I also feel for the sex workers who had their work stolen too. Both me and those SW who they put my face onto were sexually exploited and sold without our consent by someone we don't even know. Thanks for covering the situation, hopefully more people with be careful to make sure all of the sexual material they use was consensual.
@@yabo5131 excuse me? so you’re saying that women should be made into deep fake porn without their consent and they’re not allowed to complain about it because they are “actual” sa vicitms? yeah dude both these people can exist. if your idea of “consent” only relates to physical sexual assault that’s your problem
I was once recorded without my consent in a sexual manner and was blackmailed. Even though it was my body I completely empathize with all of these streamers. Because I was never physically hurt, but just the act of seeing me (and in their case, their likeness) being shown without my consent was the most damaging shit ever.
I remember less than 10 years ago, local stories about how a teacher lost her entire teaching career because when she was younger (and she was still young when they came out), she did adult content that some of her students eventually somehow stumbled upon online. That was from someone doing adult content for real. Now imagine if highschool or college students have the power to just deepfake a few convincing pictures of their teachers in adult content. They could ruin their career and reputation because even if it's proven fake, school establishment don't like to be anywhere near that kind of stuff and the content will probably remain available somewhere.
@@experimentalghoul3540 I’m not sure what you mean. Like anything else it exists because there’s a market for it people will pay for a service that lets them see their favorite celeb in adult scenes.
When I was younger, I wanted to become a programmer and create stuff that's exactly like deepfake. Now that people have done it before I even had a chance, and I've seen what people have and maybe will use it for, I wish that it never had existed. Man, I sure love technology.
@@Cruz474 Photoshops are still vile and those should be banned too. Stop thinking from the perspective of someone tugging their meat, and start thinking from the perspective of the victims
@@hithisthers7214 I'm thinking from an omniscient perspective. I was just looking to see for your consistency. I see it, so I have no quarrel with you. Respect.
@@Elfenlied8675309 that’s a logic fallacy just because something has been the case for a long time doesn’t mean that there’s evidence stating it should continue to be
@@Celeborn93 Absolutely good comparison. We have to think of black and white in these situations. Is this good or bad. It is bad. There cannot be middle ground especially when those whose likeness is being reproduced explicitly and implicitly stated they do not want to be used in that way.
I mean when every girl i see often does sexual stuff, it got me really desensitized... i know it feels bad but when it's like pokimane and all, i cant even flinch
even if the person faked does make there own sexual content, there own business gets undermined by bootleggers basically, and even if someone consents to be photographed nude in there own content, that doesnt mean they consent to being deepfaked. thanks for talking about this charlie, ur a stand up guy
@frogmen it literally is illegal to sell fake jordans. That's counterfeit product Edit: also glad to know that women are yet another product. Maybe try to see women as human being and not sexual products to produce "cheap knockoffs" of
@@quixoticvalkyrie Lol no selling fake jordans is only illegal if you try to sell them as though they are real, knowing that theyre fake. If these deep fakes are being advertised as fake, then thats it. And drop the woman are objects nonsense, same applies to mens deepfakes. As charlie has stated this has also happened to him.
Was just talking about this with my boyfriend. I can’t imagine finding P of myself online without consent, or how it would make me feel. Everyone calling these women sensitive for being in this situation is heartless.
They say that they wouldn’t mind having the same thing happen to them but guaranteed they would be upset if they saw just how realistic and convincing it would be
@@swirlffle8323 It’s because they think if someone deepfaked them, they’d get exactly the bod and sex they wanted. These incels don’t seem to understand that anyone could make them into their worst nightmare and they’d have no way to prove it’s fake. It’ll only be an issue once it happens to them.
This is technology that humanity simply isn't mature enough for. Imagine videos of crimes and the like being doctored with deepfakes in order to falsely imprison people. That's one of the first things that came to my mind when I was first introduced to it.
It just makes me sick how so many miserable people spend so much time of their day making fake videos and cheap deepfake animations on people. They deliberately do it to harm and Destroy peoples reputations.
And I don't get why they are so desperate to see somebody uncovered in the first place, acting like middle schoolers who have never seen a woman's body before
it was 100% clear from the second the technology started to exist. look at games from 1998 and today. it was inevitable that this technology is advanced as this.
I was wondering when Charlie would cover this topic, and I’m very glad that he did so in the way he did. He was respectful and did his best to make everyone aware of what was going on without making a huge deal out of it in a way that would draw even more attention to it.
you know as a woman i’m so glad to see such a prominent male figure in the community speaking out against this. i’ve seen a lot of women being disregarded and belittled for saying the exact same thing and as shitty as it is, it’s nice to have someone to back us up.
Agreed, charlie and this community are what often restore my faith in humanity to be honest. Sometimes I'm really scared if no one in this world actually have decent clarity and conscience for everything that I've seen in my life. And it is MEANS A LOT for me to know there are peoples like charlie and his followers out there with sane minds and willness to speak up for those who need it. Charlie if you see this, you are impactful and honorable. Thank you 🙏
I am really worried about this, especially in terms of crimes and trials. It has become so easy to frame someone of doing something gross which can be used during a divorce or just something illegal. Even if some IT specialists can prove that a "photo" or a "video" is a deep fake, it still can be so devastating for a person even if he didn't lose a trial. Drama usually stays for eternity in one's reputation. What I'm trying to say is AI faking action of real people can run out of control extremely easy.
So the reason why thst won't be a huge problem ris because it need thousand of hours of video and sound to make it even kinda believable so no normal person would be able to be deep fake only people in front of cameras often and if you in front of a camera often you have easier time to prove your innocent
@@bobberry1463 even if that’s true, anyone who has hours of content of them - with, or WITHOUT their knowledge - even just a few solid minutes of footage / other stuff and you can still do this. there’s been deepfake porn of people who are pretty chaste online (like billie eilish). and i’m sure people who are looking for that kind of thing won’t care if it’s poor quality or not as long as it’s close enough for sure it would be harder for people with less footage of them up / less public jobs, but even still, it’s better to protect everyone - silly example but genuinely: but does flo from progressive not deserve the same amount of privacy as any of us? just something to think about. 100% always better to make something more safe than less safe.
Sorta off topic but Charlie seems like one of those friends who would tell you your screwing up before it’s too late. It’s honestly refreshing to see someone be so blunt and honest about something when it’s about a friend. I’m sure it’s a very difficult situation but I think that it’s pretty inspiring to see that how he’s willing to stand by his morals and say it’s wrong despite having reservations, not wanting to add negativity to the situation and caring about the other person.
This is very well said. Thank you for covering this so well. People need to understand this but I know that some people won't understand it and it sucks. I think people really don't see streamers as people and it's scary. Someone could make something fake about you that's hard to disprove, and it could ruin your whole life. I feel like there's going to be court cases about this in the future. People shame people for having OnlyFans but then seek out this? I think they don't want to admit that they want things like this. And much less admit that they have a problem. Time will tell.
HealthyGamer_GG did a deep dive on this today that goes into some science about how nonconsensual porn affects not just the victims, but the consumers, and one of the chilling parts of it was that the deepfake stuff is behind paywalls because it's more addicting, because they're attached to an existing powerful parasocial relationship. It was a powerful take and I hope everyone sees it.
Isn’t all porn non consensual? The people participating in the act consented but there’s no way that they consent with everyone who’s watching, and as a passive observer i doubt that anyone is mentally checking off if it’s consensual or not anyway. As far as the individual is concerned they are partaking without participating and that is often a part of the harm done by porn.
@@sparks6177 people who make porn willingly and post it publicly are also consenting to having pretty much anyone view it. It’s comparable to RU-vidrs and actors where they sign on to have anyone who can watch their content, it’s part of the deal. Steamers do not consent to having porn made of them because, well, it’s pretty obvious why. They are not at ALL the same.
It's weird to me that there are some folks out that you have to explain how morally unacceptable it is to exploit people on the internet with deep fake porn. Is their moral compass broken? This is about respect towards other people and consent.
@@aurea. I feel sometimes like the whole internet is full of soulless sociopaths, but then I remember a lot of people on the internet are teens thinking it’s cool to “not care,” if you know what I mean.
It's what happens when viewing tons of porn is considered normal especially for guys so there's nothing stopping them other than themselves in how far deep they go
"consent" Do you complain about comics making fun of specific people? They certainly don't get "consent" to rail on about people. This is so delusional, because it assumes that these celebrities are actually being affected (exploited!!) by the deepfake industry. I like how everyone has just ignored that this has literally flown under the radar until this weird incident by a streamer. So much proof of it having a real tangible affect on celebrities in general that it took a random giant streamer to have clicked on an ad to suddenly bring this to internet wide attention. There is real criticisms to be had like the companies labeling the porn as REAL!!! and it being charged for, IE, making money off of someones likeness/copyright without their consent, but the idea that porn deepfakes are inherently themselves *evil* is actual karen behavior. These do not have actual effects on anyone, except in the small exclusive cases of direct blackmail, and even THAT situation is bullshit because there's also tech that detects deepfakes that is constantly evolving alongside AI tech, so any faked blackmail is usually very quickly detected as fake and thrown out. Charlies example of "muh companies pull the trigger like winnie hut junior" is not a problem of deepfakes, but companies being pussies, and one that should be ironed out. I'm sure a few cases of potential "leaks" turning out to be fake resulting in triggerhappy companies looking like dumbasses will curb this behavior.
Dude. My biggest concern is how this could be used to frame innocent people for crimes. The state or a malicious person could take someone down by just making up video evidence of them committing crimes they never did. If this happens a lot, we could end up in a world where video evidence can no longer be used in court (unless we find a way to better identify AI deep fakes).
Security camera software could add features to grant access to footage (where it is viewed on its official website/app), that way it can't be fabricated
I could be wrong but wouldn't you still be able to use metadata? Phone/camera manufacturers could use some sort of verification system to confirm whether a video was real. Obviously a lot of videos/images would no longer be valid but I don't think its entirely a lost cause.
My biggest concern is when people begin deep faking individuals doing illegal things. Someone doesn't like someone and so they deep fake them doing something horrible to a child and it's hard to disprove in court. On the flip side of that, once it becomes well known enough, deep faking becomes a serious issue mudding photographic evidence, suddenly it's hard to prove someone who is guilty based on photographic evidence because they can claim it was deep faked.
"deep faking becomes a serious issue mudding photographic evidence" Yeah, but that's not necessarily a bad thing. There's a lot of innocent people in prison, so having more prosecutions fall apart because of the dubiousness of video evidence could be a positive thing.
Already happening. We have seen "algorihmicaly enhanced" footage admitted in court trials. Even if it's not purposeful deepfakes, it's still extrapolated data, something that never actualy existed
Really appreciate your language use here because it feels intentional and important; referring to the women he looked at as "colleagues" and "coworkers". I think something that seems a bit lost in this discussion due to it being on Twitch is that this is a man who fully looked at porn of the people he works with. In any other "real world" scenario, if your coworker got caught with porn of you and your colleagues (regardless of the gender) on his work computer there would be an immediate understanding about how absolutely disgusting and straight up creepy that is, and how rightfully so in that situation, that colleague would most likely lose their job because of sexual harassment. I hope the women who are victims of this really have more support not just from their user base, but from Twitch directly, because this is just unacceptable behavior that's eerily being described as "normative".
@@lioreubm677 Yes and no. (Basically) all men have a sex drive wired like this, not all men act on it. Many men are good people and dont indulge in their darker side like this
@@eligedzelman5127 “darker side”? The way you’re describing men makes it sound like all men have dark, horrible, twisted urges, but the ones who don’t act on those are good. That’s not how people work, and it’s not okay to generalize men in that way. Some people do have bad thoughts and bad urges, while some don’t. And yes, it is scientifically proven that males have more libido than females, but that doesn’t make them inherently creepy. It’s okay to have sexual urges; most people do.
Deepfakes have always irked me since I first heard of them a few years back, and knowing the technology for it is only getting better, that bad feeling isn’t going away. There’s so many ways it can be used in the wrong hands- blackmail, revenge porn, straight cruelty by sending it to friends/family, getting people fired, using CHILDREN, etc. It deeply, deeply unsettles me. The response to this whole streamer situation greatly concerns me, as well. These women are being openly objectified, having their privacy invaded in one of the worst ways possible, and some folks out here are so quick to brush it under the rug. It’s a shame.
You’re 100% right here!tbh technology is scary af nowadays between the ai art the deepfakes and the ai that emulate people’s voices it’s definitely risky af and could lead to a lot of horrible shit happening and it sucks seeing people being taken advantage of and having this horrible shit happening to em men women and children alike can be victim to ai deepfakes of all kinds including adult content. The thought alone makes me feel sick! I can’t imagine what the victims in this must be feeling and going thru tbh
Lawmakers really need to completely ban this. Imagine if they deepfake a persons face who is under age and then put it on the body of someone of age, and say it’s “ok” because the persons body is of age. Very horrific slippery slope here. Disgusting!
I remember this one adult actress who had been affected by DeepFakes being applied on their content speaking out about this, it was something along the lines of “You’re taking something that I have produced for people to enjoy and you’re twisting it into a situation where the other party has literally no consent in the matter.” Adult DeepFake content is just such a strange thing to me, on the one hand I can to an extent admire the technology, but we really should be drawing the line at DeepFake memes for comedic value, cause when you cross into the territory of things being practically undetectable to the naked eye, it can genuinely ruin people’s lives.
Honestly it's hard to say where to draw the line. Comedic value is subjective and there can be stances within memes that people don't want associated with their faces. Even the film industry has morality issues about deepfaking. Good quote btw.
@@MammalianCreature I think it was in one of Shane Dawson’s old conspiracy videos on Deepfakes, long before all The weird shit about him came out. i believe it was his video “Conspiracy Theories with Shane Dawson” from 2019. I’d say the DeepFake section of that video was probably the last interesting thing he made tbh.
@@craigyeah1052 I say in memes for instance like what Corridor Digital does, they had that Keanu Reeves stops a robbery deepfake that was quite impressive, or like when people do stuff like deepfake nicholas cage into random scenes. I agree though, it’s kind of hard to tell where EXACTLY to draw the line with this kind of stuff.
im glad that someone with a large platform is talking about this issue. ive seen this exact thing happen to many female streamers, but because they were smaller, nobody said anything
i had a similar experience. i was only 16 and one of my friends (20 at the time) spread around fake screenshots of me saying sexual things to him. it was all for a “joke” but people genuinely thought it was real, and he played into it. it’s such a disgusting feeling to avoid touching anything remotely sexual as a woman, only for men to decide you don’t get to choose whether or not you’re considered sexual. they turn you into an object for their own pleasure so easily and it’s terrifying. it makes you feel like you don’t have a right to your own body anymore.
The situation is so bad that even Dr. K made a RU-vid video about the whole deepfake situation regarding the implications of it and the damage caused by them. It's so bad for everyone involved and those who consume it.
Thank you for your great breakdown of the situation, Charlie. It’s the weirdest energy for people to have such a strong stance against Only Fans creators to also have the take of “it’s not your real body so why do you care?” Seems like some consumers will only enjoy sex work so long as the sex worker can’t consent and/or profit. 🙃 Yikes.
thats exactly what it is. misogyny has been so deeply ingrained into these degenerates. they fully believe they should have access to sexual content on demand (but no, not like that!!1!)
@@professionalfurret7225 OF is better than illegal sites that get their source illegally like trafficking women (yes it happens), blackmailing them into doing it, or set up a small camera to record it without their consent. what is so bad about people using their body to make money if they consent about it? If you want to go against pron, then you also have to go against sx overall. Pick one side and dont cherry pick, all it did is harming people. The fact that you lump deepfake and OF together speak volume of what kind of person you are. One is illegally made against the person consent, one is made by the person with their consent and the will to do it. if you try to ban sx overall it just wont work. my country did that and 10 years ago it was super common to throw LIVING freshly born babies to a trashcan because mrdering is better than people knowing they have outside marriage sx.
Because they literally only care that theyre not the ones making money off it lol. They obviously do not care having men whack off to them or having sexual content of themselves on the internet. But somehow have a problem with fake images of it? give me a break lol
i'm glad charlie understands how disturbing it actually is, because i've seen some youtubers say that the only problem in this situation is that the guy watching deepfake porn didn't do enough privacy measures and that watching this stuff is okay if you're not talking about it publicly.
I think the nuance that it only matters now that it is more realistic, where as it was more humorous (at least the ones he had of him) before is a bit wrong though. It is absolutely worse for the person being faked, as it's harder to deny and refute that it's them, and would make them feel far more invaded. But, for the creator, and the consumer it is exactly the same. The intent is the same whether it looks a bit off or not. They are still trying to create an adult video that the person did not consent for.
i mean...think about it...if nobody knew, what would the ethical issue be? Like, for example, would it be unethical for someone to draw a picture of a celebrity naked, and then jerk off to it? I feel like people just love shaming others when it comes to anything sexual cause they're desperate for people to think that they're not the weird one, when in fact, we're all weird.
Yup. I'm sure laws will be made here federally soon because as of now, not many can do anything at all except get them removed. In the internet though... Things always make its way back
It’s gross, especially cause it’s not even limited to celebrities, influencers, streamers, etc. Even average every day people are getting deepfaked and it’s especially sad because with celebrities, we can assume it’s not real, but these every day people having their name and faces connected to these videos- recruiters and hiring managers aren’t going to go that extra step to see if it’s legitimate. It usually isn’t until people get sent links to the porn videos that they learn what’s being done.
I mean, I agree deepfakes are pretty messed up. But don't people draw stuff like that too? How come people haven't been talking about that? Sure it isn't the real person, but their likeness is still being used and they're still being objectified
I always thought AI would take over by human looking robots, not deepfake porn. It's seriously sad that this shit happens. It's happening on Instagram too. I think this could also shed some light on porn addiction and the dangers of it. What I'm really worried about is creeps using this with minors.
Glad you mentioned the dangers of porn addiction; I'm an addict myself (hentai) and I'm trying to find some productive ways to distract myself from feeding it.
@@soaringsquid0.129 good luck. I know other porn addicts that had success with crocheting, chainmail (metal not emails), and miniature roses as house plants. Just need to keep your mind and hands productive.
@@soaringsquid0.129 Well, you better not take any looks at AI porn made with stable diffusion and stuff... now you can produce hentai shit with just a click
it can be used for really bad manipulative situations as well.. i had a really nasty friend in the past and she once photoshoped a girl's face on a porno and told her boyfriend she was cheating... she would totally make a deep fake of someone to show their partner and say they are cheating etc... it's not just for sexual purposes...
I was so naive when deep fakes first dropped. I was just thinking, "oh man, now I can make myself look like a superhero or a movie star or something". Sucks that this is the reality of the situation.
Oh, very innocent. Teens (and the cia too tbh) will use it to make fake sex tapes to blackmail others, criminals will use it to frame others, courtrooms are already using deepfake experts.
@cats one of the industries that most rapidly attempts to adopt content related technology is the pornography industry, so its not really that hard to predict if you've given it some thought
i thought the same thing. but that’s sadly the very surface and optimistic way of using deepfake. we all know it’s going to be used for much more devious and evil intentions
it's scary how much AI has progressed. if people can do this, I don't want to imagine what we can do in 20 years. you could frame someone for terrible things without taking a step out from your home.
Just a couple of years ago I remember trying some program that could say a few sentences in the voice of Homer Simpson, Squidward etc and it was still way off, now in 5 minutes I can make Oderus from GWAR recite bible passages and the realism is only determined by what audio clips I use as reference and by playing with the speech settings. I hate to see where this will be in just another 6 months.
IMO it'll reach the point where all videos and recordings will stop being considered as legal proof for anything because of how easy it is to fake them. I doubt you could end up sending someone to jail with a deepfake, but it'll still be problematic in terms of reputation and public opinion as people are easily swayed in social media.
This stuff pisses me off so much. The responses to it like “they posted pics of their face online they knew this could happen” or “so now it’s illegal to find someone attractive or fantasize about them” or genuinely one of the worst “all women should be ok with this because only fans exists”. It’s genuinely infuriating to see response like this
I've seen the ads for these kinds of sites but never gave it much thought. It wasn't until seeing all these videos about it that I really understand what really happens and how it affects people. It sucks that A LOT of people got hurt because of the publicity but I think instead of keeping quiet, talking about how bad it is is opening up a lot of peoples understanding of how bad it is.
I don't think you know how consent works in conjunction with being an online celebrity. Porn stars give their consent to have their bodies shown online in any form as they have sold their body. Streamers consent to having their face be used outside their stream indirectly through free media practices.
this has already happened with children and the government has done NOTHING. if any good can come out of this situation, i think it’s that people are gaining awareness for just how scary the ease of these actions are and can actually lead to some change to prevent them
Problem is.. how do you outlaw it? This tech is open source so its too late to ban. It’s already illegal to use the tech on children, in theory, but it’s kind of impossible to prevent.
It's only a matter of time until some teenager creates a revenge porn deepfake of someone they don't like at school. In that situation, a person's life will probably drastically change forever, and it's hard to say if the truth would ever come out. It would also create a whole new weird legal problem. Would a teenager deepfaking their classmate into porn be classified as a sex crime against a minor? I lean towards yes, but I also have a feeling that it will take almost a decade for widespread legal precedent to be established.
Dang I never thought of it like that, like I thought most comments were blowing this out of proportion. But your comment really opened my eyes honestly thank you
Something like that actually happened to me. I managed to stop the spread of the fake content at least before the people currently in my life could see them.
Deepfake tech is insane the other day I saw an ad for a deepfaking site and I would of had no clue I was looking at a deepfake if it wasn't for the watermark
Meh, e-celeb fanfiction has existed for years. It's exactly the same thing - fantasizing about having a sexual parasocial relationship with your favorite celebrity. People who are into that are definitely creepy weirdos, but complaining that it's "unethical", especially when some of these e-celebs are encouraging parasocial relationships in the first place, is pretty hypocritical. There's of course the whole other angle of passing it off as real, but there are fake news about e-celebs all the time. This is something you cannot police. Best you can do is take responsibility, not encourage parasocial relationship with your fans (especially sexual ones like OnlyFans), and make sure you're not associated with it. Nobody is looking up DeepFakes of Michael Stevens from Vsauce.
IT will ruin someone getting caught but definitely will not ruin the one being deepfaked, unless they chose to be ruined. (because people would just comfort and give sympathy to the indicated victims) this is digital harassment in the making.
It’s easy af to prove a video is deepfaked, no matter how realistic it looks. There is software that can determine deepfakes based on a number of factors and it’s 100% accurate
I’m not even popular on the internet (at all), and someone did this shit to me just by gathering photos by following my instagram. They tried sending the fake photos or videos (I never opened them obviously) to all kinds of people I knew, including my own mother, just to blackmail me into sending them money. Luckily, I managed to spread awareness to everyone to simply delete the chat if this person messaged them. From what I know, no one saw they sent. At least no one currently in my life, thank god. This shit is a serious problem.
So a friend of mine talked with a guy named Tommyc about this, and although my friend was calm and asking basic questions, he got flamed by Tommy who basically double talked and said it was a-okay to do and a bunch of other people in that space are just dogpiling, bullying, and harassing him for being on the correct side of this, "debate".
charlie hit the nail right in the ass. The biggest issue is not just the fact that its a hug violation, but it also has horrible implications to be used as blackmail and harassment. Not to mention the potential for deep faked images of children/underage streamers. It is absolutely sickening.
@oh no cringe detector In case you are being manually this pathetic or you read responses to your pathetic bot, stop. You're not going to achieve anything by doing this.
You can use software to prove that a video is deepfake with 100% accuracy, you'd have to be a idiot to get blackmailed with the video equivalent of photoshop
That's always been a thing though, this is just an evolution of photoshop and previous visualisation methods. Before the camera people were saying the same thing about using sketch artists for Police work, "what if they could draw it wrong and convict the wrong person" Make it illegal to do things that will cause international incidents like deepfaking the President or CEO of companies, the same as it is to fraud or slander. But to make it illegal to whack off to someone without their consent....? Naive and entirely unenforceable and not at all MORAL anyway, nobody can tell you what is right or wrong to think about, a hundred years ago it was "MORALLY WRONG" according to almost everyone for people to be homosexual.
i’m not sure, the way technology is progressing it is getting harder to control and catch up to. i guess one way is to have these adult sites be monitored better. maybe every video should have written consent with footage before being able to be uploaded and confirmed.
Nope lol, deepfakes will keep on being created which is the sad reality. Mostly to appeal for the creeps that wish they saw someone in specific without clothes
dont share info on the internet lol its your fault when people take advantage of the info YOU uploaded. Your face is PUBLIC when you put it in PUBLIC space. Id hate it if it happened to me so i didn't put my info or face on the fucking internet.
I said that this would be an issue a long time ago when the Jim Carrey/Robert De Niro deep fake videos started making the rounds. I remember thinking "it's only a matter of time before they incriminate someone innocent with this". This is one time I hate being right
I also think that not only just not having consented to being deep-faked (which is still extremely horrible), someone that these women thought was their friend paid for that content and imagined about having s3x with them. Personally, that would make me extremely uncomfortable.
The deep fake thing is definitely weird and creepy but the idea Atrioc/basically any straight male hasn’t fantasized at least a little about basically every vaguely attractive woman in their life does seem to show a lack of understand of how male sexuality actually works. They just keep it to themselves. It’s the actions based on the thoughts that are the issue not really the thoughts themselves.
@@soccrplayr232 thinking about it is one thing, humans are sexual creatures, but acting on it is so weird. this is a different kind of creepy than just fantasizing about someone you think is attractive. especially bc it was people he knew personally??? nah that’s demented. this is a really good way to gauge someone’s morality and i’m genuinely surprised so many people are stupid enough to think it’s okay. i’m like genuinely shocked this even happened 💀
Wait a minute... You think your male friends don't fantasize about doing unspeakable things to you? That's a staple fantasy right next to planning hiw to fight different animals.
@@juno3281 I mean honestly I wouldn't do it and its a little messed up but not sure it was all that big of a deal. The dude selling the stuff is the actual issue not so much Atrioc looking at it and the reaction against him feels a bit exaggerated since he's the only real face to put to it and people are angry it could happen. Also not sure it was so clear he was there looking up people he knew even if they were on the site, I could easily buy he was going to do a segment about AI/deep fakes soon and went down a weird rabbit hole and got caught with it on his computer because he never closes tabs. Still weird just not sure he needs to quit streaming over it.
