I discovered I was deepfaked from this whole situation, and honestly even though I'm hurt I also feel for the sex workers who had their work stolen too. Both me and those SW who they put my face onto were sexually exploited and sold without our consent by someone we don't even know. Thanks for covering the situation, hopefully more people with be careful to make sure all of the sexual material they use was consensual.
@@yabo5131 excuse me? so you’re saying that women should be made into deep fake porn without their consent and they’re not allowed to complain about it because they are “actual” sa vicitms? yeah dude both these people can exist. if your idea of “consent” only relates to physical sexual assault that’s your problem
Deep fakes in general are a very scary concept because they have gotten so realistic. Even getting away from the sexual stuff, deep fakes can still ruin someone’s mental and reputation with how real they have gotten. What is extra scary is how good some private tts companies have gotten at copying peoples voices
It shouldn't be illegal to publish it as long as it is very clearly marked as deepfaked and not real. If everyone knows its just an edited image then it's no different than creepy fanart, it's when everyone's convinced it's real that it's a problem.
@@Raptorworld22 No, it's currently classified as revenge porn in the areas it's currently banned, and I think this is a fair classification. There's a few reasons this is the case: 1.) Well-made deepfakes are indistinguishable from real photographs, and this is being further solidified by Dreambooth technology. It's worth noting that CP "art" gets charged as actual possession if it's modeled after real children or is too realistic. 2.) "If everyone knows it's just an edited image" requires every single point on the distribution pipeline to clearly mark the image/video as deepfake. This origin can wind up obscured or lost, either accidentally or intentionally, resulting in people believing it's real. 3.) The intent of deepfake porn is to obtain sexual content of someone who hasn't produced that content. You are bypassing their willingness to take naked photos or record videos of them having sex 4.) This is a thing men don't really understand, but most women are straight up HORRIFIED by the prospect of being seen nude by people they aren't intimate with. I for one had an incident where an ex landlord put a camera in my bathroom, and 6 years later I still have severe anxiety and trust issues from it. 5.) A common victim-blaming tactic men have towards women who have their nudes leaked is "You shouldn't have taken them." With deepfake porn, a person's choice to have nude photos exist of them is completely removed. 6.) Women have to deal with constant sexism and sexual harassment in their lives. Our ability to choose who can see us at our most intimate is one of the ONLY things we can control in that regard, and it's being taken from us.
@@cargyllion 1) Didn't know that, but if this stuff really is so accurate to real life now, then I am changing my stance and agree it should be illegal. 2) I never said my idea was practical, but in a perfect world that is what would be done. 3) This point doesn't make sense to me, as it's no different than creepy fan art in that case. Do you also think we should make drawing people without consent in explicit context illegal? Actually curious what your stance is there. 4) I don't know what men you're talking to, but every man I know would be equally horrified in this context, where everyone knows/thinks it's their body and it's without their consent. 5) Isn't applicable since my original point was if *everyone knows it's fake* 6) Having been a woman for more than half of my life, I know you are talking complete BS in that first half, unless you live in Saudi Arabia. Overall, I am changing my mind and agree that this very convincing deepfake stuff should be illegal. Different opinion on fanart and terrible photoshop jobs.
@@Raptorworld22 The current situation with Dreambooth deepfaking is that anyone with an Nvidia gpu made in the past 6 years and 20 or so images of a target individual can generate a model capable of replicating that person's appearance. It can generate you nude, in an SS uniform, wearing a Jace Beleren cosplay, whatever you want as long as you fed it reference images. And it's scary accurate. Literally the only saving grace right now is the current training models can't parse complicated tattoos and facial piercings. However, there's a large community of people working to fix these issues for the expressed purpose of generating AI porn.
Aside from the tremendously creepy aspect, it's good that you brought up how deepfake porn could potentially be damaging to the careers of the people being deepfaked. Think about it; the wrong people see something like that, like advertisers or investors, they might get fooled by it and decide to cut business ties with the people getting deepfaked. In short, just imagine your favorite content creators getting blacklisted due to sexual content that they never even produced; that's horrible.
This is a good concern, but I'm actually annoyed that companies even care so much about people having sexual content. As long as it's somewhere children won't accidentally stumble across it, there really shouldn't be a problem.
@@impishlyit9780 100% agree with ya. Just because someone's made or performed in pornographic content/media doesn't mean they should be blacklisted. It's a paycheck. Nothing more, nothing less. So long as all the people viewing the adult content are of-age themselves, everything's fine. Man, I got sidetracked on this one xD, but it's an important topic too.
Even if they aren't tricked by it personally a brand could probably be convinced to drop someone just because it exists at all especially if it gets popular enough. Real or not a brand that's promoting say kids content or trying to have a "family friendly" image may not want to be associated with that. I don't understand how it's legal anywhere given these companies should have no right to monetize your likeness anyway. Really gross situation and technology keeps advancing faster than we can plan for the ramifications of it.
@@josephschultz3301 agreed. Here where i live, a female teacher broke up with her husband and he, as revenge, shared online some porn videos they made together (that were private, they never posted them anywhere before, it was private videos for themselves and pics he took of her naked). Turns out she got fired from working as a teacher and blacklisted from every teaching career in our country, while he only got like 5 months of picking up trash as community service for doing something illegal. AFter those 5 months he can get back with his life (of course HE isnt getting fired nor blacklisted from any working job even if he was in those videos too, only women gotta be slandered for sexual things) meanwhile her life is ruined. Some idiots still insist on defending him and blaming her. Our country had a lot of protests about this.
I was very innocent in high school. I never taken a nude or even made out with anyone. Never sexted. Yet, there were multiple people that were convinced I sent someone a nude. Turns out, it was some other girl that looked similar to me. The guy lied about who sent it. I have no idea why. It is an awful feeling to be judged for sending out sexual content when you never have. It is such a violation. I couldn't imagine being in the situation as the streamers. What they are going through is in a much larger scale. Truly horrific.
someone made a deepfake of my cousin committing sexual acts on a minor and it almost completely ruined his life, it was sent from his facebook to all of his friends it was awful
the biggest shock for me with this whole situation is that this wasn’t already illegal. there’s already laws and defamation lawsuits surrounding using someone’s likeness in anything without their consent, but for this kind of material is sickening.
Exactly! And then you have guys like d*stiny frying their brains out to try to understand why deepfakes are bad 🤦🏼♀️ when is just another form of defamation!
@@lacuna3693 it should be, lol. There have been cases in which celebrities sue companies because they use their image without their consent and/or against their will 🤷🏼♀️ but idk, the internet has normalized trasspassing personal boundaries to an extent where people are just mere objects...
@@lacuna3693 current law, sort of? Best example is with the old man “hide the pain Harold” or whatever that meme’s name is. His image, especially for those photos, are under copyright like any other stock image. So we do know that memes can be under copyright and can’t be used for profit or undermine other’s work. There’s also celebrities suing games, animated shows, etc. for using their likeness without their knowledge. However those are higher profiles figures, and common streamers would have a harder time fighting that in court. There’s also AI involved in deepfakes, which we still have no laws governing, and other issues of giving streamers protection from these websites. Honestly, one of the better things to combat it might be a libel/defamation lawsuit, since this basically is faking a porn tape for someone. And that’s outright stated under defamation as an injury of character and easily would at least have a trial for it.
It’s because the laws have to consistently adapt to technology so they will always be behind. We unfortunately won’t be able to experience a society we’re the laws will be ahead.
Even if he found the website randomly which is very unlikely, the fact that he didn't notify his fellow coworkers and kept it to himself is pretty stupid of an excuse.
@knockout Well in order for him to know it was a deepfake site, it would have to be advertised as such, and presumably it would also advertise being able to fake his coworkers. Also I'm pretty sure the hub doesn't allow deepfake content so it makes no sense they would allow those kinds of ads.
To his credit, that’s a pretty awkward convo to have. “Yo bro, just letting u know I found this online service where it deepfaked you onto porn.” “How did you find it” “yeah, I was down bad and clicked on some ads, paid for some website, and beat my meat to it. Sorry for not telling you sooner.” “Bro wtf” that’s only one possibility of course, but ya see where I’m going with this? After the action is done, kinda hard to bring it up casually.
it’s sad that it has to be pointed out that this type of technology can be also used to frame people for sexual assault or other heinous crimes for people to actually see an issue with AI being used in such a way.
Fun fact this won't happen since the ai that creates the deep fake is also able to detect deep fake as it trains two ai one for creating fake ai and one for detecting fake ai to improve it. So no it's not going to be possible that it would be used for blackmail
i think the crazy shit no one else or charlie touched on, is the idea that they can use deepfakes of minors and young celebrities or actors. theres probably already some floating around on telegram i bet. dont doubt it one bit. smh
The ethics of AI technology and deep faking are very concerning, and not just this particular situation. Not being able to distinguish reality versus fake reality is a slippery and dangerous slope.
It's not just not understanding consent- it's wanting to actively go against it. You'll have commenters screaming abuse at a woman that promotes her OF, but have a site like this that promises a leaked video, or accidental nip slip etc, and people will flock to it for the express purpose of seeing her in a situation she didn't want to be in.
You prob don't know the difference between public and private property. Who are you that we other humans require your blessing for us to do as we freely please with our property?
@@justasmltwngir1732 get the fuck outa here. You're gonna tell me you never flicked the bean to anyone besides the pornstar you're watching? Oh what you don't watch porn? Naw let's not even stop there you don't even tug em out right? Do you hear yourself. Everyone that masterbates has their "inspiration" cause you sure as hell ain't jerking it to literally nothing, regardless of whether or not you watch porn. And my reply to op, I would know it's not someone I loved, so no it wouldn't bother me one bit. That said in my opinion deepfakes should be labeled as a deepfake and not tried to be passed off as real.
@Edward Deepfake porn has gotten so advanced that it's quite hard to distinguish real from fake. Without proper evidence to disprove the deepfake, it can easily be used to slander. Although I do agree that deep fake porn of celebrities and social media personalities will always exist, that's just the price of fame. But what is disgusting is that it was of his friends and even his friends girlfriend.
@Edward everybody has fantasized if even a little about somebody attractive in their life but not everyone seeks deepfake porn of them. That shit is definitely weird man
I mean… the idea of even having those kinda of tabs open while streaming is mind blowing, it’s like going to a public bathroom without locking the door.
It's like going into a public bathroom stall to pull down your pants , insert a banana, then bend over and leave the door open expecting no one is gonna see that goofy shit.
When I do stream (rarely), I make sure every bit of software that isnt related to streaming is closed, not minimized. I'm not ashamed or into anything illegal, just like, even accidentally flashing OBS bothers me. then after stream I do a full restart to make sure obs itself is off. Too safe? maybe, but better than this guy
What scares me the most is the potential for cyber bullying and the fact that I can predict with great certainty, that this will be used by school students to bully other kids
Only for this generation, the next generation of kids will grow up not trusting video / audio. Out of all the dangers AI will bring, this is one of the things you should be least worried about.
This been around for decades bruh.. back in the 00's it was photoshopped celebs. They've always found ways around it & unless actual federal laws are made, this ridiculous stuff won't stop
Remember back in high school when rumors would spread about people? This is the ungodly, coked-out, and roided-up evolution of that concept. This is fucking terrifying beyond comprehension.
It's scary because anyone could suffer from this, imagine you have a crazy ex who wants to ruin your life and deepfakes you in that type of scenario and sends It to everyone who knows you
@@llamarelish4701 cool it with the misandry, being a man or not has nothing to do with it, im a man and i dont agree with him lets not generalize a gender
This comment section is making me both enraged and dissapointed by the second. There’s plenty of sane people here, sure, but why can’t everyone understand that other people don’t want to be depicted in sexual situations? These kinds of disgusting slime are better off dead, along with pedophiles and other kinds of non-human filth that think consent is just a suggestion.
@@jerome1lm It's no longer a "fantasy" if you choose to make that fantasy into a material entity (deepfaked video) which can be seen by anyone, not just the fantasizer. Seek help.
The depressing truth to all of this AI deepfaking is that there’s creeps on the internet that can easily make porn of popular minor celebrities and that alone sends chills down my spine
you know as a woman i’m so glad to see such a prominent male figure in the community speaking out against this. i’ve seen a lot of women being disregarded and belittled for saying the exact same thing and as shitty as it is, it’s nice to have someone to back us up.
Agreed, charlie and this community are what often restore my faith in humanity to be honest. Sometimes I'm really scared if no one in this world actually have decent clarity and conscience for everything that I've seen in my life. And it is MEANS A LOT for me to know there are peoples like charlie and his followers out there with sane minds and willness to speak up for those who need it. Charlie if you see this, you are impactful and honorable. Thank you 🙏
I was once recorded without my consent in a sexual manner and was blackmailed. Even though it was my body I completely empathize with all of these streamers. Because I was never physically hurt, but just the act of seeing me (and in their case, their likeness) being shown without my consent was the most damaging shit ever.
But you actually did the act, which means you still did something, it’s a very different situation from someone who had nothing to do with it. Just walking down the street and suddenly there’s porn of you. Versus you actually slept around and someone released real porn of you.
yall never had a hot friend that u wanted to sleep with but couldnt? idk why everyone is freaking out over this. everyone has their own private fantasies or curiosities. ive looked at some really really crazy stuff online just because. its not like atrioc was personally creeping over them, it was a solo curiosity that he accidentally showed.
Was just talking about this with my boyfriend. I can’t imagine finding P of myself online without consent, or how it would make me feel. Everyone calling these women sensitive for being in this situation is heartless.
They say that they wouldn’t mind having the same thing happen to them but guaranteed they would be upset if they saw just how realistic and convincing it would be
@@swirlffle8323 It’s because they think if someone deepfaked them, they’d get exactly the bod and sex they wanted. These incels don’t seem to understand that anyone could make them into their worst nightmare and they’d have no way to prove it’s fake. It’ll only be an issue once it happens to them.
Really appreciate your language use here because it feels intentional and important; referring to the women he looked at as "colleagues" and "coworkers". I think something that seems a bit lost in this discussion due to it being on Twitch is that this is a man who fully looked at porn of the people he works with. In any other "real world" scenario, if your coworker got caught with porn of you and your colleagues (regardless of the gender) on his work computer there would be an immediate understanding about how absolutely disgusting and straight up creepy that is, and how rightfully so in that situation, that colleague would most likely lose their job because of sexual harassment. I hope the women who are victims of this really have more support not just from their user base, but from Twitch directly, because this is just unacceptable behavior that's eerily being described as "normative".
@@lioreubm677 Yes and no. (Basically) all men have a sex drive wired like this, not all men act on it. Many men are good people and dont indulge in their darker side like this
@@eligedzelman5127 “darker side”? The way you’re describing men makes it sound like all men have dark, horrible, twisted urges, but the ones who don’t act on those are good. That’s not how people work, and it’s not okay to generalize men in that way. Some people do have bad thoughts and bad urges, while some don’t. And yes, it is scientifically proven that males have more libido than females, but that doesn’t make them inherently creepy. It’s okay to have sexual urges; most people do.
@@Elfenlied8675309 that’s a logic fallacy just because something has been the case for a long time doesn’t mean that there’s evidence stating it should continue to be
@@Celeborn93 Absolutely good comparison. We have to think of black and white in these situations. Is this good or bad. It is bad. There cannot be middle ground especially when those whose likeness is being reproduced explicitly and implicitly stated they do not want to be used in that way.
@@Cruz474 Photoshops are still vile and those should be banned too. Stop thinking from the perspective of someone tugging their meat, and start thinking from the perspective of the victims
@@hithisthers7214 I'm thinking from an omniscient perspective. I was just looking to see for your consistency. I see it, so I have no quarrel with you. Respect.
even if the person faked does make there own sexual content, there own business gets undermined by bootleggers basically, and even if someone consents to be photographed nude in there own content, that doesnt mean they consent to being deepfaked. thanks for talking about this charlie, ur a stand up guy
@frogmen it literally is illegal to sell fake jordans. That's counterfeit product Edit: also glad to know that women are yet another product. Maybe try to see women as human being and not sexual products to produce "cheap knockoffs" of
@@quixoticvalkyrie Lol no selling fake jordans is only illegal if you try to sell them as though they are real, knowing that theyre fake. If these deep fakes are being advertised as fake, then thats it. And drop the woman are objects nonsense, same applies to mens deepfakes. As charlie has stated this has also happened to him.
I remember less than 10 years ago, local stories about how a teacher lost her entire teaching career because when she was younger (and she was still young when they came out), she did adult content that some of her students eventually somehow stumbled upon online. That was from someone doing adult content for real. Now imagine if highschool or college students have the power to just deepfake a few convincing pictures of their teachers in adult content. They could ruin their career and reputation because even if it's proven fake, school establishment don't like to be anywhere near that kind of stuff and the content will probably remain available somewhere.
@@experimentalghoul3540 I’m not sure what you mean. Like anything else it exists because there’s a market for it people will pay for a service that lets them see their favorite celeb in adult scenes.
This is technology that humanity simply isn't mature enough for. Imagine videos of crimes and the like being doctored with deepfakes in order to falsely imprison people. That's one of the first things that came to my mind when I was first introduced to it.
It just makes me sick how so many miserable people spend so much time of their day making fake videos and cheap deepfake animations on people. They deliberately do it to harm and Destroy peoples reputations.
And I don't get why they are so desperate to see somebody uncovered in the first place, acting like middle schoolers who have never seen a woman's body before
it was 100% clear from the second the technology started to exist. look at games from 1998 and today. it was inevitable that this technology is advanced as this.
When I was younger, I wanted to become a programmer and create stuff that's exactly like deepfake. Now that people have done it before I even had a chance, and I've seen what people have and maybe will use it for, I wish that it never had existed. Man, I sure love technology.
HealthyGamer_GG did a deep dive on this today that goes into some science about how nonconsensual porn affects not just the victims, but the consumers, and one of the chilling parts of it was that the deepfake stuff is behind paywalls because it's more addicting, because they're attached to an existing powerful parasocial relationship. It was a powerful take and I hope everyone sees it.
Isn’t all porn non consensual? The people participating in the act consented but there’s no way that they consent with everyone who’s watching, and as a passive observer i doubt that anyone is mentally checking off if it’s consensual or not anyway. As far as the individual is concerned they are partaking without participating and that is often a part of the harm done by porn.
@@sparks6177 people who make porn willingly and post it publicly are also consenting to having pretty much anyone view it. It’s comparable to TH-camrs and actors where they sign on to have anyone who can watch their content, it’s part of the deal. Steamers do not consent to having porn made of them because, well, it’s pretty obvious why. They are not at ALL the same.
This is very well said. Thank you for covering this so well. People need to understand this but I know that some people won't understand it and it sucks. I think people really don't see streamers as people and it's scary. Someone could make something fake about you that's hard to disprove, and it could ruin your whole life. I feel like there's going to be court cases about this in the future. People shame people for having OnlyFans but then seek out this? I think they don't want to admit that they want things like this. And much less admit that they have a problem. Time will tell.
Sorta off topic but Charlie seems like one of those friends who would tell you your screwing up before it’s too late. It’s honestly refreshing to see someone be so blunt and honest about something when it’s about a friend. I’m sure it’s a very difficult situation but I think that it’s pretty inspiring to see that how he’s willing to stand by his morals and say it’s wrong despite having reservations, not wanting to add negativity to the situation and caring about the other person.
I mean when every girl i see often does sexual stuff, it got me really desensitized... i know it feels bad but when it's like pokimane and all, i cant even flinch
I was wondering when Charlie would cover this topic, and I’m very glad that he did so in the way he did. He was respectful and did his best to make everyone aware of what was going on without making a huge deal out of it in a way that would draw even more attention to it.
It's weird to me that there are some folks out that you have to explain how morally unacceptable it is to exploit people on the internet with deep fake porn. Is their moral compass broken? This is about respect towards other people and consent.
@@aurea. I feel sometimes like the whole internet is full of soulless sociopaths, but then I remember a lot of people on the internet are teens thinking it’s cool to “not care,” if you know what I mean.
It's what happens when viewing tons of porn is considered normal especially for guys so there's nothing stopping them other than themselves in how far deep they go
"consent" Do you complain about comics making fun of specific people? They certainly don't get "consent" to rail on about people. This is so delusional, because it assumes that these celebrities are actually being affected (exploited!!) by the deepfake industry. I like how everyone has just ignored that this has literally flown under the radar until this weird incident by a streamer. So much proof of it having a real tangible affect on celebrities in general that it took a random giant streamer to have clicked on an ad to suddenly bring this to internet wide attention. There is real criticisms to be had like the companies labeling the porn as REAL!!! and it being charged for, IE, making money off of someones likeness/copyright without their consent, but the idea that porn deepfakes are inherently themselves *evil* is actual karen behavior. These do not have actual effects on anyone, except in the small exclusive cases of direct blackmail, and even THAT situation is bullshit because there's also tech that detects deepfakes that is constantly evolving alongside AI tech, so any faked blackmail is usually very quickly detected as fake and thrown out. Charlies example of "muh companies pull the trigger like winnie hut junior" is not a problem of deepfakes, but companies being pussies, and one that should be ironed out. I'm sure a few cases of potential "leaks" turning out to be fake resulting in triggerhappy companies looking like dumbasses will curb this behavior.
I am really worried about this, especially in terms of crimes and trials. It has become so easy to frame someone of doing something gross which can be used during a divorce or just something illegal. Even if some IT specialists can prove that a "photo" or a "video" is a deep fake, it still can be so devastating for a person even if he didn't lose a trial. Drama usually stays for eternity in one's reputation. What I'm trying to say is AI faking action of real people can run out of control extremely easy.
So the reason why thst won't be a huge problem ris because it need thousand of hours of video and sound to make it even kinda believable so no normal person would be able to be deep fake only people in front of cameras often and if you in front of a camera often you have easier time to prove your innocent
@@bobberry1463 even if that’s true, anyone who has hours of content of them - with, or WITHOUT their knowledge - even just a few solid minutes of footage / other stuff and you can still do this. there’s been deepfake porn of people who are pretty chaste online (like billie eilish). and i’m sure people who are looking for that kind of thing won’t care if it’s poor quality or not as long as it’s close enough for sure it would be harder for people with less footage of them up / less public jobs, but even still, it’s better to protect everyone - silly example but genuinely: but does flo from progressive not deserve the same amount of privacy as any of us? just something to think about. 100% always better to make something more safe than less safe.
im glad that someone with a large platform is talking about this issue. ive seen this exact thing happen to many female streamers, but because they were smaller, nobody said anything
i had a similar experience. i was only 16 and one of my friends (20 at the time) spread around fake screenshots of me saying sexual things to him. it was all for a “joke” but people genuinely thought it was real, and he played into it. it’s such a disgusting feeling to avoid touching anything remotely sexual as a woman, only for men to decide you don’t get to choose whether or not you’re considered sexual. they turn you into an object for their own pleasure so easily and it’s terrifying. it makes you feel like you don’t have a right to your own body anymore.
Thank you for your great breakdown of the situation, Charlie. It’s the weirdest energy for people to have such a strong stance against Only Fans creators to also have the take of “it’s not your real body so why do you care?” Seems like some consumers will only enjoy sex work so long as the sex worker can’t consent and/or profit. 🙃 Yikes.
thats exactly what it is. misogyny has been so deeply ingrained into these degenerates. they fully believe they should have access to sexual content on demand (but no, not like that!!1!)
@@professionalfurret7225 OF is better than illegal sites that get their source illegally like trafficking women (yes it happens), blackmailing them into doing it, or set up a small camera to record it without their consent. what is so bad about people using their body to make money if they consent about it? If you want to go against pron, then you also have to go against sx overall. Pick one side and dont cherry pick, all it did is harming people. The fact that you lump deepfake and OF together speak volume of what kind of person you are. One is illegally made against the person consent, one is made by the person with their consent and the will to do it. if you try to ban sx overall it just wont work. my country did that and 10 years ago it was super common to throw LIVING freshly born babies to a trashcan because mrdering is better than people knowing they have outside marriage sx.
Because they literally only care that theyre not the ones making money off it lol. They obviously do not care having men whack off to them or having sexual content of themselves on the internet. But somehow have a problem with fake images of it? give me a break lol
Deepfakes have always irked me since I first heard of them a few years back, and knowing the technology for it is only getting better, that bad feeling isn’t going away. There’s so many ways it can be used in the wrong hands- blackmail, revenge porn, straight cruelty by sending it to friends/family, getting people fired, using CHILDREN, etc. It deeply, deeply unsettles me. The response to this whole streamer situation greatly concerns me, as well. These women are being openly objectified, having their privacy invaded in one of the worst ways possible, and some folks out here are so quick to brush it under the rug. It’s a shame.
You’re 100% right here!tbh technology is scary af nowadays between the ai art the deepfakes and the ai that emulate people’s voices it’s definitely risky af and could lead to a lot of horrible shit happening and it sucks seeing people being taken advantage of and having this horrible shit happening to em men women and children alike can be victim to ai deepfakes of all kinds including adult content. The thought alone makes me feel sick! I can’t imagine what the victims in this must be feeling and going thru tbh
Dude. My biggest concern is how this could be used to frame innocent people for crimes. The state or a malicious person could take someone down by just making up video evidence of them committing crimes they never did. If this happens a lot, we could end up in a world where video evidence can no longer be used in court (unless we find a way to better identify AI deep fakes).
Security camera software could add features to grant access to footage (where it is viewed on its official website/app), that way it can't be fabricated
I could be wrong but wouldn't you still be able to use metadata? Phone/camera manufacturers could use some sort of verification system to confirm whether a video was real. Obviously a lot of videos/images would no longer be valid but I don't think its entirely a lost cause.
Lawmakers really need to completely ban this. Imagine if they deepfake a persons face who is under age and then put it on the body of someone of age, and say it’s “ok” because the persons body is of age. Very horrific slippery slope here. Disgusting!
I remember this one adult actress who had been affected by DeepFakes being applied on their content speaking out about this, it was something along the lines of “You’re taking something that I have produced for people to enjoy and you’re twisting it into a situation where the other party has literally no consent in the matter.” Adult DeepFake content is just such a strange thing to me, on the one hand I can to an extent admire the technology, but we really should be drawing the line at DeepFake memes for comedic value, cause when you cross into the territory of things being practically undetectable to the naked eye, it can genuinely ruin people’s lives.
Honestly it's hard to say where to draw the line. Comedic value is subjective and there can be stances within memes that people don't want associated with their faces. Even the film industry has morality issues about deepfaking. Good quote btw.
@@MammalianCreature I think it was in one of Shane Dawson’s old conspiracy videos on Deepfakes, long before all The weird shit about him came out. i believe it was his video “Conspiracy Theories with Shane Dawson” from 2019. I’d say the DeepFake section of that video was probably the last interesting thing he made tbh.
@@craigyeah1052 I say in memes for instance like what Corridor Digital does, they had that Keanu Reeves stops a robbery deepfake that was quite impressive, or like when people do stuff like deepfake nicholas cage into random scenes. I agree though, it’s kind of hard to tell where EXACTLY to draw the line with this kind of stuff.
My biggest concern is when people begin deep faking individuals doing illegal things. Someone doesn't like someone and so they deep fake them doing something horrible to a child and it's hard to disprove in court. On the flip side of that, once it becomes well known enough, deep faking becomes a serious issue mudding photographic evidence, suddenly it's hard to prove someone who is guilty based on photographic evidence because they can claim it was deep faked.
"deep faking becomes a serious issue mudding photographic evidence" Yeah, but that's not necessarily a bad thing. There's a lot of innocent people in prison, so having more prosecutions fall apart because of the dubiousness of video evidence could be a positive thing.
Already happening. We have seen "algorihmicaly enhanced" footage admitted in court trials. Even if it's not purposeful deepfakes, it's still extrapolated data, something that never actualy existed
To me, the biggest thing that disgusts me that nobody is talking about is how he brought this deep family struggle and streamed it for everyone. These streamers are sick in the head for bringing so much personal shit on stream. Deepfakes are stupid and weird, but bringing your wife on stream to cry in a very awkward way is weird as well.
that's what i also dont get. before looking it up i thought she caught him doing it, and forced him to come out, but nah, it was his chat, so why is she there? and also why is this so public. if he need to excuse, do it to the offended party. not an open video that is only going to make it worse for everyone involved.
@@marcosdheleno He said he didnt sleep at all the entire night it happened. So not only was he on lack of any sleep, this is his entire career that he has been building up for years and he probably saw it flashing before his eyes that everything could be gone so he felt he had to do something. Hindsight is 20/20, not everyone can make perfect decisions all the time. Its easy to see why what he did was wrong after it happened.
Dude wanted a fast fap and found no good material so he created some himself. Is that really that bad? I hope he releases the full material, I am getting bored
I feel like it was done on purpose so more people would try to do this and get into it. People that had no idea deep fakes existed. Now that it is public knowledge, watch everything disturbing that happens (political figure gaffes etc) now can just be excused as deepfakes
i'm glad charlie understands how disturbing it actually is, because i've seen some youtubers say that the only problem in this situation is that the guy watching deepfake porn didn't do enough privacy measures and that watching this stuff is okay if you're not talking about it publicly.
I think the nuance that it only matters now that it is more realistic, where as it was more humorous (at least the ones he had of him) before is a bit wrong though. It is absolutely worse for the person being faked, as it's harder to deny and refute that it's them, and would make them feel far more invaded. But, for the creator, and the consumer it is exactly the same. The intent is the same whether it looks a bit off or not. They are still trying to create an adult video that the person did not consent for.
i mean...think about it...if nobody knew, what would the ethical issue be? Like, for example, would it be unethical for someone to draw a picture of a celebrity naked, and then jerk off to it? I feel like people just love shaming others when it comes to anything sexual cause they're desperate for people to think that they're not the weird one, when in fact, we're all weird.
It’s gross, especially cause it’s not even limited to celebrities, influencers, streamers, etc. Even average every day people are getting deepfaked and it’s especially sad because with celebrities, we can assume it’s not real, but these every day people having their name and faces connected to these videos- recruiters and hiring managers aren’t going to go that extra step to see if it’s legitimate. It usually isn’t until people get sent links to the porn videos that they learn what’s being done.
I mean, I agree deepfakes are pretty messed up. But don't people draw stuff like that too? How come people haven't been talking about that? Sure it isn't the real person, but their likeness is still being used and they're still being objectified
The situation is so bad that even Dr. K made a TH-cam video about the whole deepfake situation regarding the implications of it and the damage caused by them. It's so bad for everyone involved and those who consume it.
I always thought AI would take over by human looking robots, not deepfake porn. It's seriously sad that this shit happens. It's happening on Instagram too. I think this could also shed some light on porn addiction and the dangers of it. What I'm really worried about is creeps using this with minors.
Glad you mentioned the dangers of porn addiction; I'm an addict myself (hentai) and I'm trying to find some productive ways to distract myself from feeding it.
@@soaringsquid0.129 good luck. I know other porn addicts that had success with crocheting, chainmail (metal not emails), and miniature roses as house plants. Just need to keep your mind and hands productive.
@@soaringsquid0.129 Well, you better not take any looks at AI porn made with stable diffusion and stuff... now you can produce hentai shit with just a click
It's only a matter of time until some teenager creates a revenge porn deepfake of someone they don't like at school. In that situation, a person's life will probably drastically change forever, and it's hard to say if the truth would ever come out. It would also create a whole new weird legal problem. Would a teenager deepfaking their classmate into porn be classified as a sex crime against a minor? I lean towards yes, but I also have a feeling that it will take almost a decade for widespread legal precedent to be established.
Dang I never thought of it like that, like I thought most comments were blowing this out of proportion. But your comment really opened my eyes honestly thank you
Something like that actually happened to me. I managed to stop the spread of the fake content at least before the people currently in my life could see them.
it can be used for really bad manipulative situations as well.. i had a really nasty friend in the past and she once photoshoped a girl's face on a porno and told her boyfriend she was cheating... she would totally make a deep fake of someone to show their partner and say they are cheating etc... it's not just for sexual purposes...
This stuff pisses me off so much. The responses to it like “they posted pics of their face online they knew this could happen” or “so now it’s illegal to find someone attractive or fantasize about them” or genuinely one of the worst “all women should be ok with this because only fans exists”. It’s genuinely infuriating to see response like this
I've seen the ads for these kinds of sites but never gave it much thought. It wasn't until seeing all these videos about it that I really understand what really happens and how it affects people. It sucks that A LOT of people got hurt because of the publicity but I think instead of keeping quiet, talking about how bad it is is opening up a lot of peoples understanding of how bad it is.
I was so naive when deep fakes first dropped. I was just thinking, "oh man, now I can make myself look like a superhero or a movie star or something". Sucks that this is the reality of the situation.
Oh, very innocent. Teens (and the cia too tbh) will use it to make fake sex tapes to blackmail others, criminals will use it to frame others, courtrooms are already using deepfake experts.
@cats one of the industries that most rapidly attempts to adopt content related technology is the pornography industry, so its not really that hard to predict if you've given it some thought
i thought the same thing. but that’s sadly the very surface and optimistic way of using deepfake. we all know it’s going to be used for much more devious and evil intentions
charlie hit the nail right in the ass. The biggest issue is not just the fact that its a hug violation, but it also has horrible implications to be used as blackmail and harassment. Not to mention the potential for deep faked images of children/underage streamers. It is absolutely sickening.
@oh no cringe detector In case you are being manually this pathetic or you read responses to your pathetic bot, stop. You're not going to achieve anything by doing this.
You can use software to prove that a video is deepfake with 100% accuracy, you'd have to be a idiot to get blackmailed with the video equivalent of photoshop
That's always been a thing though, this is just an evolution of photoshop and previous visualisation methods. Before the camera people were saying the same thing about using sketch artists for Police work, "what if they could draw it wrong and convict the wrong person" Make it illegal to do things that will cause international incidents like deepfaking the President or CEO of companies, the same as it is to fraud or slander. But to make it illegal to whack off to someone without their consent....? Naive and entirely unenforceable and not at all MORAL anyway, nobody can tell you what is right or wrong to think about, a hundred years ago it was "MORALLY WRONG" according to almost everyone for people to be homosexual.
So a friend of mine talked with a guy named Tommyc about this, and although my friend was calm and asking basic questions, he got flamed by Tommy who basically double talked and said it was a-okay to do and a bunch of other people in that space are just dogpiling, bullying, and harassing him for being on the correct side of this, "debate".
it's scary how much AI has progressed. if people can do this, I don't want to imagine what we can do in 20 years. you could frame someone for terrible things without taking a step out from your home.
Just a couple of years ago I remember trying some program that could say a few sentences in the voice of Homer Simpson, Squidward etc and it was still way off, now in 5 minutes I can make Oderus from GWAR recite bible passages and the realism is only determined by what audio clips I use as reference and by playing with the speech settings. I hate to see where this will be in just another 6 months.
IMO it'll reach the point where all videos and recordings will stop being considered as legal proof for anything because of how easy it is to fake them. I doubt you could end up sending someone to jail with a deepfake, but it'll still be problematic in terms of reputation and public opinion as people are easily swayed in social media.
I’m not even popular on the internet (at all), and someone did this shit to me just by gathering photos by following my instagram. They tried sending the fake photos or videos (I never opened them obviously) to all kinds of people I knew, including my own mother, just to blackmail me into sending them money. Luckily, I managed to spread awareness to everyone to simply delete the chat if this person messaged them. From what I know, no one saw they sent. At least no one currently in my life, thank god. This shit is a serious problem.
I said that this would be an issue a long time ago when the Jim Carrey/Robert De Niro deep fake videos started making the rounds. I remember thinking "it's only a matter of time before they incriminate someone innocent with this". This is one time I hate being right
thank you for talking about this aspect of the issue. I've seen so many absolutely horrible takes of people saying "its not their bodies" "normal people would get over it in a week theyre upset for clout" "its weird and creepy but not harmful" and its absolutely infuriating so hopefully some people will see this and understand the gravity of whats been done. Like Charlie said: imagine you posted a selfie once in your life and now someone took that and put it on a body--not some animated 3D thing, a real convincing looking body--thats not yours and is its doing something extremely pornographic. A full sex tape. Now imagine your parents have seen it. Your friends. Your significant other. Your kids if you have them. Your boss and all your coworkers. If someone looks for your name that video comes up. People might ask you to do porn or say explicit things to you now. You are treated differently. All of this, completely without your knowledge or consent, just because someone thought your selfie was hot and felt entitled to make porn of you to sell for a profit and for their own pleasure. Edit: I want to clarify that the example I used here is a hyperbole that I only used to try and help relate the situation to a more "normal" level. It takes much more than a selfie to replicate and deepfake a face so I don't want anyone to panic or be fearful, that was never my intention and I'm sorry if it came off that way. I was simply hoping to provide that perspective to help some people who might not fully grasp how seriously this can harm someone who doesn't do sexual content and did not consent to it
@@protomato6427 Difference is, porn actors signed into it. They're aware this is happening or could happen to them because they're literally the ones in the videos doing it. If you're not a porn actor, you wouldn't want to be treated like one out of nowhere. Of course, there are still some stuff that people say and do towards porn actors and sex workers in general that they shouldn't have to put up with.
this has already happened with children and the government has done NOTHING. if any good can come out of this situation, i think it’s that people are gaining awareness for just how scary the ease of these actions are and can actually lead to some change to prevent them
Problem is.. how do you outlaw it? This tech is open source so its too late to ban. It’s already illegal to use the tech on children, in theory, but it’s kind of impossible to prevent.
Yup. I'm sure laws will be made here federally soon because as of now, not many can do anything at all except get them removed. In the internet though... Things always make its way back
losing brain cells reading some of these comments. don’t understand how someone can understand the concept of deepfakes and not only think it’s okay, but go out of their way to defend it online like what is wrong w u
Meh, e-celeb fanfiction has existed for years. It's exactly the same thing - fantasizing about having a sexual parasocial relationship with your favorite celebrity. People who are into that are definitely creepy weirdos, but complaining that it's "unethical", especially when some of these e-celebs are encouraging parasocial relationships in the first place, is pretty hypocritical. There's of course the whole other angle of passing it off as real, but there are fake news about e-celebs all the time. This is something you cannot police. Best you can do is take responsibility, not encourage parasocial relationship with your fans (especially sexual ones like OnlyFans), and make sure you're not associated with it. Nobody is looking up DeepFakes of Michael Stevens from Vsauce.
IT will ruin someone getting caught but definitely will not ruin the one being deepfaked, unless they chose to be ruined. (because people would just comfort and give sympathy to the indicated victims) this is digital harassment in the making.
It’s easy af to prove a video is deepfaked, no matter how realistic it looks. There is software that can determine deepfakes based on a number of factors and it’s 100% accurate
Human brains aren't adapted to seeing ourselves doing sexual things that we don't remember doing. In this case it's because we didn't actually do it, but the point stands. It's deeply psychologically disturbing. Dr. K on HealthyGamerGG did a video on this situation as well, it's really insightful.
@@AkiRa22084 We're not adapted to that either, but it's one frame and we can, over time, convince ourselves that it's fake and we didn't do that. I'm not saying it's no big deal - editing anyone into sexual stuff that they didn't consent to is wrong. But video is a new level that we're not adapted to as a culture, let alone as a species. Our culture still considers video to be a standard of evidence. Even leaving alone that seeing yourself do something you'd never do is damaging to your mental health, it's still damaging to professional reputation and personal relationships, not to mention potential criminal investigations. The CIA & FBI have already used slander and framing to take down people they decided to, people that we now consider to be on the right side of history. I have no doubts they'll do it again and worse.
Also my friend just brought up fake revenge porn, which leads to "evidence" of cheating to break up relationships, or maybe non-sexual content that becomes "evidence" that you should be written out of your parents' will, for example.
I discovered I was deepfaked from this whole situation, and honestly even though I'm hurt I also feel for the sex workers who had their work stolen too. Both me and those SW who they put my face onto were sexually exploited and sold without our consent by someone we don't even know. Thanks for covering the situation, hopefully more people with be careful to make sure all of the sexual material they use was consensual.
So sorry that had to happen to you
dang, honestly deep faking is getting way to real, its going too far
Unga bunga unga bunga unga bunga
@@yabo5131 excuse me? so you’re saying that women should be made into deep fake porn without their consent and they’re not allowed to complain about it because they are “actual” sa vicitms? yeah dude both these people can exist. if your idea of “consent” only relates to physical sexual assault that’s your problem
@@yabo5131 she never said anything about SA. Someone selling your image, without your consent, for sexual purposes is sexual exploitation not SA
Deep fakes in general are a very scary concept because they have gotten so realistic. Even getting away from the sexual stuff, deep fakes can still ruin someone’s mental and reputation with how real they have gotten. What is extra scary is how good some private tts companies have gotten at copying peoples voices
Especially if it's That vegan teacher's latest shorts.
waltah🫵
And as another bad side effect, it gives possible deniability to REAL evidence of people doing bad things. It's all-around awful.
at least watch the video first
Watch the video first weirdo
this shouldn't be a 'ugh this is so weird' situation
publishing or selling ai deepfake porn should be illegal, a legitimate punishable offense
How about making all porn illegal
It shouldn't be illegal to publish it as long as it is very clearly marked as deepfaked and not real. If everyone knows its just an edited image then it's no different than creepy fanart, it's when everyone's convinced it's real that it's a problem.
@@Raptorworld22 No, it's currently classified as revenge porn in the areas it's currently banned, and I think this is a fair classification. There's a few reasons this is the case:
1.) Well-made deepfakes are indistinguishable from real photographs, and this is being further solidified by Dreambooth technology. It's worth noting that CP "art" gets charged as actual possession if it's modeled after real children or is too realistic.
2.) "If everyone knows it's just an edited image" requires every single point on the distribution pipeline to clearly mark the image/video as deepfake. This origin can wind up obscured or lost, either accidentally or intentionally, resulting in people believing it's real.
3.) The intent of deepfake porn is to obtain sexual content of someone who hasn't produced that content. You are bypassing their willingness to take naked photos or record videos of them having sex
4.) This is a thing men don't really understand, but most women are straight up HORRIFIED by the prospect of being seen nude by people they aren't intimate with. I for one had an incident where an ex landlord put a camera in my bathroom, and 6 years later I still have severe anxiety and trust issues from it.
5.) A common victim-blaming tactic men have towards women who have their nudes leaked is "You shouldn't have taken them." With deepfake porn, a person's choice to have nude photos exist of them is completely removed.
6.) Women have to deal with constant sexism and sexual harassment in their lives. Our ability to choose who can see us at our most intimate is one of the ONLY things we can control in that regard, and it's being taken from us.
@@cargyllion 1) Didn't know that, but if this stuff really is so accurate to real life now, then I am changing my stance and agree it should be illegal.
2) I never said my idea was practical, but in a perfect world that is what would be done.
3) This point doesn't make sense to me, as it's no different than creepy fan art in that case. Do you also think we should make drawing people without consent in explicit context illegal? Actually curious what your stance is there.
4) I don't know what men you're talking to, but every man I know would be equally horrified in this context, where everyone knows/thinks it's their body and it's without their consent.
5) Isn't applicable since my original point was if *everyone knows it's fake*
6) Having been a woman for more than half of my life, I know you are talking complete BS in that first half, unless you live in Saudi Arabia.
Overall, I am changing my mind and agree that this very convincing deepfake stuff should be illegal. Different opinion on fanart and terrible photoshop jobs.
@@Raptorworld22 The current situation with Dreambooth deepfaking is that anyone with an Nvidia gpu made in the past 6 years and 20 or so images of a target individual can generate a model capable of replicating that person's appearance. It can generate you nude, in an SS uniform, wearing a Jace Beleren cosplay, whatever you want as long as you fed it reference images. And it's scary accurate.
Literally the only saving grace right now is the current training models can't parse complicated tattoos and facial piercings. However, there's a large community of people working to fix these issues for the expressed purpose of generating AI porn.
Aside from the tremendously creepy aspect, it's good that you brought up how deepfake porn could potentially be damaging to the careers of the people being deepfaked. Think about it; the wrong people see something like that, like advertisers or investors, they might get fooled by it and decide to cut business ties with the people getting deepfaked. In short, just imagine your favorite content creators getting blacklisted due to sexual content that they never even produced; that's horrible.
This is a good concern, but I'm actually annoyed that companies even care so much about people having sexual content. As long as it's somewhere children won't accidentally stumble across it, there really shouldn't be a problem.
We just need to make discrimination on a professional level completely illegal
@@impishlyit9780 100% agree with ya. Just because someone's made or performed in pornographic content/media doesn't mean they should be blacklisted.
It's a paycheck. Nothing more, nothing less.
So long as all the people viewing the adult content are of-age themselves, everything's fine.
Man, I got sidetracked on this one xD, but it's an important topic too.
Even if they aren't tricked by it personally a brand could probably be convinced to drop someone just because it exists at all especially if it gets popular enough. Real or not a brand that's promoting say kids content or trying to have a "family friendly" image may not want to be associated with that. I don't understand how it's legal anywhere given these companies should have no right to monetize your likeness anyway. Really gross situation and technology keeps advancing faster than we can plan for the ramifications of it.
@@josephschultz3301 agreed. Here where i live, a female teacher broke up with her husband and he, as revenge, shared online some porn videos they made together (that were private, they never posted them anywhere before, it was private videos for themselves and pics he took of her naked). Turns out she got fired from working as a teacher and blacklisted from every teaching career in our country, while he only got like 5 months of picking up trash as community service for doing something illegal. AFter those 5 months he can get back with his life (of course HE isnt getting fired nor blacklisted from any working job even if he was in those videos too, only women gotta be slandered for sexual things) meanwhile her life is ruined. Some idiots still insist on defending him and blaming her. Our country had a lot of protests about this.
I was very innocent in high school. I never taken a nude or even made out with anyone. Never sexted. Yet, there were multiple people that were convinced I sent someone a nude. Turns out, it was some other girl that looked similar to me. The guy lied about who sent it. I have no idea why. It is an awful feeling to be judged for sending out sexual content when you never have. It is such a violation. I couldn't imagine being in the situation as the streamers. What they are going through is in a much larger scale. Truly horrific.
that is so horrible oh my god. i am so sorry you had to deal with that
Nah lol them girl streamers are fine they'll just break ties with dude an go on about there life in my opinion
@@whitemamba0089 "in my opinion" girl ur opinion doesnt impact anything no offence
@@9t4nek Did you just call him a girl? Shame on you
Sure Courtney. Your parents might believe you but I don't.
someone made a deepfake of my cousin committing sexual acts on a minor and it almost completely ruined his life, it was sent from his facebook to all of his friends it was awful
That is super fucked up, I hope that he's since doing better.
That's crazy and messed up.
jesus…
That’s so fucked. I’m curious how defenders of this AI pron would rationalise this.
Who did that
the biggest shock for me with this whole situation is that this wasn’t already illegal. there’s already laws and defamation lawsuits surrounding using someone’s likeness in anything without their consent, but for this kind of material is sickening.
Exactly! And then you have guys like d*stiny frying their brains out to try to understand why deepfakes are bad 🤦🏼♀️ when is just another form of defamation!
It is sickening but does that also mean it's illegal to edit someone's face into a meme without their consent?
@@lacuna3693 it should be, lol. There have been cases in which celebrities sue companies because they use their image without their consent and/or against their will 🤷🏼♀️ but idk, the internet has normalized trasspassing personal boundaries to an extent where people are just mere objects...
@@lacuna3693 current law, sort of? Best example is with the old man “hide the pain Harold” or whatever that meme’s name is. His image, especially for those photos, are under copyright like any other stock image. So we do know that memes can be under copyright and can’t be used for profit or undermine other’s work. There’s also celebrities suing games, animated shows, etc. for using their likeness without their knowledge.
However those are higher profiles figures, and common streamers would have a harder time fighting that in court. There’s also AI involved in deepfakes, which we still have no laws governing, and other issues of giving streamers protection from these websites.
Honestly, one of the better things to combat it might be a libel/defamation lawsuit, since this basically is faking a porn tape for someone. And that’s outright stated under defamation as an injury of character and easily would at least have a trial for it.
It’s because the laws have to consistently adapt to technology so they will always be behind. We unfortunately won’t be able to experience a society we’re the laws will be ahead.
Even if he found the website randomly which is very unlikely, the fact that he didn't notify his fellow coworkers and kept it to himself is pretty stupid of an excuse.
Let’s be real, It 100% wasn’t an ad at all.
@@bonoboboy821 ofc, I mean that's way too obvious anyway
@knockout Well in order for him to know it was a deepfake site, it would have to be advertised as such, and presumably it would also advertise being able to fake his coworkers. Also I'm pretty sure the hub doesn't allow deepfake content so it makes no sense they would allow those kinds of ads.
@@mezdemundi7115 why wouldnt pornhub allow it? they have ads for brazzers which is a competitor.
To his credit, that’s a pretty awkward convo to have. “Yo bro, just letting u know I found this online service where it deepfaked you onto porn.” “How did you find it” “yeah, I was down bad and clicked on some ads, paid for some website, and beat my meat to it. Sorry for not telling you sooner.” “Bro wtf” that’s only one possibility of course, but ya see where I’m going with this? After the action is done, kinda hard to bring it up casually.
We did it, guys. We have lived to see man-made horrors beyond our comprehension.
I comprehend them.
Black Mirror is mandatory as far as I'm concerned. Sleep walking into an AI dystopia
I think there's been a few things in history that were a little more horrible
I shall study these horrors so I may one day comprehend them
It's just photoshop but automatic. Ya'll freak out way too easy.
Charlie is slowly transitioning into a being of pure black shirt energy
@Red Star 🅥 🤓
it’s like watching rick grimes go from officer friendly to season 5 rick
It's his villan arc
Cap also fake check mark
Almost as good as black air force energy
it’s sad that it has to be pointed out that this type of technology can be also used to frame people for sexual assault or other heinous crimes for people to actually see an issue with AI being used in such a way.
I can see governments and corrupt law enforcement abusing this
@@jess648 very true! and that’s terrifying to think about
@@alyssareed3666 yeah…
Fun fact this won't happen since the ai that creates the deep fake is also able to detect deep fake as it trains two ai one for creating fake ai and one for detecting fake ai to improve it. So no it's not going to be possible that it would be used for blackmail
i think the crazy shit no one else or charlie touched on, is the idea that they can use deepfakes of minors and young celebrities or actors. theres probably already some floating around on telegram i bet. dont doubt it one bit. smh
The ethics of AI technology and deep faking are very concerning, and not just this particular situation. Not being able to distinguish reality versus fake reality is a slippery and dangerous slope.
Everything on the internet is fake.
Oh stop living in the past. /s
When moist barely uses any metaphors to explain the situation, you know he's completely serious.
Ĥii
@Auracle this is not just Photoshop for videos dude
@Auracle would you like to be put in a porn vid without your consent?
You’re acting like photoshop can’t be used to destroy people’s lives either.
@Satchelhandle fr
It's actually scary how many people don't understand the simple concept of consent
It's not just not understanding consent- it's wanting to actively go against it. You'll have commenters screaming abuse at a woman that promotes her OF, but have a site like this that promises a leaked video, or accidental nip slip etc, and people will flock to it for the express purpose of seeing her in a situation she didn't want to be in.
You prob don't know the difference between public and private property. Who are you that we other humans require your blessing for us to do as we freely please with our property?
@@nicholasgarcia399 explain yourself and this property you are talking about?
@@nicholasgarcia399 what in the world
@@nicholasgarcia399 women aren't property but nice try, incel
If you're still trying to defend it, just imagine if it was someone you loved.
@Edward don’t try to say “EVERYONE”. Don’t lump other people in with your gross behavior.
@@justasmltwngir1732 get the fuck outa here. You're gonna tell me you never flicked the bean to anyone besides the pornstar you're watching? Oh what you don't watch porn? Naw let's not even stop there you don't even tug em out right? Do you hear yourself. Everyone that masterbates has their "inspiration" cause you sure as hell ain't jerking it to literally nothing, regardless of whether or not you watch porn.
And my reply to op, I would know it's not someone I loved, so no it wouldn't bother me one bit. That said in my opinion deepfakes should be labeled as a deepfake and not tried to be passed off as real.
@Edward Deepfake porn has gotten so advanced that it's quite hard to distinguish real from fake. Without proper evidence to disprove the deepfake, it can easily be used to slander. Although I do agree that deep fake porn of celebrities and social media personalities will always exist, that's just the price of fame. But what is disgusting is that it was of his friends and even his friends girlfriend.
I won’t lie there are more horny motherfuckers than acceptable here. People really will sexualise anything, even the most wholesome humans imaginable.
@Edward everybody has fantasized if even a little about somebody attractive in their life but not everyone seeks deepfake porn of them. That shit is definitely weird man
I mean… the idea of even having those kinda of tabs open while streaming is mind blowing, it’s like going to a public bathroom without locking the door.
Ikr!! Dude has a serious problem lmao.
It's like going into a public bathroom stall to pull down your pants , insert a banana, then bend over and leave the door open expecting no one is gonna see that goofy shit.
Those doors usually don't have working locks
When I do stream (rarely), I make sure every bit of software that isnt related to streaming is closed, not minimized. I'm not ashamed or into anything illegal, just like, even accidentally flashing OBS bothers me. then after stream I do a full restart to make sure obs itself is off. Too safe? maybe, but better than this guy
@@Fox_Olive is it that hard to create another user account in your operating system? damn.
What scares me the most is the potential for cyber bullying and the fact that I can predict with great certainty, that this will be used by school students to bully other kids
I give it 3 years
Damn.........................
Only for this generation, the next generation of kids will grow up not trusting video / audio. Out of all the dangers AI will bring, this is one of the things you should be least worried about.
It could also be used to blackmail or discredit people, disrupt criminal investigations, create fake alibis...
Elon was right about AI taking over monkaS
I can only hope deepfake detection evolves as rapidly as deepfakes are
Proper anti-cheat in games is easily bypassable, taking that as an example, deepfake detection has no chance.
Schaffrillas when he watches The Owl House instead of paying attention to the road. 🚗💥
The technology used to make deepfakes is what’s used to detect it as well so the advancement of it should stay 1:1
This been around for decades bruh.. back in the 00's it was photoshopped celebs. They've always found ways around it & unless actual federal laws are made, this ridiculous stuff won't stop
@Mikonson your shoe size is 6, taking that example, you have very small package
thanks for speaking up about this. the fact that people disregard this is insane.
They won't be disregarding it when it happens to them
@@candy-ninja who in the world would wanna see corn of an ugly loser who gets off on ignoring women's consent though? :/
@Edward booooooo 👎
Because it's hard to care about people who speak of morality when their community is rather depraved.
@Edward bro got pissy cuz i boo’d him 💀
Not everything that is legal is morally correct
Just like onlyfans
Remember back in high school when rumors would spread about people? This is the ungodly, coked-out, and roided-up evolution of that concept. This is fucking terrifying beyond comprehension.
And considering how even adults still act like high school kids despite being in professional positions...
I am in high school rn I am a freshman and I never hear rumors about people in my school
@@luckyoshi you're just lucky. If you genuinely believe high school isn't drama ridden you're naive as fuck
@@luckyoshi your personal anecdotes do not invalidate everyone elses experience pal
i like to see more of it...
Charlie with a black shirt really has the energy of a dad explaining why something is wrong.
Its not good sign.. idk what happened.. maybe sold his soul? Replaced by clone?
Schaffrillas when he watches The Owl House instead of paying attention to the road. 🚗💥
It’s basically like Spider-Man with the symbiote, too powerful of a force to be reckon with.
@@furryprideworldwide816 L
@@furryprideworldwide816 Loser!
It's scary because anyone could suffer from this, imagine you have a crazy ex who wants to ruin your life and deepfakes you in that type of scenario and sends It to everyone who knows you
Seems like the issue is the crazy ex not the deepfakes
@@eugenelevin9809 only a man could type this holy shit
@@llamarelish4701 cool it with the misandry, being a man or not has nothing to do with it, im a man and i dont agree with him lets not generalize a gender
@@llukeglanton no it’s true, literally ONLY a man could say something as stupid as that. im sorry you cant realize that.
@@alyssareed3666 the misandry is insane ngl
This comment section is making me both enraged and dissapointed by the second. There’s plenty of sane people here, sure, but why can’t everyone understand that other people don’t want to be depicted in sexual situations? These kinds of disgusting slime are better off dead, along with pedophiles and other kinds of non-human filth that think consent is just a suggestion.
absolutely right
Are you gonna police peoples fantasies?
@@jerome1lmyes. Especially when it’s affecting other’s lives…
@@jerome1lm It's no longer a "fantasy" if you choose to make that fantasy into a material entity (deepfaked video) which can be seen by anyone, not just the fantasizer. Seek help.
@@cyanscrewdriver2092 amen
The depressing truth to all of this AI deepfaking is that there’s creeps on the internet that can easily make porn of popular minor celebrities and that alone sends chills down my spine
You and I both know that this is very much a real thing already. What’s worse is that I doubt that there will ever be an end to it
@@Lunar_Capital it’s an unfortunate realty we live in, that’s what makes this scarier
Apparently there’s already been AI CP being made and it’s absolutely disgusting
@@suburban5
Just hoping lawmakers see this more as a real problem.
If this really scares you that much, I hope you never discover just how messed up the world really is.
you know as a woman i’m so glad to see such a prominent male figure in the community speaking out against this. i’ve seen a lot of women being disregarded and belittled for saying the exact same thing and as shitty as it is, it’s nice to have someone to back us up.
Agreed. Pretty friggin' sad how many men are downplaying this.
Agreed, charlie and this community are what often restore my faith in humanity to be honest. Sometimes I'm really scared if no one in this world actually have decent clarity and conscience for everything that I've seen in my life. And it is MEANS A LOT for me to know there are peoples like charlie and his followers out there with sane minds and willness to speak up for those who need it. Charlie if you see this, you are impactful and honorable. Thank you 🙏
Yes 100000%
True
right
I was once recorded without my consent in a sexual manner and was blackmailed. Even though it was my body I completely empathize with all of these streamers. Because I was never physically hurt, but just the act of seeing me (and in their case, their likeness) being shown without my consent was the most damaging shit ever.
But you actually did the act, which means you still did something, it’s a very different situation from someone who had nothing to do with it. Just walking down the street and suddenly there’s porn of you. Versus you actually slept around and someone released real porn of you.
Ya thats messed up, hopefully you got away from that person.
this should be illegal, it's terrifying.
The worst part is that the people being deep faked were personal friends. That is a level of down bad I never wish to witness, let alone experience.
She baked his wedding cake 😭
absolutely down horrendous and creepy bro
Schaffrillas when he watches The Owl House instead of paying attention to the road. 🚗💥
And he’s married
yall never had a hot friend that u wanted to sleep with but couldnt? idk why everyone is freaking out over this. everyone has their own private fantasies or curiosities. ive looked at some really really crazy stuff online just because. its not like atrioc was personally creeping over them, it was a solo curiosity that he accidentally showed.
Was just talking about this with my boyfriend. I can’t imagine finding P of myself online without consent, or how it would make me feel. Everyone calling these women sensitive for being in this situation is heartless.
я обязательно сделаю П с тобой, когда эти ИИшки станут общедоступными ❤
You’re def not interesting enough to be on the internet deepfake
They say that they wouldn’t mind having the same thing happen to them but guaranteed they would be upset if they saw just how realistic and convincing it would be
What is the "bye bye man" ?
@@swirlffle8323 It’s because they think if someone deepfaked them, they’d get exactly the bod and sex they wanted. These incels don’t seem to understand that anyone could make them into their worst nightmare and they’d have no way to prove it’s fake. It’ll only be an issue once it happens to them.
You've gained quite a bit of respect from me, for calling out someone even though you consider them a friend. Takes guts
Really appreciate your language use here because it feels intentional and important; referring to the women he looked at as "colleagues" and "coworkers".
I think something that seems a bit lost in this discussion due to it being on Twitch is that this is a man who fully looked at porn of the people he works with. In any other "real world" scenario, if your coworker got caught with porn of you and your colleagues (regardless of the gender) on his work computer there would be an immediate understanding about how absolutely disgusting and straight up creepy that is, and how rightfully so in that situation, that colleague would most likely lose their job because of sexual harassment.
I hope the women who are victims of this really have more support not just from their user base, but from Twitch directly, because this is just unacceptable behavior that's eerily being described as "normative".
TL;DR, close your porn tabs at work.
Starting to understand why my dad would tell me it really is all men
@@lioreubm677 Yes and no. (Basically) all men have a sex drive wired like this, not all men act on it. Many men are good people and dont indulge in their darker side like this
@@eligedzelman5127 “darker side”? The way you’re describing men makes it sound like all men have dark, horrible, twisted urges, but the ones who don’t act on those are good. That’s not how people work, and it’s not okay to generalize men in that way. Some people do have bad thoughts and bad urges, while some don’t. And yes, it is scientifically proven that males have more libido than females, but that doesn’t make them inherently creepy. It’s okay to have sexual urges; most people do.
@@Cruz474Or even better, be a decent human being and don’t make porn of people without their consent.
The guy just got married in August, he had to admit he paid for those deep fakes. I'd die of embarrassment.
daaaaaaammnnn omg
Plenty of dudes buy porn now a days and hide it from their wives
and his bestfriend's girlfriend who made his wedding cake for free is also on the deepfake website. disgusting behavior.
anyone who pays for porn is too far gone tbh
@@yxnnah yikes, i knew it was bad but didn't know it was THIS bad. What was bro thinking when he made that decision
Absolutely insane that people have to come out and say "please don't put my face on a random naked woman's body"
the internet is beyond messed up
This has been happening for literally decades. It will continue to happen.
@@Elfenlied8675309 that’s a logic fallacy just because something has been the case for a long time doesn’t mean that there’s evidence stating it should continue to be
@@Elfenlied8675309 So has murder. But you don't defend that.
@@Celeborn93 nice comparison
@@Celeborn93 Absolutely good comparison. We have to think of black and white in these situations. Is this good or bad. It is bad. There cannot be middle ground especially when those whose likeness is being reproduced explicitly and implicitly stated they do not want to be used in that way.
This isn't just weird, it should be illegal.
It can destroy careers and lives
Meh, publishing/selling can make a case for making illegal. Don't see a problem in keeping it private.
@@Cruz474 It's a violation. It's inhumane, grotesque and criminal. Doesn't matter if it's private or not
@@hithisthers7214 Ok then why aren't photoshops banned.
@@Cruz474 Photoshops are still vile and those should be banned too.
Stop thinking from the perspective of someone tugging their meat, and start thinking from the perspective of the victims
@@hithisthers7214 I'm thinking from an omniscient perspective. I was just looking to see for your consistency. I see it, so I have no quarrel with you. Respect.
even if the person faked does make there own sexual content, there own business gets undermined by bootleggers basically, and even if someone consents to be photographed nude in there own content, that doesnt mean they consent to being deepfaked. thanks for talking about this charlie, ur a stand up guy
Cheap knockoffs are cheap knockoffs bud. It aint illegal to sell fake jordans
@@HybridxProject Yes it is
@frogmen it literally is illegal to sell fake jordans. That's counterfeit product
Edit: also glad to know that women are yet another product. Maybe try to see women as human being and not sexual products to produce "cheap knockoffs" of
@@quixoticvalkyrie Lol no selling fake jordans is only illegal if you try to sell them as though they are real, knowing that theyre fake. If these deep fakes are being advertised as fake, then thats it. And drop the woman are objects nonsense, same applies to mens deepfakes. As charlie has stated this has also happened to him.
Go where the money is, if i don't want to be "undermined". Price match that shit, or cry a river.
I remember less than 10 years ago, local stories about how a teacher lost her entire teaching career because when she was younger (and she was still young when they came out), she did adult content that some of her students eventually somehow stumbled upon online.
That was from someone doing adult content for real.
Now imagine if highschool or college students have the power to just deepfake a few convincing pictures of their teachers in adult content.
They could ruin their career and reputation because even if it's proven fake, school establishment don't like to be anywhere near that kind of stuff and the content will probably remain available somewhere.
Yeah it really feels like opening Pandora’s box, there’s no telling how far it’ll go
Why does deep fake even exist to begin with?
@@experimentalghoul3540 So you can elect puppets into office.
@@experimentalghoul3540 I’m not sure what you mean. Like anything else it exists because there’s a market for it people will pay for a service that lets them see their favorite celeb in adult scenes.
Regulations are being put in place in 2023.
It’s honestly surreal that deepfaking has reached such a point to where it’s starting to become an actual concern.
This is technology that humanity simply isn't mature enough for. Imagine videos of crimes and the like being doctored with deepfakes in order to falsely imprison people. That's one of the first things that came to my mind when I was first introduced to it.
It just makes me sick how so many miserable people spend so much time of their day making fake videos and cheap deepfake animations on people. They deliberately do it to harm and Destroy peoples reputations.
And I don't get why they are so desperate to see somebody uncovered in the first place, acting like middle schoolers who have never seen a woman's body before
It’s been a “concern” since 2015 it’s not really new nowadays
it was 100% clear from the second the technology started to exist.
look at games from 1998 and today. it was inevitable that this technology is advanced as this.
Crazy how we've all forgotten about empathy and the golden rule. If you dont want this done to you, why do it to others?
When I was younger, I wanted to become a programmer and create stuff that's exactly like deepfake. Now that people have done it before I even had a chance, and I've seen what people have and maybe will use it for, I wish that it never had existed. Man, I sure love technology.
HealthyGamer_GG did a deep dive on this today that goes into some science about how nonconsensual porn affects not just the victims, but the consumers, and one of the chilling parts of it was that the deepfake stuff is behind paywalls because it's more addicting, because they're attached to an existing powerful parasocial relationship. It was a powerful take and I hope everyone sees it.
Definitely will dig into that, Dr. K has amazing, insightful, compassionate content. Thanks!
Thanks for the rec
Isn’t all porn non consensual? The people participating in the act consented but there’s no way that they consent with everyone who’s watching, and as a passive observer i doubt that anyone is mentally checking off if it’s consensual or not anyway. As far as the individual is concerned they are partaking without participating and that is often a part of the harm done by porn.
@@sparks6177 I mean they’re essentially consenting to all consuming by consenting to have to video publicly displayed.
@@sparks6177 people who make porn willingly and post it publicly are also consenting to having pretty much anyone view it. It’s comparable to TH-camrs and actors where they sign on to have anyone who can watch their content, it’s part of the deal. Steamers do not consent to having porn made of them because, well, it’s pretty obvious why. They are not at ALL the same.
I remember when deepfakes meant putting Nic Cage in all the movies, ah good times.
Aww
Good ol’ times
Now it's about putting something in nic cage
This is very well said. Thank you for covering this so well. People need to understand this but I know that some people won't understand it and it sucks.
I think people really don't see streamers as people and it's scary. Someone could make something fake about you that's hard to disprove, and it could ruin your whole life. I feel like there's going to be court cases about this in the future.
People shame people for having OnlyFans but then seek out this? I think they don't want to admit that they want things like this. And much less admit that they have a problem. Time will tell.
Sorta off topic but Charlie seems like one of those friends who would tell you your screwing up before it’s too late. It’s honestly refreshing to see someone be so blunt and honest about something when it’s about a friend. I’m sure it’s a very difficult situation but I think that it’s pretty inspiring to see that how he’s willing to stand by his morals and say it’s wrong despite having reservations, not wanting to add negativity to the situation and caring about the other person.
extremely well said. it’s devastating how desensitized our society has become to advancements like this.
Well said yourself.
The societies in the west are pretty much fucked, no surprise there
Kind of cool I'm glad I know of it now 😃
wow
I mean when every girl i see often does sexual stuff, it got me really desensitized... i know it feels bad but when it's like pokimane and all, i cant even flinch
The sheer embarrassment of this situation feels so tangible, I don't know how one could live with that
bots. on a serious topic video.
MrBeast IS THE ĀŅŤŀ christ
He's definitely gonna be known as the Deepfake guy for the rest of his days
@@radicallybeanbots on every video
I’m better than Penguinz0 my content is better😎😎
Not to mention HOW THIS CAN EFFECT MINORS AS WELL. I've seen too much of that shit ALREADY
I was wondering when Charlie would cover this topic, and I’m very glad that he did so in the way he did. He was respectful and did his best to make everyone aware of what was going on without making a huge deal out of it in a way that would draw even more attention to it.
It's weird to me that there are some folks out that you have to explain how morally unacceptable it is to exploit people on the internet with deep fake porn. Is their moral compass broken? This is about respect towards other people and consent.
I wonder the exact same thing. The lack of empathy astounds me.
@@aurea. I feel sometimes like the whole internet is full of soulless sociopaths, but then I remember a lot of people on the internet are teens thinking it’s cool to “not care,” if you know what I mean.
It's what happens when viewing tons of porn is considered normal especially for guys so there's nothing stopping them other than themselves in how far deep they go
"consent" Do you complain about comics making fun of specific people? They certainly don't get "consent" to rail on about people.
This is so delusional, because it assumes that these celebrities are actually being affected (exploited!!) by the deepfake industry. I like how everyone has just ignored that this has literally flown under the radar until this weird incident by a streamer. So much proof of it having a real tangible affect on celebrities in general that it took a random giant streamer to have clicked on an ad to suddenly bring this to internet wide attention.
There is real criticisms to be had like the companies labeling the porn as REAL!!! and it being charged for, IE, making money off of someones likeness/copyright without their consent, but the idea that porn deepfakes are inherently themselves *evil* is actual karen behavior. These do not have actual effects on anyone, except in the small exclusive cases of direct blackmail, and even THAT situation is bullshit because there's also tech that detects deepfakes that is constantly evolving alongside AI tech, so any faked blackmail is usually very quickly detected as fake and thrown out. Charlies example of "muh companies pull the trigger like winnie hut junior" is not a problem of deepfakes, but companies being pussies, and one that should be ironed out. I'm sure a few cases of potential "leaks" turning out to be fake resulting in triggerhappy companies looking like dumbasses will curb this behavior.
There is no such thing as a moral compass.
I am really worried about this, especially in terms of crimes and trials. It has become so easy to frame someone of doing something gross which can be used during a divorce or just something illegal. Even if some IT specialists can prove that a "photo" or a "video" is a deep fake, it still can be so devastating for a person even if he didn't lose a trial. Drama usually stays for eternity in one's reputation.
What I'm trying to say is AI faking action of real people can run out of control extremely easy.
So Disney is not capable of doing s proper Deepfake in one shot but we supposed to believe this can be done in court videos.
De-lu-sio-nal.
So the reason why thst won't be a huge problem ris because it need thousand of hours of video and sound to make it even kinda believable so no normal person would be able to be deep fake only people in front of cameras often and if you in front of a camera often you have easier time to prove your innocent
@@bobberry1463 even if that’s true, anyone who has hours of content of them - with, or WITHOUT their knowledge - even just a few solid minutes of footage / other stuff and you can still do this. there’s been deepfake porn of people who are pretty chaste online (like billie eilish). and i’m sure people who are looking for that kind of thing won’t care if it’s poor quality or not as long as it’s close enough
for sure it would be harder for people with less footage of them up / less public jobs, but even still, it’s better to protect everyone - silly example but genuinely: but does flo from progressive not deserve the same amount of privacy as any of us?
just something to think about. 100% always better to make something more safe than less safe.
We need to stop believing video evidence is infallible, that's the main takeaway here.
@@heavenwaits "does flo from progressive not deserve the same amount of privacy as any of us?"
I don't see how it's a violation of privacy.
You see this could be even worse in the case of what if someone tried to deepfake an underage person
My thoughts exactly. This shit is dangerous
Watching porn is bad paying to watch it is even worse
@@Deletedaccount2022ieit is
im glad that someone with a large platform is talking about this issue. ive seen this exact thing happen to many female streamers, but because they were smaller, nobody said anything
I love sweet Anita deepfakes
Cry more
@@THIRTEENTH13TH bruh what
@@Justin-rt7yp get out
@@Justin-rt7yp 😐
i had a similar experience. i was only 16 and one of my friends (20 at the time) spread around fake screenshots of me saying sexual things to him. it was all for a “joke” but people genuinely thought it was real, and he played into it. it’s such a disgusting feeling to avoid touching anything remotely sexual as a woman, only for men to decide you don’t get to choose whether or not you’re considered sexual. they turn you into an object for their own pleasure so easily and it’s terrifying. it makes you feel like you don’t have a right to your own body anymore.
Cry more.
@@Justin-rt7yp Whoa there buddy, bad day today huh?
@@Justin-rt7yp hope the fbi finds your secret hard drive
Men vs Women? You are as bad as the guy honestly. Be a human.
@@Justin-rt7yp Step away from the underage girls
Didn't even know that existed. How desperate can one person get....
Thank you for your great breakdown of the situation, Charlie. It’s the weirdest energy for people to have such a strong stance against Only Fans creators to also have the take of “it’s not your real body so why do you care?” Seems like some consumers will only enjoy sex work so long as the sex worker can’t consent and/or profit. 🙃 Yikes.
Yeah, I wish both OF and deepfakes would go away. Coomsumers are out of control and sex workers exploit them.
Both OF and deepfakes are wrong
thats exactly what it is. misogyny has been so deeply ingrained into these degenerates. they fully believe they should have access to sexual content on demand (but no, not like that!!1!)
@@professionalfurret7225 OF is better than illegal sites that get their source illegally like trafficking women (yes it happens), blackmailing them into doing it, or set up a small camera to record it without their consent.
what is so bad about people using their body to make money if they consent about it? If you want to go against pron, then you also have to go against sx overall. Pick one side and dont cherry pick, all it did is harming people.
The fact that you lump deepfake and OF together speak volume of what kind of person you are. One is illegally made against the person consent, one is made by the person with their consent and the will to do it.
if you try to ban sx overall it just wont work. my country did that and 10 years ago it was super common to throw LIVING freshly born babies to a trashcan because mrdering is better than people knowing they have outside marriage sx.
Because they literally only care that theyre not the ones making money off it lol. They obviously do not care having men whack off to them or having sexual content of themselves on the internet. But somehow have a problem with fake images of it? give me a break lol
Deepfakes have always irked me since I first heard of them a few years back, and knowing the technology for it is only getting better, that bad feeling isn’t going away. There’s so many ways it can be used in the wrong hands- blackmail, revenge porn, straight cruelty by sending it to friends/family, getting people fired, using CHILDREN, etc. It deeply, deeply unsettles me. The response to this whole streamer situation greatly concerns me, as well. These women are being openly objectified, having their privacy invaded in one of the worst ways possible, and some folks out here are so quick to brush it under the rug. It’s a shame.
deepfaking should probably be illegal idk
There were people claiming deep fakes were coming that you can't tell from reality 12 years ago.
Yea it is
You’re 100% right here!tbh technology is scary af nowadays between the ai art the deepfakes and the ai that emulate people’s voices it’s definitely risky af and could lead to a lot of horrible shit happening and it sucks seeing people being taken advantage of and having this horrible shit happening to em men women and children alike can be victim to ai deepfakes of all kinds including adult content. The thought alone makes me feel sick! I can’t imagine what the victims in this must be feeling and going thru tbh
holy shit you're right people can make actual cp off it damn
Dude. My biggest concern is how this could be used to frame innocent people for crimes. The state or a malicious person could take someone down by just making up video evidence of them committing crimes they never did. If this happens a lot, we could end up in a world where video evidence can no longer be used in court (unless we find a way to better identify AI deep fakes).
Video, audio, everything. A post truth world.
Yh that true or used to create more diversion by creating like fake hate crime ect u never know with western govornents
Security camera software could add features to grant access to footage (where it is viewed on its official website/app), that way it can't be fabricated
I could be wrong but wouldn't you still be able to use metadata? Phone/camera manufacturers could use some sort of verification system to confirm whether a video was real. Obviously a lot of videos/images would no longer be valid but I don't think its entirely a lost cause.
It just should be illegal in all honesty
Lawmakers really need to completely ban this. Imagine if they deepfake a persons face who is under age and then put it on the body of someone of age, and say it’s “ok” because the persons body is of age. Very horrific slippery slope here. Disgusting!
He didn’t click on an ad he didn’t only look at it once. You don’t get caught watching porn after just one time.
I remember this one adult actress who had been affected by DeepFakes being applied on their content speaking out about this, it was something along the lines of “You’re taking something that I have produced for people to enjoy and you’re twisting it into a situation where the other party has literally no consent in the matter.”
Adult DeepFake content is just such a strange thing to me, on the one hand I can to an extent admire the technology, but we really should be drawing the line at DeepFake memes for comedic value, cause when you cross into the territory of things being practically undetectable to the naked eye, it can genuinely ruin people’s lives.
Honestly it's hard to say where to draw the line. Comedic value is subjective and there can be stances within memes that people don't want associated with their faces. Even the film industry has morality issues about deepfaking. Good quote btw.
If you remember who, drop their name. I want to see their full side of the story.
@@MammalianCreature I think it was in one of Shane Dawson’s old conspiracy videos on Deepfakes, long before all The weird shit about him came out. i believe it was his video “Conspiracy Theories with Shane Dawson” from 2019. I’d say the DeepFake section of that video was probably the last interesting thing he made tbh.
@@craigyeah1052 I say in memes for instance like what Corridor Digital does, they had that Keanu Reeves stops a robbery deepfake that was quite impressive, or like when people do stuff like deepfake nicholas cage into random scenes.
I agree though, it’s kind of hard to tell where EXACTLY to draw the line with this kind of stuff.
@@MammalianCreature 🤨📷
My biggest concern is when people begin deep faking individuals doing illegal things. Someone doesn't like someone and so they deep fake them doing something horrible to a child and it's hard to disprove in court. On the flip side of that, once it becomes well known enough, deep faking becomes a serious issue mudding photographic evidence, suddenly it's hard to prove someone who is guilty based on photographic evidence because they can claim it was deep faked.
"deep faking becomes a serious issue mudding photographic evidence"
Yeah, but that's not necessarily a bad thing. There's a lot of innocent people in prison, so having more prosecutions fall apart because of the dubiousness of video evidence could be a positive thing.
no. photographic evidence will become meaningless
Already happening. We have seen "algorihmicaly enhanced" footage admitted in court trials.
Even if it's not purposeful deepfakes, it's still extrapolated data, something that never actualy existed
@@peacemaster8117 there is more criminals getting away than innocent people in jail. The justice system is already a joke. Its not a good thing at all
Its never gonna get better when all the top streamers just softball him...
There should be lawsuits against people who do this, its not only copyright but also defamation
"I don't have anything to add"
Video lasts another 9 minutes.
To me, the biggest thing that disgusts me that nobody is talking about is how he brought this deep family struggle and streamed it for everyone. These streamers are sick in the head for bringing so much personal shit on stream. Deepfakes are stupid and weird, but bringing your wife on stream to cry in a very awkward way is weird as well.
that's what i also dont get. before looking it up i thought she caught him doing it, and forced him to come out, but nah, it was his chat, so why is she there? and also why is this so public. if he need to excuse, do it to the offended party. not an open video that is only going to make it worse for everyone involved.
@@marcosdheleno He said he didnt sleep at all the entire night it happened. So not only was he on lack of any sleep, this is his entire career that he has been building up for years and he probably saw it flashing before his eyes that everything could be gone so he felt he had to do something. Hindsight is 20/20, not everyone can make perfect decisions all the time. Its easy to see why what he did was wrong after it happened.
His wife was there because she also wanted to say something in the apology stream, I doubt Atrioc asked her to be there
Dude wanted a fast fap and found no good material so he created some himself. Is that really that bad? I hope he releases the full material, I am getting bored
I feel like it was done on purpose so more people would try to do this and get into it. People that had no idea deep fakes existed. Now that it is public knowledge, watch everything disturbing that happens (political figure gaffes etc) now can just be excused as deepfakes
You know shit getting real when he’s not wearing white
the damage porn has done to men of this generation is HORRENDOUS. men have become monsters.
Men have always been monsters. Centuries ago we would be committing atrocities. We still do actually
I hope he apologizes for asking people to make deep fakes of Matt Walsh in hopes his kids would come across it.
@@user-cf6fo6bj1u kinda true but not all men
Bro your name is "eat a fart sandwich"
i'm glad charlie understands how disturbing it actually is, because i've seen some youtubers say that the only problem in this situation is that the guy watching deepfake porn didn't do enough privacy measures and that watching this stuff is okay if you're not talking about it publicly.
I think the nuance that it only matters now that it is more realistic, where as it was more humorous (at least the ones he had of him) before is a bit wrong though. It is absolutely worse for the person being faked, as it's harder to deny and refute that it's them, and would make them feel far more invaded.
But, for the creator, and the consumer it is exactly the same. The intent is the same whether it looks a bit off or not. They are still trying to create an adult video that the person did not consent for.
@@PaulFilmer If anything, it's now easier for anyone to do anything, because they can blame it on deepfakes
@@protomato6427 This is irrelevant to this situation as a whole, and this comment specifically, but thanks for the insight.
i mean...think about it...if nobody knew, what would the ethical issue be? Like, for example, would it be unethical for someone to draw a picture of a celebrity naked, and then jerk off to it? I feel like people just love shaming others when it comes to anything sexual cause they're desperate for people to think that they're not the weird one, when in fact, we're all weird.
@@nGUNNARp you would feel very different if it was you having sex with a minor to F your life up! Yea… this is real bad.
It’s gross, especially cause it’s not even limited to celebrities, influencers, streamers, etc. Even average every day people are getting deepfaked and it’s especially sad because with celebrities, we can assume it’s not real, but these every day people having their name and faces connected to these videos- recruiters and hiring managers aren’t going to go that extra step to see if it’s legitimate. It usually isn’t until people get sent links to the porn videos that they learn what’s being done.
Cry more
@@Justin-rt7yp seems like somebody's cranky
I mean, I agree deepfakes are pretty messed up. But don't people draw stuff like that too? How come people haven't been talking about that? Sure it isn't the real person, but their likeness is still being used and they're still being objectified
What's the issue though? As long as everyone knows it's fake all this crying seems like white knighting.
It only became a issue when someone was getting paid.
The situation is so bad that even Dr. K made a TH-cam video about the whole deepfake situation regarding the implications of it and the damage caused by them. It's so bad for everyone involved and those who consume it.
You're exactly right Charlie, this is disgusting!!
I always thought AI would take over by human looking robots, not deepfake porn. It's seriously sad that this shit happens. It's happening on Instagram too. I think this could also shed some light on porn addiction and the dangers of it. What I'm really worried about is creeps using this with minors.
Glad you mentioned the dangers of porn addiction; I'm an addict myself (hentai) and I'm trying to find some productive ways to distract myself from feeding it.
@@soaringsquid0.129 good luck. I know other porn addicts that had success with crocheting, chainmail (metal not emails), and miniature roses as house plants. Just need to keep your mind and hands productive.
@@soaringsquid0.129 Well, you better not take any looks at AI porn made with stable diffusion and stuff... now you can produce hentai shit with just a click
@@soaringsquid0.129 Good luck dude!
@@soaringsquid0.129 I wish you luck with your journey!!! Addictions are hard
What scares me is that people will start doing this with minors which will be ten times worse
Shit... you're right. What the hell has this world come to?
This can also be applied to AI generated art, it's all completely fucked. I sincerely hope this issue is made more prevalent to other people.
Already exists...
@@cutlassfury3393 no... this is nightmare you're lying. Lying is dishonorable
Supreme Court already ruled doing so to be CP
thank you for using your platform to talk about this.
love how so many people are outing themselves rn
Huge amount of respect for Charlie with how he handled this video.
🤖🤖🤖🤖🤖🤖🤖🤖
🦿🦿🤖🦾🤖🦿🦾🤖🦾🦿🦾🤖🤖🤖🤖🤖🤖🤖
I agree. Charlies the Man
ironic coming from a bot that has a sexualized image in the profile to make discord mods click on it
@@not_so_anon_person_on_the_8250 Does that mean they copied the comment?
It's only a matter of time until some teenager creates a revenge porn deepfake of someone they don't like at school. In that situation, a person's life will probably drastically change forever, and it's hard to say if the truth would ever come out. It would also create a whole new weird legal problem. Would a teenager deepfaking their classmate into porn be classified as a sex crime against a minor? I lean towards yes, but I also have a feeling that it will take almost a decade for widespread legal precedent to be established.
Dang I never thought of it like that, like I thought most comments were blowing this out of proportion. But your comment really opened my eyes honestly thank you
Something like that actually happened to me. I managed to stop the spread of the fake content at least before the people currently in my life could see them.
@@thehale_ That's messed up. I'm sorry you went through that
@@thehale_ Jesus Christ what is wrong with people
bro u giving people ideas 😭
it can be used for really bad manipulative situations as well.. i had a really nasty friend in the past and she once photoshoped a girl's face on a porno and told her boyfriend she was cheating... she would totally make a deep fake of someone to show their partner and say they are cheating etc... it's not just for sexual purposes...
I had no idea who this dude was until the controversy
This stuff pisses me off so much. The responses to it like “they posted pics of their face online they knew this could happen” or “so now it’s illegal to find someone attractive or fantasize about them” or genuinely one of the worst “all women should be ok with this because only fans exists”. It’s genuinely infuriating to see response like this
Fan fiction always have been weird, especially when they are about real people. Turning them into images makes it even worse.
@@Quisl the thing is, you always knew that it was fanfiction and not real. But most people can’t even tell these pictures are fake.
@@Quisl
No it hasn't
@@bobstevenson3130 “Can’t tell they’re fake” like you aren’t accessing the content on a website that has “deepFAKE” in the title
@@SSchemeS they mean images might be posted and seen by people who dont know its fake
You can hear the sheer sadness in Charlie’s voice as he talks about his friend getting caught for doing these horrible things. So sad.
Sure, he knows well that he committed a mistake by not vetting the people he calls his friends
how is this horrible 😭😂
@@csolisr bro, come on, how do you vet your friends sexual porn interests... this isn't something you go out of your way to find out.
@@MegaMuff420 So you would be fine with people making deep fake porn of your gf or mom or sister?
why is it horrible he got caught? its way more horrible that he consumed that kind of malicious media in the first place 😐
I've seen the ads for these kinds of sites but never gave it much thought. It wasn't until seeing all these videos about it that I really understand what really happens and how it affects people. It sucks that A LOT of people got hurt because of the publicity but I think instead of keeping quiet, talking about how bad it is is opening up a lot of peoples understanding of how bad it is.
Anyone defending this whole thing should be thrown into the middle of nowhere and forbidden to ever have access to internet ever again
I was so naive when deep fakes first dropped. I was just thinking, "oh man, now I can make myself look like a superhero or a movie star or something". Sucks that this is the reality of the situation.
Oh, very innocent. Teens (and the cia too tbh) will use it to make fake sex tapes to blackmail others, criminals will use it to frame others, courtrooms are already using deepfake experts.
i bet you are excited for human-like robots to vacuum your house.
@cats one of the industries that most rapidly attempts to adopt content related technology is the pornography industry, so its not really that hard to predict if you've given it some thought
Oh you sweet summer child. Just wait till A.I. winter.
i thought the same thing. but that’s sadly the very surface and optimistic way of using deepfake. we all know it’s going to be used for much more devious and evil intentions
charlie hit the nail right in the ass. The biggest issue is not just the fact that its a hug violation, but it also has horrible implications to be used as blackmail and harassment. Not to mention the potential for deep faked images of children/underage streamers. It is absolutely sickening.
@oh no cringe detector In case you are being manually this pathetic or you read responses to your pathetic bot, stop. You're not going to achieve anything by doing this.
You can use software to prove that a video is deepfake with 100% accuracy, you'd have to be a idiot to get blackmailed with the video equivalent of photoshop
That's always been a thing though, this is just an evolution of photoshop and previous visualisation methods. Before the camera people were saying the same thing about using sketch artists for Police work, "what if they could draw it wrong and convict the wrong person"
Make it illegal to do things that will cause international incidents like deepfaking the President or CEO of companies, the same as it is to fraud or slander. But to make it illegal to whack off to someone without their consent....? Naive and entirely unenforceable and not at all MORAL anyway, nobody can tell you what is right or wrong to think about, a hundred years ago it was "MORALLY WRONG" according to almost everyone for people to be homosexual.
Exactly. The people who can't see this have stones for brains
@oh no cringe detector Shut up, bot
So a friend of mine talked with a guy named Tommyc about this, and although my friend was calm and asking basic questions, he got flamed by Tommy who basically double talked and said it was a-okay to do and a bunch of other people in that space are just dogpiling, bullying, and harassing him for being on the correct side of this, "debate".
It is okay for them until its their face that is used and spread around.
I hadn’t heard about this until Leon Lush mentioned it in his video. Thank you for explaining what’s happening.
it's scary how much AI has progressed. if people can do this, I don't want to imagine what we can do in 20 years. you could frame someone for terrible things without taking a step out from your home.
Hopefully we’d also have a way to prove what’s real and what’s not.
Just a couple of years ago I remember trying some program that could say a few sentences in the voice of Homer Simpson, Squidward etc and it was still way off, now in 5 minutes I can make Oderus from GWAR recite bible passages and the realism is only determined by what audio clips I use as reference and by playing with the speech settings. I hate to see where this will be in just another 6 months.
Well some things are not fakeable
@@Holuunderbeere bet u in 10 year people will be able to fake someone stealing at walmart and using it as proof
IMO it'll reach the point where all videos and recordings will stop being considered as legal proof for anything because of how easy it is to fake them. I doubt you could end up sending someone to jail with a deepfake, but it'll still be problematic in terms of reputation and public opinion as people are easily swayed in social media.
I’m not even popular on the internet (at all), and someone did this shit to me just by gathering photos by following my instagram. They tried sending the fake photos or videos (I never opened them obviously) to all kinds of people I knew, including my own mother, just to blackmail me into sending them money. Luckily, I managed to spread awareness to everyone to simply delete the chat if this person messaged them. From what I know, no one saw they sent. At least no one currently in my life, thank god. This shit is a serious problem.
Woah that’s some pretty heavy (and illegal) shit. Do you know who it was?
Can't you like sue someone for this?
It's likely fake like when you get an email that says they recorded you through your webcam and to pay them.
@@Donovarkhallum That wa s a big skype tactice.
That is awful... sorry
I said that this would be an issue a long time ago when the Jim Carrey/Robert De Niro deep fake videos started making the rounds. I remember thinking "it's only a matter of time before they incriminate someone innocent with this". This is one time I hate being right
😶🌫That first joke about the parallel parking hit me WAY to hard, good job sir
thank you for talking about this aspect of the issue. I've seen so many absolutely horrible takes of people saying "its not their bodies" "normal people would get over it in a week theyre upset for clout" "its weird and creepy but not harmful" and its absolutely infuriating so hopefully some people will see this and understand the gravity of whats been done. Like Charlie said: imagine you posted a selfie once in your life and now someone took that and put it on a body--not some animated 3D thing, a real convincing looking body--thats not yours and is its doing something extremely pornographic. A full sex tape. Now imagine your parents have seen it. Your friends. Your significant other. Your kids if you have them. Your boss and all your coworkers. If someone looks for your name that video comes up. People might ask you to do porn or say explicit things to you now. You are treated differently. All of this, completely without your knowledge or consent, just because someone thought your selfie was hot and felt entitled to make porn of you to sell for a profit and for their own pleasure.
Edit: I want to clarify that the example I used here is a hyperbole that I only used to try and help relate the situation to a more "normal" level. It takes much more than a selfie to replicate and deepfake a face so I don't want anyone to panic or be fearful, that was never my intention and I'm sorry if it came off that way. I was simply hoping to provide that perspective to help some people who might not fully grasp how seriously this can harm someone who doesn't do sexual content and did not consent to it
I’d probably say that it’s a deepfake.
So you are saying life of a porn actor is a nightmare? Well, you are partially correct, but it's a problem of prudes, not porn.
@@protomato6427 Difference is, porn actors signed into it. They're aware this is happening or could happen to them because they're literally the ones in the videos doing it. If you're not a porn actor, you wouldn't want to be treated like one out of nowhere. Of course, there are still some stuff that people say and do towards porn actors and sex workers in general that they shouldn't have to put up with.
Think about victims of sexual assault? They could be revictimized by seeing that. It also takes away consent. That super hard on people mentally.
it'd be better imo if it was their body but just someone else's face.
Talking about this is a great thing for victims! Because now, more people should be aware that you CAN'T trust videos or photos
"It's not their real body, why do they care?" = "It's only a drawing/animation/cartoon, plus she's 5000 years-old! Why do they care?"
I can't imagine children will be safe from this. This needs to be outlawed and should be upheld in court.
Didn’t even think ab this. Ew
this has already happened with children and the government has done NOTHING. if any good can come out of this situation, i think it’s that people are gaining awareness for just how scary the ease of these actions are and can actually lead to some change to prevent them
@@DreamsOfLennox sad thing is i doubt it will reach enough of the people that need to hear it
Problem is.. how do you outlaw it? This tech is open source so its too late to ban.
It’s already illegal to use the tech on children, in theory, but it’s kind of impossible to prevent.
How could you possibility ban it?
We need some serious privacy laws. Stuff like this is only going to get worse because so much of our data is making other people money.
This should be treated the same as blackmail porn
Yup. I'm sure laws will be made here federally soon because as of now, not many can do anything at all except get them removed.
In the internet though... Things always make its way back
This is going to help the rule 34 community ngl
yes, more laws, more state intervention. that always helps
i’d be surprised if it doesn’t get outlawed at some point because i can already see people deepfaking politicians onto criminals like murders and shit
losing brain cells reading some of these comments. don’t understand how someone can understand the concept of deepfakes and not only think it’s okay, but go out of their way to defend it online like what is wrong w u
This is so disturbing. We're living an an actual nightmare
The whole deepfake thing is honestly scary. It can ruin someone's life super quick.
yep, but so far i think it's only ruined atrioc's.
Meh, e-celeb fanfiction has existed for years. It's exactly the same thing - fantasizing about having a sexual parasocial relationship with your favorite celebrity. People who are into that are definitely creepy weirdos, but complaining that it's "unethical", especially when some of these e-celebs are encouraging parasocial relationships in the first place, is pretty hypocritical.
There's of course the whole other angle of passing it off as real, but there are fake news about e-celebs all the time. This is something you cannot police. Best you can do is take responsibility, not encourage parasocial relationship with your fans (especially sexual ones like OnlyFans), and make sure you're not associated with it. Nobody is looking up DeepFakes of Michael Stevens from Vsauce.
IT will ruin someone getting caught but definitely will not ruin the one being deepfaked, unless they chose to be ruined. (because people would just comfort and give sympathy to the indicated victims) this is digital harassment in the making.
It’s easy af to prove a video is deepfaked, no matter how realistic it looks. There is software that can determine deepfakes based on a number of factors and it’s 100% accurate
Too be fair at the point it’s at now people can still tell if the video is fake or not
Human brains aren't adapted to seeing ourselves doing sexual things that we don't remember doing. In this case it's because we didn't actually do it, but the point stands. It's deeply psychologically disturbing. Dr. K on HealthyGamerGG did a video on this situation as well, it's really insightful.
What about Photoshop?
@@AkiRa22084 We're not adapted to that either, but it's one frame and we can, over time, convince ourselves that it's fake and we didn't do that. I'm not saying it's no big deal - editing anyone into sexual stuff that they didn't consent to is wrong.
But video is a new level that we're not adapted to as a culture, let alone as a species. Our culture still considers video to be a standard of evidence. Even leaving alone that seeing yourself do something you'd never do is damaging to your mental health, it's still damaging to professional reputation and personal relationships, not to mention potential criminal investigations.
The CIA & FBI have already used slander and framing to take down people they decided to, people that we now consider to be on the right side of history. I have no doubts they'll do it again and worse.
Also my friend just brought up fake revenge porn, which leads to "evidence" of cheating to break up relationships, or maybe non-sexual content that becomes "evidence" that you should be written out of your parents' will, for example.
@@aliceh5289they did ? Genuinely curious