Inside The Scary World of K-Pop Deepfakes
ฝัง
- เผยแพร่เมื่อ 21 พ.ย. 2023
- K-POP Deepfakes are becoming extremely dangerous and they're sort of an epidemic. There must be something done to put a stop to them.
Instagram: bit.ly/3NWCjW1
Twitter: bit.ly/3NyjmJS
Facebook: bit.ly/3OhuslH
#kpop #kpopnews #KOOKIELIT - บันเทิง
so scary. these things can seriously ruin peoples careers.
Ik I saw this happened to a innocent 18 year old girl
It’s so fun hope no one stops it with this imaginary comes to life n people’s get traumatized 😂
fr, this can be a life destroyer
what are you yapping about@@newmoon6549
I made a post on Facebook on a fan community of NCT of how doing AI images of the members engaging in +18 or similar activities was entirely wrong and needed to stop and nctzens mocked me and said I was taking it very seriously and that it wasn’t that deep… like we are talking about real people. I can’t believe people don’t realize this.
Ew…I hope they know how disgusting they are.
Yes, it is sad. That is why I miss the old days so much when none of this existed yet. Life was more simple and there were more inconveniences, but was better overall.
Sorry to say this, but I have seen more image of other idols from other groups were being edited in a very disturbing contents too. That really got me speechless and I felt so sad for those idols. Seriously...
That's so disgusting! Although they didn't thank you for taking safety precautions,I'm doing it now.Thank you for spreading awareness instead of ignoring it.❤❤
Nctzens are literally biggest enemy of NCT(after sm) these nctzens think that sexualizing any member is fun....siriusly????and now this deep fake
I feel so bad for the idols, they're human too and this is so morally wrong and creepy
Recently I’ve seen a lot of Sehun in IG but in twitter it was Jeno, Jaehyun, and Jungkook
We should not only worry about the idols but also ourselves. AI is developing day by day, this is very scary... Precautions regarding AI should be taken worldwide!
It seems like this advance technology is two faces weapon. It makes things more convenient while also makes things scarier and more dangerous.
Basic people like u will always fear the unknown. Pathetic
When I wanted to generate Monsta X pictures for custom concept, the ai gave me kinda dirty pictures. Companies are banning idol or artists in general for now but idk for the future. Also they banned inappropriate words too. For now you can say which picture is AI generated because there are some deformed parts (it depends on the ai generator).
As of now, BING is the only AI image generator that can create normal content.
@@EclesysGalaxy Bing can also create dirty images if you know what to type.
@@kathlinedistribution886 I didn't need to know that X-X
@@EclesysGalaxy just saying... but they banned making people so its whatever now
Kpop idols are humans too they may feel uncomfortable..😢😢
Things like this make me want to never be a kpop idol
Thank you so much kookielit for addressing such topics and raise awareness about these topics.
Because I've been in KPOP fandoms since 2012/2013 till now and I've seen so many concerning behaviors i must confess I've been part of in a way or another. One by reading 18+ fanfics from Tumblr and then following shipping accounts (example: gdtop and jiko content. Although I never followed those who presented idols in question in compromising fan arts or manga style about their ship).
If you've been a fan of Kpop since last decade you'll know that the 'shipping' culture was so rampant in the mids 2010s. It was crazy. The same s*x ships were so delusional they even had esseys in YT "explaining" their delulu theories.
I'm not gonna mention the artist but the idol in question was sooooooo harassed by shippers, that even his dating life was exposed hacking constantly his private account to "prove" he wasn't dating any of his bandmates. It was total crazy.
I remember there was a GG back then too, where two members were shipped and those fan edits got so intense that even ruined their public friendship. I could go on and on.
Now we have a scary access to AI from fans who ship idols with wither bandmates or other groups'. And imagine the wild imagination of those shippers with access to AI...
I'm in a new fandom and I have tried to persuade people that shipping their bandmates should just be for fun and respectful and if you'll make 18+ content about your delulu ship, it should be private and respect their public image. I've gotten so much h*te.
Oh well.
I wish ppl just ship for fun and don't take those ships seriously to the point of being so delulu that you think idols are dating their bandmates for real.
One thing I love about BTS is that they didn't perpetuate the fanservice the 2nd gen idols did and now 4th gen idols don't do fan service at all. So 👏🙏 thx BTS for ending the toxic fan service culture on and off stage.
I could go on and on I have 10+ years of experiences 😅 but well, already write too much sorry kookielit.
By any chance can you tell me which artist it was who need to prove themselves that they are not dating any of their group member ....
Chanbaek(Baekhyun and Chanyeol from Exo) were a very popular same sex "ship" back in the earlier days of kpop and you could tell they knew about the fanfiction, artwork etc. of those two and they became much less physically affectionate in public..
@@yasminchan7425 i use to thought it was sehun and luhan ship
I see a lot of Al 18+ fanfics of Jk and V and they are very disgusting🤢
BTS ended the fanservice 😂😂 they created one of the biggest ship ever Takook. Do you really think that just fans ship them it’s the companies that pushes those ships to gain more fans and satisfy their fans. Bts gained a lot of fans just because of taekook. Idol just act along their companies agenda. Chanbaek also did a lot fanservice like taekook. After gaining fans and beeing famous they say they don’t want to be shipped. It’s always the same in every group they push those ships and then want fans to chill. Yeah there are a lot delulu fans too but you can’t just blame them.
Hold up!!!!! Now i know that writer Kim Soon-ok writes true stories about kdramas. This was in her current kdrama " 7escape " and the theme was about deep fake videos 😳😳😳😳😳😳😳😳
My qn is . Are idols not human beings both female and male?????
What do people gain after traumatising idols with deep fake videos because not everyone will be able to notice that it's fake???! Whoever gets arrested, either an adult or a minor, they should face the law
As much as we want this to stop, this is only gonna get even worse. Deepfakes go Beyond just Kpop and it already began a long time ago even before the pandemic was announced. With our continuous technological advancements coupled with the amount of adult content creators on the internet, This issue would only scale even higher in the future, not just in Kpop, in fact various streamers as well as government agencies have dealt with this kind of issue before, and unfortunately the chances of this being Permanently stopped is just as good as the chances of All adult websites to be deleted.
The people engaging with that content is a problem too.
Wonho has so many done of him.
😢😢😢
Equality yes😍
@@illtakeapotatochipandeatit390equality what 😊?
@@victorlarryesmenda2805 equality in a sense that if female idols get a whole bunch of deep fakes made of them it should happen to the males too if not more🤷🏻♂️
my heart literally dropped seeing my jeno on the thumbnail ;(
I remember when fandoms used to post deepfake images and videos of the Blackpink members, specifically Jennie back in 2018-2019 and some still do, truly disgusting I hope we see regulations and laws about this soon.
Not kim kardashian's crying face in 7:05 LOL
AI is dangerous to world if used inappropriately..
I just hope people will react to such things with brain rather sending hates to person which had done nothing
This is terrifying
this is quite alarming. I remember when people had to ask to photograph a person who is not a celeb. but now people snap photos of regular people like it is nothing, even is restrooms and hospitals. not a good trend at all.
Universe app is something that the companies signed them up for. Not saying that a company wouldnt think twice about pushing their idols too much but in the long run I doubt they would put them in a situation where they could be misconstrued and ruin their repetition like that. I had it for a while and hearing JinJin and the rest of Astro wish me a happy birthday made my day when I have very little to be happy about on that day with most of my family being passed away and very little friends.
This out of hand of 😢
The same act that can bring something to life can also destroy the same living thing.
Tbh I don't Like AI at all they are so scary and dangerous
I’m wondering what do all of you guys think about kpop companies making AI groups in the Kpop industry do you agree with it or don’t agree
I love some Jpop including Volcaloids I have watched MV of them but I would never buy albums or go to a concert because all you are seeing is someone clever programming, not a true artist even if they're voiced by real people and if I was assured that they would be getting most of the money then I might change my mind
Kpop is first and foremost a music industry and music should come first. Parasocial relationships, obsessions, stalkings and sexualization of real people is not an issue with a virtual group and it can be just about the music. It's a really good idea to bring to life some songs and show vocal talents of talented people, cool choreography moves, etc. without putting any real person in danger of public eye. It can be all or minimally fake, it's irrelevant if in the end what you hear in a car, on your way to work, during workout, etc. is a good song like MAVE "Pandora" that I heard and enjoyed way before learning that's an AI group.
It's not for people to like to obsess over other people and put music secondary, but that's another issue.
I think it's a good thing for talented people who can't debut as real idols due to issues such as physical appearance or anxiety, to be able to sing without revealing their identities and showing their faces.
I don't mind it since it's technically a good way for ppl who want to sing without revealing their face or private information. It also creates less problems such as scandals, s*xualisation, obsessions, etc. But if it's soon going to become so big that people who WANT to become a human kpop idol can't and get forced to being an AI idol, then I refuse. Basically, I think it's fine as long as we balance it well.
I have no worries. They cannot beat the exchange that real people have, someone who's human like you, someone you can really relate. Can they?
0:10 superkind catching strays lmaoooo
TXT was the first one I came across last year, then Enhypen. Then this month it's from Seventeen. Kinda creepy though 😨
And Riki is still underage 😢
It’s so scary how ai will soon take over the world like I wouldn’t doubt that in a couple years ai will even be doing our jobs
Universe app was terminated ages ago?
Who is the gorgeous guy in the thumbnail? Some AI generated fake nobody; or a real person?
He looks stunning.
It’s Jeno from NCT. The two pictures in the background are deepfakes, but the middle image with the eyes covered is an image of him.
@@tallgirl6527 thank you. He’s really handsome. Good for him.
I would say what disturbed me most, as least in regard to AI image generation, is how much attention/likes I have seen some of these images get on Twitter/X. There was one user I found in particular who generated NSFW images of Exo/BTS members, and they had over 12k followers on X! Most of their NSFW images were garnering upwards of 2-4k likes and over 200k views??? Thankfully I just checked today, and they have been banned.. but it is still very concerning. Especially when you consider how possible it is that it reached the idol the fake was of, or maybe someone they knew. Unfortunately, the sexualization of idols has gotten so out of hand, and AI art/deep fakes has become a very easy access point for exploitation and pleasing perverted fans sexual fantasies. I hope Kpop companies and social media companies begin taking action against this.
to me its the scariest side of ai, it could get much more advanced in a short time and not just kpop industry but the whole world should take cautions.
I saw Jeno and the title and I got so scared omg
I saw Jeno and i had to watch this vid
Same here, my heart dropped when I first saw it😭
wait tf isn't that Jeno in the thumbnail
This is a touchy subject. On the dark side of this issue, "yes".. ..creating fake celebrity media (pix, vids, audio, etc.) can, and often does, result in inappropriate content that is denigrating and damaging. The problem isn't just an issue for celebrities. Political figures are also worried that AI can create content that results in extreme instability and security risks between other nations. Clearly, there is an issue here. But the issue is not the AI, it's the individuals using it for inappropriate and/or underhanded purposes. AI is just a tool.
Before AI, the bridge to reality and the uncanny valley it crossed over resulted in content that was easy to spot. In the past couple of years, that bridge has shortened drastically and the valley is now very shallow. In a couple more years, there won't be any pause in your mind when viewing artificially created content. So what do we do? Do we "try" to put limitations and guard rails on the technology? I can tell you right now that won't work. AI is computer code. Whatever you try to do with the code, someone else will unto it; without exception.
Besides, is AI really the problem? Before AI, people used Photoshop to "Frankenstein" celebrity faces into adult content. Before that, people used paint, pencil, pastel and other tactile mediums to create fictitious content. Do we then try to put limitations in Photoshop? How could you? Do we ban the use of paint and pencils? None of that makes sense. The reason AI is an issue is "not" the AI, but the users of it.
I hate to point to a problem that has no solution, but how do you fix people? Technology, like the internet and social media, has opened up the world for individuals that were otherwise sheltered and cut off from society, but it is an illusion that is actually creating a separation between the user and others. People are emboldened by their anonymity while simultaneously feeling a greater sense of distance from others. Communication through technology is a pale substitute for actual face-to-face interactions. There is a "feature creep" that can build over time that emulates the psychological damage individuals experience from solitary confinement in prisons. It takes much longer for it to develop and is incredibly subtle, but it does occur. As a result, we are all drifting further apart as we interact with each other more through technology. People are broken; and broken things can and will cause damage.
In the end, this type of issue (the production of artificial media of actual people) is a problem, but the solution is not as simple as erasing a few lines of code from an application. Sorry; just trying to bring a little truth to the table.
/headbow
It's all about making money as s*x sells anywhere in the world. And whatever laws are brought in anywhere in the world, people will get around them as long as there's money to be made.
thumbnail is from where?
I hope it gets banned no matter how harmless some think it is. 👎
i am a law student and we have to write research paper thanks for this video inspire me to write my paper
Scary!!
I'm sure this happened to Seunghan and Soobin
I think it's ok for good purposes like that one backvelvet fancy face swap
And the fact is that, it's not going to stop anytime soon. It's not going to get better. I'm not being pessimistic that's just the fact. When they said women and even men needs not put themselves on display in SNS, they thought we are being archaic or old school (we Muslims that is), God that created us knows the type of creatures he's created and what they could do. Hence he has given us a guide on how to protect ourselves which is to be modest and not display ourselves on the internet. The world is sick honestly
There's a whole website dedicated to women K-pop idols deep fakes
but i think it's shutdown
btw i found to website locator that the server was from uk
i was going back and fourth with those haters under jennies comments and they sent me disgusting pic of her what shocked me is that they looked so so real but im glad they havent piblished them yet coz it will tarnish her image worse than it is now i was traumatized for dayz
Deep fakes are absolutely horrifying, I can’t imagine how traumatic it is to see your face imposed onto a image/video without your consent, especially of this nature. Also, just to correct your brief introduction into the subject; AI music and photos aren’t “technically harmless”. Both of them pose a real threat to creative jobs and they steal material without consent. You’re feeding it data and essentially giving it permission to steal in order to make AI products you want. You’re also fabricating an artist’s likeness or voice which is a breach of their humanity and that can very easily be exploited in the same way deepfakes are.
@@FIGHTFAN777 personally wouldn't care about what?
That on app or whatever it is where the fans can have their idol call them and rates their relationship or whatever it does is so wrong, these fans already have an unhealthy obsession with these idols and this is just feeding into it, these people are seriously ill, to really believe you are in any type of relationship with these idols that they go so far as stalking them, getting inside their building to hand them a marriage license with all your information on it, how dumb to think they won’t come after you, you gave them all your info. I wonder what the hell these parents know about what their kids do and how they feel about it. If I had a kid who did this, she would not be allowed to have anything of that idol, she’d be on a tight leash until she grew up and acted correctly, he is a human, an idol, he doesn’t probably even know who you are, and he for sure is not going to be anything other than an idol and you only a fan, no more than that
i thought that was jeno
it’s jeno in the thumbnail. it’s just an ai deepfake of him. the middle one is him though, it just has a censor bar
Women have no peace
2:07 He is peem, He is famous from the clip in TikTok Thailand. someone took his clip to be edited into v bts .
What are these K-pop idol deepfake websites so I can add them to my blocklist.
websites are hard to block but if you know lemme know
@@JSN_1997 if you find them let me know I want to avoid them so just give me the url so I can make sure I don’t go there by accident
I'm not afraid of AI, i'm afraid by the people who feed it
I’ve seen some of the deepfake porn she’s talking about, no joke it’s super serious. Kookielit says you can tell it’s fake for now, but there’s A LOT that genuinely look legit, they’re just thankfully lowkey. But the line is thinner than you think.
They should delete all of this deepfake nonsense, because it can cause harm to Kpop idols and can hurt their self-esteem. This can also drive them to self-harm. Take Goo Hara and Sulli for example, they both took their own lives due to the hate they got from the malicious haters.
❤
I see Jeno ,i clicked it!
AI seems to have forgotten that there are copyright laws and laws that protect artists and their image. It's illegal to take a picture/video of a celebrity and use it to advertise your business, but it's somehow ok to have their image and voice used for your app/platform, etc. It's illegal to use literary content to use for your paper or work and pass as your own, but AI sampling various works and passing it as their own it's ok. How come? The laws are clear, but because they say AI is using it, then the laws don't apply? Why? Is AI sentient? Or is it that a human being is using AI to make money and directing said AI on what to use and what to show as a final product?
Whos in the thumbnail?
I think Jeno from NCT dream.
I draw the line at AI Covers and cheap AI generated photos, the ones that have a deep shine and look really fake, they are easy to notice that they are fake.
Add to the fact that in general, Korean faces have low visual weight and not much pronounced features, so deepfakes can seem extremely realistic
IS THAT JENO????
This is disturbing
This is so scary considering the amount of minors in the industry nowadays....
These k pop companies should hold people accountable for this kind of content videos, and should place a fine on the people producing and posting these videos
Its better for us to do not use our phone this much… and watching seeing this kinda video will make you sick one day. You will never now if its fake or not. So the must to do thing is: follow the official pages of the idol… and do not click on everything like rumor, spend time outside look at the sky… watch original movies, and watch original contents.
Honestly, I don't know. Imposing a certain law can control deepfakes to some extend. But idiots being idiots will always find a way to get through the law. This is literally why you can't cancel someone or ruin someone's life morally of something you found on the internet. Though I completely agree that making deepfakes of minors should be a life-sentence.
No, perverts make these awful videos.
It's not too far when AI going to take over humans life and its so scary to even thing about it even they r using AI in idol voices and no one can believe that its deep fake but yeah this thing should need to stop but its All technology
As a computer science student, Ai actually can't dominate the world by itself. The only thing that matters is the way we use AI. So pls guys we are the one who should take the first step by using it in the correct way as it can be useful in many ways.
What about real people who doesn't have army of fans to protect them? For real person such fakes source of humiliation and life destruction. Teenagers already started bulling other kids with ai porn
ntg , just imagine yourself in place of those idols. how would u feel to have nasty videos of yourself ( which are surely fake ) posted on the internet without your concern? how would u feel if you know there are thousands having some pleasure watching your videos which only you know are fake ? think about it.
first
Ew disgusting, this is why parasocial relationship shouldn't exist!!
Ban AI and don’t post your children on the internet
Pffft Deepfakes are simply put just the same as difamation and should be addresses as such !
i know people can be gross🤢 but not twice cuz😟...😧not Mina...
Who cares? I watch AI videos featuring male kpop idols regularly and they're great. Yum
Most deepfakes are just from people being horny lol it’s not that deep
are u serious? these things can possibly end somebodys career. it's so clear how real ai can be, and can very much lead people to believe these things are real..
But it is that deep
So if it's of a minor is it also still not that deep?
@@JINXED2-pe2tcAnd the logic reaction would be prohibit debuting minors and if they still do, than the fans -who are so caring - should boycott them. There is not other way out.
Sorry for my english. English is not my first language
@@ecem.41 it's okay! Your English is fine! Sadly, it's hard to stop company from debuting minors.