ฝัง
- เผยแพร่เมื่อ 7 ก.ย. 2024
- And remember the Mannequin Challenge? Yep, they used that too.
Subscribe and turn on notifications 🔔 so you don't miss any videos: goo.gl/0bsAjO
The quest for computer vision requires lots of data - including real world images. But that can be hard to find, which has led researchers to look in some pretty creative places.
The above video shows how researchers used Tik Tok dances and the Mannequin Challenge to train AI. The quest is for “ground truth” - real world examples that can be used to train or grade an AI on its guesses. Tik Tok datasets provide this by showing lots of movement, clothing types, backgrounds, and people. That diversity is key to train a model that can handle the randomness of the real world.
The same thing happens with the Mannequin Challenge - all those people pretending to stand still gave researchers - and their models - more real world data to train with than they ever could have hoped for.
Watch the above video to learn more.
Further Reading:
Here’s the original project pages for each researcher in the video:
Tik Tok aided depth: www.yasamin.pa...
Mannequin Challenge: google.github....
Geofill and Reference-Based Inpainting: paperswithcode...
Virtual Correspondence: virtual-corres...
Densepose: densepose.org/
Make sure you never miss behind the scenes content in the Vox Video newsletter, sign up here: vox.com/video-n...
Vox is an explanatory newsroom on a mission to help everyone understand our weird, wonderful, complicated world, so that we can all help shape it. Part of that mission is keeping our work free. You can help us do that by making a gift: www.vox.com/con...
Watch our full video catalog: goo.gl/IZONyE
Follow Vox on TikTok: / voxdotcom
Check out our articles: www.vox.com/
Listen to our podcasts: www.vox.com/po...
This is the fourth of five videos Phil is doing on the ins, outs, and struggles of AI! Watch more of our robot revolution coverage by checking out our AI playlist here: th-cam.com/play/PLJ8cMiYb3G5ek1Ux66aJ_qWf6CfBaAkGG.html
Every time I watch this kind of videos about AI I can't avoid to wonder what gives them the right to use open internet data? (not the legal one as that depends of the rule: money vs people), how the military is gonna be using this who is financing this projects and what other ones behind scenes. Technology has been always used to do what it supposed to do but also to control societies/communities.
Does researchers and all the people involve in the creative and technical process even question themselves before just doing, what is gonna be used for, who will have the possibility of use it and how could affect society in general but also particular communities like workers, social classes, genders, etc. "If I don't do it someone else will" can't be the base of economic and technological research/advance.
Can you do a history of why Sudan is having a civil war
Sorry if I am not compatible with this hype, in the past ~25 years I have worked on dynamic knowledge management in information systems as a developer, architect, analyst, and a few years ago even as an academic researcher.
I so much want to see a world that can tell the difference between _learning_ and _adaptation_ - machine or human, does not matter. A world that realizes that LLM is AI only if that acronym resolves to Automated Ignorance. A world that finally calculates the carbon footprint of this global masquerade before moaning about resource crisis. Until then, we are just "Amusing Ourselves to Death", as Neill Postman predicted.
_PhD research on TikTok dance "AI"... epic._ 🤦
*struggles of Tiktok trying to be unbanned 😂😂
Forcing an AI to watch countless hours of TikTok is definitely how the robot uprising starts
💀
It will help with that!
Now we're closer to getting 99% accurately shot at by robot soldiers! ^u^
@@casper6014 I meant that global leaders are going to get some ideas, but that's also very true.
skynet is incoming
And now we cannot even blame them.
Using old Mannequin Challenge videos for training a depth prediction model is such a wildly clever idea! 🤯
The most genius thing for death
Art n science is brilliant
You have to wonder if the CIA or some academics are behind some viral 'challenges' or TikTok dances.
the most genius thing for the end of life as we know it 🤗
Thats why you use social media platforms free.
i really like how phil is so personable, it feels like he's casually having a conversation with just me.
a great presenter
A great orator and educator aye?
@@KobrokoHere brothel
And he's an absolute zaddy.
@@Becausing 🥵🎉
Check out his personal channel too. He has tons of great videos like this on a whole variety of topics.
That’s actually insanely cool. A bizarre social trend from years ago becomes the weirdly perfect dataset for these computer vision models. Those researchers literally couldn’t have asked for better
Plot twist, they were the ones who created the trend in the first place
@@cheesybirdmess7349 This is what I was thinking about. But in reverse: What trend should we start next to create another, even more amazing dataset?
@@cheesybirdmess7349 That actually may be true. AI development started in 2015
@@cheesybirdmess7349 It’s not a plot twist lol it’s the reality
I believe that the challenges are a way to collect data to train AI.
Not just TikTok,
People share photos from their childhood, teens and adult versions. No wonder how good those filters work 😂
Some challenges are just in line with AI data projects that I’ve rolled in.
do ppl do earn money on this and those who posted their photos dont even know? Or are you being asked for permision if your eg tic tok is being used for AI training?
@@hervva No, you're not.
@@hervva the terms & conditions my friend 😉 (no one reads them unfortunately)
TikTok is already suspected of using user data for Chinese surveillance, so I wouldn't be surprised to find out it's being used for other less wholesome predictive algorithms as well.
Phil's shower dance is 100% ground and life truth
Never thought I'd see a day when the mannequin challenge becomes useful.
Never thought Napoleon Bonaparte would see the day Mannequin Challenges come into existence period.
The whole point of tiktok has ways been AI. People fear China getting stronger than us, but you’re helping them every time you use that app. Great job.
New drinking game: Take a shot whenever you hear "ground truth" while watching this video.
Talk about data privacy though 😂
I was just wondering this, kinda scary
@bigfishh Its probably hidden in Terms of Services . Pretty sure 99.99% of people just click agree on it and unknowingly give their data.
Though the methodology is fascinating, the actual question is what will this research be applied on? I can imagine predictive vigilance and ever-expanding tracking and warfare capabilities. It'd also be nice to know who has funded all of these researches.
Lol it’s not that deep, this is mostly object extraction. A lot of new phones have that feature where you can grab the silhouette of things out of pictures and it uses similar CV techniques. Or this can may be used for image segmentation and helps AIs understand what objects are in pictures and how they relate to each other spacially
"the actual question is what will this research be applied on?" The better question is what *won't* it be applied on, it will help in alot of things from consumer things like VR to important things like 3d medical scans, to forensics, etc. These research are made to benefit as much technologies and occupations as possible.
@@casperguo7177 Oh buddy, are you familiar with Clearview AI? I got some bad news for you...
🐻🍯
TikTok funds itself and we know exactly what they'll apply it towards: making their app more addictive and their ads more profitable.
Everything is a training set. You use to be an advertising target, now you are a training set.
or both
😂
Bingo.
Imagine if your entire purpose in life was to watch tiktok dance videos endlessly.
When the robot uprising happens I bet this one will be extra cruel in return for what we made it do 😂
in my opinion it's better to watch something different than something the same over and over again
@@clydencee just trained a model for half a year CPU time last week and it looked each of 5,000 photos over about 100 times. So yes, I concur
As people have pointed out in the comments: we don't have to accept that our personal data, our images and videos can be used by anyone for any purpose. Doing research is great In many countries it is allowed to use most data for that purpose. The problem begins when said research is sponsored by a for profit company and is used by them for generating profit. That's a loophole and it's been abused for the last years.
AI image generators like Stable Diffusion, Midjourney and the others have abused this loophole to create their product that's been developed on the data they have no rights to.
No matter how cool the technology is, we have to protect our rights!
They are also entitled to the right to panorama.
Personal images made public like a person's medical information or home are a real privacy concern, but I hope you don't think every online artwork and doodle great or small should be immune to future projects like these!
@@kmjgsdkmjgsd Every piece of information in the form of text, image, or audio we post should not be used without vocal consent, period. It doesn't matter whether it's something important or silly. We can't pick and choose where we decide to apply the laws, and where a company can wave them away in the name of progress.
@@septiquaddoubleyou4019 what is the right to panorama?
I never downloaded tiktok way back when it was being advertised a ton on Snapchat because my assumption was that it was the “dance” app was going to be used to aid AI in understanding body movement for the Chinese government to further improve their I.D. tools on an individual’s gait and other identifiers. This just further reinforces that the original purpose was not a fun dance app.
all social media companies sell data to the government & other companies, so facebook, instagram, youtube, and tiktok are all equal “threats” regardless of the country of origin.
It's scary to think that AI companies can use data like this even if it's to train an AI. I guess it's the same way with how image generators like Bluewillow was trained with a few differences.
If it's free, then you are the product
More like the customer, you just don’t realize it yet
I mean even paying customer are products cuz they contribute to the overall statistics and data that can be used in mass social engineering.
In this capitalistic techno hellscape, everything is product 😅
I'm loving these AI-themed videos from Phil!
ikr, Its fascinating but also scary at times.
Don’t most people post things online to communicate with friends or have fun? When did we sign up for collecting data and training machines?
It's a free service so they collect data to sell once we accept their ToS.
Soon as you click “Accept” Terms and Conditions 😂 Should’ve read it before clicking it
when you agreed to the TOS
Have you heard about facebook?
You didn't. You signed up to enable them using anything you post on there. That's true for Facebook etc. There was a case where a picture posted by somebody on facebook was used as an ad.
Imagine if this video was AI generated and it turned out Vox was never real to begin with
That would be very scary bro 😭
Yes
Can you make a video about the rollout of digital IDs in some African states and how it threatens a variety of human rights?
EVERYTHING ABOUT THIS HEADLINE MAKES ME WANNA BAN ALL OF IT GHAAAAAA
From learn, to exploring how to, i love how the tech esp AI is rapidly growth
when your dancing could be training a military drone to detect targets
I appreciate you guys showing the titles of the papers you’re citing, other channels could learn from this!
*Not Vox desperately trying to find something positive about tiktok* 💀
Never thought Mannequin Challenge can use on it!
لقد تاب اللّٰـهُ علىٰ من هو أغلظ منك جُرمًا، وأشدُّ منك ذنبًا
فلا تقنط من رحمة اللّٰـه.❤
"The machines - they are learning but for now, we are still the teachers..." Cue dramatic dystopian music.
3:25 hey I thought that was my secret dance
Never would have expected that tik toks can be considered a valid source of any sort of truth 😂
Is beautiful when art meets science
Until it kills art.
This will be great for diagnostics
But also for surveilance
This makes the mannequin challenge even more fun than I realized!
I don't even like tiktok or dances, challenges but this is wild. Also, great video guys 🎉
For an art project, I used an AI that was trained to estimate the 3d depth estimation of a scene.
Guess what is is trained on: 👇
Well, many datasets but mainly:
Street scenes from car cameras.
There's enough material to make an AI guess what the next frame "moving forward" looks like (=what is closer and further away) and then check how accurate it was.
@Zaydan Alfariz 💀💀💀Nvidia stole her work
It'd be nice if we could all agree that the term "AI" will be applicable once they can teach themselves. In the meantime, "ML" for "machine learning" is the same number of letters.
AI is more broad than ML tho. AI has historically been referred to a large range of decision making algorithms
ML is a subset of AI
You must not know what either means
TRANSFORMING A 2D ENVIRONMENT INTO 3D ONE LIKE ENTERING A PHOTO?! INTERESTING OwO
Social media had real benefit for a change instead of being used to show off, brag, rant, or troll.
TikTok for moving people and still backgrounds. MC for moving backgrounds and still people. You could ask for a better unexpected data set.
That poor researcher had to suffer huge amounts of IQ loses while she was gathering data at the universe's deepest abyss, Tiktok
Chinese gov: This is good, this is really good. I'll take it from here, TikTok. Thanks!
I'm not understanding the end goal with AI. What are we trying to do here?
it's a large datasets of how humans move in 3D space. In war, Chinese robots will be able to distinguish humans thanks to having seen millions of humans from different races and heights dancing (moving)
We should change the world calendar to BC (Before Covid) or BT (Before TikTok) 😔
Authoritarian regimes will love this! ^_^
Learn to see us… and imitate us. I guess I’m worried about what that will
Mean ultimately.
Hmmmm- the mannequin challenge- how convenient- Stop getting played everyone-wake up while we are still the teachers 😉
It's really cool to see my current research direction summarized in a video. :D
we should all be compensated for being data sets to proprietary software...at the very least.
Why, when millions of people will just do it for free?
Essential predictive models for training killer micro-drones/nanobots to find earholes and nostrils
I only came up with 2 solutions. The easiest is game engines. Instead of creating a functional game you only have to create a realistic setting using 8k textures for object permanence recognition. The harder method is to build a body for A.I., it doesn't need to be a human body but something that can move and pick up objects. With proximity sensors, cameras, lidar, gyroscopes, pressure sensors, and a weight scale the a.i robot will be able to move around an apple, pick one up and know it's size weight speed distance hardness etc... and be able to use all it's robot senses to try and identify an object instead of just pictures. The benefit of doing this is that a robot would be able to gather its own data set in real time using the real world as reference.
Funny to think that we are watching some of the last non artificially generated images on the internet
2023 is really the big shift
"Crying in the shower"-dance is the best misunderstanding of how Tiktok works yet.
I can't imagine the time it consumes to train the model: I am training a model to predict emotions in reviews and it takes a lot of time of computing
One day machine will: I am the teacher now.
I was enjoying this video right up to the point where you shown James Corden
This would make such a good conspiracy theory
Love Phil Edwards! This guy is born to teach
WHERE IS THE OUTCOME! WHAT DID IT GENERATE?
and this is how skynet started in the terminator
2:12 "AI can learn how people work..." In my time people were used to learn how machines wored instead
And now that computer ended up getting cancer. An impossibility? Not anymore.
The graphics are pretty, but the moving noise completely ruins the image with the low bitrate. Consider changing that in future videos.
What is the moving noise?
You sure it's not the aesthetic?
@@thepinoz The graphics from 1:02, background has moving noise which is a part of an aesthetic that usually visually emulates screenprinting technique, but is totally inappropriate for use in video.
The fact this video completely ignores the underlying fact institutions are using videos of people who did not consent to being fed into a database is pretty grim. Aren't universities supposed to care about anonymity and consent in their research? Jeez
I agree with you, but I’m pretty sure everyone on TikTok agreed somewhere to waive their rights to videos they post on their platform
TikTok videos are public domain
"Aren't universities supposed to care about anonymity and consent in their research?"
do you know their identities?
They actually did and it is on every social media when you create your account and click I agree.
What happens once an AI can make its own flash cards?
They didn’t “use” the mannequin challenge, they created the mannequin challenge.
who is they?
@@itseveryday8600 big pharma
@@itseveryday8600 the lizard people
The "wait for it" training the AI.
Interesting how just when a new AI learning requirement appears, a new security check or TicTok challenge appears. First, proving you were not a computer by identifying barely readable text turned out to be instigated to also teach an AI to correctly transcribe scanned text. Next, proving you were not a computer involved identifying which cells in an image contained a select object, turned out to be Google's AI being trained to recognise objects better in Street View scans. Now, AI needs better flash cards to recognise people and render them properly. Will this be for AI police, government remote identification, or to completely put people out of work by fooling people they are actually talking to a real live human being online? Sometimes, it must make you think, are we already being manipulated by AI to train it better?
Datasets are really important for AIs that utilize machine learning such as Bluewillow AI or other models. Otherwise, responses come out fuzzy.
The next evolution of AI really needs to be built with a layer of 3D modeling. Blending the intersection of what is known from 2d planes of existing models with an understanding of how those planes map into 3d spaces would be a massive leap forward…not just with people, but essentially any object.
It’s already being done.
The next step is the machine will want to know what makes us move. What's on the inside under our skin. If you peel back the tendon and muscle how do the bones work. Does the leg and arm still move when it is detached? How about the head it seems useless. Grind up human for ground truth!
That’s not how it works at all
Imagine the comments if this video happened to be shown on Xinhua news instead of Vox.
It's SkyNet I tell ya. It's gathering data to finally launch a global attack against mankind *puts tin foils hat on
Wonder how that one program that can fly though environments from just a handful of pictures factors into this
But why are they doing this research? What is it solving? It’s always look at this cool thing being made and not why is this thing being made.
why is there an empty glass in the shot!? I kept waiting for it to be a part of the video.
This kind of technology will make it possible to build 3d game worlds from real video and photo. The next Google Street View could be a 3d game environment (using all the images and videos available). Imagine fusing Google Immersive View, MS Flight simulator and GTA...
4:57 Holy shi that's impressive!
AI for Science Engineering ...STOP STUDYING US
i'm sure they compensated each of the tiktokers for their contribution😂😂😂
Probably improving Chinese CCTV technology as well
Here's my guess as to why tiktok dances would be a good data set, It has a huge library of people with different physicalities all dancing in similar ways; but with a wide amount of variables, however when people dance for tiktok they have to stay within the vertical rectangle of the phone camera which cuts off a lot of the background if they want to be seen dancing well.... just a guess?
Seems fun but there’s a TON of use cases for body positioning from a film , without complex 3d cams.
Nice ending, We can still have faith in humanity (?)
0:49 she obviously tired. Look at her eyebags
2:10 - that looks like the Samsung HoloLAB rig.
The man just declared the entire section of unsupervised learning useless in a video about tik tok😂
I love these videos and have binged Vox a lot recently, however I have a view as to a next video closely in relation to this as it does need more awareness. A title with a similar video to this just different target script being "How our data on TikTok is being stolen for AI". Now I know people likely agree in the ToS but most people don't read it and aren't aware that our data is being used in something like that, worse if it is text based. Again, not disliking the video, I love it but another video would be about our data getting used for AI without most people know thats whats going on
This is why I think the conversation around AI using artists' and musicians' work to train the data sets is so important to set a precedent. Because it's not just going to affect us creative people and our careers. It's way bigger than that. Everything that we've posted online for the last 30 years could potentially be used in ways we never imagined when we uploaded stuff. It needs to be regulated to serve all of humanity.
Especially since a lot of tiktok videos are made by children
Great Vid! Completely unrelated but hoping you'll answer, what watch are you wearing in the video? Looks like a casio but curious about the model and the strap. I really like it 👌
I love this guy, he gives Jhonny Harris vibes ngl
Errr... they were coworkers.
But doesn't the mannequin challenge generate a lot of inaccuracy? Even slight movements will compromise the precision. And I believe using scenes from tv shows like friends that may have an even worse effect, since sometimes the shot and reverse shots are not filmed simultaneously and can have major differences.
"Even slight movements will compromise the precision." why would it need that much precision?
0:44 the lady herself looks AI generated. very uncanny.
I made a Tick Tock, called I cried in the shower this morning.
Oo oooh… law suits coming up by Tick Tock.
also good training data for the chinese government to look for humanoid objects, which they already do
This makes complete sense. China is one of if not the leader on AI.
Even though it’s cool, fb algorithm it’s what trained face recognition hardware….
Suprised that the experts didnt jump out the window watching that many tik tok dances....the horror
So we would not be able to stand still to hide from terminator thank you TikTokers!
Stealing personal information without consent. If the video was meant for an innocent dance, it shouldn’t be used for alternative purposes to invade privacy or steal data.