It's so sad, man. I remember the few rare times I knew I was dreaming, but I slowly felt myself waking up and started to feel myself shift on the bed instead of moving in the dream.
I specifically appreciate how they're trying to be descriptive, but since it's like reality soup that generates based on the palette of the image, the best they can do is stuff like "We need this orange" "Lets try to see what we can do with the floor" "Hold onto this red" "They're trying to take away the nether from me"
More like trying to control a semi-lucid dream. Once it's lucid it's pretty easy, but when you're in that weird state where you aren't quite sure if you're dreaming and haven't stabilized it, then shit gets weird.
So, AI Minecraft speedrun revolves around finding colours/patterns that look like required resources/places, rather than actually finding these places/resources. It's so absurd yet so interesting.
@@LucasFerreira-fp4nj I meant playing it like Minecraft (mining, crafting, looting, farming) is useless because when you do a 360 flip everything is replaced. Like at the very least other AI generative stuff you could maybe see as a (worse, poorer quality) version of the 'real thing', but this is more 'the backrooms' than it is 'minecraft'
@@adventofnullIt's also in its infancy, and is already amazing if you understand how it works. I'm baffled at how they managed to make it this coherent. It really should be even worse than this. Technology is getting crazy.
I feel like if the AI was a little less sloppy and had a slightly longer memory, it could actually be amazing. Of course, it won't be actual Minecraft and probably never can be, but the idea of having to find red blocks to convert to lava to get to the nether is really interesting. As it is, it's too random to actually be enjoyable for more than a one-off gimmick, though. If the AI could remember, like, a couple hundred frames in the past, then it might be cool. It'd still allow for converting your surrondings based on blocks; you'd just need to stare at the blocks for a bit longer. A couple hundred frames, or however long the AI memory is.
@@kalahatze One solution I’d propose is a scenario-detection model that changes the dataset depending on certain recognized images, I.E. nether portal/end portal blocks. From that moment forward, the AI model switches from its overworld training to strictly Nether/End gameplay, preventing an accidental return from looking at the wrong color. Granted, implementing segmented diffusion defeats the purpose of this being purely a tech demo. But if you wanted to turn this into a game, that would be the next step. Signed, armchair programmer.
@HoodedSpidey You don't need segmented diffusion. This creates images frame by frame, at least as far as my understanding goes. Just switch to a different AI after a certain frame is complete. Use some kind of grounding dino model to recognize a nether portal, then for the next frame, you can change the AI or something. It actually seems fairly easy to do, although I'm not quite sure exactly how this works in detail. Edit: Actually, you don't even need a new dataset. Just use a LoRA.
@@kalahatze My main concern about just using a LoRA is that there may not be enough footage in the nether, and I worry about how it’ll affect the “rules” of Minecraft (it’s broken enough as is.) I do agree that we *probably* don’t need an entirely new dataset, however there should definitely be more footage to supplement things like portal ignition, traversing fortresses, gravitational acceleration, and mob behavior. Admittedly I didn’t even know about DINO models until now, It’s really cool to learn that most of the tech exists already & that it’d be simpler than I imagined. Thank you for being willing to talking to me despite my limited knowledge. I’ll be doing more research on all of this.
This is such an interesting concept, the game is trying to gaslight them and they are trying to gaslight the game back, it's like a boss fight against the entire world
Wild. Almost seems like they trained it on a lot of simpler short videos, and only a few contained nether, so while it knows what nether looks like, it wants to maintain the overworld look instead.
I mean while most content is in the overworld that doesnt really change the fact that not enough nether footage means the ai cant simulate anything BUT the overworld too well
I tried playing this the other day and seriously all day I was going around feeling like everything was shifting around me and nothing was real. Real-life cognitohazard.
It most likely did not have enough training footage for the nether, so it did not understand the difference well enough and that's why it was trying to take the nether away
In this demo I suppose, they used footage with keys clicked at exact time as training data. They had to use nether footage, because this algorithm wouldn't be generating those images without it. It was most probably less frequent in dataset, therefore occured the effect of nether vanishing.
You and your friend's commentary is absolutely immaculate. The way you call out things like it's some kind of official speedrunning terminology is too good. "It's reddening!" "Orangification." "THEY'RE TRYING TO TAKE IT AWAY" "They can't take this away from me" "It's starting to turn to dirt.." You should do something fun, like crazy BS modpack reviews or such, like those terrible Minecraft horror mods. Something fun just reviewing absurd Minecraft things
This feels EXACTLY like how you try to keep a dream from changing to something else, the most tripping thing about minecraft ai is that it's the closest thing we have to actual dreams
Comparing it to reconstructed dreams it's pretty accurate. Our brain does the exact same thing just like data moshing....You think of a lamp post for a few seconds but now you move and you're next to a wall, not a lamp post. also PilotRedSun's "Not so fast" is so incredibly dreamlike it's scary. I don't know how he created them so accurately
What did this player dream? This player dreamed of sunlight and trees. Of fire and water. It dreamed it created. And it dreamed it destroyed. It dreamed it hunted, and was hunted. It dreamed of shelter. - Minecraft end credits
trying to grab a glass of water off your nightstand half awake with a fever but then you realize your mom took the cup away and you're actually grasping at air
Holy fucking shit, I ain’t ever seen anything like this. AI generated videos felt weird themselves, now we can play an real-time AI generating game? This is actually fascinating.
My eyes have never hurt so much, but its crazy to think its at all possible to fuck with the AI and force it to not only create the Nether but potentially the End with the right conditions
Do you though? It’s just that it goes off of fed data. A lot of the times it was fed lava was likely pictures in the nether. It just assumes what should be there based off of the conditions of whatever it was trained on.
this has to be one of my favorite demonstrations of AI right now. Tricking the AI into thinking you're in a certain biome/Dimension by looking at the right blocks is such an interesting skill
The AI constantly guessing where the speedrunners are, while the Speedrunners themselves are trying to guess what the AI will interpret is absolutely funny
This is just the trippiest thing ever! The way things appear and dissapear out of nowhere, the way you end up in a completely different place when you look away, the way when you trying to enter a house, but instead enter a realm of wooden blocks is just MIND BREAKING!
It’s interesting because this AI has been trained on millions of videos, but only of mainly the first 5 minutes of Minecraft gameplay. So I doubt many had videos of getting to the nether or the end explaining the AI essentially panicking trying to bring him back to the overworld
ai is supposed to be studying us, now it's the other way around lmao also those magma blocks getting thanos-snapped out of your screen is just too funny
Wow this is incredible tech. Imagine in the future you will be able to have unique game experiences based on your play style with artificial intelligence changing the game do your gameplay.
One of the sad things of how "AI" like this one works is that it doesn't really learn anymore after being deployed/published. It's like crystallized intelligence. The forms of AI that can continously learn are more expensive to run and may require dedicated brain-like circuit chips to be feasible. All of the above is just the vague impression I have gathered so far about "AI", I'm no expert.
Ever since this got popular I’ve been waiting to see someone just spin around and look up and down to keep generating new landscapes until something cool happens. That would be the first thing I would do in this game
i love how you got diamond tools when you got the stronghold. it is 100% likely that most of the stronghold data used to train the plays had diamond tools.
Holding onto the nether sounds like holding onto a dream when you know you're about to wake up.
It's so sad, man.
I remember the few rare times I knew I was dreaming, but I slowly felt myself waking up and started to feel myself shift on the bed instead of moving in the dream.
2hu
Saw this listening to Wake Up by Travis
“I DONT WANNA WAKE UP” 🗣️🔥🔥
holy shit thats so accurate.
HAKUREI REIMU??? 😰😰😰
Guys the CEO of racism is here
After decades of progress we finally got an unplayable version of Minecraft.
bedrock is pretty unplayable
@@DivineLight661 your face is unplayable
@@davebob4973my balls are
@DivineLight661 ur feet is unplayable
So bedrock edition
I specifically appreciate how they're trying to be descriptive, but since it's like reality soup that generates based on the palette of the image, the best they can do is stuff like
"We need this orange"
"Lets try to see what we can do with the floor"
"Hold onto this red"
"They're trying to take away the nether from me"
I have not yet heard a better descriptor for this than “Reality soup”. 😂
Reality soup as simulated by linear algebra soup
3:01
*Task completed:* "Get into the Nether"
*Current task:* "Stay in the Nether no matter what"
"95% of people cannot achieve that"
i love this shit lol, its like trying to control a lucid dream
more like trying to control a verifiably non-lucid dream
More like trying to control a semi-lucid dream. Once it's lucid it's pretty easy, but when you're in that weird state where you aren't quite sure if you're dreaming and haven't stabilized it, then shit gets weird.
Yeah fr@@famlrnamemssng
It's more like trying to control someone else's dream
Superliminal if it were a real dream
So, AI Minecraft speedrun revolves around finding colours/patterns that look like required resources/places, rather than actually finding these places/resources. It's so absurd yet so interesting.
It hallucinates things not only into existence but out of it, so trying to experience the AI like an actual 'game' is an effort in futility.
@@adventofnull what futility? This itself is already hella fun lmao
@@LucasFerreira-fp4nj I meant playing it like Minecraft (mining, crafting, looting, farming) is useless because when you do a 360 flip everything is replaced. Like at the very least other AI generative stuff you could maybe see as a (worse, poorer quality) version of the 'real thing', but this is more 'the backrooms' than it is 'minecraft'
@@adventofnullIt's also in its infancy, and is already amazing if you understand how it works. I'm baffled at how they managed to make it this coherent. It really should be even worse than this. Technology is getting crazy.
@@adventofnull it needs to have enough nodes to render full 360° of the game and then it zooms in to produce the view
i love the references to the ethereal "they", as if there are little men inside the computer making the image shift
"they" want you to think that "they" aren't real
Bro fighting his own dementia 💀
The woke left is trying to take away our nether
It's obviously the Machine Spirit
@@Subird The machine spirit on this case being, ironically, non-binary
this is actually so cool, having to try to trick the game into generating what you want is so fun
I feel like if the AI was a little less sloppy and had a slightly longer memory, it could actually be amazing. Of course, it won't be actual Minecraft and probably never can be, but the idea of having to find red blocks to convert to lava to get to the nether is really interesting. As it is, it's too random to actually be enjoyable for more than a one-off gimmick, though. If the AI could remember, like, a couple hundred frames in the past, then it might be cool. It'd still allow for converting your surrondings based on blocks; you'd just need to stare at the blocks for a bit longer. A couple hundred frames, or however long the AI memory is.
*gaslight the game into thinking😂
@@kalahatze One solution I’d propose is a scenario-detection model that changes the dataset depending on certain recognized images, I.E. nether portal/end portal blocks.
From that moment forward, the AI model switches from its overworld training to strictly Nether/End gameplay, preventing an accidental return from looking at the wrong color. Granted, implementing segmented diffusion defeats the purpose of this being purely a tech demo. But if you wanted to turn this into a game, that would be the next step.
Signed, armchair programmer.
@HoodedSpidey You don't need segmented diffusion. This creates images frame by frame, at least as far as my understanding goes. Just switch to a different AI after a certain frame is complete. Use some kind of grounding dino model to recognize a nether portal, then for the next frame, you can change the AI or something. It actually seems fairly easy to do, although I'm not quite sure exactly how this works in detail.
Edit: Actually, you don't even need a new dataset. Just use a LoRA.
@@kalahatze My main concern about just using a LoRA is that there may not be enough footage in the nether, and I worry about how it’ll affect the “rules” of Minecraft (it’s broken enough as is.) I do agree that we *probably* don’t need an entirely new dataset, however there should definitely be more footage to supplement things like portal ignition, traversing fortresses, gravitational acceleration, and mob behavior.
Admittedly I didn’t even know about DINO models until now, It’s really cool to learn that most of the tech exists already & that it’d be simpler than I imagined. Thank you for being willing to talking to me despite my limited knowledge. I’ll be doing more research on all of this.
Don't let them take it from you. You worked hard for that nether.
*neither
@@DoctorAlrightwhat
@@DoctorAlright what
@@DoctorAlrightwhat
3:37 That carrot casually turning into a yellow bed
Metamorphosis
@@SchadenfreudeUY I can do anything! Ueheheh!
This is such an interesting concept, the game is trying to gaslight them and they are trying to gaslight the game back, it's like a boss fight against the entire world
Definitely not gaslighting lmao 🤣
@@xlretardstop gaslighting
They’re trying to take away our nether, we need to stop this
Make the nether great again
We are now unburdened by what has been
We need to build a wall and make the piglins pay for it
They're eating the ocelots
Wild. Almost seems like they trained it on a lot of simpler short videos, and only a few contained nether, so while it knows what nether looks like, it wants to maintain the overworld look instead.
Your intuition is actually 100% true
Nah it's definitely because most of Minecraft content and gameplay is in the overworld
I mean while most content is in the overworld that doesnt really change the fact that not enough nether footage means the ai cant simulate anything BUT the overworld too well
I’d guess that virtually all Minecraft content is overwold since most smps and guides are mostly there
This is like an SCP entry about containing a cognitohazard
The nether is an antimeme
Genuinely yeah this seems like an unimaginable dimension the scp foundation would contain or something
@@WanderTheNomad there is no antimemetic division, there is no antimemetic division, there is a body in that water, there is no antimemetic division.
I tried playing this the other day and seriously all day I was going around feeling like everything was shifting around me and nothing was real. Real-life cognitohazard.
It is like telling a dementia patient to remember a specific memory they had (not that I have any experience with that).
gaslighting speedrun
Of course you hadn't, you didn't remember it
Beating Minecraft With Dementia
Is it even Possible?
Dementia craft
I love the whole
0:30 these are vines
0:33 nevermind they're magma blocks congrats
0:39 what blocks
It looks like it interpreted the magma texture as the block break particles, so they just exploded.
2 Magma blocks: *Mr.* *Stark* *I* *don't* *feel* *so* *good.*
0:33 geologists when an eruption occurs
Duh
LMAOOOOO
Me and my imaginary friend trying to beat minecraft in a lucid dream
Minecraft manifestation speedrun
“lock in”
*manifests harder*
It most likely did not have enough training footage for the nether, so it did not understand the difference well enough and that's why it was trying to take the nether away
In this demo I suppose, they used footage with keys clicked at exact time as training data. They had to use nether footage, because this algorithm wouldn't be generating those images without it. It was most probably less frequent in dataset, therefore occured the effect of nether vanishing.
You and your friend's commentary is absolutely immaculate. The way you call out things like it's some kind of official speedrunning terminology is too good.
"It's reddening!"
"Orangification."
"THEY'RE TRYING TO TAKE IT AWAY"
"They can't take this away from me"
"It's starting to turn to dirt.."
You should do something fun, like crazy BS modpack reviews or such, like those terrible Minecraft horror mods. Something fun just reviewing absurd Minecraft things
for real, im in hysterics 😭 Orangification especially
Ok, that's the best use of ai: dream games. Like, make it a little less erratic, optimise it, remove the time limit and it's just gonna be so much fun
FRRRR
omg such an amazing idea
screw AI art. embrace near unplayable non euclidian versions of well known videogames
@@GoroAkechi_Real Catacombs of Solaris my beloved
@@GoroAkechi_Real i misread your comment but still. also infinite pizza
How speedruning minecraft on good zaza feels like :
Your zaza got laced with dmt bro
"Are you sure you want all of them? it's gonna make you very very high"
"Yes, all of them."
"See? this zaza ain't shi-"
5:45 there was a stronghold to the left
i was going to say that
This video feels revolutionary in terms of what's possible with this "game"
This AI really is amazing. You've really shown how to manipulate it to get to different areas of the game. Amazing video
"i think I'll be ok with this amount of acid, i won't lose control of my mind or anything"
My mind 1 hour in:
This feels EXACTLY like how you try to keep a dream from changing to something else, the most tripping thing about minecraft ai is that it's the closest thing we have to actual dreams
Comparing it to reconstructed dreams it's pretty accurate. Our brain does the exact same thing just like data moshing....You think of a lamp post for a few seconds but now you move and you're next to a wall, not a lamp post. also PilotRedSun's "Not so fast" is so incredibly dreamlike it's scary. I don't know how he created them so accurately
getting enchanted diamond tools is crazy
What did this player dream?
This player dreamed of sunlight and trees. Of fire and water. It dreamed it created. And it dreamed it destroyed. It dreamed it hunted, and was hunted. It dreamed of shelter.
- Minecraft end credits
It dreamed of feeling like being on drugs while playing minecraft.
Someone make a mod where you can play ai generated minecraft while you sleep
I love how the whole speed run is just tricking the AI into giving them what they want
I'm convinced the guy talking in the background is just schizophrenia
I think having good items (enchanted tools, etc) triggers more endgame stuff, like the fortress and the end
"ah we got some magma, we can use this we can use this-" *magma dematerializes* "AH D:"
trying to grab a glass of water off your nightstand half awake with a fever but then you realize your mom took the cup away and you're actually grasping at air
Holy fucking shit, I ain’t ever seen anything like this. AI generated videos felt weird themselves, now we can play an real-time AI generating game? This is actually fascinating.
My eyes have never hurt so much, but its crazy to think its at all possible to fuck with the AI and force it to not only create the Nether but potentially the End with the right conditions
2:10 You would have to really understand how AI sees the world to achieve this.
Do you though? It’s just that it goes off of fed data. A lot of the times it was fed lava was likely pictures in the nether. It just assumes what should be there based off of the conditions of whatever it was trained on.
@@cancerousnut7767 turns into orange
this is what chasing that drugged out sleep trip was like
4:21 You guys almost made it to the end if you had just kept up with the obsidian pillars and the purple.
This is actually absurd lmaooo
This perfect encapsulated the feeling of trying to cling to the memories of a dream as I wake slowly and try and finish the dream
This is like playing non-euclidian Minecraft while being on 10 different psychedelics.
This is how i am when i am in the middle of a good dream and keep waking up
Time traveller: *Moves a chair*
The timeline:
this has to be one of my favorite demonstrations of AI right now. Tricking the AI into thinking you're in a certain biome/Dimension by looking at the right blocks is such an interesting skill
Accurate portrayal of me learning how to control my lucid dreams for the first time
I love how they say "dont let THEM take it away!" as if it were a conscious person plotting against them
lucid dream speedrun
The ai seems to be trained on mostly overworld footage,hence why when you go to the nether it just turns into overworld so quickly,same with the end
The AI constantly guessing where the speedrunners are, while the Speedrunners themselves are trying to guess what the AI will interpret is absolutely funny
It’s like a game with no internal memory. It’s just generating everything in real time and culling it once it’s no longer on screen
this feels like a dreamscape i fw it heavily
The way you look into lava and wait until it becomes nether feels like a lucid dream
This feels like a psychic prediticing your minecraft speedrun
it's crazy that you're playing minecraft without any of the original code, nor a functional physics engine. it's just pictures
Nice, never thought of doing a Speedrun using AI generated image game? idk how you call it
This is just the trippiest thing ever! The way things appear and dissapear out of nowhere, the way you end up in a completely different place when you look away, the way when you trying to enter a house, but instead enter a realm of wooden blocks is just MIND BREAKING!
I’ve been periodically getting sicker throughout the day. I have a feeling my dreams tonight are going to mirror this…
It’s interesting because this AI has been trained on millions of videos, but only of mainly the first 5 minutes of Minecraft gameplay.
So I doubt many had videos of getting to the nether or the end explaining the AI essentially panicking trying to bring him back to the overworld
I love the shorthand you've developed for the wacky behavior
Best AI minecraft content so far. You were able to exercise some sort of control over this thing!
This was like watching a recording of a dream about minecraft.
This is like trying to cling to a dream instead of waking up
I love the dude's friend in the background 😭
*NOW YOU’RE PLAYING WITH AI.*
I’m so glad another YTer is using the short context span to its advantage.
This is like realizing your lucid in a dream and trying to make it go your way before waking up.
Isso é tão absurdo, ele tem um limite de tempo pra continuar jogando e é tudo carregado aleatoriamente em tempo real, lenda 👊🔥
*looks at like 6 warp blocks* OH MY GOSH THIS IS NETHER THIS IS NETHER THIS IS NETHER
the ais lack of object permanence makes it so much better lol
The magma blocks disappearing was insane
ai is supposed to be studying us, now it's the other way around lmao
also those magma blocks getting thanos-snapped out of your screen is just too funny
Wow this is incredible tech. Imagine in the future you will be able to have unique game experiences based on your play style with artificial intelligence changing the game do your gameplay.
This is seriously meta, I can’t wait for the AI to adapt to the fact that you are taking the limitations of the AI and using it as part of the game.
One of the sad things of how "AI" like this one works is that it doesn't really learn anymore after being deployed/published. It's like crystallized intelligence. The forms of AI that can continously learn are more expensive to run and may require dedicated brain-like circuit chips to be feasible.
All of the above is just the vague impression I have gathered so far about "AI", I'm no expert.
Its so cool how this is very beginning of this Ai generated game tech stuff and people are still having lots of fun with it and making it work
Truly fresh and novel entertainment, what an era to be alive...
This is like being able to consciously explore dreams with your friends
That honeycomb horizon to lava strat is so smart! I could never get past the lava honeycombing.
Normal Minecraft: you go to places to beat the game
AI Minecraft: the places go to you to beat the game
4:42 pale garden moment
it's like listening to a guy calling out commands to his nascar driver on how to race
finally the first AI mincraft run
"i cant get to the end of this wood"
its literally a dream
I love how most of the process is purely based on colors and shapes.
playing this minecraft feel like when you recognize the dream, but trying to not wake up
Ever since this got popular I’ve been waiting to see someone just spin around and look up and down to keep generating new landscapes until something cool happens. That would be the first thing I would do in this game
Me: Plays minecraft
What my grandparents see:
I love how they play Minecraft by colors and looks and it makes totaly sense the way it's generated
i love how you got diamond tools when you got the stronghold. it is 100% likely that most of the stronghold data used to train the plays had diamond tools.
New title: Trying to beat mincraft but its a drug trip
bro is manifesting the speedrun
I had a nightmare of the beginning part of being trapped in some wood area of just infinite overlapping roofs in angles like mc houses
Oh man, can't wait until we see a highly personalized games in 20 years!
Going to hell with dementia be like (minus the Hell Sirens, IYKYK)
Pov: my dreams after binge playing Minecraft for two weeks
AI minecraft is like playing in a world being held together by the universe’s most schizophrenic alchemist
That looks like when you’re trying to control a lucid dream
That was a crazy good run
This feels kinda like when you’re in a lucid dream and you’re trying to shift the dreamscape into something else lol
here as your 1k subscriber, i feel im gonna see more of you