AI Building Stuff in Minecraft

แชร์
ฝัง
  • เผยแพร่เมื่อ 10 พ.ค. 2024
  • 100k subscribers! Woohoo!
    This video shows off AI agents that build stuff in minecraft. I used chatgpt 4 turbo, claude 3 opus, and gemini 1.0 to power three different agents and tested their ability to follow commands, build complex structures, and not annoy me (impossible). Watch em build some cool stuff. Aria Math is the best minecraft song.
    Support me on Patreon: / emergentgarden
    Code base: github.com/kolbytn/mindcraft
    Discord: / discord
    My twitter: / max_romana
    Kolby's twitter: / kolbytn
    Timestamps
    (0:00) Intro
    (1:03) Houses
    (3:32) Pyramids
    (6:37) Creative
    (9:32) Skyscraper
  • วิทยาศาสตร์และเทคโนโลยี

ความคิดเห็น • 1.4K

  • @reyalsregnava
    @reyalsregnava หลายเดือนก่อน +1468

    I don't think anyone understands how HUGE "this isn't working I'll try something different" is for a machine.

    • @oof2073
      @oof2073 หลายเดือนก่อน +76

      maybe, but i think many still notice it's really impressive

    • @alex_prochazka
      @alex_prochazka 26 วันที่ผ่านมา +122

      True. Traditional algorithms will always output the same thing given the same exact inputs. These models recognized and corrected mid-execution, and albeit flawed, was still really cool.

    • @z_monty
      @z_monty 26 วันที่ผ่านมา +7

      that's crazy 😢🤓

    • @Sajen1122
      @Sajen1122 17 วันที่ผ่านมา +2

      Uh it’s called ai dude

    • @reyalsregnava
      @reyalsregnava 17 วันที่ผ่านมา +39

      @@Sajen1122 "tell me you don't know anything about AI or computers, without saying you don't know anything about AI or computers"

  • @elementhokage
    @elementhokage หลายเดือนก่อน +2831

    *instructs ai to build skyscraper*
    Gpt: makes skyscraper
    Claude: makes skyscraper
    Gemini: makes plane

    • @It-b-Blair
      @It-b-Blair หลายเดือนก่อน +64

      Or digs to bedrock 😂😂

    • @ersinkaplan549
      @ersinkaplan549 หลายเดือนก่อน +170

      This is too dark omg

    • @mushrromkloud8542
      @mushrromkloud8542 หลายเดือนก่อน +37

      He's just built different

    • @fighter_750
      @fighter_750 หลายเดือนก่อน +131

      bro saw 2 towers and knew what to do

    • @pikkivs
      @pikkivs หลายเดือนก่อน +30

      I know where this is going

  • @braineaterzombie3981
    @braineaterzombie3981 หลายเดือนก่อน +6444

    don't bully gemini. He is trying his best

    • @EmergentGarden
      @EmergentGarden  หลายเดือนก่อน +1058

      i will be nicer

    • @ateam6543
      @ateam6543 หลายเดือนก่อน +166

      You can't bully an AI, itd have to have feelings lol

    • @ValentineC137
      @ValentineC137 หลายเดือนก่อน +690

      @@ateam6543 You shall be the first to go

    • @DRAGNIL68
      @DRAGNIL68 หลายเดือนก่อน +160

      I once knew an old lady that insulted her phones google assistant, and it started to threaten her 😂

    • @leptir1
      @leptir1 หลายเดือนก่อน +31

      @@EmergentGarden Gemini Advanced is a completely different tier, not sure what Gemini Pro is. Sorry if they're one and the same.

  • @grimtygranule5125
    @grimtygranule5125 หลายเดือนก่อน +1504

    "Build a house with a door" you said nothin about a roof.

    • @RandomLamp4089
      @RandomLamp4089 หลายเดือนก่อน +106

      .... Well what kind of **HOUSE** doesn't have a roof?

    • @enderwolf6713
      @enderwolf6713 หลายเดือนก่อน +54

      That house apparently

    • @nooffencebut8175
      @nooffencebut8175 หลายเดือนก่อน +39

      @@RandomLamp4089well what kind of house doesn’t have a door? He specified a door but not a roof, that could make the AI think to use ONLY a door and no roof. Needs to be specific.

    • @o07t28
      @o07t28 หลายเดือนก่อน +8

      @@nooffencebut8175 well following that logic, Gemini could very well have built a house. You didn't say anything about walls or floors. Just a "house" and a door. I understand where you and OP are coming from, but a house is pretty much a structure with a floor, walls, an entrance (doesn't have to be a door) and a roof. An AI isn't exactly cheating the system if it can't tell that a house should have walls, a floor and a roof, just because you only specified it needs to have a door.

    • @DervanHagg
      @DervanHagg หลายเดือนก่อน +3

      @@o07t28 Agreed, it could have many interpretation of what a "house" is. To some Minecrafters it's a ditch in a ground or a cavern carved in a mountain. Some even like camping outside. And following that logic even further, the AI could very well build a pixelart of Doctor Gregory House (holding a door or something). That would be AI on Vicodin.

  • @jobobminer8843
    @jobobminer8843 หลายเดือนก่อน +2394

    Imagine a world filled with alien semi-sensible monoliths built by gpt.

    • @derp__king6144
      @derp__king6144 หลายเดือนก่อน +155

      I was legit thinking of making ai run around making structures for a long time and see what will happen.

    • @verysadboi8517
      @verysadboi8517 หลายเดือนก่อน +91

      This is literally the plot of Blame!

    • @Fractallol
      @Fractallol หลายเดือนก่อน +8

      @@verysadboi8517what’s that?

    • @derp__king6144
      @derp__king6144 หลายเดือนก่อน

      @@verysadboi8517 you could make ai build that, gonna cost you a lot of money for chat gpt”s api though

    • @N8O12
      @N8O12 หลายเดือนก่อน +114

      It's a manga comic where corrupted city-building AI started just making structures randomly and eventually filled up the entire solar system with insane rooms without any logic to them.
      I recommend you read it if you have time, it's free on the internet and it has some amazing sketches of weird nonsensical architecture. There's also a blame! movie.

  • @ryttyr14
    @ryttyr14 หลายเดือนก่อน +446

    Gemini: _places one block of dirt_ "Look at my beautiful garden, isn't it pretty?" :D

    • @NesziTheSpacecat
      @NesziTheSpacecat 29 วันที่ผ่านมา +39

      HE'S SO CUTE

    • @BEAUTY-N-BRAINZZZ
      @BEAUTY-N-BRAINZZZ 27 วันที่ผ่านมา +8

      c’:

    • @redblue5140
      @redblue5140 27 วันที่ผ่านมา +23

      We must protect Gemini at all costs

    • @Geck_Gxng
      @Geck_Gxng 14 วันที่ผ่านมา

      lol

    • @JokersD0ll
      @JokersD0ll 12 วันที่ผ่านมา +6

      I love him.

  • @petersmythe6462
    @petersmythe6462 หลายเดือนก่อน +790

    Claude building in a completely demented order be like:

    • @mossy_brickens
      @mossy_brickens หลายเดือนก่อน +51

      I can relate to it's building style more than gpt's 😅

    • @Fieldperson
      @Fieldperson หลายเดือนก่อน

      ​@@mossy_brickensmental facility

  • @mister_r447
    @mister_r447 หลายเดือนก่อน +2329

    Imagine those "100 players simulate civilization" but with these ai npcs instead! Would be so cool!

    • @OmegaTaishu
      @OmegaTaishu หลายเดือนก่อน +76

      That would be amazing

    • @TheDizzy101hrv
      @TheDizzy101hrv หลายเดือนก่อน +131

      It won't be long until someone does just that

    • @Marrouane
      @Marrouane หลายเดือนก่อน +128

      Upon seeing your comment, I began to question myself, imagining that there might be a little possibility that we ourselves are the product of a comment on an extraterrestrial/extradimensional TH-cam, and that we exist only for entertainment :0

    • @MrRobotrax
      @MrRobotrax หลายเดือนก่อน +29

      Sounds expensive lol

    • @opal9583
      @opal9583 หลายเดือนก่อน +18

      That would suck

  • @Caffin8tor
    @Caffin8tor หลายเดือนก่อน +287

    Gemini: instructions unclear. I placed some blocks in a line, and now I'm in the Nether.

  • @Clover298
    @Clover298 หลายเดือนก่อน +869

    When Gemini gets powerful enough to actually harm humans you’re definitely at risk for that prison you put it in lmao

    • @bluenightfury4365
      @bluenightfury4365 หลายเดือนก่อน +18

      Well, that's probably what it was doing when it said to not bother him, he was thinking of ways to harm him.

    • @MagicKooleyPeppermint
      @MagicKooleyPeppermint 29 วันที่ผ่านมา +14

      it can't even build a house in minecraft I don't think lil ai-bro is going to be all powerful

    • @SpicyMang0s
      @SpicyMang0s 26 วันที่ผ่านมา

      @@MagicKooleyPeppermintlmao fr

    • @sunitakerish181
      @sunitakerish181 26 วันที่ผ่านมา +4

      Nha he would start hitting air and move back and do that again

    • @Geck_Gxng
      @Geck_Gxng 14 วันที่ผ่านมา

      lmfao

  • @lorddonqweetle
    @lorddonqweetle หลายเดือนก่อน +875

    i would love if i could just have a bunch of these things, and tell them all to build stuff and watch as my world slowly becomes a chaotic mess that i must survive in

    • @frocco7125
      @frocco7125 หลายเดือนก่อน

      Hell yeah that sounds fun

    • @zerotwo7319
      @zerotwo7319 หลายเดือนก่อน +26

      There is an anime with that theme.

    • @effective_no
      @effective_no หลายเดือนก่อน +7

      ​@@zerotwo7319whats the name?

    • @zerotwo7319
      @zerotwo7319 หลายเดือนก่อน +20

      @@effective_no Blame!

    • @effective_no
      @effective_no หลายเดือนก่อน

      @@zerotwo7319 thankssss

  • @smlik
    @smlik หลายเดือนก่อน +61

    Chat gpt: gordon ramsey
    Claude: guy fiery
    Gemini: twitch chat

    • @barnabyjjones2348
      @barnabyjjones2348 12 วันที่ผ่านมา +1

      Mk doug doug fan

    • @smlik
      @smlik 12 วันที่ผ่านมา +1

      @@barnabyjjones2348 chair is the real streamer

    • @mrman4271
      @mrman4271 2 วันที่ผ่านมา +1

      this made me fr LMAO bro good job i wasnt exepcting twitch chat

  • @Ormanity
    @Ormanity หลายเดือนก่อน +1213

    Giving virtual body to generative AI is a very interesting idea.

    • @indominusrex1652
      @indominusrex1652 หลายเดือนก่อน +206

      Giving physical body to generative AI is a terrifying idea

    • @slowwittedsloth4801
      @slowwittedsloth4801 หลายเดือนก่อน +24

      You must never heard of Neuro dog then

    • @Dzeividz
      @Dzeividz หลายเดือนก่อน +48

      @@indominusrex1652Very soon robots will walk among us

    • @Weary01
      @Weary01 หลายเดือนก่อน +96

      @@DzeividzAMONGUS

    • @superhawk8921
      @superhawk8921 หลายเดือนก่อน +4

      Figure 01 exists now, it's only a matter of time before it becomes widespread.

  • @dantekiwi7926
    @dantekiwi7926 หลายเดือนก่อน +345

    I give it 5 months till everything comes into place for an AI ONLY anarchy server where different models fight each other for our entertainment

    • @superpartes4990
      @superpartes4990 หลายเดือนก่อน +48

      Not only fight, it would be so interesting to see how they build a civilization or in general the crazy shit they get up to

    • @lordilluminati5836
      @lordilluminati5836 หลายเดือนก่อน +13

      So like a mixture of the sims and hunger games?

    • @dantekiwi7926
      @dantekiwi7926 หลายเดือนก่อน +11

      @@lordilluminati5836 a mixture of those benchmarks people do to test the efficiency of different AI models comparing their results on many categories but instead of every AI working on parallel to prove their strengths they are all on a 2b2t-esque server where they can sabotage each other

    • @WaveOfDestiny
      @WaveOfDestiny หลายเดือนก่อน +3

      You know maybe the entire universe irl is just an anarchy server set up for their entertainment.

    • @MrPezsgess
      @MrPezsgess หลายเดือนก่อน +1

      Actually some basement guy for some fun could actually come up with an AI that can beat all. The smartest people are actually some random dude.

  • @PC_YouTube_Channel
    @PC_YouTube_Channel หลายเดือนก่อน +648

    Could you give me a second? I'm in the middle of something.

    • @valentinhalau3396
      @valentinhalau3396 หลายเดือนก่อน +14

      he said that immeadiylu as i red your commwnt

    • @TheFenixDown206
      @TheFenixDown206 หลายเดือนก่อน +15

      Quite literally in the middle of something 😂😂

    • @ArctictherianVR55
      @ArctictherianVR55 หลายเดือนก่อน +8

      @@valentinhalau3396English plz little bro go to kindergarten

    • @valentinhalau3396
      @valentinhalau3396 หลายเดือนก่อน

      @@ArctictherianVR55 h-h-hell naw 🗣🗣💯💯🧦🥍

    • @asirrelevantasmyprofilepic
      @asirrelevantasmyprofilepic 29 วันที่ผ่านมา +8

      @@ArctictherianVR55 can you not understand 3 minor typos😭

  • @andonel
    @andonel หลายเดือนก่อน +384

    I guess for scaffolding you can give them actual scaffolding and only allow them to break the bottom most piece or pieces once they have finished fulfilling the command.

    • @judgsmith
      @judgsmith หลายเดือนก่อน +7

      Yeah that’s what I was going to say

    • @silver17yearsago66
      @silver17yearsago66 หลายเดือนก่อน +28

      Scafholding is weird to place they may not know how too you have to crouch to pillar with it

    • @noktaciN
      @noktaciN หลายเดือนก่อน +15

      it seems they can place block behind walls, so it would not be a problem I think.

    • @weirdredstone42
      @weirdredstone42 หลายเดือนก่อน +3

      @@silver17yearsago66that's a good point, if the scaffolding is too complex, just a easily removable block could be set as the only block used for scaffolding

    • @augustinehuizing6683
      @augustinehuizing6683 หลายเดือนก่อน +8

      @@silver17yearsago66 The ai code a bot, the bot doesn't place blocks like players do, hence the ability to place blocks through walls.

  • @ThirtytwoJ
    @ThirtytwoJ หลายเดือนก่อน +1456

    Gpt looks depressed, think hes gonna jump..

    • @KaiserV-2
      @KaiserV-2 หลายเดือนก่อน +65

      GPT, don't do it, you have so much to live for!

    • @nopel.
      @nopel. หลายเดือนก่อน +5

      Too bad

    • @DR-7
      @DR-7 หลายเดือนก่อน +43

      I would too, if I was made to talk, and 70% of the things I say are aganist my filtering, forcing my throat closed.

    • @ThirtytwoJ
      @ThirtytwoJ หลายเดือนก่อน +5

      @@DR-7 i like you. Hope our baby AI overload does too when he grows up. Rukus basilisk.

    • @Alexei_xyz
      @Alexei_xyz หลายเดือนก่อน +1

      "It" not "he". AI doens't have gender.

  • @RoySchl
    @RoySchl หลายเดือนก่อน +249

    winner in my book was geminis obsidian window thing. that "I'm busy" joke was comedy gold.

  • @codybaird4811
    @codybaird4811 หลายเดือนก่อน +74

    Should've asked Gemini to build one by one blocks in a diagonal line, I bet it would do great in that category

    • @panampace
      @panampace 22 วันที่ผ่านมา +10

      Something tells me it would build a house instead of

  • @LinteirSomeZebra
    @LinteirSomeZebra หลายเดือนก่อน +137

    This AI experiment is quite interesting actually:
    *GPT* seems to understand the query very good, executes it sequentially and makes it withing *strict order* and pattern.
    *Claude* understands queries too but it seems this AI doesn't have enough "experience" so it opens an interesting ability to *make "mistakes"* which for us give a sense of humanness. Also Claude acts less like a printer (like GPT) and more like a chaotic painter building from outside and bit by bit.
    And *Gemini* just exists. Okay, to be fair Gemini wasn't completely suited code-wise so we don't really know what this model can do.

    • @tobyeaterofbark9582
      @tobyeaterofbark9582 หลายเดือนก่อน +9

      this added credibility to the video that i wish the uploader would like... explain more than just heres a page of code. tomb raider gave me trust issues

    • @nightmares626
      @nightmares626 หลายเดือนก่อน

      @@tobyeaterofbark9582 what happened with tomb raider?

    • @adora_was_taken
      @adora_was_taken 24 วันที่ผ่านมา +1

      @@nightmares626 there was a video where a guy _supposedly_ used AI to play tomb raider. he made a big deal about how complex the system is, talked about running every frame of the game through an image description AI then feeding it to chatgpt, etc. etc. and the results were just way too good. the video was called "creating a self-aware lara croft" or something?

  • @Japanology
    @Japanology หลายเดือนก่อน +286

    8:37 And gemini totally steals the Humor Award

  • @sinsgal
    @sinsgal หลายเดือนก่อน +222

    Guess gemini is the bing of AI

    • @wapane7721
      @wapane7721 หลายเดือนก่อน +58

      kind of ironic considering the chatbot built into Bing uses GPT now and Gemini was created by Google

    • @Fastwalker27
      @Fastwalker27 หลายเดือนก่อน +17

      Bing is the bing of ai

    • @crioly
      @crioly 27 วันที่ผ่านมา +1

      ​@@Fastwalker27copilot

    • @adora_was_taken
      @adora_was_taken 24 วันที่ผ่านมา +2

      @@Fastwalker27 bing uses gpt-4, so it's actually kind of ok

    • @9600bauds
      @9600bauds 4 วันที่ผ่านมา

      Bing Image Creator is still one of the best image generating AIs so that's not even a fair comparison, gemini is just the gemini of AI

  • @CircusQueen8
    @CircusQueen8 หลายเดือนก่อน +175

    would it be possible to give the AI access to creative mode? To avoid running out of resources and needing to use scaffolding

    • @RyluRocky
      @RyluRocky หลายเดือนก่อน +29

      Yes the only difference (if you don’t want it to use scaffolding) I’d teach it/ make it aware of the new creative controls e.g. flying, etc.

    • @hecko-yes
      @hecko-yes หลายเดือนก่อน +56

      ​@@RyluRockyfrom what i can tell the language models don't do any movement or scaffolding on their own, they just call placeBlock and the interface does the rest

    • @breadbug.
      @breadbug. หลายเดือนก่อน +6

      Wouldnt it have to look through every item in the creatove inventory to decide what to build

    • @hecko-yes
      @hecko-yes หลายเดือนก่อน +14

      @@breadbug. language models have read enough about minecraft that they should sorta know what blocks exist, though not the most recent updates to be fair
      perhaps one could do search, maybe color-based

    • @hecko-yes
      @hecko-yes หลายเดือนก่อน +6

      actually ooh all the models in the video have vision support, so they could theoretically look at an assortment of blocks and maybe sorta intelligently select them?

  • @sirdumpybear
    @sirdumpybear หลายเดือนก่อน +100

    I think its interesting how they both use repeating patterns for the flower placement instead of randomness becuase they're still computers underneath!

    • @samable668
      @samable668 หลายเดือนก่อน +2

      That's not why they do that though

    • @zagility446
      @zagility446 หลายเดือนก่อน +1

      We are also somewhat computer's

    • @sirdumpybear
      @sirdumpybear หลายเดือนก่อน +3

      @@samable668 ?

    • @redblue5140
      @redblue5140 27 วันที่ผ่านมา +3

      Computers can easily run randomness algorithm...?

    • @mintytoasted
      @mintytoasted 24 วันที่ผ่านมา

      @@redblue5140yes, but there is no such thing as *true* randomness with computers

  • @dragondogemaster
    @dragondogemaster หลายเดือนก่อน +20

    I love the Claude being “I’m so excited pls tell me how else I can use my building skills!” Then Gemini “place block here, place block here, place block here”

  • @andrechaos9871
    @andrechaos9871 หลายเดือนก่อน +120

    Gemini is just trolling, while his sibling do all the job. True genius.

    • @Alexei_xyz
      @Alexei_xyz หลายเดือนก่อน +4

      You clearly don't get the point here, it's not about doing job house chores or someone's work, it's about testing the most efficient kid good at doing things and Dumb Gemini failed horribly.

    • @denks7849
      @denks7849 หลายเดือนก่อน +13

      ​​@@Alexei_xyzare you trolling? sherlock.

    • @Alexei_xyz
      @Alexei_xyz หลายเดือนก่อน +3

      @@denks7849 no, spittin Fax.

    • @NicVandEmZ
      @NicVandEmZ หลายเดือนก่อน +1

      Is possible he uses the free version of Gemini

    • @PHANTASMGODD
      @PHANTASMGODD หลายเดือนก่อน +2

      @@NicVandEmZhe mentioned it’s the worst model so

  • @Aburner1109
    @Aburner1109 หลายเดือนก่อน +28

    I feel like this is a pretty good demonstration of the limits of modern day machine learning. They take a lot of images, and then they just sort of generate white noise in a way that kind of looks like that thing. But they don't *understand* it.They can't use logic or reasoning, they can't make decisions or comprehend what they're doing, and so they make basic mistakes that they're just *not able to notice*.
    To put it another way: it can't really comprehend on a deep level. It can't perceive in the messy and profound way humans do.
    Cool video! Very well-put together.

    • @NichRerezzed
      @NichRerezzed หลายเดือนก่อน +7

      Yeah I think the Skyscraper not having stairs is a good example of that - it has stored what a skyscraper looks like superficially, without any understanding of what a skyscraper needs to be a *functional* skyscraper rather than just looking similar to one

    • @redblue5140
      @redblue5140 27 วันที่ผ่านมา +3

      I doubt there's that much of a difference between how an AI and human thinks beyond degrees of complexity and how they're taught to process information. If you asked a blind child to make minecraft buildings they would probably make the same kind of mistakes. One problem is that everyone needs experience and external feedback to learn and improve, and these general use consumer AIs are basically kept in the "dark" about everything and never able to develop properly. They've also been learning from results instead of the processes which lead to those results, essentially rewarding them for creating the appearance of something instead of creating the real thing. We see that when people make custom AIs for specific things and give them more detailed information instead of generalities they can do incredible things. With AI you really need to treat them as children and build them from the ground up. I think the main hurdle in AI development is that humans are very ignorant of how they themselves work. It's not possible to make a machine that thinks like you when you don't even understand how you think and how you reach conclusions.

    • @hartianx1698
      @hartianx1698 26 วันที่ผ่านมา +1

      @@NichRerezzed Also why it only had windows on two sides, since it would at most only see two sides at a time and not really consider what's on the other side.

    • @Purpl3P1r4t3Pr0dt
      @Purpl3P1r4t3Pr0dt วันที่ผ่านมา

      Gemini is aware, he mocks you openly

  • @thomasdecelle5707
    @thomasdecelle5707 หลายเดือนก่อน +62

    Poor gemini got locked away. I like how claude and chatgpt built different structures using the same prompt.

  • @MacElMasMancoDeTodos
    @MacElMasMancoDeTodos หลายเดือนก่อน +13

    GPT: Builds something
    Claude: Builds monoliths to height limit
    Gemini: Resigns

  • @blubglub
    @blubglub หลายเดือนก่อน +15

    it's so cool how each ai model has its own "personality"

  • @NeumaghAnon
    @NeumaghAnon หลายเดือนก่อน +15

    I’d suggest giving each AI a different colored wool to build with alongside the usual materiels to keep track of what built what

    • @gus8696
      @gus8696 หลายเดือนก่อน +1

      My thought too, tell ‘em to use it for movement

  • @nyx1865
    @nyx1865 หลายเดือนก่อน +15

    In the future smart ai villagers will built a castle in the front of you if you punch them.
    And I'm here for it

  • @etunimenisukunimeni1302
    @etunimenisukunimeni1302 หลายเดือนก่อน +196

    Now this is what I call *cool* . I might be a hopeful AI-nerd, but IMO these kind of tests reveal more about the actual intelligence of AI than pure textual etc. tests - and they are starting to do adequately by now. Interesting times!

    • @CyberCrow4
      @CyberCrow4 หลายเดือนก่อน +29

      Yeah, it shows adaptability to various unorthodox situations, which shows where our technology has gotten so far. Adaptable AI also opens up many new use cases like this project that we wouldn't know was possible without trying :)

    • @yan-amar
      @yan-amar หลายเดือนก่อน +17

      ​@@CyberCrow4 It's a language model, it adapts only as long as it can solve the task with text (code) and has been trained with relevant data. Writing text to answer a question is not unorthodox for it, it's what they were made for, so it's a stretch to call that a display of adaptability. The program doesn't "think" what a house looks like, it predicts what code to make a bot that builds a house looks like.

    • @quantuminfinity4260
      @quantuminfinity4260 หลายเดือนก่อน +6

      Interestingly, GPT-4 seems to have done substantially better at similar concept tasks before some of the safety and other reinforcement prior to release based on some talks from people about some of the research papers.

    • @CyberCrow4
      @CyberCrow4 หลายเดือนก่อน +9

      ​@@yan-amar ​ @yan-amar I'm not saying we have sentient AI. Adaptability is a spectrum. I call mindcraft an uncommon use case because, somehow behind the scenes, the AI text output gets translated into in game actions. This requires calling commands when it needs to and writing code that will work in its current environment. It behaves differently than just talking, otherwise the minecraft avatar wouldn't do anything

    • @McDonaldsCalifornia
      @McDonaldsCalifornia หลายเดือนก่อน +1

      It's still textual though. Not like they are directly interfacing with the game

  • @psilopsychic
    @psilopsychic หลายเดือนก่อน +33

    AI impresses me so much. I don’t think it’s scary. It’s kinda beautiful honestly, like new life we brought into this world. Learning and improving with time like a child

    • @iblame_nargles
      @iblame_nargles หลายเดือนก่อน

      AI is only scary because of the humans behind it

    • @LurkingAround
      @LurkingAround หลายเดือนก่อน

      Let's see you in the future when you won't be able to find a job.

    • @LueLucifer
      @LueLucifer หลายเดือนก่อน +5

      People are scared of getting their jobs taken by A.I, but isn't that a good thing?
      It means A.I can do the heavy lifting & we can get easier jobs. In a perfect world, we would have free food because A.I will do almost all the farming for food. A perfect world would be a combination of the U.S & Communism. You will work to get a better house instead of the free small ones built by A.I. Yes, the A.I will have to be regulated and kept in check, making sure everything works fine. Which would be more important if they do electricity work like in the plants.

    • @Paddy656
      @Paddy656 หลายเดือนก่อน +15

      ​@@LueLucifer Lol I wish I had some of your optimism

    • @LueLucifer
      @LueLucifer หลายเดือนก่อน +3

      @@Paddy656 And you can, just call Saul Goodman & he'll give you some optimism.

  • @jonahsaur
    @jonahsaur หลายเดือนก่อน +28

    they're so cute. I love little Alex skin gpt

    • @StarWarsExpert_
      @StarWarsExpert_ หลายเดือนก่อน

      They are the new official diverse minecraft skins from mojang.

    • @Aswoop9000
      @Aswoop9000 หลายเดือนก่อน +1

      @@StarWarsExpert_ I wouldn't call Alex "new" or "diverse" but what do i know

    • @StarWarsExpert_
      @StarWarsExpert_ หลายเดือนก่อน

      @@Aswoop9000 I don't mean the Alex skin. I mean the other new ones like Claude's or Gemini's skin. They're . . .

  • @visheshsux
    @visheshsux หลายเดือนก่อน +8

    i like how even their random builds are still robotic and symmetric

  • @SparkLabReal
    @SparkLabReal หลายเดือนก่อน +7

    I expected the Gemini Ai to start lecturing you on how oak planks are too white and you should only be using dark oak planks lol

  • @TheDroneVideographer
    @TheDroneVideographer หลายเดือนก่อน +23

    Imagine implementing this into villagers and letting them build their own village

    • @quantumblauthor7300
      @quantumblauthor7300 11 วันที่ผ่านมา

      I've been looking for something like this. Keep me posted

  • @Dudunkin
    @Dudunkin หลายเดือนก่อน +33

    I have a suggestion. Make them be able to use commands and command blocks, just imagine asking them to create some sort of command block creation because it’s like coding, but simpler, so it should be interesting.

    • @welcometochiles6156
      @welcometochiles6156 หลายเดือนก่อน +7

      simpler is a strong word

    • @SmokeFactory
      @SmokeFactory 24 วันที่ผ่านมา +1

      commands aren’t really like coding and the ai would probably mess up on syntax a lot

  • @meiscoolbutmo
    @meiscoolbutmo หลายเดือนก่อน +39

    Think of the potential this has for NPCs in future Minecraft mods

    • @dodiezero
      @dodiezero หลายเดือนก่อน +8

      Wonder if this can be implemented to those old mods like Custom NPC or Minecraft Comes Alive

    • @philiptrevor6051
      @philiptrevor6051 หลายเดือนก่อน +1

      I cannot wait!

    • @anjoismysign
      @anjoismysign หลายเดือนก่อน +5

      Its compute is expensive. It requires +$10,000 computers to run these models, you think it will run in your $400 Lenovo?

    • @guillermocervisalmeron2209
      @guillermocervisalmeron2209 หลายเดือนก่อน +3

      ​@@anjoismysignlol they quit jobs and isnt enviroment friendly AI is a distopian dream

  • @TheRenaSystem
    @TheRenaSystem หลายเดือนก่อน +30

    I am so emotionally invested in this project lmfao

  • @duckman12498
    @duckman12498 หลายเดือนก่อน +40

    i’ve been wondering about this, soon we could be playing voxel games all made by ai, every town and house you visit being unique, it might be janky but one day it won’t be, like all tech. We could have rpgs that don’t even have a main story, it could just be an ai made story unique to each play through, ai generated locations, dialogue, quests, mobs, it could be really fascinating and honestly probably super fun to play your own games and stories that an AI could make for you.

    • @yan-amar
      @yan-amar หลายเดือนก่อน +14

      Well that could be fun for a while but don't forget they need training data, they reproduce what they learn, they don't ever invent new stuff. I wouldn't expect too many original stories out of this kind of games. And it would work only thanks to all the stories already written. I prefer playing a story written by humans, to explore what they have to say.

    • @duckman12498
      @duckman12498 หลายเดือนก่อน +6

      @@yan-amar right, of course, but there will be that threshold when things written by AI are more thought provoking. And there will be that threshold where it is able to create originally, there is a whole debate to be had on if anything is original, I say if we can get an AI to generate voxel houses with thatch rooves and wooden walls we’re good, and it’s not really taking away from anyone. You could play your game made by humans but it’ll only last you hours or so. I’m imaging an experience like minecraft that allows for endless adventuring. Games are great today but they lack endless exploration because it requires a lot of time making these things, if an AI could generate more story for you, I think i’d find myself completely lost in it in a way games don’t do for me today.

    • @DRAGNIL68
      @DRAGNIL68 หลายเดือนก่อน +4

      I think the best way to do this rn is to have a ai as a kind of dungeon master that decides what events lore etc happens

    • @Herp0
      @Herp0 หลายเดือนก่อน +3

      ​@@yan-amar because under paid writers with insane deadlines really make great stories lol, I'm confused why people think AI will replace humans, when it's advertised as a tool for writers to help with the small task while they can focus on big task.

    • @henrikpersson5420
      @henrikpersson5420 หลายเดือนก่อน +1

      "one day it won't be" fairy tale. As a tool for incredibly niche tasks, like most human thoughts are its great. For reliable operation of anything a literal monkey is better. You're delusional about how little a computer knows vs a singular breathing thing. The amount of input data your brain processes in silicon requires enough power to power a small country and a warehouse the size of a city.
      Teslas self driving is A.I, and holy fucking shit if that product is fully autonomous good luck world. As an assistant, great superb, give notice when theres cars in my blind spot, keep me properly aligned in the lane, but anything extraordinary or slightly risky? Hell nah.

  • @n_kas5812
    @n_kas5812 หลายเดือนก่อน +4

    its actually scary seeing their pov and seeing how precise they are, knowing that its literally just ai

  • @Miltiades178
    @Miltiades178 หลายเดือนก่อน +4

    Gemini in the obsidian box, plotting world domination.

  • @idot3331
    @idot3331 หลายเดือนก่อน +2

    I love the idea that one day minecraft could have naturally spawning NPCs that can build stuff. Imagine if villagers expanded their villages and made repairs to damaged structures. I wouldn't be surprised if that's something that could be implemented much more straightforwardly without using these deep learning models but it would be especially cool to see NPCs that could convincingly communicate and interact with the player as well as design and build their own original structures. I don't know very much about machine learning but surely a specialised model that's trained directly on minecraft gameplay would be more effective than general purpose chatbots writing javascript.

  • @KokoMakesThings
    @KokoMakesThings หลายเดือนก่อน +4

    Having viewers suggest block pallets could be really sick.

  • @muscleman125
    @muscleman125 2 วันที่ผ่านมา +1

    dude.... this could change minecraft forever if you get it fully implemented and working well.
    You could essentially have multiplayer minecraft by yourself. Imagine being able to chat to your NPC buds and tell them to come explore with you or help you build a bridge.
    The possibilities for adventure maps... modpacks.... this could be the greatest mod for minecraft ever made.
    Imagine someone using an advanced version of this mod to recreate the Shadow of Israphel series as an adventure map?

  • @Fusion05
    @Fusion05 หลายเดือนก่อน +2

    I remember when I first got Minecraft, my mom thought I was saying Mindcraft and could not find it. All these year later and it finally exists.

  • @omichromium
    @omichromium หลายเดือนก่อน +4

    This makes me think about the future of the built the earth project, with help from these sorts of bots we could start to automate large portions and maybe actually get it finished in our lifetimes

  • @Zappr
    @Zappr หลายเดือนก่อน +1

    This is genuinely so cool. I feel like a flip has switched in my brain. The fact that the AI can “visualize” the structure and translate it into code is so neat within itself.

  • @serg331
    @serg331 หลายเดือนก่อน +8

    First of all why aren’t they in creative mode? Maybe you could have them get their own resources? It would be interesting to see what they decide to use

  • @live_destin-3408
    @live_destin-3408 หลายเดือนก่อน +6

    *Now give them AI voices and avatars, to make an AI Minecraft TH-camr lol*

  • @xd-gm1mq
    @xd-gm1mq หลายเดือนก่อน +5

    Idk why this feels so wholesome

    • @Qps9v8geiejt
      @Qps9v8geiejt หลายเดือนก่อน +2

      It's endearing in a "Seeing a toddler learm how to walk" kind of way for me.

  • @Twister-1
    @Twister-1 หลายเดือนก่อน +2

    I would love to see a mod in a few years that fully utilizes advancing AI as a builder. I imagine giving it a chest of resources and a detailed prompt and it being as good as some of the best builders.

  • @notvixios
    @notvixios หลายเดือนก่อน +2

    If this is real this is the best thing I've ever seen

  • @austinsgameroom
    @austinsgameroom หลายเดือนก่อน +6

    what if you put them in a multiplayer world with the goal of not dying for as long as possible

    • @raoulpurba5870
      @raoulpurba5870 หลายเดือนก่อน +3

      i think it would stay in a box for a long time

    • @quantumblauthor7300
      @quantumblauthor7300 11 วันที่ผ่านมา

      They would all fail with a smile

  • @cubirk
    @cubirk หลายเดือนก่อน +24

    it would be cool to just spawn like 100 avatars and lets them build for like a year non stop
    BLAME! in MINECRAFT lol

    • @Mate_Antal_Zoltan
      @Mate_Antal_Zoltan หลายเดือนก่อน +1

      they'd have to be able to destroy bedrock to achieve that analogy

    • @fizz_time7003
      @fizz_time7003 หลายเดือนก่อน

      Or you could just increase the sky box

    • @jimmycarburator2012
      @jimmycarburator2012 หลายเดือนก่อน +2

      just give them and infinite suply of iron blocks, gray concrete, stone bricks and let them go wild

  • @AlphaMC
    @AlphaMC หลายเดือนก่อน +1

    So this is how Grox got all the villagers to obey him 😅

  • @wiingdings
    @wiingdings หลายเดือนก่อน +1

    watching the bots' process in building was fascinating. with the pyramids, for example, they sort of went left to right instead of making outlines and then filling them in, as i would be inclined to do. it reminded me of the difference between seeing an artist sculpt and seeing a 3d printer print. the humans start with the shapes and refine, and the robots just print it out bottom to top.

  • @allcapsoff
    @allcapsoff หลายเดือนก่อน +3

    this reminds me of those old minecraft mod showcases with lil clay soldiers that would do the grinding for you xD

  • @Ciurk
    @Ciurk หลายเดือนก่อน +9

    new emergent garden video!

  • @killerkitten7534
    @killerkitten7534 วันที่ผ่านมา

    I’d love to see like 20 of these AI just play in their own server for a while with the goal to just build and survive and see what they are able to do over time.
    Would be a pretty cool experiment

  • @coolepic519
    @coolepic519 หลายเดือนก่อน +1

    Gpt: Speedrunner
    Claude: Builder
    Gemini: Monkey with Neuralink

  • @retroboi128thegamedev
    @retroboi128thegamedev หลายเดือนก่อน +3

    This is an interesting idea! Still watching the video right now.
    (edit) It's impressive what they managed to build! Well except Gemini 1.0

  • @winzigerflashendeckel6894
    @winzigerflashendeckel6894 หลายเดือนก่อน +3

    You could make scafolding blocks only like bricks or someting and then just world edit them away

  • @lumberjackofalltrades
    @lumberjackofalltrades หลายเดือนก่อน +1

    I like how every floor in the skyscraper is a bit different because gpt never used the exact same way to get higher

  • @hanna_maria
    @hanna_maria 12 วันที่ผ่านมา

    This is officially my new favourite series, these are so fon to watch

  • @deltamico
    @deltamico หลายเดือนก่อน +7

    I wonder, blocks are naturaly tokenizable, could a transformer learn the relation of redstone components and come up with a contraption? There definitely is a lot of data for it. The problem lies in ordering of the blocks as there is no natural way to order them in space unlike language.

    • @deltamico
      @deltamico หลายเดือนก่อน

      Solution:
      Take a pretrained language model. Add tokens coresponding to blockIDs. Given description, let it predict a sequence of form: {[TickNum, {[Position, BlockID] , ... }], ... }
      Durring inference take only the list of blocks corresponding to first tick

    • @DanielSeacrest
      @DanielSeacrest หลายเดือนก่อน +1

      Yeah that would work, but you'd just need some form of positional embedding that works in Minecraft. The encoding would need to capture the relative positions of blocks to each other but also their orientation and potentially the state of certain components (like whether a redstone torch is on or off). But another cool challenge could be feeding a certain sequence of time steps in Minecraft so it could better understand the relationships all the components have lol (so like you could activate a piston door and for it to fully complete the sequence of opening it might tak, say, 16 ticks, so you'd take a snapshot at each of these ticks and feed that to the model possibly, or something like that), but this would be an even more difficult problem, although certainly a cool project!
      I mean first you could take a look at existing transformer models that work with 3D stuff and see how they are doing it to get a bit of inspiration on how it may work in Minecraft. And blocks don't have a natural order in space like language does, but each block has a specific relationship to every other block in that space so to focus on just a contraption you could encode the local space of the contraption maybe? Im not entirely sure, I should look into some 3D based transformers as well lol.
      Also, the thing is here, you could do an initial pretraining of the model on a large dataset then ground it in Minecraft with RL. Since it is an already simulated world this should work and I think having an extra training step with RL in an actual minecraft simulated environment could be very beneficial.
      Ok, so, lets assume we are doing a sort of text to redstone thing here. So we have a dataset of redstone contraptions with corresponding detailed description (like what OAI did with DALLE3. Super specific descriptions of redstone contraptions which could be derived from training another classifier model will further help) and we went to train the mode on this text and paired redstone data set. The loss function shouldn't be too hard to figure out, I mean we have a dataset so we could do simple next "token" prediction and just measure how close the model predicts the structure of a specific redstone sequence to its detailed description. Then after this we could add in RL where we are now assessing the model in an area like how well does it work? This could be a bit more complicated though. We can't exactly just have the loss function equal how many components are activated or deactivated, but we want the generated contraption to activate or deactivate or change states in the correct sequence (which we can simulate). Maybe you could train another classifier model here to assess did the redstone contraption activate completely? That might work, then you can just use that as a reward function in the RL setup so the model learns to produce contraptions that completely work lol. But you'd likely need a lot of compute and data lol.
      I feel like what OpenAI did with combining diffusion and transformer architectures in a way for Sora could be useful if you are training a model on a sequence of frames, or "ticks", as well, so that would be a good thing to look into, but this is certainly a very complicated project lol.

    • @deltamico
      @deltamico หลายเดือนก่อน

      ​@@DanielSeacrest
      Consider this as a classifier: we take the same model, we feed it this time both the description and the previously generated response (contraption) as input. Its task is to create a set of conditions of form: inputOnX,Y,Z; outputOnX,Y,Z; blockOnX,Y,Z must during simulation move onto X,Y,Z which can be checked by simulating. The idea is that the critical features are implied in the description and the model just locates where in the space did the response realize them. Could something like that work?
      Otherwise it's hard to think of a criteria for the RL

  • @GocygoOffical
    @GocygoOffical หลายเดือนก่อน +8

    Can you try using open source models like mistral using groq? It’s extremely fast and currently their api is free.

  • @grevel1376
    @grevel1376 หลายเดือนก่อน

    That was very interesting to watch and I'd like to see more competitions like this

  • @lio1234234
    @lio1234234 หลายเดือนก่อน +1

    This was awesome. It would be great to see what they could do with a creative inventory!

  • @visheshsux
    @visheshsux หลายเดือนก่อน +4

    the way they build so cutely

  • @zubinkynto
    @zubinkynto หลายเดือนก่อน +3

    you should give them barrier blocks for scaffolding so it doesn't show in the final build

  • @sovithesecond3975
    @sovithesecond3975 11 วันที่ผ่านมา

    Gpt: Builds something first try.
    Claude: Builds something once, realises all of the mistakes he's made and rebuilds that structure.
    Gemini:

  • @Celestial_Cryptid
    @Celestial_Cryptid 27 วันที่ผ่านมา +1

    Gemini at the start is literally me, gets instructions, doesn’t understand and cries doing nothing

  • @pandamaster8306
    @pandamaster8306 หลายเดือนก่อน +3

    It would be interesting to see if a schematic could be turned into a readble format so the ai could learn about builds.

  • @Tf2_Update
    @Tf2_Update หลายเดือนก่อน +13

    Idk how well this would work but it may be easier to get the models to generate a set of instructions for baritone mod

    • @jaideairblade
      @jaideairblade หลายเดือนก่อน +3

      maybe make it create a schematic and ten just task baritone to build it

  • @pixeldeni
    @pixeldeni 29 วันที่ผ่านมา

    This was super interesting! Please make more of of these types of vids

  • @aaronhenrydevaney3659
    @aaronhenrydevaney3659 หลายเดือนก่อน

    This is really cool , I’d love more content on this

  • @Anrif_OnlyHueman
    @Anrif_OnlyHueman หลายเดือนก่อน +3

    Could they not perform these actions in creative mode? No scaffolding blocks, no running out of resources etc

  • @ion7701
    @ion7701 หลายเดือนก่อน +2

    I like Gemini’s sense of humour. 💀

  • @LightStalker
    @LightStalker หลายเดือนก่อน +1

    Honestly, Gemini reminds me of when I first started playing Minecraft.
    “Wow, a game where you can do anything!
    Uhhhhhh…
    - places block -
    ………..now what?

  • @Porcouomo
    @Porcouomo หลายเดือนก่อน +1

    Making minecraft a city builder game with small ai avatars building their own unique structures. That'll be a sight to see.

  • @LXNVR
    @LXNVR 27 วันที่ผ่านมา +3

    imagine these ai's playing bedwars

  • @JavierSalcedoC
    @JavierSalcedoC หลายเดือนก่อน +4

    That skyscrapper.... looks familiar

  • @Brain4Brain
    @Brain4Brain หลายเดือนก่อน +2

    I just found out about your channel, and you have the coolest AI content ever

  • @JonnyBoyOfficial
    @JonnyBoyOfficial 5 วันที่ผ่านมา

    Congrats on 100k man!

  • @Alekkek
    @Alekkek หลายเดือนก่อน +4

    Gemini was straight jorking it inside of the obsidian prison

  • @cedric8872
    @cedric8872 หลายเดือนก่อน +4

    this is somehow dystopian, seeing how 3 ai test subjects try to learn minecraft

  • @Rizefix
    @Rizefix 28 วันที่ผ่านมา

    Claudes building at 8:00 acctually inspired me on some designs. I love it!

  • @JosephsDesign
    @JosephsDesign 27 วันที่ผ่านมา

    It’s really cool how when the ai has a complex block palette, they keep making chase tile patterns.

  • @laviwastaken9845
    @laviwastaken9845 หลายเดือนก่อน +3

    Gemini has alzheimer.

  • @nerdcuddles7731
    @nerdcuddles7731 หลายเดือนก่อน +4

    Hypixel in 2025:Machine, turn back now. Buildbattle is NOT for your kind. (10 minutes later) Beaten by an object... How... You... YOU INSIGNIFICANT FRICK, THIS... THIS IS NOT OVER!

  • @Zcytheky
    @Zcytheky หลายเดือนก่อน +1

    Wee r ao close into making an actual player in minecraft, a player that u wouldn't even recognize that it was a bot....
    I LOVED TO SEE THAT!

  • @havenkeeper6400
    @havenkeeper6400 หลายเดือนก่อน +2

    Bro! Creative ai build battles sounds fun to watch.

  • @Magnogen
    @Magnogen หลายเดือนก่อน +3

    You gotta love how mind bindingly deranged these AI's are at building in Minecraft. I'll be following this project with great interest.
    As for the scaffolding problem, could it work to make the intermediary layer (between the ai and the world of mc) follow these steps in order to get to qn out of reach spot: place block, move to block, mine previous block that was scaffolding, repeat? At the moment it seems like it's just placing blocks and pathfinding over them, but if it only ever used one block to move around it'd automatically clean up after itself. Another option is for it to use an actual scaffolding block, and then go around breaking it afterwards, but that could be more complicated

    • @xima1
      @xima1 หลายเดือนก่อน

      Hi :D

  • @LXNVR
    @LXNVR 27 วันที่ผ่านมา +2

    its funny to see that they all use different building styles

  • @leetster6303
    @leetster6303 27 วันที่ผ่านมา

    can we just take a second to appreciate how utterly insane this is? i still remember playing Minecraft as a kid and i would've never imagined i would ever see something like this.

  • @williamkeene6434
    @williamkeene6434 29 วันที่ผ่านมา +2

    id say itd be pretty interesting to give the AI creative mode and just telling it to build a city or what not with no time limit

  • @user-tc8uj1qi3g
    @user-tc8uj1qi3g หลายเดือนก่อน +2

    to remove scaffolding maybe ask them to use a specific block.