A.I Learns to Make $1.000.000 (Deep Reinforcement Learning)

แชร์
ฝัง
  • เผยแพร่เมื่อ 14 ม.ค. 2025

ความคิดเห็น • 87

  • @Zuzelo
    @Zuzelo  ปีที่แล้ว +17

    How was the Pogo & Chiklz Montage?
    Also, the comment for the algorithm!

    • @Epicdoge117.
      @Epicdoge117. 7 หลายเดือนก่อน

      Give chiklz the existing punishment 😈

  • @humaane8045
    @humaane8045 ปีที่แล้ว +17

    One thing you could do is sort of a "hide-and-seek" survival, where Chiklz needs to get a bunch of resources to survive but make searchlights that turn on and off periodically which drain health when he is in them. Even if you make the searchlight in fixed locations, it would be interesting to see if the AI would be able to learn when a path was clear and when it was not.
    I do like a lot of you A.I. content and have admittingly been bingeing it today.

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว +3

      Ohhhh so he gotta be steaaaalthy!!
      Perhaps a bank heist?! Hmmmm

  • @alfredrnnejohannesen95
    @alfredrnnejohannesen95 ปีที่แล้ว +22

    Love to see pogo appearing in so many videos. Really makes your channel feel unique.

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว +1

      Pogo iz gud!

  • @skrelvthemite
    @skrelvthemite ปีที่แล้ว +15

    chiklz likes to chug that water

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว +3

      He does! Also, considering water is like $10 a bottle. He had an additional $1130 at the end :D

  • @altairpl8026
    @altairpl8026 ปีที่แล้ว +5

    4:30 he said F**k in Polish just so you know

  • @UselessAccountYT
    @UselessAccountYT ปีที่แล้ว +3

    This is the first video I have seen from you, I like the content already!

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว +2

      I am glad you like it :) There is much more on the way!

  • @Charlieee1
    @Charlieee1 ปีที่แล้ว +27

    I'm guessing that your reward function includes time survived and coins, so it makes sense for the AI to buy as many water bottles as possible to live as long as possible without ending the simulation (at 1000 coins).

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว +8

      Yeah, I also think that might have been the case. The agent just understood that it is more profitable to just stay around 1k and buy water to drop that value :D

  • @aahhhh101
    @aahhhh101 ปีที่แล้ว +4

    I would love more

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว

      There will be more!

  • @coleagnew691
    @coleagnew691 ปีที่แล้ว +8

    Here is another idea: add on more available plots of land each one for differ types of animals, and different animals produce different things and consume different things. BUT pogo can also hire “farm hands” to do certain tasks for him to make it easier for him to own more pens.

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว +2

      Ooooh I like it!

    • @coleagnew691
      @coleagnew691 ปีที่แล้ว +1

      @@Zuzelo thanks!

  • @gabrielv.4358
    @gabrielv.4358 11 หลายเดือนก่อน +1

    Muito legal, bem feito. Gostei dos graficos fofos também. Continue assim!

  • @LuizMoratelli
    @LuizMoratelli ปีที่แล้ว +1

    Good to see Chiklz again! Great Video like always :D

  • @Sharptheperson
    @Sharptheperson ปีที่แล้ว +3

    Minecraft hearts and food bar llooll

  • @Draktand01
    @Draktand01 ปีที่แล้ว +5

    I’d be interested to see a survival town civ where thousands of ai get born, go to school for learning a task, and then get thrown out into the field trying to perform said task.
    The teaching methods used at the school continue to evolve based on the success rate of the method in the field.
    The AI’s are born knowing ver little other than hiw to attend school, and all the training parameters are decided by the school.
    Note that the school doesn’t have the ability to do neural surgery, and the evolutionary success of the base pre school neural net is based on the neural net’s ability to learn and perform a wide verity of tasks, encuraging general intelligence.
    Every little thing that an agent needs to do other than knowing how to walk to a specified location is considered a task, and is learned at school.
    The only non general intelligence should probably be the teachers, in order for them to evolve the teaching methods faster.
    Basically, the teachers are a different breed of human, just like in real life, lol.
    So the AI genetic selection is based on one task only, it’s ability to learn from the teachers on how not to die before they reproduce.

  • @howtogame2745
    @howtogame2745 ปีที่แล้ว +1

    Dude ur channel is soooooo underrated

  • @eitanl9640
    @eitanl9640 5 หลายเดือนก่อน +1

    7:17 why is no one talking about how sus this is

  • @lordrams9058
    @lordrams9058 ปีที่แล้ว +1

    What is the song in 0:32?

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว

      Paichit Aksornnarong

  • @berekettibebu8861
    @berekettibebu8861 ปีที่แล้ว

    i love this ai videos, amazing stufff

  • @mithulc8422
    @mithulc8422 ปีที่แล้ว +3

    Would like to see if there was a griefer would the ai attack it or not

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว +1

      Hm interesting. What would the griefer do? Steal the animals?

    • @mithulc8422
      @mithulc8422 ปีที่แล้ว +1

      ​@@Zuzelo steal chicken or also have it sell chickens to pogo and have pogo limit the amount of chicken it can buy

    • @mithulc8422
      @mithulc8422 ปีที่แล้ว +1

      Or Like if chiklz touches the griefer the griefer would stop for sometime

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว

      @@mithulc8422 Sounds interesting! I might actually try it for the next episode :D

  • @callmeclover_
    @callmeclover_ ปีที่แล้ว +1

    idea:
    add upgrade stages so that he has to think ahead in order to make more money.
    example:
    /-upgrade> mud bath (pig only, med money)
    basic plot (chickens only, low money) -upgrade> large plot (cow chicken pig, med money) = -upgrade> coop (chickens only, high money)
    \-upgrade> barn (cow only, med money)
    different upgrades cost more money, but produce more. different animals cost more, but sell for more.
    another idea is to add the ability to make a well with 1 plot, so you dont have to buy water, but you have to spend alot of money on it.

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว

      Haha you are reading my mind! That was initially the idea, but it turned out to be slightly too complex for Chiklz, so I dumbed it down! Next time tho will be with upgrades!

  • @marcboss
    @marcboss ปีที่แล้ว +2

    Very good video, in the next video will you add something to this like farming or something else, maybe even change the shop so the prices change depending on what he buys?

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว

      You mean farming like plants? Sounds interesting

    • @marcboss
      @marcboss ปีที่แล้ว

      @@Zuzelo Yes so he can choose between farming crops and growing animals each having upsides and downsides

  • @helloc5507
    @helloc5507 ปีที่แล้ว +3

    What is ur specs of ur device which u are training and simulating on?, Also chiklz might not be using other plots because ot probably has no long term strategy benefits

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว +1

      CPU: i9-12900KS
      GPU: RTX 3050
      RAM: 128GB
      That might be the case indeed. Another suggestion was that he focused on the closest farm to reduce the travel time

    • @helloc5507
      @helloc5507 ปีที่แล้ว

      ​@@Zuzeloinstead of giving time penalty add idle time,like let the growing of chicken take some time so that in the time it takes to grow chiklz will work on other plots

  • @ZephPeterson
    @ZephPeterson 7 หลายเดือนก่อน +1

    Chikilz buys so much water because his activities are time-gated by the water consumption rate. He only has time to do 2 or 3 things without needing to drink or take damage. I suspect if poor chikilz had a list of what had damaged him most, it would be overwhelmingly lack of water.

    • @Zuzelo
      @Zuzelo  7 หลายเดือนก่อน

      hmmm that does make sense, if/when I make a part 2, I will try to add a limit perhaps to water purchase/consumption. Maybe that will bring some interesting results as well

  • @snefden
    @snefden ปีที่แล้ว

    You could give every think the agend can hold (water, meet and the corn) a weight, which slows him down

  • @coderchris8425
    @coderchris8425 ปีที่แล้ว +1

    more farming more animals. There. I said it.

  • @kauanv4315
    @kauanv4315 ปีที่แล้ว +1

    legal

  • @villev624
    @villev624 ปีที่แล้ว

    I love your videos they are to good!

  • @Learningchannel-g3z
    @Learningchannel-g3z ปีที่แล้ว +2

    Can you PLEASE consider making this open source!
    If not, can you explain the basic algorithm you used to make this reinforcement learning?
    I appreciate your wonderful work❤

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว +3

      The algorithm I use is PPO and is the standard algorithm used in Unity ML Agents (package for doing Machine Learning stuff in unity).
      If you need a good tutorial on how to start, CodeMonkey has a nice video how to get it installed :)

    • @sparetime1356
      @sparetime1356 ปีที่แล้ว +1

      @@Zuzelo Wow! Thank you very much!!
      Is it possible if you can tell me the number and name of environment input and action output the model had?
      Also just an idea but multiple pogo doing farming seems nice video😊
      MADDPG maybe a good algorithm! Overcooked ai is an example implementation

  • @Duesikazergaming
    @Duesikazergaming ปีที่แล้ว +1

    Always some pogors content!

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว +1

      Not as pogors as the comment!

  • @yarik_boom777
    @yarik_boom777 ปีที่แล้ว +1

    👍

  • @EgalIlI
    @EgalIlI ปีที่แล้ว +2

    Thanks for this nice video.
    [I will burn your house] 1:57 -1:58

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว

      Thanks for this nice comment

  • @AntiWareWolf
    @AntiWareWolf 7 หลายเดือนก่อน

    id like to see farms which u must water

  • @Polishoreo
    @Polishoreo หลายเดือนก่อน

    4:34 KuRwA!

  • @Reservedfortruth
    @Reservedfortruth ปีที่แล้ว

    You could make it like so AI's inventory can only hold 5 water bottle and 3 wheat so he would only rely on surviving not collecting.

  • @CoolDude2054iscool
    @CoolDude2054iscool ปีที่แล้ว +2

    Who would win? Chiklz or Pogo

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว +1

      Well, Pogo is a trained and versatile warrior, while Chiklz is.... Chiklz

  • @gravygardner
    @gravygardner ปีที่แล้ว

    why did i hear a whisper @2:05? creepy at 2:52 am 🥲

  • @MasonHolly
    @MasonHolly ปีที่แล้ว

    This mixed with AI Learns to Survive 2

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว

      Chiklz survives in the middle of a battlefield? xD

  • @skull4658
    @skull4658 ปีที่แล้ว +1

    i like it

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว +1

      POG

  • @Dack-i
    @Dack-i ปีที่แล้ว +1

    Chikls vs pogo

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว

      But..but Pogo has guns!

    • @Dack-i
      @Dack-i ปีที่แล้ว

      @@Zuzelo chikls is an alien he probably got the light saver and look at that brain it’s THICK while pogo got that small brain friendly fire strategy’s

  • @HubertMachaj-t6h
    @HubertMachaj-t6h 5 หลายเดือนก่อน

    4:35 "kurwa"

  • @jasrozycki2909
    @jasrozycki2909 ปีที่แล้ว

    4:36 POLSKAAAAAAAAAAAA

  • @ulrichbrodowsky5016
    @ulrichbrodowsky5016 ปีที่แล้ว

    Can he wait? Because I suspect that he buys water as waiting strategy

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว

      In theory it is possible for him to wait, there is a possibility to not do anything

  • @hello-sq2xo
    @hello-sq2xo ปีที่แล้ว +1

    he did make only 2k where is the 998k left

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว

      Tax

  • @The_child_molester
    @The_child_molester ปีที่แล้ว

    Alternate title:robot boi Play mobile game

  • @phnkcell710
    @phnkcell710 ปีที่แล้ว

    Kurwa a love that word😂😂

  • @n7129
    @n7129 ปีที่แล้ว +1

    WHY'S he buying so much water??????😅

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว +1

      He likes to stay HYDRATEEEEED!

  • @michaelbray4997
    @michaelbray4997 ปีที่แล้ว +1

    why so little views??

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว

      :(

    • @user-qr9vi5ur6f
      @user-qr9vi5ur6f ปีที่แล้ว

      ​@@Zuzeloplease consider changing the name of your channel. It's so hard to find your channel.. maybe add AI in the name?

  • @Polishoreo
    @Polishoreo หลายเดือนก่อน

    Lé Algorithm Commént

  • @tarents222
    @tarents222 ปีที่แล้ว

    Survivor ai survives capitalism

  • @lostsikenoyesno2454
    @lostsikenoyesno2454 ปีที่แล้ว

    Prt2

  • @wackiin1312
    @wackiin1312 ปีที่แล้ว

    dzień dobry
    troche szkoda roweru

  • @suprabhattripathi1660
    @suprabhattripathi1660 ปีที่แล้ว +1

    Love your content! Just a suggestion: if you train your agent skills step by step like th-cam.com/video/L_4BPjLBF4E/w-d-xo.html, you can make the videos longer and add more story.

    • @Zuzelo
      @Zuzelo  ปีที่แล้ว

      Not always my environments allow for such type of training. However here I attempted something similar where I tried training first with 1 plot of land and adding the other 2 later on. Sometimes I just want more randomness from the agent, so I give the more freedom