The Iterated Prisoner's Dilemma and The Evolution of Cooperation

แชร์
ฝัง
  • เผยแพร่เมื่อ 2 ต.ค. 2024
  • The iterated prisoner's dilemma is just like the regular game except you play it multiple times with an opponent and add up the scores. But it can change the strategy and has more real world applications as it resembles a relationship.
    THE PRISONER'S DILEMMA • The Prisoner's Dilemma
    FOOT NOTES
    Additional requirements for an iterated prisoner’s dilemma game
    For a one off prisoner’s dilemma, they payoffs can just be like 5 greater than 3 greater than 1 greater than 0 (like in the video). But for an iterated prisoner’s dilemma game to be an iterated prisoner’s dilemma game, the total payout for both cooperating has to be bigger than the total payout for one person cooperating and one person defecting. Basically 2x3 greater than 5+0.
    If it was like 8 points for defecting while the other cooperates, it would still follow the on off prisoners dilemma format, 8 greater than 3 greater than 1 greater than 0. But with an iterated prisoner’s dilemma game the best strategy would be to go back and forth between cooperating and defecting (giving them on average 4 each, rather than 3 for both cooperating). Which can happen for sure, but it’s a different sort of game.
    With a one-off prisoner’s dilemma this doesn’t matter so much. Trade might change the relationship, but it should still appear as a prisoner’s dilemma. The incentives that make it the prisoner’s dilemma would be the same. Their best strategies would still be to always defect.
    Tournament 1 vs tournament 2 (A set number of rounds vs not knowing when it ends)
    There is a bit of a logical quirk when the players know how many rounds there are. A big part of game theory is getting into your opponents head, predicting what they will do. Also thinking about the whole game and reasoning backwards.
    So when they know how many rounds there are, the last round against any given opponent, has no consequences. If you defect in the first round the opponent can reciprocate and you probably won’t be better off or it. But an opponent can’t reciprocate against any defecting in that last round. And since no matter what the other person is going to do, defecting gives a better payout. A player should defect in the last round... so should everyone really. They will only get more for doing that. We should expect them to do it.
    But then if everyone is defecting in the last round, not in response to anything that happened before, then really the second to last round also has no consequences. Nobody is going to defect because you defected in the second to last round. What they’re doing in that next round is already set, if we defect in the second to last round we’re not giving up future gains we could have gotten while cooperating. So everyone should defect in the second to last round because there are no consequences and the payoff is higher. But then if everyone is defecting in these rounds, then the third to last round also has no consequences…. Blah blah, defect the whole time. With this reasoning the correct strategy is to always defect.
    But we already know that ALWAYS DEFECT isn’t a great strategy here. Because defecting has consequences.
    But reasoning backwards, in this context, only works if everyone is doing it. If everyone has thought that way. If everyone reasoned this way, then everyone is always defecting. Then always defecting is the best strategy against that.
    But the people who submitted for this tournament clearly didn’t reason this way.
    Maybe because most of the time in the real world, we don’t know how many rounds there are, so we always think our actions will have consequences. Also we rarely interact with one person in isolation. We can build a reputation for being un-cooperative. If we are dicks to people who we are about to never see again those who will may not want to cooperate with us as much. So those who submitted thought like this.
    Maybe because they didn’t know about the idea.
    But even still, in the context of that tournament it would still better to defect in the last round. I suspect TIT FOR TAT or FORGIVING TIT FOR TAT modified to defect in the last round would have won... in the tournaments at least. If you're done with a relationship and you kill them and take your stuff, the people watching you won'y want to cooperate with you.
    For that tournament they actually changed the definition of what a “nice” strategy was to allow defecting in those last few rounds against an opponent. The weird space where the two ideas meet.
    Cooperating with whom?
    Cooperation and defection refer to between the two players. Not necessarily with outside forces like with the police.
    Patreon patreon.com/us...

ความคิดเห็น • 927

  • @MindYourDecisions
    @MindYourDecisions 8 ปีที่แล้ว +513

    Well done! Repeated games are one of the more difficult topics to explain, and this presentation should help many more people understand tit-for-tat and cooperation in the repeated prisoner's dilemma.

  • @net_has
    @net_has 8 ปีที่แล้ว +1180

    Whenever anyone says "nice guys finish last", I just refer them to this dilemma.

    • @MidWitPride
      @MidWitPride 8 ปีที่แล้ว +181

      Unconditionally nice guys finish last. No one should be nice to people who are trying to take an advantage of you. Also, most of these "nice guys" are not really being nice, but are (very poorly) trying to manipulate someone. They are just using niceness to get laid, so it is this very artificial kind of niceness, where they say nice things all the time, but never really self-sacrifice, and when they just come across as creepy, they cry how women only date jerks. Then there are the genuinely nice guys, but they don't advertise themselves as "the nice guy", but think that being nice is just part of basic human decency, so they don't make a big deal out of it. I would be extremely wary of people who all the time advertise some quality of theirs. Be it their niceness, intelligence, morality, whatever. It usually means they are trying to take the attention away from some other shady shit they are up to.

    • @net_has
      @net_has 8 ปีที่แล้ว +78

      Dude, "nice guys finish last" doesn't even refer to romantic/sexual endeavors. Though it can be applied to them, that's not the point of the saying. I wasn't thinking about that at all when I wrote this.

    • @MidWitPride
      @MidWitPride 8 ปีที่แล้ว +52

      If you google that phrase, +90% of results will be about romance.

    • @net_has
      @net_has 8 ปีที่แล้ว +7

      Actually, it's a pretty even split. As far as image results go, it's almost entirely about romance, but otherwise, that's far from accurate.

    • @Balldropper
      @Balldropper 8 ปีที่แล้ว +68

      When people refer to "nice guys" they don't refer to tit for that, they refer for the dude who, in this scenario, NEVER retaliates.

  • @firebolt3490
    @firebolt3490 6 ปีที่แล้ว +173

    You know that they're not milking the video for revenue when the run time is 9:58

    • @firebolt3490
      @firebolt3490 6 ปีที่แล้ว +10

      That's exactly what I mean, I wasn't trying to be sarcastic, sorry if it came off that way.

    • @ninnikins4768
      @ninnikins4768 4 ปีที่แล้ว +22

      Wish it was 2 seconds longer, these people need money if they wanna survive on this site.

    • @exoticcats6119
      @exoticcats6119 4 ปีที่แล้ว +1

      In late July monetization will be at 8 minutes

    • @Hdusiekwbshsjs
      @Hdusiekwbshsjs 4 ปีที่แล้ว +5

      This didn’t age well

    • @StrayFei
      @StrayFei 3 ปีที่แล้ว +1

      @Matthew_ you can monetize videos that are 8 minutes now

  • @pheepis5993
    @pheepis5993 7 ปีที่แล้ว +355

    him: everyone likes points
    me:wait... golf.

    • @anselmschueler
      @anselmschueler 7 ปีที่แล้ว +22

      Golf just has antipoints. You lose points when playing.

    • @MrFishtoot
      @MrFishtoot 5 ปีที่แล้ว +5

      I'm a golfer and I still hate all the points that I'm left with at the end of a round and I would like them to pack up, leave and take the kids with them.

  • @iamnot.procrastinating6886
    @iamnot.procrastinating6886 8 ปีที่แล้ว +295

    silent for half a year and then you reward us with 2 videos in a month?
    This is madness... THIS IS ... This place.

    • @louisng114
      @louisng114 8 ปีที่แล้ว +20

      Since it is July right now, I suspect school is the reason.

    • @turun_ambartanen
      @turun_ambartanen 8 ปีที่แล้ว +14

      there are quite some channels out there, that seem to be managed by a student. they post videos december/early in the year and around june/july/august. simply the time between semesters at an university. thats why many of these channels cover a specific field in detail, but not much more.
      i think the person behind "this place" studies biology, exspecially in the field of evolution.

    • @TheGreen_Banana
      @TheGreen_Banana 5 ปีที่แล้ว

      I'm debating going with a sparta or Patrick joke..

  • @GBart
    @GBart 8 ปีที่แล้ว +320

    Why good beats evil in the end, proven with math

    • @sk8rdman
      @sk8rdman 8 ปีที่แล้ว +72

      No. It proves that the optimal strategy in a prisoner's dilemma scenario is to retaliate immediately, and always be the second to forgive.
      That's not what I would call good. It's not necessarily evil either. It's just the best strategy.
      The prisoner's dilemma has a reward system designed to encourage cooperation anyway. The fact that a "good" strategy beats out an "evil" one is due to the way the reward system is designed; not an inherent law of nature. Not all reward systems work this way, so we can't call this a proof for good vs evil.

    • @CharTheDude
      @CharTheDude 7 ปีที่แล้ว +13

      Except in the last round

    • @Treblaine
      @Treblaine 5 ปีที่แล้ว +5

      "Evil will always triumph because good is dumb" - Dark Helmet.

    • @MrFishtoot
      @MrFishtoot 5 ปีที่แล้ว +5

      This seems like a stupid thing to ask but could you give an example of a real world reward system that does not reward cooperation?

    • @Puya008
      @Puya008 4 ปีที่แล้ว +9

      @@MrFishtoot It's not a stupid thing to ask, because actually that's a good and important question. His comment saying that "this is not a law of nature" is nonsense and false, because this strategy and rewarding system is exactly how nature by itself works. We can see this proof everywhere we look in the evolution of animals and also in today's economy. We humans managed as species to get this far and developed because we learned how to cooperate and as a result we evolved much better comparing to solitary animals or any uncooperating species.
      Retaliating when necessary and cooperating when is fair is a very good strategy in life.

  • @moritzkockritz5710
    @moritzkockritz5710 8 ปีที่แล้ว +286

    Where can I get the letter G? There is no link in the discription

    • @louisng114
      @louisng114 8 ปีที่แล้ว +86

      Believe, and the letter G will reveal the link to you.

    • @y__h
      @y__h 8 ปีที่แล้ว +29

      +louisng114 GG

    • @roidroid
      @roidroid 8 ปีที่แล้ว +40

      GG?
      i wanted G when it was unique and exclusive, but now it looks like it's multiplying, i don't want it anymore.

    • @louisng114
      @louisng114 8 ปีที่แล้ว +26

      roidroid Such impudence! The letter G is not multiplying. It is just the duality of G. One is two, and two are one. It is the same being in two different forms.

    • @MIQofDMC
      @MIQofDMC 8 ปีที่แล้ว +8

      Silly you. It's like someone who is wearin lasses askin where their lasses are.

  • @gagaoolala9167
    @gagaoolala9167 8 ปีที่แล้ว +156

    Could you explain the HARRINGTON strategy? I couldn't find any articles.

    • @ThisPlaceChannel
      @ThisPlaceChannel  8 ปีที่แล้ว +76

      The book didn't give much description of it. Harrington isn't the name of the strategy (nor is JOSS), these are the last names of the people who entered them into those tournaments. That may be why you can't find info on them. Most of the strategies in the book were referred to that way.
      But here is where the passage talking about it. Or if that is a temporary link search for "harrington evolution of cooperation" and it should bring it up.
      books.google.ca/books?id=GxRo5hZtxkEC&pg=PT33&lpg=PT33&dq=harrington+evolution+of+cooperation&source=bl&ots=j4qSHfDXTE&sig=71hE72G-aiTDFzYqvttJnczbNn8&hl=en&sa=X&ved=0ahUKEwiu6dnRwN3NAhUj9IMKHa7iDHcQ6AEIIjAA#v=onepage&q=harrington%20evolution%20of%20cooperation&f=false

    • @TheBasikShow
      @TheBasikShow 8 ปีที่แล้ว +4

      If you'll forgive me asking, what is "the book"? It sounds interesting.

    • @hero19876
      @hero19876 8 ปีที่แล้ว +13

      click "read more", there's a link

    • @DamianSAAAN
      @DamianSAAAN 7 ปีที่แล้ว +5

      I think he provided one, I read about this in the Selfish Gene.

    • @columbus8myhw
      @columbus8myhw 7 ปีที่แล้ว +2

      Exploitative strategies don't go extinct in the real world… As they say, "There's a sucker born every minute." An example would be con-men.

  • @gamefan1353
    @gamefan1353 8 ปีที่แล้ว +54

    Where exactly can I order my G's ? I almost ran out recently and need to stock up a_ain. Damnit, I ran out of them, _reat...

    • @johnallen3542
      @johnallen3542 5 ปีที่แล้ว +4

      Heres some g's gggggggggggggggggggggggggggggggggggggggggggggggggggggggggg

    • @ilt255
      @ilt255 5 ปีที่แล้ว +1

      gg

    • @want-diversecontent3887
      @want-diversecontent3887 4 ปีที่แล้ว

      Try Avoid7. Don’t use a seventh-symbol.

  • @Dagerae
    @Dagerae 7 ปีที่แล้ว +50

    I had a contest like this in my computer science class. Each strategy played each other one 200 times. My program started by cooperating, then acted like tit-for-tat unless one of two things was true: either the opponent had defected more often than cooperated or the opponent had defected 5 or more times. I also submitted an alternate program that was the same, except it always defected on the last round.

    • @flukenchrome9259
      @flukenchrome9259 2 ปีที่แล้ว +6

      That strategy would be the only viable non-nice strategy

  • @carykh
    @carykh 3 ปีที่แล้ว +19

    This is such a well-animated and well-explained video! I wonder if it makes sense to defect on the very last move because you can’t be retaliated against?
    EDIT oooh I just read the description and I see you discussed it there

  • @ralph7349
    @ralph7349 8 ปีที่แล้ว +6

    almost 100000 subs ?! this channel grows fast (it is what it deserves for this great quality)

    • @liskers
      @liskers 8 ปีที่แล้ว +3

      They aren't growing fast enough. They deserve a lot more.

    • @ralph7349
      @ralph7349 8 ปีที่แล้ว +1

      +Aveyago I agree

  • @Anonymous-jo2no
    @Anonymous-jo2no 8 ปีที่แล้ว +24

    What is the Harrington strategy? I tried searching, but I cannot find about it anywhere.

  • @UnCavi
    @UnCavi 8 ปีที่แล้ว +25

    You are, by far, one of the best channel I know on TH-cam. I'd put You on the same level as Vsauce or Kurzegesagt, if not even higher.

    • @maartenbamelis9581
      @maartenbamelis9581 8 ปีที่แล้ว +3

      Mix in Kurzegesagt's facts with Vsauce's philosophy. All three of them great channels. Oh and +1 to This Place for the satire at the end ;)

  • @y__h
    @y__h 8 ปีที่แล้ว +156

    This is supposed to be like life isn't it?

    • @natttomes4588
      @natttomes4588 8 ปีที่แล้ว +6

      i think so

    • @sk8rdman
      @sk8rdman 8 ปีที่แล้ว +27

      It's supposed to demonstrate why certain strategies (like tit-for-tat) evolve in environments where the reward system is similar to that of the prisoner's dilemma. These sorts of environments are often, though not necessarily always, present in real life scenarios. In that sense, yes; it can be used to demonstrate the benefits of strategic patterns in certain (but not all) real life scenarios.
      The important factor here is the reward system. As reward rules change, strategies will change to fit them.

    • @shitdamner
      @shitdamner 7 ปีที่แล้ว +2

      his avatar is earth and his name is this place. so yes

    • @SpaghettiToaster
      @SpaghettiToaster 6 ปีที่แล้ว +3

      No.

    • @heinzguderian9980
      @heinzguderian9980 6 ปีที่แล้ว +15

      It demonstrates how morality can arise from natural selection.

  • @iconoclastic23
    @iconoclastic23 8 ปีที่แล้ว +27

    What a great video! Most people don't realize it, but game theory is build in to our very genes, and indeed the genes of every living organism. You really illustrate this point in an easy to understand way. I remember reading about these tournaments in The Selfish Gene, a book that quite literally changed my view of what life is in a radical way.

    • @ThisPlaceChannel
      @ThisPlaceChannel  8 ปีที่แล้ว +8

      I really like that book. I learned about evolution in high school and university but didn't really get an understanding for it till that book. I can't believe how old it is though. We should have been learning evolution through that lens the whole time.

    • @iconoclastic23
      @iconoclastic23 8 ปีที่แล้ว +11

      This Place
      The gene-centered view of evolution is very useful model for thinking about how life works, but it's also a very challenging and counter-intuitive way of thinking about how life works. We humans love to feel important, and it's hard to feel important if one sees oneself as merely a vehicle constructed by their genes for the "purpose" of gene replication.
      The more you learn about biology, though, the more this view rings true. Consider the sea squirt, a creature that develops a brain during its larval stage, but as soon as it reaches the next part of its life cycle it finds a nice comfy spot to anchor and live out the rest of its existence without the need to move or react to its environment in any way. Then the first thing it does is digest its own brain and nervous system since they're no longer useful to the genes of that organism.
      We only have a brain, and by extension a consciousness, because it's useful to our genes for their vehicle to be able to move around and react in real time to happenings in their environment. Then you can start to think about all the many and varied ways that our genes manipulate our consciousness to their own ends, and you start to realize how deep that rabbit hole goes.
      This is precisely why I think metacognition is one of the most important things we can do, unless we consider our own thoughts and why they occur to us, we're slaves to the unthinking will of our genes; but as soon as we see the chains for what they are, they melt away. And make no mistake, what is best for us is not the same as what is best for our genes. Our genes will tell us that sacrificing ourselves for two siblings or eight first cousins is a roughly even trade.
      Our genes know nothing of human flourishing, they simply run on the unthinking calculus of how to best replicate; and most of us are running their operating system on the hardware of our minds without even thinking about it, we're walking around on complete auto-pilot. That's why The Selfish Gene is more than just an interesting book, it's an important book; and I'm glad that you're bringing many of the concepts contained therein to a new generation.

    • @bwoy12345
      @bwoy12345 8 ปีที่แล้ว

      It feels like after your comment got This Place's attention you saw it as an opportunity to share thoughts so you immediately tried to say everything you could that was relevant lol

    • @iconoclastic23
      @iconoclastic23 8 ปีที่แล้ว +1

      bwoy12345
      Sure. I have quite a bit to say about the gene-centered view of evolution and I don't know very many people who understand it well enough to talk about it with.

  • @GrndMsterShake
    @GrndMsterShake 8 ปีที่แล้ว +46

    Virtues Last Reward anyone?

    • @everettmeekins4121
      @everettmeekins4121 8 ปีที่แล้ว +3

      Awesome game, have you played/ are playing Zero Time Dilemma?

    • @hugofontes5708
      @hugofontes5708 8 ปีที่แล้ว +3

      ok, this is getting a bit creepy now
      I randomly decided to try 999 a week ago, around 5-6 years after a friend of mine suggested it. I did google a few things up (ice-9, glycerin, "can I find Snake?") then I find out there's a new game (ZTD) and bump into a 999 live gameplay 00:00 today and I find this comment here. Morphogenetic fields playing tricks on my unconscious

    • @hugofontes5708
      @hugofontes5708 8 ปีที่แล้ว +1

      I hadn't seen any ZTD or VLR news before playing and finding stuff

    • @fawkzy
      @fawkzy 8 ปีที่แล้ว +6

      I was hoping to find a comment referencing VLR :P

    • @sophiethegreat9
      @sophiethegreat9 6 ปีที่แล้ว +1

      ^^

  • @brinerustle
    @brinerustle 7 ปีที่แล้ว

    The fascinating thing about this is that it even explains interspecies cooperation. Kropotkin's Mutual Aid was a hugely popular work when it was first pulished, and I think we've spend much of the last century in denial of the evidence for cooperation, because no one could think of a reason it might exist. Now we know! Thanks!

  • @christopherg2347
    @christopherg2347 5 ปีที่แล้ว +10

    I remember hearing of this, in a "Social Darwinism" context. People always asume that the *most complex* one are the best adapted.
    But this is an actuall test where one of the least complex tactics (just copy the other sides last move) won. It was way less complex then any other strategy entered (except maybe "always play nice") but still won out.

  • @skiller5034
    @skiller5034 7 ปีที่แล้ว +51

    New strategy : TIT FOR 1 1/2 TATS basically TIT FOR TAT, but it defects every other enemy defection, doesn't matter if they are back-to-back or 100 rounds away. Plus, if the opponent defects at the same time, it becomes TIT FOR TAT as long as the opponent keeps defecting, then when the opponent cooperates again, it switches back to itself, as in defect on the second defection. It may not do as well as regular TIT FOR TAT, but it might just be better than FORGIVING TIT FOR TAT, since it would still retaliate on strategies like TESTER, while still preventing defection echos.

    • @gino14
      @gino14 4 ปีที่แล้ว +13

      "Tit For Tat but I'll Remember This."

    • @LadySunami
      @LadySunami 4 ปีที่แล้ว +5

      Yeah, I was wondering what a "less forgiving" tit for tat would be like. For instance, it "forgives" the first time, but then if they do it again, the programming swaps to regular tit for tat mode unless they "play fair" for some number of rounds, after which it goes back to being forgiving.
      You could call "only forgives once" version "fool me once" or something like that. Then you could make several variants that have different requirements for rounds of fair play before switching back to "forgiving" mode, and see which works out the best. You could also try variants like having it so each time they "betray" it sticks to regular tit for tat mode even longer before going back to being forgiving, and/or after a certain number of betrayals it *never* leaves tit for tat mode.

    • @saumitrashukla591
      @saumitrashukla591 3 ปีที่แล้ว +2

      Kinda like we forgive, but not forget?

    • @kaleidoscope5054
      @kaleidoscope5054 3 ปีที่แล้ว

      Smart

  • @danielh4836
    @danielh4836 7 ปีที่แล้ว +14

    This would make an amazing evolution AI

  • @devinfaux6987
    @devinfaux6987 5 ปีที่แล้ว +28

    You know, it's always nice to have your worldview -- that cooperation is better than competition -- validated statistically.

    • @razzberry6180
      @razzberry6180 3 ปีที่แล้ว +6

      Right. But it cant be pathologically compassionate, which is why communism always gets the boot. And it cant be pathologically narssistic, which is why cronyism degenerates.
      But there is still competition...a competition of competing strategies. There isnt a Jesus Christ strategy where one it has been established it always and everywhere shall be flr all time.

    • @m.kastro591
      @m.kastro591 3 ปีที่แล้ว +3

      I wish everyone had that mentality now a days. Everyone would all be winners no matter what.

    • @AveryAyla8823
      @AveryAyla8823 ปีที่แล้ว +2

      You might enjoy reading Mutual Aid: A factor of evolution, by Peter Kropotkin.

    • @SN00888
      @SN00888 ปีที่แล้ว

      @@m.kastro591 if everyone is the winner, then nobody is, because it would be 8 billion-way draw.

    • @jetison333
      @jetison333 หลายเดือนก่อน

      @@SN00888 Life isn't a zero sum game, you can gain without forcing someone else to lose.

  • @Kabitu1
    @Kabitu1 8 ปีที่แล้ว +28

    Now I'm just wondering who got a worse score than a random strategy

  • @hotdog2841
    @hotdog2841 8 ปีที่แล้ว +40

    God I love your voice. Have my baby?

    • @igesio
      @igesio 8 ปีที่แล้ว +1

      i hate his voice ugh

    • @sagiksp4979
      @sagiksp4979 8 ปีที่แล้ว +71

      He'll kill it

  • @brandonrandonandon
    @brandonrandonandon 8 ปีที่แล้ว +9

    waiting for the day that people discover this channel and it blows up
    ill be watching like a proud father

  • @miabobeea2644
    @miabobeea2644 3 ปีที่แล้ว +3

    Giggling like a child because of the plaque that reads T4T

  • @marshmiike2
    @marshmiike2 8 ปีที่แล้ว +11

    Where can I buy the letter G?

  • @tedtubegaming
    @tedtubegaming 4 ปีที่แล้ว +9

    Idea: Tit for traitor:
    tit for tat
    but it defects last round
    so no reaction can be had

    • @ironicdivinemandatestan4262
      @ironicdivinemandatestan4262 4 ปีที่แล้ว +2

      Yeah, but since both defecting is worse for the group, once tit for traitors kill off a portion of the tit for tats, they'll get less than the tit for tats get with each other.

    • @gino14
      @gino14 3 ปีที่แล้ว

      In the 2nd tournament, the host did not disclose how many rounds there would be specifically to avoid this, as it goes against the spirit of the experiment

    • @littlevirus3562
      @littlevirus3562 3 ปีที่แล้ว

      Another idea: reverse tester:
      Betrays twice, then cooperate, then acts as tit for tat

  • @NoriMori1992
    @NoriMori1992 7 ปีที่แล้ว +6

    "Video's over now."
    Three videos in and I already love you. That was excellent.

  • @DeFaulty101
    @DeFaulty101 6 ปีที่แล้ว +5

    When you consider that life consists of a bunch of squishy computers, it's hard not to appreciate our mental algorithms, which are so complex regarding strategy, that we make and seek out videos such as this.

  • @00Linares00
    @00Linares00 8 ปีที่แล้ว +19

    I made the portuguese translation :D

  • @evollove19
    @evollove19 7 ปีที่แล้ว +1

    Wonder what a more punishing strategy would look like/ so that if you use tit for tat, but you don't stop punishing the defector till he rewards you with two turns. Then on the 2nd turn he uses the hand shake green is when you switch back.

  • @DeconvertedMan
    @DeconvertedMan 8 ปีที่แล้ว +58

    can this can explain why morals are they way they are? (I think so)

    • @calebbenson7293
      @calebbenson7293 8 ปีที่แล้ว +10

      Excellent observation!

    • @videogyar2
      @videogyar2 8 ปีที่แล้ว

      Also governments.

    • @thatbozo
      @thatbozo 8 ปีที่แล้ว +1

      Yes it is often used in state of nature discussions and explains why the state was established.

    • @fmlAllthetime
      @fmlAllthetime 8 ปีที่แล้ว +3

      Doesn't explain the state in the modern sense if you read anything by Kropotkin.

    • @sk8rdman
      @sk8rdman 8 ปีที่แล้ว +5

      Only so long as organisms gain benefits based on a system of rules similar to the prisoner's dilemma.
      Depending on the distribution of rewards, you will see different variations in strategy evolve.

  • @lisbeth9668
    @lisbeth9668 6 ปีที่แล้ว

    Wow, TMM brought me here and that was amazing, thank you!

  • @islilyyagirl
    @islilyyagirl 4 ปีที่แล้ว +3

    here's an idea, T4T but it always defects on the last turn

  • @realultraformerlyultranact6542
    @realultraformerlyultranact6542 4 ปีที่แล้ว +2

    Double Grudger: Grudger, but let 1 defect through.

  • @jademonass2954
    @jademonass2954 5 ปีที่แล้ว +14

    this is that game! The evolution of trust!

  • @Nathan-wm8yb
    @Nathan-wm8yb 8 ปีที่แล้ว +13

    Are you an accordion player?

  • @-AAA-147
    @-AAA-147 8 ปีที่แล้ว +4

    I love how the Prisoner's Dilemma has so many applications to the real world. Evolution, company rivalry, and even how people interact with each other.

  • @badmanjones179
    @badmanjones179 5 ปีที่แล้ว +2

    me before this:
    after this video:
    I must Learn all there is to Know about the Prisoners Dillema

  • @avasam06
    @avasam06 7 ปีที่แล้ว +3

    I really wasn't expecting such a complete video on this subject

  • @fanaticgamingboy
    @fanaticgamingboy 9 หลายเดือนก่อน +2

    Did Veritasium copy this video? his story seems pretty similar with some (imo unconvincing) application of the ideas plus some new stuff at the end. I guess maybe the story for the prisoner's dilemma can only be told in so many ways? but tbh i'm a little suspicious.

    • @bclxprss
      @bclxprss 3 หลายเดือนก่อน

      Veritasium directly has this video on their references so they definitely took inspiration. But the Veritasium video has more than enough original content (notably, interviews with Strogatz and Axelrod, the actual sources of both videos) to justify its own existence

  • @890Mitch
    @890Mitch 8 ปีที่แล้ว +4

    Can't wait to get my letter G in the mail!

  • @Niker107
    @Niker107 8 ปีที่แล้ว

    As usual, amazing video. Good work!

  • @peterp-a-n4743
    @peterp-a-n4743 5 ปีที่แล้ว +5

    This dumps a good part of religious and moral philosophy. Thanks for making it as simple as possible but not simpler.

  • @bennemann
    @bennemann 5 ปีที่แล้ว +1

    I highly recommend everyone playing "The Evolution of Trust" free online flash game by Nicky Case. It's basically an interactive version of this video that's easier to understand and where you can change some rules to see how it changes which strategies survive.

  • @luboisfat
    @luboisfat 8 ปีที่แล้ว +3

    Actually tit for tat still wouldnt be optimal. The optimal one would be tit for tat where you always pick "defect" on the last round, since that would be the most beneficial move that would have no consequences.

    • @TheAdmiralBacon
      @TheAdmiralBacon 8 ปีที่แล้ว +7

      "And they didn't do a set 200 rounds; that way nobody would know when the interaction would end."
      Pro tip: When the people who clearly know a lot about a topic (like Jesse, or the people running the tournament) tell you something, they're *probably right*, especially when your counter-point feels oh so clever. Before you try correcting them maybe try re-examining the evidence with your Thinking Cap on.

    • @nettlescats3796
      @nettlescats3796 8 ปีที่แล้ว

      He just didn't listen to the whole thing.

    • @luboisfat
      @luboisfat 8 ปีที่แล้ว +1

      Uh, i was obviously talking about the first scenario.

    • @TheAdmiralBacon
      @TheAdmiralBacon 8 ปีที่แล้ว

      +luboisfat in which case forgiving tit for tat is more optimal, as are many many others methods.

    • @luboisfat
      @luboisfat 8 ปีที่แล้ว

      TheAdmiralBacon But it clearly says in the graph that Tit for Tat is the best option.

  • @lostindixie
    @lostindixie 5 ปีที่แล้ว

    So this is how humans developed their innate sense of justice. Nothing intellectual, just a survival adaptation. Fascinating.

  • @sagiksp4979
    @sagiksp4979 8 ปีที่แล้ว +3

    What will you be doing for 100k subs?

    • @ThisPlaceChannel
      @ThisPlaceChannel  8 ปีที่แล้ว +38

      nothing. but I give you permission to eat a cupcake in my honour.

    • @jykos55
      @jykos55 8 ปีที่แล้ว +2

      +This Place , Can I have milk too?

    • @ThisPlaceChannel
      @ThisPlaceChannel  8 ปีที่แล้ว +38

      milk is for winners

    • @MultiAndroid00
      @MultiAndroid00 8 ปีที่แล้ว +1

      Milk for all!

  • @tylerdarlington4269
    @tylerdarlington4269 5 ปีที่แล้ว +2

    There is a very good interactive game called The Evolution of Trust which shows basically all of this stuff but in a game. It's really cool!

  • @an2qzavok
    @an2qzavok 8 ปีที่แล้ว +12

    You can exploit tit-for-tatter by deflecting on the last round if you know what is the last round.

    • @dropmelon
      @dropmelon 8 ปีที่แล้ว +1

      That's the JOSS strategy stated in the video.

    • @an2qzavok
      @an2qzavok 8 ปีที่แล้ว +2

      +remilia scarlet no, JOSS deflects randomly, nat only on last iteration.

    • @dropmelon
      @dropmelon 8 ปีที่แล้ว +1

      failing@commenting Oh,ok.
      That strategy you said could work for the last round of the first one since the first tournament have a fixed 200 rounds.

    • @calebbenson7293
      @calebbenson7293 8 ปีที่แล้ว +8

      It wouldn't be as good against itself.

    • @Logistikon11
      @Logistikon11 8 ปีที่แล้ว +2

      Right like building trust with someone then stabbing them in the back. as you leave.

  • @downwardspiral8501
    @downwardspiral8501 5 ปีที่แล้ว

    Take a shot every time he says "Tit For Tat".

  • @juubes5557
    @juubes5557 7 ปีที่แล้ว +3

    You explain this very complicated.

  • @explode4025
    @explode4025 6 ปีที่แล้ว +2

    Search the evolution of trust.

  • @isabellev9576
    @isabellev9576 7 ปีที่แล้ว +2

    "That's a healthy piece of real estate!" - Everyone's favorite blue midget Homestar, Homsar on the letter G

  • @Athrosus
    @Athrosus 8 ปีที่แล้ว

    I love your videos , keep them coming !!!

  • @draco18s
    @draco18s 5 ปีที่แล้ว +1

    One variant of the generational game to look at:
    codegolf.stackexchange.com/q/122118/47990
    A little backstory: because the number of iterations was known (200) there started a chain of backstabbing in the final rounds (it got silly) and N tits for a tat (defect N times every time its defected against, which got up to N=54). The tweak that this particular sim had was that every generation each bot would start with 10% of the points it had accumulated during the previous generation (as well as being more populous in the pool).
    The winning bot (mine) couldn't win against one of its competitors in a straight up pairing (namely the T4T and Backstab variants; could only tie), so it *feeds itself to defector variants* in order to boost the defector population which CAN out-perform T4T and Backstab (by starting with a point lead from the previous round and then resulting in a low-point draw). During later generations Perfect Gentleman returns and out-competes the survivors.
    Literally wins 95% of the simulations with 100% victory. The remaining 5% is when every PG in the first generation pairs off against a defector and goes extinct.

  • @MananagKiVato
    @MananagKiVato 8 ปีที่แล้ว +2

    Where can I get a letter G?

  • @matthewmarcinko3993
    @matthewmarcinko3993 5 ปีที่แล้ว +2

    *Who else is basing all future interactions with people off this knowledge?* 😂🙋🏻‍♂️

  • @erhaveas
    @erhaveas 8 ปีที่แล้ว

    This is a great video. Thank you very much.

  • @slugkid8775
    @slugkid8775 8 ปีที่แล้ว +1

    If you *just* watched the first video[th-cam.com/video/t9Lo2fgxWHw/w-d-xo.html] and understood it, you can start this one at 0:56.
    @ThisPlace, thanks for making these videos. I enjoyed every one of them.

  • @OrchidAlloy
    @OrchidAlloy 8 ปีที่แล้ว +1

    Hello, maker of This Place. Have you considered making a Patreon?

  • @bwill325
    @bwill325 6 ปีที่แล้ว

    fantastic, great animations

  • @tochoXK3
    @tochoXK3 5 ปีที่แล้ว +2

    I like how this video kinda explains why many animals have some kind of moral (many experiments have shown that humans aren't the only animals with a sense of morality)

  • @demonwolf8024
    @demonwolf8024 5 ปีที่แล้ว +1

    Personally I'm a grudger. I don't care that it may hurt me, I enjoy swinging that double edged sword at someone who has wronged me.

  • @CoryMck
    @CoryMck 5 ปีที่แล้ว +2

    *If everyone was nice, the world would be a nice place*
    _profound_

  • @jrace4179
    @jrace4179 8 ปีที่แล้ว +1

    In other words, you should live by the Golden Rule.

  • @RonnygoBOOM
    @RonnygoBOOM 8 ปีที่แล้ว +1

    I did a presentation on this in grad school. We held a little iterated prisoners dilemma with starburst candies as the reward :). Then we broke down the math of it a little bit. You explained it very well, and I appreciate your animations. As a funny aside: I met my wife in that class :).

  • @jbmkids9035
    @jbmkids9035 7 ปีที่แล้ว +2

    I love this video so much! I see life as an (endless) iterated prisoner's dilemma, I was just never able to put it in words why I think we are all better off cooperating (with an occasional punishment). Thank you for making this! :)

  • @penguinchess
    @penguinchess 2 ปีที่แล้ว +1

    Wouldn't a strategy that played like tit-for-tat but always defected on the last round be better?

  • @kkirschkk
    @kkirschkk 8 ปีที่แล้ว

    MORA!!!!!! WE WANT MORA!!!!GAAAAAAAAA[muffled noises of drowning in my own spit]

  • @ArtificialDjDAGX
    @ArtificialDjDAGX 6 ปีที่แล้ว +2

    so, TfT always copies the opponents last move but starts with cooperation?
    Great strategy overall.

  • @shrug1250
    @shrug1250 4 ปีที่แล้ว +1

    There’s a game that’s exactly like this

  • @kalvinmorrison2327
    @kalvinmorrison2327 8 ปีที่แล้ว +1

    The real cruelty comes in when we're at the point where the tits and tats become spears and nuclear bombs.

  • @hko2006
    @hko2006 8 ปีที่แล้ว +1

    I have watched 3 to 4 video about Prisoner's Dilemma but this is the first one with such in depth look into the strategies, really liked it. Thanks making this!

  • @tigercraft489
    @tigercraft489 2 ปีที่แล้ว

    I wonder how a vengeful Tick for Tack would do, where like Tick for Tack if the opponent corporates so does it but if they defect it will defect twice no matter what and continue to defect until the opponent corporates then it will corporate until the opponent defects again.

  • @dry90125
    @dry90125 7 ปีที่แล้ว +1

    The 131 dislikes were all people who supported always defect lol.

  • @thelamergamer1894
    @thelamergamer1894 4 ปีที่แล้ว +2

    Any Zero Escape fans here?

  • @fermitupoupon1754
    @fermitupoupon1754 5 ปีที่แล้ว +1

    The party game Jack Box has a prisoner's dillema like question pop up in one of the minigames. Every year when we play it at the LAN party, the question comes up "take the money, and everyone who didn't loses the game. But if everyone takes the money, everyone loses the game. If no one takes the money, nothing happens" and the answer is to always take the money. As that scenario requires that everyone else in the group also takes the money for you to lose the game.

    • @cuntraptor446
      @cuntraptor446 5 ปีที่แล้ว

      "Hi welcome to trivia night!"

  • @sdsign4229
    @sdsign4229 8 ปีที่แล้ว +1

    Could someone please discuss the prisoner's dilemma in Virtue's Last Reward? In this game, it's not just an "Iterated Prisoner's Dilemma", but it's iterated with RANDOM OPPONENTS in the group! I really wonder what the best strategy is mathematically for that!

  • @turtle376
    @turtle376 6 ปีที่แล้ว +1

    "I'm going to reciprocate whatever they do, bwurp bwurp bwurp"

  • @megaagentj2248
    @megaagentj2248 5 ปีที่แล้ว +1

    In the single tit for tat invading Defecters maybe the defecters learn to farm tit for tats

  • @briansouthparkstudio1357
    @briansouthparkstudio1357 6 ปีที่แล้ว +2

    what about suspicious tit for tat lol it's tit for tat that starts with a defect

  • @shaun_rambaran
    @shaun_rambaran 7 ปีที่แล้ว +2

    I remember Richard Dawkins talking about this.

  • @Owen_loves_Butters
    @Owen_loves_Butters 3 ปีที่แล้ว +1

    5:56 how the heck did tester score lower than joss?

  • @martingutsch6985
    @martingutsch6985 8 ปีที่แล้ว

    Very well done!

  • @fredericchristie3472
    @fredericchristie3472 7 ปีที่แล้ว +1

    Wonderful analysis. I highly recommend that everyone actually read Axelrod's book: it's actually incredibly accessible to everyone and it's incredibly informative and thought-provoking.

  • @Firefly256
    @Firefly256 3 ปีที่แล้ว +1

    Reminds me of “the evolution of trust” game

  • @tapashalister2250
    @tapashalister2250 6 ปีที่แล้ว +1

    i wanna see what would happens if you put in a neural network on the job of coming up with a stratagy

  • @stadin6156
    @stadin6156 8 ปีที่แล้ว +1

    What about a adaptive strategy that uses the first rounds to identify the other strategy, to then apply the best counter-strategy?
    One problem i see with adaptive is that it is only effective if there is very many rounds.
    This strategy also allows of an "anti-strategy"; pretender. The pretender pretends to be a different strategy in the beginning and then changes strategy once the adapter has applied its counter strategy ( pretender knows when adaptive has applied counter-strategy because adaptive will react the same way every round).

  • @theBigBeepo
    @theBigBeepo 7 ปีที่แล้ว

    Subbed this is awesome

  • @MrCabbott16
    @MrCabbott16 7 ปีที่แล้ว +1

    Read Axelrod's "Evolving New Strategies", watched this, reread Axelrod... much greater clarity now. Great video. Bravo

  • @theccft
    @theccft 6 ปีที่แล้ว +1

    This is literally the most interesting video I've EVER seen, and overall one of the best videos I've seen.

  • @Rncko
    @Rncko 4 ปีที่แล้ว

    Yeah, a good experiment but sadly it doesn't apply to fiction.
    ...
    In fiction it would always be 7:08
    Especially if your background setting is Violence/Combat related where defect & cooperate = death of cooperator.

  • @katakana1
    @katakana1 3 ปีที่แล้ว

    These are the same numbers as the variation called:
    The Great Exchange of Minerals between Separate Territories to Obtain Never-before-seen and Expensive Substances (GEMSTONES)

  • @warrengday
    @warrengday 8 ปีที่แล้ว

    Brilliant.

  • @emmaparadis8342
    @emmaparadis8342 4 ปีที่แล้ว

    I want to point out the game the evolution of trust by nicky case which allows you to play with these numbers

  • @TruthAndLoyalty
    @TruthAndLoyalty 6 ปีที่แล้ว

    What about forgiving tit for tat with a history? If its weakness is being taken advantage of repeatedly, it would do a lot better modifying its forgiveness based on the history of interactions.

  • @owennewo14
    @owennewo14 8 ปีที่แล้ว +1

    I love your videos! The animation and lecture styles used really appeal to me.
    What can I do to support this channel?

  • @tannu4377
    @tannu4377 6 ปีที่แล้ว +2

    That would look good game :D