Why doesn't Facebook use git?

แชร์
ฝัง
  • เผยแพร่เมื่อ 22 พ.ค. 2024
  • Huge shoutout to Graphite for sponsoring this video, always happy to nerd out about stacked diffs for a bit (even if Mercurial is a thought that gives me nightmares)
    SOURCES
    graphite.dev/blog/why-faceboo...
    devblogs.microsoft.com/bharry...
    stacking.dev/
    arstechnica.com/information-t...
    engineering. 2014/01/07...
    Check out my Twitch, Twitter, Discord more at t3.gg
    S/O Ph4se0n3 for the awesome edit 🙏
  • วิทยาศาสตร์และเทคโนโลยี

ความคิดเห็น • 447

  • @idle_user
    @idle_user หลายเดือนก่อน +1250

    I should go to bed

  • @pilotashish
    @pilotashish หลายเดือนก่อน +782

    tldw: fb chose to move away from git when it wasn't scaling well for very large repos. Git can handle such large repos now, but FB still using mercurial

    • @tedchirvasiu
      @tedchirvasiu หลายเดือนก่อน +43

      Thanks bro

    • @shivanshraghav538
      @shivanshraghav538 หลายเดือนก่อน +57

      maybe add that the git maintainers at the time were not the most cooperative in helping out fb to address the performance issues which resulted in fb adopting mercurial again

    • @4.0.4
      @4.0.4 หลายเดือนก่อน +8

      Real MVP.

    • @szaszm_
      @szaszm_ หลายเดือนก่อน +24

      Also, FB Engineering uses stacked diffs, which are the norm and recommendation with Mercurial, but not with Git. The sponsor Graphite implements stacked diffs for / on top of git.

    • @joaoventura6378
      @joaoventura6378 หลายเดือนก่อน +4

      That and it supports diff stacking which git doesn't

  • @marna_li
    @marna_li หลายเดือนก่อน +93

    Microsoft tried splitting up .NET into separate repositories, versioning hell, until they made it into a monorepo. They can still build stuff separately, but their entire development environment is in one repo.

  • @thomac
    @thomac หลายเดือนก่อน +253

    Monorepos do not magically solve communication between teams and interface definitions. You can "just create a PR" all the same with multiple repositories. And in a monorepo scenario you'll still get flak for touching stuff other teams are responsible for without talking with them. There's always some level of communication, diplomacy and bureaucracy when things are large scale.

    • @LongJourneys
      @LongJourneys หลายเดือนก่อน +9

      I'm the lead developer at my company and I refuse

    • @TerriTerriHotSauce
      @TerriTerriHotSauce หลายเดือนก่อน +3

      Facebook seem to have a tendency to try to idiot-proof their tooling.

    • @Fs3i
      @Fs3i หลายเดือนก่อน +1

      Of course, but at least this is possible!

    • @szaszm_
      @szaszm_ หลายเดือนก่อน +22

      The other teams can review the parts they're responsible for in your PR, but at least with a monorepo, the whole feature is an atomic unit that's either present or missing. With distributed repos, you can have different versions of each component, and it's possible that one component supports the feature, but the other doesn't, breaking things. So you need to build version management on top of it, which adds complexity.

    • @NeunEinser
      @NeunEinser หลายเดือนก่อน +7

      Yes, that is true. However, you don't loose this in a monorepo. If you want, you can still make changes just in one part and wait for someone else to do his part.
      In a monorepo, you gain the ability to potentially do changes in all parts and sevices of the software. And it can also be much easier to work together with other teams. You can start a branch, start doing the changes you need, and before you are completely done and it's completely working, the frontend dev can come along, grab your branch and start the project on his machine, can start implementing stuff.
      Then, it depends a bit on your workflow, but potentially, you could make a PR with the combined changes to update everything at once, without needing to worry about breaking your staging temporarily.
      Even better, when doing changes elsewhere, you can run your build, run your tests, etc and see unexpected issues earlier.
      The alternative is, you update a project, it gets published to your company's package feed, you pull the package in your other projects, down the line you notice something broke somewhere, you do fixes in the first repository again, pull updates again in other repositories, see that sth else is broken now, and so on. It's just so much more annoying and time consuming.

  • @elirane85
    @elirane85 หลายเดือนก่อน +26

    Considering the fact that they had to basically neuter the shit of flow (their worst version of typescript) to the point where it doesn't do type inference anymore and everything has to be explicitly defined because the code base is so large that running type inference was basically impossible, I'm not sure how this whole idea of one giant repo for everything is such a good idea for everyone.
    I am all for mono-repos, but there is a certain size limit where unless your company has the budget to have a team writing custom programing languages/type systems to solve your code base scaling problems, I suggest sticking to the "standard" git/repos model ;)

  • @danielbaulig
    @danielbaulig หลายเดือนก่อน +23

    As someone who was at Facebook at the time and personally knew some of the source control folks working on this I can corroborate this article.
    The only point is that I believe that stacked diffs workflow were a thing independent from Mercurial. We had those on git, too. The workflows and tooling significantly improved over the years though and a lot of that work happened on top of mercurial obviously.

    • @markbooth3066
      @markbooth3066 7 วันที่ผ่านมา

      Yeah, if I understand the timeline correctly, it looks like mq (mercurial queues) predated Facebook involvement in the project.

  • @dvsnavia
    @dvsnavia หลายเดือนก่อน +20

    As a software engineer making video games I can tell you that perforce is the only source control used in basically every AAA video game, would be pretty cool if you looked into it to see a perspective from a different industry!

    • @krisitof3
      @krisitof3 หลายเดือนก่อน +5

      As a game developer (who worked at AAA too), Perforce is pretty much universally hated by the whole industry. It's not used because it's good, it's more like OracleDB (very specific and hell to migrate)

    • @wildfirewill
      @wildfirewill 21 วันที่ผ่านมา

      ​@@krisitof3 Facts... I hate OrcaleDB. Currently using it on a project I'm working for contract. Currently my personal company started working on a game. After 12 years as a software engineer pivoting into game development as I always wanted to do. But never touch your heart of perforce. Currently using Mercurial because the last project I was working on for about 9 years in Mercurial. For me and the team that I'm leading it's out of familiarity.

    • @Special1122
      @Special1122 13 วันที่ผ่านมา

      never heard, is it VC for source code or assets as well

    • @markbooth3066
      @markbooth3066 7 วันที่ผ่านมา

      Perforce may be more agile now, @@Special1122 , but when I was considering it, alongside Git, Mercurial and Bazaar, to replace VSS, in the noughties, it felt very old school.

  • @Tom-bp6no
    @Tom-bp6no หลายเดือนก่อน +10

    We tried mercurial in 2012 I think and had quite a lot of merge issues, I don't remember the specifics but unfortunately the engineering team running the pilot were really defensive and presumed we were using it wrong, only to be repeatedly shown to be wrong.
    They ended up moving to Git in the end.
    I didn't really have any preference, and us guinea pig devs were open minded about it, unfortunately the team proposing it seemed to be the problem, though I'm sure they blamed us.
    I've used CVS, SVN, Mercurial, Git, and I don't really care as long as it works!

    • @fulconandroadcone9488
      @fulconandroadcone9488 หลายเดือนก่อน

      Like most people use CLI anyways. If anything if it is posible to make so many GUIs for CLI app why in the world doesn't someone make custom CLI front end for those tools. You like Mercurial CLI but need to use git, use Mercurial commands for git.

    • @markbooth3066
      @markbooth3066 7 วันที่ผ่านมา

      That really surprises me. Even after 14 years of using git, I'm appalled by it's terrible default merge heuristics. I long for the quick and simple merges of my mercurial days. Even now, when merges get difficult, I pull out kdiff3, the default Mercurial merge tool, and it makes complex git merges *so* much easier.

  • @Sk8nRock
    @Sk8nRock หลายเดือนก่อน +11

    I have only ever used Mercurial once in a small startup that I worked for and I have to say that I enjoyed it a lot more than Git.

  • @JoaoTakada
    @JoaoTakada หลายเดือนก่อน +14

    In game dev land where codebases and file sizes can get huge mercurial and perforce are a lot more common at least before git lfs

  • @l3xforever
    @l3xforever หลายเดือนก่อน +85

    1:06 “Mercurial, svn, and git” um no, the newly formed dvcs front was pushed by mercurial, git, and bazaar. SVN was a reigning king of centralized version control at the time of passing.
    Also better support for monorepos and branch management is why Mozilla is using Hg for Firefox.

    • @isaactfa
      @isaactfa หลายเดือนก่อน +10

      *was using
      The're phasing out mercurial in favour of git.

    • @l3xforever
      @l3xforever หลายเดือนก่อน +9

      @@isaactfa it's true that they've been migrating to git for a while now, but it's mostly because newer developers don't know anything but git, and official firefox docs still point to hg repo

    • @actually_it_is_rocket_science
      @actually_it_is_rocket_science หลายเดือนก่อน +7

      He said back in the day svn was one of the big 3. Svn is still wildly used. Svn came out only 4/5 years before git.

    • @firetruck988
      @firetruck988 หลายเดือนก่อน +1

      @@isaactfa Look at the state of mozilla right now, I don't think version control should be a priority.

    • @autohmae
      @autohmae หลายเดือนก่อน

      You forgot to mention: Linus had tried mercurial, but mercurial didn't scale for the Linux kernel at the time, so git was created.

  • @jermunitz3020
    @jermunitz3020 หลายเดือนก่อน +19

    I used mercurial before git and it’s actually really nice since the CLI is much easier to understand. Mercurial has become a Betamax and every IDE and CICD system has really good git support to cover up the uglier parts of git.

    • @Bozebo
      @Bozebo หลายเดือนก่อน +8

      The GIT CLI is so bad, you have to literally browse the GIT source to learn to actually use it properly.

    • @natescode
      @natescode หลายเดือนก่อน

      ​@@Bozebounfortunately true. Hence why I have so many GIT aliases

  • @ShrirajHegde
    @ShrirajHegde หลายเดือนก่อน +132

    Do we have to support you on patreon to make you use Dark Reader? 😅

    • @taylorkoepp3048
      @taylorkoepp3048 หลายเดือนก่อน +4

      LOL

    • @syedmohammadsannan964
      @syedmohammadsannan964 หลายเดือนก่อน +1

      nah man, browser extensions sus

    • @ShrirajHegde
      @ShrirajHegde หลายเดือนก่อน

      @@syedmohammadsannan964 every heard of open-source?

    • @__--red--__
      @__--red--__ หลายเดือนก่อน +1

      @@syedmohammadsannan964 what's wrong with it mane?

    • @syedmohammadsannan964
      @syedmohammadsannan964 หลายเดือนก่อน

      @@__--red--__ They can spy on you or hack you as much as they want, and no guarantee of them not doing so. Unlike apps from say, the Google play store or app store, where Google and Apple both carefully review the apps posted there and getting viruses from apps downloaded from them are rare. On the other hand, Chrome extensions are almost completely unregulated in every way. You would have no idea that an extension used by 10K people with 4.9 star reviews is spyware or not.

  • @ArneBab
    @ArneBab หลายเดือนก่อน +9

    Mercurial was beautifully engineered from the start: what needed highest performance is in C and the rest in Python. And it always started with “how can we do that right in the UI? What does the backend need so that this always works?”. For example before adding mutability to the code, they added "phases" to the core (whether something has moved to other repos: secret/draft/public) and now with the hg evolve extension, you can have safe collaborative history rewriting.
    Also that’s why everything felt like it just works - very different from things like git ... --autostash which only works for some commands.

  • @glyphrider
    @glyphrider หลายเดือนก่อน +2

    for distributed version control (dvcs), the big three are/were git, mercurial (hg), and bazaar (bzr). subversion (svn) was more of a traditional client-server, file-locking version control system, alongside cvs and others; svn was the last/best of that breed before it became completely supplanted by dvcs.

  • @xthebumpx
    @xthebumpx หลายเดือนก่อน +19

    MS getting git to scale video would be great

  • @armynyus9123
    @armynyus9123 หลายเดือนก่อน +39

    As one who misses mercurial still, after 5 years of having to use git, I find the sentence "git might be more user friendly" a bit crazy. No stress but *my* 2 cents: Mercurial is a well designed application. Git is a framework based on an object store, with tools bolted left and right onto it.

    • @Bozebo
      @Bozebo หลายเดือนก่อน +6

      Git is complete insanity..
      No wait, I meant: Git is complete insanity...
      The third dot is very important!

    • @autohmae
      @autohmae หลายเดือนก่อน +4

      What is also interesting to mention, if Mercurial had scaled at the time Linus needed it for the Linux kernel, he would have used Mercurial.

    • @armynyus9123
      @armynyus9123 หลายเดือนก่อน +3

      @@autohmae Exactly. Totally sad story for the Mercurial author, such a beautiful tool and then this. github then was the nail in the coffin

    • @ArneBab
      @ArneBab หลายเดือนก่อน +3

      Same here. I still use Mercurial for all my personal problems, because it is just so much nicer to use, and can only work well with git at work thanks to magit.

    • @jamesmillerjo
      @jamesmillerjo หลายเดือนก่อน +2

      Yes. git is capable, but lovable? Depends.

  • @ustav_o
    @ustav_o หลายเดือนก่อน

    hey man love your videos and streams, keep it up!

  • @kaelon9170
    @kaelon9170 หลายเดือนก่อน +8

    Please do a video on Microsoft scaling git for their purposes. Very interested.

  • @davel202
    @davel202 หลายเดือนก่อน +1

    This is really cool. Inspired me to look up other control systems for Mac and Unix.

  • @harolddost
    @harolddost หลายเดือนก่อน +4

    This is why i really like gerrit (git-based), you can do stacked reviews and cross repo reviews so that things get merged simultaneously so that build changes across the global change.

    • @markbooth3066
      @markbooth3066 7 วันที่ผ่านมา

      Agreed, the use of topics are essential to multi-repo workflows, ensuring changes to a dependency doesn't break things using it.

  • @connormc711
    @connormc711 หลายเดือนก่อน +25

    As an ex Facebook employee I can say I love landing 13 high stacks of diffs but hate it when it breaks half way through from a merge conflict

  • @penguindrummaster
    @penguindrummaster 13 วันที่ผ่านมา +1

    The fascinating thing about this story to me is that it mirrors my own personal growth in certain ways. The brazen young developer who is convinced that everyone else is stupid and they should just do it your way. Eventually growing up to be a wizened individual that knows collaboration leads to new ideas and potentially improvements you'd never imagined.

  • @Benjamin-Chavez
    @Benjamin-Chavez หลายเดือนก่อน +2

    Love this type of content Theo!

  • @szirsp
    @szirsp หลายเดือนก่อน +1

    1:10 Mercurial, git and Bazaar were the main 3 distributed version control system.
    SVN (Subversion) and CVS were the other most used (open) version/revision control systems.

    • @markbooth3066
      @markbooth3066 7 วันที่ผ่านมา

      Mercurial, git and Bazaar were the pretenders to the throne, but Mercurial, git and svn were most commonly talked about in those early days, unless you were part of a few very specific communities. CVS's popularity was already waning, and my first VCS (RCS) was thankfully no longer anywhere to be seen.

  • @cptCrax
    @cptCrax หลายเดือนก่อน

    The Perforce consistency problem was considered enough of a security loophole at Amazon that it sealed the deal on moving the company to Git in 2013 or so

  • @drheck
    @drheck หลายเดือนก่อน +27

    Google uses mercurial also. I think it's great. Such an improvement over perforce.

    • @kienanvella
      @kienanvella หลายเดือนก่อน +3

      Was going to mention Google. I know at least chromium was and probably still is on mercurial

    • @orbital1337
      @orbital1337 หลายเดือนก่อน +8

      @@kienanvella Since chromium is open source it actually doesn't use the Google internal tooling. It's just git with gerrit on top. The internal projects at Google "kinda" use mercurial as in they have a mercurial-based client but there is a ton of custom code around it.

    • @aussieatcmu6015
      @aussieatcmu6015 หลายเดือนก่อน

      fig (google's mercurial version of git) and critique (Google's pull request tool) are so much better than GitHub.
      I recently (at the start of this year) left Google to join a startup, and man, do I miss fig.

  • @gotoastal
    @gotoastal หลายเดือนก่อน +5

    More folks need to check out the patch-theory-based DVCSs like Darcs & Pijul

  • @alasdairmacintyre9383
    @alasdairmacintyre9383 หลายเดือนก่อน +2

    Been meaning to read this. Love that there are people on youtube that read me stuff 😅

  • @alessandrorossi1294
    @alessandrorossi1294 หลายเดือนก่อน +1

    At my first job I needed to teach myself to use a version control system. I went with mercurial because it was so much easier to understand how it worked! That was followed by 8 years at a different job where I learned git. But I still have a soft spot in my heart for mercurial. Git was tough to learn at first but I figured out most of it eventually

  • @sarjannarwan6896
    @sarjannarwan6896 หลายเดือนก่อน +19

    I think another important thing when it comes to dev push back is personal incentives. If my company wanted to move to some piece of technology, even if it might be the most optimal for what we want I might push back because it could harm personal development.
    I feel like that's a downside/risk of all these custom workflows and getting too used to big tech internal tooling.

  • @ArneBab
    @ArneBab หลายเดือนก่อน

    Besides: do you know that with the infocalypse extension there’s Mercurial tooling to have fully decentralized repositories over Freenet / Hyphanet, including pull-requests? (though this was hurt a lot by incompatibilities in byte/string handling between Python2 and Python3 - took ages to debug, because with Python 3 the different interfaces file system, network, version control give and require different data structures, but with Python2 they were all plain strings)

  • @LukasSmith827
    @LukasSmith827 หลายเดือนก่อน +1

    learning how Meta solves these optimization problems at scale is such an interesting topic that needs to be discussed more!

  • @seannewell397
    @seannewell397 หลายเดือนก่อน +8

    Re discussion around 8:50 - I've seen too many senior engineers go this route, and they have huge, _huge_ PRs. I think I can read between the lines here, and see that you want feature _slices_ to ship to prod so you can iterate quickly (multiple ships a week or a day to get stuff out), but i worry too many others hear "mono repo let's me cook" and take >1 week to do a huge feature release. And i know SW release is separate from product release, so the flags could still be off and you keep merging fixes to your broken feature, but c'mon - monorepos may be enabling some antipatterns here. small prs ftw.

    • @seannewell397
      @seannewell397 หลายเดือนก่อน +1

      I do agree that _flexibility_ is a powerful tool. many small repos do not lend themselves to being flexible, monorepos don't take away any paths to production from you.

    • @paxsevenfour
      @paxsevenfour หลายเดือนก่อน

      ⁠@@seannewell397honestly asking because we’ve been having the same discussions at work recently: how do many smaller repositories not contribute to flexibility? How is a large monorepo, conversely, more flexible?
      We have so many architectural & engineering principles that show modularity - generally speaking - has less cognitive complexity, is more maintainable, is more flexible & easier to change, easier to test at a low-level, separates concerns, supports encapsulation, etc etc…. And we see how these principles manifest themselves in things like shared libraries & packages that I pull in to a project instead of keeping all of that code in my own codebase. Or how large monolithic programs are less optimal for all of those reasons compared to modular programs, except where other concerns like maybe performance is critical.
      I’m still trying to wrap my own head around the apparent contradictions between writing small, modular, loosely coupled code but using a huge monolithic repository that co-mingles it with everyone else’s code and takes away my code’s fine-grained version control. The workarounds for most of these problems just go back to simulating smaller discrete repos like using a codeowners file to prevent others from modifying my code in the monorepo’s subdirectory.
      Lol… It really just seems like we enjoy going around and around by rehashing & relearning the same concepts & pitfalls over and over again. I dunno.

    • @TurtleKwitty
      @TurtleKwitty หลายเดือนก่อน +1

      That's why feature branches are a thing, you have offshoots from that for the smaller PRs but the feature remains one cohesive unit until it's ready to ship

    • @AZaqZaqProduction
      @AZaqZaqProduction หลายเดือนก่อน +1

      @@TurtleKwitty trunk based development with features hidden behind flags is a much better system imo. If feature branches are too long-lived, merge conflicts become inevitable.

    • @fulconandroadcone9488
      @fulconandroadcone9488 หลายเดือนก่อน

      @@AZaqZaqProduction and add huge file sizes on top, you get conflict and you don't even know was that line supposed to be 200 lines below.

  • @bleso_a
    @bleso_a หลายเดือนก่อน

    Great video Theo! Thank you 🙏🏾

  • @looksgoodhoss
    @looksgoodhoss หลายเดือนก่อน +2

    Never worked on a monorepo but I love the sound of it. If it breaks, it breaks locally, not on dev test or prod.

    • @Bozebo
      @Bozebo หลายเดือนก่อน

      Surely it's generally "horizontal" not "vertical" (though quite likely vertical in terms of networking and that's the mistake people make not using a monorepo because they think every svc needs an entire repo). You don't have a different prod and dev repo do you?

    • @fulconandroadcone9488
      @fulconandroadcone9488 หลายเดือนก่อน

      @@Bozebo I worked on a project where they had, I think 5 front end apps, which for the most part had a lot in common and a shit ton could have been reused. You could not have people from one app switch to another as it was that much different structure.

  • @Wielorybkek
    @Wielorybkek หลายเดือนก่อน +2

    really cool piece of history!

  • @vedanthinorn
    @vedanthinorn 26 วันที่ผ่านมา

    Back in 2009/2010 The small dev shop I was working in made the call to switch away from SVN. We switched to Mercurial after a long discussion simply because we felt more comfy creating in-codebase addons to Mercurial whereas Git seemed much more hostile to that sort of activity. However, that only lasted about 4 years and we eventually ended up switching to Git (Which was a very smooth transition) after the company bought another that was using Git.

  • @lukaswerner4390
    @lukaswerner4390 หลายเดือนก่อน

    I need that Microsoft git video!! That sounds sick!

  • @xprowler404x
    @xprowler404x หลายเดือนก่อน

    saw this live, good as always!

  • @dizzysnakepilot
    @dizzysnakepilot หลายเดือนก่อน +1

    I was on the initial team from Perforce visiting Facebook around 2009. They didn't reject us because of some fundamental design flaw though, by 2009 it just wasn't a forward looking solution.

  • @yungsters
    @yungsters หลายเดือนก่อน +2

    Great video that brings back a lot of nostalgia. I especially love the focus on the human aspects and on communication.
    Early on when I just joined the React Native team, I remember visiting our London office. A random engineer from the office found me during lunch and told me I was one of the last ~100 engineers still using Git instead of Mercurial, and he asked me what was missing for me to change.
    I had only held out because I worried about disrupting my workflow before Mercurial was really solid, and I told that engineer that I would switch (and I did).

  • @jirkasimecek792
    @jirkasimecek792 หลายเดือนก่อน +3

    I would definitely watch the Microsoft git back story video.

  • @Standbackforscience
    @Standbackforscience หลายเดือนก่อน +4

    I've worked at several companies that use monorepos, and every one of them proudly proclaimed that google does it so it must be right. All of them also had terrible engineering leadership and zero architectural convention. They used monorepos because they built a businesses on top of a mishmash of uncoordinated and badly-planned apps, all stitched together into a tangled mass that no one dared change. Monorepos are like waterfall - sometimes they're the right approach. Most of the time though, they're a smell.

    • @markbooth3066
      @markbooth3066 7 วันที่ผ่านมา

      Where I work once had a monorepo in svn. Merges were a nightmare. I remember merge reports that were so long they kept breaking Confluence.
      When we moved to git, we split out the project into dozens of repos, with a complex system to deploy all of those repositories, and a gerrit review system to keep to make sure changes in one, didn't break another. Merges were easier, but we had many more of them.
      When we moved away from the arcane orchestration system we were using, to using maven, we started coalescing those repos back into something closer to a mono repo, as dependencies got increasingly difficult to manage. Now, we rarely commit to more than two or three repo's depending on which project we support.

  • @JeremyEllington
    @JeremyEllington หลายเดือนก่อน +6

    If only the Git CLI were as usable as the Mercurial CLI.

    • @natescode
      @natescode หลายเดือนก่อน +1

      Git alias help a ton

  • @zayadur
    @zayadur หลายเดือนก่อน +1

    This is going to be an odd question. How did you get your browser window to be equidistant from the edges of the screen? I've been doing this obsessively for a decade, so I'm curious.

    • @peterschlonz
      @peterschlonz หลายเดือนก่อน

      I think its the Arc Browser for Mac, (Beta for Windows)

  • @Holobrine
    @Holobrine หลายเดือนก่อน

    Curious about something now…what if git sort of had multiple repositories in a larger repository, say along module lines, such that versioning is synced across them all but it doesn’t have to process modules that you didn’t edit? So in a sense it’s internally sharded, but without the drawbacks of version async. Under the hood it would be like separate repos that are forced to undergo all branches, commits, and PRs together, but it looks like one repo at the front end.

    • @adtc
      @adtc หลายเดือนก่อน

      Is that like git modules or git subtrees ?

  • @gold-junge91
    @gold-junge91 หลายเดือนก่อน

    So nice to hear maybe you can male a series

  • @masoudesmaeilian5083
    @masoudesmaeilian5083 หลายเดือนก่อน

    For git status, they bring the inode integration, so it doesn't need to check, inode is notifying about the changed files, although I don’t know why this option is not on by default.

  • @cauebahia
    @cauebahia หลายเดือนก่อน

    Hey Theo, when you say that you can add breaking changes to the BE and update the FE consumer in the same PR for a monorepo, I get it. But how are those services being deployed? I mean how do you guarantee that the FE won't be deployed before the BE or vice versa? How do you deploy those together? As always, great video and content! Thanks

    • @t3dotgg
      @t3dotgg  หลายเดือนก่อน +1

      Very good question! I have two answers, "how most do it" and "how I do it"
      How MOST do it: Build automated CI/CD, point clients at 'versioned' servers, leave old servers deployed for X amount of time (see: "skew protection")
      How I prefer to do it: Server the frontend THROUGH your backend, so the server generates the "most current" client on every request

    • @Bozebo
      @Bozebo หลายเดือนก่อน

      @@t3dotgg Why on every request? I mean I know what you mean but it sounds like build the thing on every request xD

    • @Bozebo
      @Bozebo หลายเดือนก่อน

      Mono or multi repo makes literally no difference to that problem whatsoever?

    • @cauebahia
      @cauebahia หลายเดือนก่อน

      @@t3dotgg Thanks for your reply! Maybe you could do a video on the "deploying monorepos" topic? That would be awesome! After watching this video, I tried searching for it, and I didn't find anything.
      I'd be curious to know more about how the versioned builds/servers work, how they rollback (I mean, if you rollback the server, the client might hit a dead endpoint, or some old endpoit which is not compatible, because the breaking change is not there anymore), how long the "old" servers are kept running, how the CI/CD avoids redeploying the services that didn't change, how often they deploy (they probably have thousands of merges every day), etc.
      On a much smaller scale, I believe Vercel/NextJS does something like this. I mean, a single NextJS repo is basically a monorepo (api folder + frontend), and vercel generates new deployments on every push, including preview/testing ones.
      And I'm curious to know more about your preferred approach as well. Would that work for an SPA?

  • @coolbrotherf127
    @coolbrotherf127 หลายเดือนก่อน

    Even as a CS student, how source control fundamentally works and best practices are almost never actually talked about in classes outside of the basics. Even now, I only have a very surface level knowledge of how it's actually used in a professional environment.

  • @TheTopProgrammer
    @TheTopProgrammer หลายเดือนก่อน

    Please do the scaling git and cover the technical aspects of how it works and the tools and technologies that are used to accomplish such a feat!

  • @randymccoy8097
    @randymccoy8097 หลายเดือนก่อน +2

    Git really shot itself in the foot ignoring its scaling issues for so long. I was asked to make assessment to see if git could replace Source Depot, (Microsoft version of Perforce) over a decade ago. I proved pretty convincingly that it couldn't. I asked the git team at the time if time if there was a way to mitigate these issue and got pretty much the same response that Facebook got.

    • @xybersurfer
      @xybersurfer หลายเดือนก่อน

      that's pretty sad. i think this behavior is something ingrained in the Linux community

  • @Nil-js4bf
    @Nil-js4bf หลายเดือนก่อน +2

    Isn't a stacked diff just branching off an existing branch in order to create a chain of PRs, each based off the previous one? If so, my company does that when building a feature that needs a lot of changes delivered at once since it breaks down each chunk of work into a smaller PR for review. The article made it sound like a Mercurial invention but I would have thought git always had this feature? Or maybe it was always possible in both tools but Facebook popularized it as a workflow?

    • @Alaestr
      @Alaestr หลายเดือนก่อน

      This is the thing. Although there is a suggestion that the stack can be a branched graph hinting at another feature that would be maybe a bit harder to replicate simply with git. Not impossible. One way to do it would be to have a featureA and featureB branch and then branch off of one of them e.g. featureA creating featureC and then merge featureB into featureC. And here we go, we have a stacked diff workflow.
      I suspect meta built more tooling around stacked diffs to facilitate it easily, but it can be feasibly replicated in git.

    • @adtc
      @adtc หลายเดือนก่อน +1

      Coincidentally we tried stacking workflow without even realizing it when a developer just created a new branch off an existing branch that's awaiting PR review (because the new feature is dependent on it). It became a nightmare when we approved the review and squashed the PR. Now the new branch, even when rebased, would duplicate all the commits from the original PR even if those diffs were squashed into a single commit. Without a highly focused developer training covering "interactive rebase", this is not an easy situation to fix. The second PR for the new branch erroneously shows all the commits from the first PR even though none of those commits contribute to the overall diff of the second PR at all.
      Conclusion: Git is not designed for stacking workflow.

  • @sanampakuwal
    @sanampakuwal หลายเดือนก่อน +1

    need microsoft ish video as well, entering in git land, acquiring github and related things at that time

  • @luisliz
    @luisliz หลายเดือนก่อน +1

    It’s crazy the things these companies have to do to scale the repos. I use lfs (at work not for lols) and you have to be careful with things like making sure you don’t read every file or accidentally download everything. I think I ran vim once and downloaded like 70gb of the repo before i noticed and my computer went crazy.
    and seeing the stack diff thing does make me a little jealous because I’ve had to learn to rebase and do all these things to keep things updated correctly when doing multiple features 😭

  • @To1ne
    @To1ne หลายเดือนก่อน

    More of these please!

  • @virkony
    @virkony หลายเดือนก่อน +6

    8:18 how does monrepo source solves problem of sync deployment?
    You can achieve snapshot like behavior with almost anything. Be it Git submodules or custom file that keeps track hashes (like webOS did).

    • @KaKi87
      @KaKi87 หลายเดือนก่อน

      This. It seems they never heard of this...

  • @timseguine2
    @timseguine2 หลายเดือนก่อน +2

    Above a certain size, monorepos become more of a burden than a help. And at any size they disincentivize code modularity.

  • @TheCalcaholic
    @TheCalcaholic หลายเดือนก่อน +2

    Regarding things being in sync: Aren't git modules or git subtrees a way better solution for that? That way you can do version pinning but retain a lot more flexibility as to how your projects are integrated with each other.

    • @nephatrine
      @nephatrine หลายเดือนก่อน

      Yes.

    • @ArneBab
      @ArneBab หลายเดือนก่อน +2

      git modules are a nightmare when anything goes wrong. In the free software projects where we had used them, we painstakingly moved away again, because they broke too hard when something was wrong. Missing robustness. Except for one where we had to re-introduce that, but that’s just a shell repo with some github actions.

  • @jsalsman
    @jsalsman หลายเดือนก่อน

    How well was bazaar working on large monorepos back then? I always thought it was the nicest as a sole developer.

  • @weltsiebenhundert
    @weltsiebenhundert หลายเดือนก่อน

    What Browser / OS does he use?
    I love this side bare, instead of bottom task bar

  • @TristanStoutenburg
    @TristanStoutenburg หลายเดือนก่อน +2

    I would love to see a video about lfs and other things Microsoft did to improve git

  • @virkony
    @virkony หลายเดือนก่อน

    I didn't knew there were a special name for that practice of creating reviews on top of other reviews before they being merged. In Gerrit it was just a normal way of donig things.
    But I know that some people are against having stack of changes argumenting that it requires more re-bases and conflicts resolutions.
    And I guess people who are more into pure CI, would say that it is effectively having a vendor branch which is against continuous integrations.

  • @VFPn96kQT
    @VFPn96kQT หลายเดือนก่อน +2

    Our company use mercurial too instead of git too. It works great.

  • @rjmunt
    @rjmunt หลายเดือนก่อน +4

    Ive learned that game devs typically use perforce. It works. Seems to handle merge conflicts better than git.

    • @nikkehtine
      @nikkehtine หลายเดือนก่อน +1

      Depends. It's a commercial solution so I doubt most gamedevs use it, maybe some big game studios do. Git LFS seems to do the job for most.

    • @elirane85
      @elirane85 หลายเดือนก่อน +1

      Game devs also use C++ and "fat IDEs" like visual studios. Not everything the cool kids do works for us nerds ;)

    • @dallas_barr
      @dallas_barr หลายเดือนก่อน +4

      Perforce is good at managing binary files, common in game development.

    • @baileyharrison1030
      @baileyharrison1030 หลายเดือนก่อน

      @@elirane85 VS's C++ debugger is insanely good. I've never seen any C++ vscode setup that comes close to Visual Studio's functionality.

    • @mordofable
      @mordofable หลายเดือนก่อน +1

      @@nikkehtine Perforce is considerably more preferred over git + lfs in the game dev industry. From my experience, the fact it's a commercial solution doesn't play much impact in the conversation of viability. git + lfs still has a lot of complications over perforce for game dev, especially for larger games.
      That said, I personally don't like perforce, and using it felt really clunky and unintuitive for the years I've done game dev with it.

  • @paxdriver
    @paxdriver หลายเดือนก่อน +1

    Please do a video on stacked diffs. This is new to me (2 yr casual git novice, speaking)

  • @oneito947
    @oneito947 หลายเดือนก่อน

    Phabricator is now called phorge and community maintained

  • @evergreen-
    @evergreen- หลายเดือนก่อน

    Does Facebook have any open source projects that use Mercurial though? So, they still use git for some things

  • @eccenux
    @eccenux หลายเดือนก่อน

    7:37 "magic of the monorepo is... that it is in sync" ⬅this so much! 🙂 Performance of git is bad and/or complicated, but being in sync is a great point of using something that actually support monorepo.

  • @aciddev_
    @aciddev_ หลายเดือนก่อน +1

    i like how the command and short name for mercurial is hg, which is chemical symbol for mercury :)

    • @markbooth3066
      @markbooth3066 7 วันที่ผ่านมา +1

      Mercury is after all, very mercurial, as is software development. *8')

  • @worldadmin9811
    @worldadmin9811 หลายเดือนก่อน +1

    followup should be about Sapling! :)

  • @manno9149
    @manno9149 หลายเดือนก่อน +1

    I'm really interested in the video about how Microsoft scaled up git.

  • @icantseethis
    @icantseethis หลายเดือนก่อน +6

    Yeah but I bet you cant tell me why they use windows at microsoft

  • @firstlast-tf3fq
    @firstlast-tf3fq หลายเดือนก่อน +4

    Nah, I don’t rate monorepos at all. There are huge downsides and few upsides. All of the downsides you’ve said to having smaller repos aren’t issues with the repos, they’re issues with shitty processes.

  • @zenpool
    @zenpool หลายเดือนก่อน +2

    The way these early git maintainers acts is indicative of Linus Torvalds influence lol.

  • @dave_jones
    @dave_jones หลายเดือนก่อน

    OCM is a major part of any org when they have to make hard decisions, you can’t just make a change and expect everyone to get onboard or get out.

  • @noahmetz5892
    @noahmetz5892 หลายเดือนก่อน +3

    "Ideally you should have one thing you clone that has all the services you run and all the services they need to run"
    Does nobody use submodules? Does having one "monorepo" that just links to the correct versions of various other repos not work?

    • @VictorYarema
      @VictorYarema 7 วันที่ผ่านมา

      Just a classical skill issue. They don't know how to use the tool properly so they blame the tool.

    • @markbooth3066
      @markbooth3066 7 วันที่ผ่านมา

      I've tried to promote the use of submodules many times at work, but they are quite a blunt tool, and every time I've tried, I've faced pushback.

  • @gaiusjcaesar09
    @gaiusjcaesar09 หลายเดือนก่อน

    Multi repo is hell. Joined a team that separates everything into different repos. I have 4 repos: infrastructure, pipelines, application (lambdas) & frontend (React). Changing an API means changing 3 different repositories, getting 6 reviews, and all the normal issues with devops (random bugs or issues).

  • @joeyjoah
    @joeyjoah หลายเดือนก่อน

    At first I hated the monorepo, but over time I came to love it and now it's the git flow that feels weird lol

  • @lukeshepard5988
    @lukeshepard5988 หลายเดือนก่อน +1

    Facebook didn't actually start on git. (Source: I worked there prior to 2012). Their primary early version control system was subversion. But git supports local branches, which allows stacked diffs at all (much harder to do in svn). Many devs began using git-svn to allow local branches before the company eventually moved to a git backend. That's where this video picks up...

  • @privacyvalued4134
    @privacyvalued4134 หลายเดือนก่อน

    14:47 Buy in is so critical for ANY project. If you don't have end-user buy in (i.e. the people who will be most impacted by a change), then the system will go entirely unused. Software development is more about getting social acceptance than the language or code being written/used. Yes, you still have to develop the software, but if no one uses it, then it was a waste of time.

  • @be1tube
    @be1tube หลายเดือนก่อน +2

    This video improved my impression of Meta

  • @4.0.4
    @4.0.4 หลายเดือนก่อน +1

    Please make a video about how you can make a tweet into a 20 minute video. This could have been a half-length TH-cam Short with the same info.

  • @nightshade427
    @nightshade427 หลายเดือนก่อน

    Radicle decentralized peer to peer git looks interesting as well

  • @legendcat8913
    @legendcat8913 หลายเดือนก่อน +4

    please talk about scale git

  • @abc-nw3hi
    @abc-nw3hi หลายเดือนก่อน

    i would be really interested in a direct comparison of pijul against mercurial

  • @Dhalucario
    @Dhalucario หลายเดือนก่อน +5

    I kinda wish fossil was more of a thing. It seems like such a pleasant alternative to the other VCS.

    • @WHYUNODYLAN
      @WHYUNODYLAN หลายเดือนก่อน +1

      Oh god. I use it at work for some repos and I have to disagree. OOTB it seems nice but you quickly miss many git features and run into many nuisances.

    • @Dhalucario
      @Dhalucario หลายเดือนก่อน

      @@WHYUNODYLAN Dang, I am sorry to hear that. Are the devs aware of the missing features?

    • @d3stinYwOw
      @d3stinYwOw หลายเดือนก่อน

      @@WHYUNODYLAN Maybe it's because you're used to git way of work? When you pilot stuff, try to embrace solution as whole.

    • @WHYUNODYLAN
      @WHYUNODYLAN หลายเดือนก่อน +1

      @@Dhalucario The fossil devs? Yeah, sorta.
      The main difference for version control is that fossil doesn't allow rewriting of history, which is very intentional. I do a lot of weird stuff with my repos so that's already a fairly big nuisance for me. However, I sorta misrepresented my point because the other features I prefer in git, well, they aren't actually to do with git.
      Fossil is a whole "project management" system--issue tracking, wiki pages, etc. So it provides the same stuff as e.g. Github, but, frankly, it's not as good as what I'm used to. For instance, there's no concept of pull requests so at work we have to perform code reviews in Jira tickets. Fossil devs consider it to be more "featureful" for having this stuff built-in, but it's also very restrictive, since you can't jump between tools like you can with Github/Gitlab/Codeberg.

    • @WHYUNODYLAN
      @WHYUNODYLAN หลายเดือนก่อน

      @@d3stinYwOw I could maybe agree with this if we were able to lean into fossil fully. We still have to use a whole bunch of other tools for project management, so we only use fossil as a VCS system. That being said, I think I'd still much prefer something like Forgejo if we were to go the route of "one tool for everything".

  • @yt.Interest
    @yt.Interest หลายเดือนก่อน +21

    im going to bed, unlike that dude V

  • @hellowill
    @hellowill หลายเดือนก่อน +2

    Lol my new company has a repo per microservice... I tried explaining we can still do microservices with a monorepo but they don't listen lol.
    So if you go to make a common change (e.g. edit some linter rules) you have to do that in like 10-20 places now.
    And yeah, multiple PRs for a feature (when it could be 1) is counterproductive.

    • @Bozebo
      @Bozebo หลายเดือนก่อน +1

      "I tried explaining we can still do microservices with a monorepo but they don't listen lol."
      I've been there. Apparently engineers don't know what a directory is!

  • @rayansailani4465
    @rayansailani4465 หลายเดือนก่อน

    Would likes video on how git scaled with git-LFS considering we use it for handling some monoliths…

  • @winchesterdev
    @winchesterdev หลายเดือนก่อน +1

    I was waiting to hear where sapling fits into the story, but nothing.

  • @ArneBab
    @ArneBab หลายเดือนก่อน +1

    I admire the dev-team at Facebook¹ for taking the step to model how their tooling would look a few years later and taking steps to fix infrastructure before the limitations turn into crippling problems. That’s how they came to choose Mercurial. And strangely, only few companies understood that and followed. How much the tech-world *ignored* that blog post highlighted how horribly broken tech-communication is.
    ¹ regardless of how much I dislike Facebook itself.

  • @iochimura
    @iochimura หลายเดือนก่อน

    Would love a video on Git-LFS 😃

  • @MrSN99
    @MrSN99 หลายเดือนก่อน +7

    i need to stop procrastinating

  • @MasterSamus
    @MasterSamus หลายเดือนก่อน

    What browser are you using?

  • @Fanaro
    @Fanaro หลายเดือนก่อน

    8:20 Does the Linux kernel use monorepos?

    • @chielonewctle7601
      @chielonewctle7601 หลายเดือนก่อน

      I don't think so. Functionalities can be implemented with kernel modules.

  • @rmschindler144
    @rmschindler144 หลายเดือนก่อน +3

    if Szorc is a Polish name, as it appears to be, then it’s pronounced, ‘shorts’

  • @Bozebo
    @Bozebo หลายเดือนก่อน

    I was rejected for my first big job application out of Uni because I didn't know Mercurial xD
    At a time when very few places even used source control.

  • @JayAntoney
    @JayAntoney 20 วันที่ผ่านมา

    Yes please. Lfs for git video!