The August 17 outage, and the work ahead

(github.blog)

122 points | by 0xedb 2 hours ago

29 comments

  • cube00 2 minutes ago
    > Errors in those services triggered a client-side retry loop that increased traffic during recovery

    Symptomic of a wider trend to avoid showing the user any error at all costs, even if that means they sit watching a spinner for 7 hours.

  • arn3n 48 minutes ago
    Everyone suggesting that they simply charge users for commits to drive off AI-heavy users forgets that Github is owned by Microsoft, who has a big incentive to keep having developers use AI.

    I suspect that Microsoft would even prefer to have Github operate at a loss, if that loss were because all its users were using their models and paying for OpenAI subscriptions to generate the code.

    • OJFord 21 minutes ago
      > I suspect that Microsoft would even prefer to have Github operate at a loss,

      I assumed it does, do you know that it doesn't?

      • madeofpalk 9 minutes ago
        I presume there’s a lot of companies out there paying GitHub very large sums to host all their private repos.
        • OJFord 6 minutes ago
          No doubt. ...You can have non-zero revenue and still be loss-making though.
  • blakesterz 2 hours ago

      "Since April, monthly commits have grown from 1.4 billion to 2.9 billion. "
    
    Wow, that is some incredible growth in a really short time.
    • brookst 1 hour ago
      It really is. I know I've gone from tens a month to thousands a month. They have to be projecting >100B/month in the next year or two.
      • xyzsparetimexyz 1 hour ago
        wow. they should really institute a maximum amount of individual pushes per-month per-user.
        • consumer451 21 minutes ago
          That would just drive users into the arms of the alternatives, which would love to own the world's code... like Cursor/Musk.

          Microsoft and GitHub's only option is to suck it up, absorb this growth, and lower failure rates. They have the money, so that's not the issue.

          As someone on the sidelines, this is really interesting to watch unfold.

          • Macha 7 minutes ago
            Well either they can handle this load that Microsoft can't, or they can't. If Microsoft are going to continue to be unreliable in the absence of the rate limit then:

            If alternatives can handle the load, those who would consider those alternatives if Microsoft opposed a rate limit are likely to move to them anyway.

            If alternatives aren't able to manage, then user's aren't going to jump since those services won't actually provide more usage.

            • b112 2 minutes ago
              I think the number of commits is a red herring, but that said, I wonder how spiky their load is.

              Imagine a fee over X commits, but only during certain hours. I can imagine 90% of the commits over 6 or 8 timezones, maybe 50% over 4 right now...

        • xienze 56 minutes ago
          Which will just increase the cries of "enshittification" and hasten the mass migration to the next free platform that surely, this time, won't ever go down.
          • Avicebron 23 minutes ago
            We're small enough that we've been hosting our git infra for about a year now, I wonder how many other companies figured out they could make the trade. I've had a Github since a couple years after they started and I think they are going to become a Stack Overflow, albeit slower with MS at the helm. If Github is going to be 99% slop it's going to be really hard to use as a fun tool to show what you can do, what you've worked on, side projects, etc. I took github off my resume and I'm probably not going to relaunch my weblog if I end up job hunting, too much low-effort crap and people basically copying what a lot of us had been doing manually for years to really feel like it's anything other than a negative signal.
        • elliotec 14 minutes ago
          Why? I'm curious of your reasoning here. Do you think that capping commits would decrease the downtime problems? They have virtually infinity resources to scale the tech so I can't see that making any improvement, people would just leave.
    • toephu2 49 minutes ago
      Not that impressive when you realize it's mostly due to AI slop
      • whatsThisBtn4 1 minute ago
        Are you using free AI and built in harnesses?

        Try spending $20/mo on gpt sol and combine it with OpenClaw.

      • seizethecheese 42 minutes ago
        Impressive for whom? It's impressive for the service to have such growth at that scale, the code being slop is somewhat irrelevant. Your comment just seems like mood affiliation (AI should be dismissed, growth was from AI, therefore growth should be dismissed).
        • Aachen 36 minutes ago
          How is it impressive if we all know it's autogenerated? There's no more people there than there were before. Heck, at ~2x growth that's possibly a decrease in real humans there since bots generate loads of them per person
          • airstrike 13 minutes ago
            It's an impressively large quantity of X, not an impressively good X.
        • shimman 33 minutes ago
          Is it impressive? All it's doing is decaying the services. 15 years ago never have imagined I would go to the lengths to host a github alternative on a VPS but after doing just this (also being the last one in the my professional group to do so), GitHub is giving a master class in destroying their reputation in pursuit of advocating for hostile entities.

          Not all growth is good, especially growth that is actively hurting the company.

          There is an equilibrium in both nature and software. Purposely designing systems that mimic the effects of cancer is going to benefit who exactly?

          • seizethecheese 18 minutes ago
            This growth is surely good for github. If another company becomes the "github for AI agents", they'll lose not just their business for AI but also human coders. (Sure, maybe there will be a human coder only github, but it will be quite small.)
    • VCFundedGenYer 7 minutes ago
      Not really. It's AI commits. Not quality commits.
      • whatsThisBtn4 3 minutes ago
        Does anyone else feel bad for people like this?

        I had an interview with someone who has refused to use AI, and he has been unemployed for 2 years since graduating.

        On the bright side, if my 6 year old can make 3D video games, I expect seasoned programmers to be able to pick it up quickly. I think ego is the hardest thing to break.

      • aaronvg 6 minutes ago
        it doesn't matter though, commits create load in their system
    • mikert89 39 minutes ago
      alot of distributed systems in big companies grow at this rate, its not exponential, its mundane
      • tracerbulletx 32 minutes ago
        When a service that was already the primary git hosting provider for most of the world for 20 years grows at that rate its not mundane and its not comparable to any example.
      • trymas 27 minutes ago
        Eh, I would be more empathic in this situation[0].

        Github isn’t small startup, where other 10x threshold is as cheap as buy bigger box in your IaaS.

        When you are already biggest player in the ecosystem and you suddenly get 10x persisted traffic, with at least 30x+ forecast “soon” - I am not surprised they have issues.

        [0] even at current MS owned github

      • t-sauer 19 minutes ago
        Did you read the article? It is growing exponential.
  • jdm2212 2 hours ago
    > Errors in those services triggered a client-side retry loop that increased traffic during recovery.

    The worst outages I've been part of always have some version of this :(

    • k33P1Tr3aL 1 hour ago
      the 'ol thundering herd problem...
      • pixl97 1 hour ago
        Exponential backoff is your friend... too few people use it.
        • SAI_Peregrinus 12 minutes ago
          Jittered exponential backoff. You don't want the whole herd to come back at the same time, you have to add timing jitter to the clients.
        • r3trohack3r 52 minutes ago
          Don’t forget jitter!
          • jhealy 2 minutes ago
            Reminds me of this blog post I read yesterday, about Buildkite introducing jitter in their CI agent to reduce synchronisation

            https://buildkite.engineering/sleeping-at-scale/

          • Aachen 29 minutes ago
            I always add some jitter but never actually had a problem where it would have been relevant. Recently I added it to a project where others also see it (not just a hobby thingy but something at work) and I was wondering if it would look silly, like premature optimisation. I looked on Wikipedia for how established the practice is and it barely gets a sentence... with no reference.

            Do you know of a documented instance where it would have helped?

            • IanCal 13 minutes ago
              It’s not hard to get started, it’s a case of adding small amounts of randomness.

              If you have, say, a long poll then kick off all users due to a deploy or error (or a broadcast message) then you can have a situation where you’ve got a huge clustering of connections at 1 minute, which spreads very slowly out as real life issues give you jitter for free. You can avoid this or at least return to normal much quicker by adding some jitter.

              It might happen if all your users back off at the same rate too, if the clustering causes a bunch of errors. Error -> lots reconnect 1 minute after -> fail -> lots reconnect 2, 4…

              More likely to occur in cases where there’s a way you can have people all connecting at the same time - synchronisation to a real world event is one case and then connecting again at the same time after.

            • r3trohack3r 18 minutes ago
              Have experienced it, but didn’t document.

              Downstream database of our edge serverless platform went down. A tonne of requests failed all at once. Every service in the microservice request path, and the client, had their own retry policy.

              Clients all retried at the same time. Retries amplified in our microservice graph (1 request at the front door ended up with like 10s of retries internally as each downstream microservice along the path retried requests). Request queues backed up and couldn’t drain fast enough. Clients all timed out at roughly the same time. All waited the same time. All retried again at the same time.

              It was a pulsing thundering herd of many hundreds of thousands of requests at the front door that was amplified by internal retries.

              Had to tune up load shedding to 100% after the database outage was mitigated until the backend recovered then tune it down in increments to restore service.

              Added jitter to clients and turned off retries on the serverless platform.

            • kbbgl87 10 minutes ago
              I've had to simulate jitter recently to reproduce a memory spike in a go app using traffic control (tc). have you observed how your app works under jittery network?
            • christophilus 26 minutes ago
              If you’re talking about internet clients, I think the real world provides sufficient jitter. If you’re talking about a fleet of clients on your 10gbps network, jitter might be useful.
  • sajithdilshan 1 hour ago
    The comments just shows how entitled people have become. Most people use GitHub and features for free and have the audacity to complain.

    The outage is due to massive load increase. In 4 months the number of commits doubled to 2.9 Billions. Anyone worked with high load systems knows that’s it’s not a normal growth and how difficult even to keep on horizontally scaling in a short time period such a complex system.

    GitHub should charge at least maybe 5$ monthly fee and most of the entitled freeloaders would leave the platform and it would free up resources

    • thesdev 41 minutes ago
      > the entitled freeloaders

      Now remind me again, who trained a coding-assistant without consent on those "freeloaders" code and sold it for profit?

    • jiehong 4 minutes ago
      It seems that paid users are equally impacted as free users.

      It sounds a little bit unfair to me.

    • lysace 39 minutes ago
      "Most people use GitHub and features for free"

      Do you have a source for that factoid? (I suspect the vast majority of Github resource usage is paid. And we are upset.)

      • Aachen 28 minutes ago
        That sounds unusual for a free platform (not a limited trial but an actual free tier). Isn't it usually the case that only some small percentage can be convinced to pay?
        • foolswisdom 5 minutes ago
          They're arguing that most usage of resources would be by companies, who are presumably paying.
    • duped 10 minutes ago
      I mean, a lot of us have paid GitHub a lot of money for CI on private repos. And when GitHub themselves encourages the insane behavior of vibe coders and agents instead of just charging or rate limiting access of bots, it's hard to give them sympathy.
    • jollyllama 27 minutes ago
      Meh, just needs better QoS. Let the free tier shoulder the outages.
    • ssl-3 39 minutes ago
      Entitlement? Please. It's not like Github is a charity that operates on kindness and goodwill.

      It's a service that is owned and operated by Microsoft Corporation, and we're the product of it.

  • rcleveng 1 hour ago
    Great read - I'm glad they realize there's work ahead but what I'm missing is: * Paid customers: we know you pay us often a ton of money, and we burn your month on actions during these outages - we'll refund you for the days we spent your money and gave you no value. * Paid customer: We know you put your trust in us, so we'll ensure we have a separate pool of capacity to ensure we can keep that trust. * Paid customer: we'll proactively refund you when we miss our SLA.

    What I read from this is: * Scaling is hard, we don't have enough capacity * We give away a shitton of compute for free * I have to talk about Azure not being a steaming pile of poop, otherwise my bonus will get tweaked downward in the next comp cycle.

    Notice there's nothing about paid customers, I'll add in what they are missing:

    Paid customers: Go F*ck yourself, you don't pays us enough to be an interesting line item compared to windows server.

  • CodeCompost 58 minutes ago

       Central US data center failed to scale with it
    
    I'm in Europe and I experienced token failures as well.
  • dpweb 1 hour ago
    Sorry to suggest this but if they charged everyone say $1/mo. it would absolutely help the massive surge from AI coding they seem to have had.

    I don't like paying for free stuff but gh certainly worth it.

    • Shish2k 1 hour ago
      Unfortunately time and time again, the overwhelming majority of people show that they would rather deal with an unreliable scummy company for "free" than pay $1/mo for a reliable service which treats them with respect :(
      • chrisjj 1 hour ago
        Surely that's the point. Shed users.
    • dcrazy 1 hour ago
      Pay per issue and commit. Buy 1,000 commit credits at a time.

      Might force people to review their slop before pushing it.

      • verdverm 20 minutes ago
        I would support time based quotas or limits per tier (free, solo, team, etc)

        But I'm not going to pay per commit over my monthly plan

  • yipinwong 1 hour ago
    AWS CloudWatch has an option to show the trend and what it will be like after x-period.

    Doesn't Azure have such options so that engineers can predict to scale better? Seems like engineers are not ready for this per postmortem

    • jdm2212 1 hour ago
      The trend line does not tell you what will actually happen at scale, even if you think you're perfectly prepared for the next 10% or 20% growth. As Mike Tyson put it, "everyone has a plan until they get punched in the face".
    • dhruvrrp 16 minutes ago
      The problem is there are a class of problems that only appear after you go over the tip of what your system can handle, which are very difficult to predict or model.
  • iSloth 1 hour ago
    Has to be one of the most vague outage summaries of the year
  • ivraatiems 2 hours ago
    "We are committed to fixing these problems, as long as it doesn't involve buying things other than AI computers, hiring humans, or using non-Microsoft products."

    Calling Azure the solution to this problem when it is in fact the source of most of these problems is just fantastic doublespeak.

    Github is ripe for disruption and I hope it is disrupted soon.

    • dcrazy 2 hours ago
      > We installed as much hardware as available power allowed in our existing data centers while accelerating our migration to Azure.

      And from the RCA [1]:

      > The immediate cause of the failure was network saturation on load balancers in Central US due to a new peak in traffic.

      [1]: https://www.githubstatus.com/incidents/zkxwbgr0cnmx

      • ivraatiems 1 hour ago
        "While accelerating our migration to Azure," meaning, they will only solve problems if it helps them also use Azure more.

        It is unbelivable that aload of 2.8b commits was totally fine, and a load of 2.9b was a sitewide outage, unless they have no reporting or their tooling is completely incompetent. If things can fall apart so easily, throwing more capacity at the problem won't fix it.

        • dcrazy 1 hour ago
          You’re torturing your own logic to make Azure the villain here. And it also sounds like you lack experience with capacity exhaustion. Things fail slowly, then suddenly.
          • ivraatiems 1 hour ago
            No, I am calling Github disingenuous liars with poor motives, offering an unbelivable explanation. Not sure where the torture is, except in their statement.

            If it was failing slowly, why didn't they fix it then? Why didn't they notice?

            Could it be because they fired all the people who know how to monitor and identify such problems? That's what SREs are for.

            • dcrazy 1 hour ago
              Baseless accusation made from a position of zero information.
              • ivraatiems 1 hour ago
                Opinion based on stated facts.

                Please share the information you have which contradicts the conclusions I have drawn from Github's statement.

                (And we know they're liars. They report very few of the actual incidents they have; see for example https://mrshu.github.io/github-statuses/)

                • dcrazy 1 hour ago
                  I don’t owe you anything, much less a separately sourced counterargument. You openly admit that your opinion is not based not on GitHub’s proffered statements but on your self-admitted assumption that GitHub is actively lying in an attempt to cover up an Azure-related root cause.
        • rcleveng 1 hour ago
          There's always a cliff, this part is fine. You sometimes know the cliff but often do not.
        • cyberax 1 hour ago
          This absolutely can happen in large systems. If some part of the system is at capacity, then slightly increasing the load can cause it to fall behind and start accumulating a backlog.

          These backlogs can cause clients to make more retries, exacerbating the problem. Potentially further cascading through the system.

          • Kinrany 1 hour ago
            I believe their point is that "system is at capacity" is something they ought to start fixing before the capacity is exceeded
            • dcrazy 1 hour ago
              But then people like OP will claim that the capacity concerns are a lie manufactured to support an unjustified move to Azure.
            • cyberax 1 hour ago
              Sure. But you might not even be realizing that something is just at the cusp if the load is spiky enough.

              The art of large system design is to identify and avoid these kinds of chokepoints. And when something happens, propagate the "backpressure" up the stack to avoid queuing.

              AWS got a fair share of similar outages, so the newer SDKs now try to not exacerbate these kinds of issues: https://docs.aws.amazon.com/sdkref/latest/guide/feature-retr...

              The original AWS EBS outage is probably the canonical example: https://aws.amazon.com/message/65648/

        • stackghost 25 minutes ago
          >"While accelerating our migration to Azure," meaning, they will only solve problems if it helps them also use Azure more.

          Look, I hate Microslop as much as anyone but you'd have to purposely misinterpret TFA in order to arrive at this interpretation. C'mon.

    • bpavuk 1 hour ago
      I'm betting on Tangled and Codeberg. Tangled has a better press and in general is a dark horse, Codeberg has the "brand" and some network effects from projects that moved to there. (famously, Zig.) I heard that Sourcehut is having a moment as well, and I love the idea of email-based workflow and not having to have an account to contribute to someone's project hosted there, but I'm not maintaining anything worthwhile paying the $4/mo sub.
      • DANmode 28 minutes ago
        What if it was $2?
    • kjellsbells 1 hour ago
      Ok, but there's no universe where a major Microsoft-owned property is not being forced to run on Azure. Just like AWS pushing to get off Oracle back in the day. It would be career-destroying to suggest otherwise regardless of technical merit (and tbf, no infrastructure is bulletproof, unless you want to port GitHub to z/OS on mainframe)
    • mort96 2 hours ago
      If you're a big company, you can afford having one engineer spend one or two days per year to maintain your self-hosted GitLab or Forgejo. On top of better reliability than GitHub, you'll get the additional bonus that your source code won't accidentally leak through being in Copilot's training set.

      If you're a hobbyist, Codeberg is great, has a nice community and automatically shields you from slop contributions.

      • ivraatiems 1 hour ago
        The issue with these systems is that they lack Github's sophistication for issue tracking, knowledge transfer, and automation. I think Gitlab is a mature product in its own space and unlikey to change, for instance, at this point.

        Codeberg also has the issue of having a political stance which means they will not accept just anyone's use of the platform. That is absolutely their right and I have no issue with it, but it's unattractive to me - as someone who agrees with most of their current politics - because the day they decide they don't like me, I'm screwed.

        • mort96 1 hour ago
          I never found GitHub's systems for issue tracking to be all that great. Cross-repository issues and development plans are hard to track within a git host. I've always used an external panning and issue tracking tool, mostly Linear, and it works really well. GitLab's Linear integration is excellent, FWIW.

          I've actually worked with a couple of companies who do use GitHub for their code, and they all use Linear in addition to GitHub.

          I understand the concern you're talking about wrt. Codeberg, but I wouldn't view it as a significantly bigger risk than anything else. Any platform can suddenly decide that your project is against ToS (GitHub will absolutely not accept just anyone's use of their platform either) and Codeberg introducing some rules recently doesn't, in my mind, drastically increase the risk of a dramatic ToS change in the future. But we all have to make our own risk evaluations and I won't judge yours. Luckily, moving between Git hosts isn't that difficult; setting up CI again and losing merge request history does suck but it's not the end of the world, unlike something like, say, losing your AWS/GCP/whatever account.

        • Shish2k 1 hour ago
          "sophistication" seems like a strange way to describe GitHub to me - I've found in every individual aspect (code browsing, issue tracking, code review, package management, etc), it's the worst out of all the systems I use regularly... But it's good _enough_ for most people, and it has all those features in one place, which is more convenient than wrangling 10-15 high quality but disconnected systems
        • rcleveng 1 hour ago
          Gitlab has the benefit of having very little traffic, both free and paid. Their limits are still way above the current usage so less likely to be an issue
          • mh- 46 minutes ago
            Worth mentioning GitLab's paid enterprise offering are more expensive than GitHub's, on a per-seat basis.

            Lots of companies moved because it was cheap, but it's not anymore. Ironic that companies might choose to migrate to them now for stability, rather than price.

        • shimman 28 minutes ago
          Dude no one uses github tracking for anything serious, come on. The only thing github has over gitea/forgejo is discussions. That's the only real social "innovation" github has contributed to open source development and it's just a shitty tacked on forum.

          Also for accuracy, Codeberg has a pro-human and anti-corporation stance. Both of which are definitely en vogue at the moment.

          Much better than GitHub's pro slop sentiment, which is doing nothing but destroy their reputation.

      • unrented7977 1 hour ago
        Speaking from experience, it cost mW about a week or two per year to maintain GitLab for the startup I worked at.

        My personal GitLab on the other hand really does take only a day or two per year.

        That said, a week or two per year is just what it costs to maintain any one thing period. I spent about that much time maintaining PCs in the office, or my personal proxmox setup. It's not onerous at all.

        GitLab is super bloated and a little sucky to admin, but it's not too bad all things considered. I'm admin in my new job's GitHub org and it sucks a whole lot more to maintain.

    • awesome_dude 1 hour ago
      > Github is ripe for disruption and I hope it is disrupted soon.

      It's an expensive, low revenue generating site.

      There are, and have always been, competitors, including "host it all yourself" solutions, but nothing has really stuck.

      How is it "ripe" for disruption?

      • ivraatiems 1 hour ago
        They had $1b revenue in 2023 and now probably more than $2b in revenue... do you have cost figures showing what their expenses are?
        • bluedino 1 hour ago
          > We have since added more than 3 million CPU cores, 120 petabytes of high-speed storage, and significant network capacity. We installed as much hardware as available power allowed in our existing data centers while accelerating our migration to Azure.

          That can't be cheap.

          • cyberax 1 hour ago
            A server box now has around 256 CPU cores. So that's about 12000 servers. If each one is $10k that's $120 million. Not a lot compared to Github's income.
            • anvuong 41 minutes ago
              $10,000 is only enough for CPU cost (2x AMD EPYC 9754). The rest of the servers (mainboard, RAM, storage, power supply, network card, rack, cooling, etc.) can easily triple or quadruple the cost.
              • cyberax 2 minutes ago
                Yup. Still, it's less than their annual income by several times.
            • bluedino 1 hour ago
              Does that $10k server not need RAM?
              • mh- 45 minutes ago
                If parent commenter is off by an order of magnitude in their costs, their point still stands.
        • awesome_dude 1 hour ago
          Microsoft don't release the costs as you know, but

          Compute and Storage for Free Tiers: Hosting code for over 150 million developers and processing over 2 billion GitHub Actions (CI/CD) workflows a month requires astronomical server power and data storage. The "Free" tier is a massive cost sink that Microsoft treats as a loss-leader marketing expense

          Let me know when you understand how that's not free.

  • kvemkon 1 hour ago
    I fear to ask, how archive.org keeps up to catch all those events for archiving...
  • rawland 1 hour ago
    dang and friends, can you lock (some) threads? This is getting out of hand, it seems to me?

    GitHub outages seem to be very normal and even more emotional these days. Yet, that’s no reason to treat each other destructively. It’s sad.

    So let’s turn this energy into creating something better.

  • ChrisArchitect 1 hour ago
    Related recently:

    GitHub has alternatives, but no replacement

    https://news.ycombinator.com/item?id=49135365

    Why developers are ditching GitHub for Codeberg and self-hosting alternatives

    https://news.ycombinator.com/item?id=48842611

    and new entry:

    Cursor Origin Code Hosting

    https://news.ycombinator.com/item?id=49334209

  • bibimsz 57 minutes ago
    well written
  • lenerdenator 1 hour ago
    We need to have a package of FLOSsoftware that you could run on the cloud of your choice that offers most of what GitHub does (niceties on top of Git) without the centralization.

    GitLab was close last I remember but there was some sort of enterprise tier when I tried hosting stuff on a local server years ago. I want true FLOSS, not another SaaS equivalent of the coke dealer giving clients the good uncut stuff when they're just starting out only to sell crap when they're addicted.

    • cschep 1 hour ago
      https://forgejo.org/ promises to be this, have only lightly used it on https://codeberg.org/ but it seems nice?
      • 0x457 1 hour ago
        Forgejo is pretty neat. Their CI story is sad because it's based on act and it lacks features like GH Apps so service accounts are not possible (using a user account as service is barf).

        I self-host it and its pretty easy to have uptime higher than github when you have 3 users total.

        Absolutely do not recommend using GitLab.

      • 0xblinq 1 hour ago
        "Forgejo is a self-hosted lightweight software forge"

        That says absolutely nothing. The "What is Forgejo?" question is unanswered and instead you get a lot of words about their values, their inclusivity, etc. And the next thing in the docs is how to install it. It's ridiculous.

        I still don't know what it is or what it does.

    • verdverm 18 minutes ago
      I'm particularly fond of the concepts within git-appraise, gits back to the federated foundations

      https://github.com/google/git-appraise (unmaintained)

    • denzen 1 hour ago
      Have you looked into Forgejo?
  • rvz 1 hour ago
    And another outage. [0] Looking forward to the subsequent post-mortem on that one.

    You might want to not go all in on GitHub anymore since it is very unstable to use. A self-hosted instance would have a far better uptime than GitHub over the years.

    6 years ahead [1] on not going all in an centralizing everything on GitHub.

    [0] https://www.githubstatus.com/incidents/bhbcjn4n3jzp

    [1] https://news.ycombinator.com/item?id=22867803

  • amazingamazing 1 hour ago
    Exponential growth. No company could handle that without some issues. Good luck to them. And for those who cannot tolerate this, there are many self hosted options.
  • throwaway613746 25 minutes ago
    [dead]
  • djha-skin 1 hour ago
    [dead]
  • nycpig 1 hour ago
    Almost 8 hours of downtime across all core workflows, and the word "sorry" or "apologize" appears nowhere in this post.

    "If you were trying to ship software that day, we let you down" is classic corporate non-apology speak.

    I’m done.

    • bibimsz 53 minutes ago
      thats what i liked about it. its fact and action oriented. what does a "sorry" buy you that the "we let you down" doesn't.
    • sajithdilshan 1 hour ago
      Bye Felicia
  • mnmnmn 9 minutes ago
    [dead]
  • codegeek 2 hours ago
    [dead]
  • annoyingnoob 1 hour ago
    Github down, no hard drives available, no memory available, thanks AI!

    Seems like we are headed for Tech Gridlock.

    • jdm2212 1 hour ago
      This stuff is good! This is what a booming economy looks like. There are people out there competing with you for resources because they have cool ideas they want to implement.
      • a2ff6eeb0 1 hour ago
        Or at least they asked the AI to come up with cool ideas, which is even more interesting. It's exciting watching the world transition away from humanity being in the driver's seat!
    • yipinwong 1 hour ago
      What they can implement is to slowdown the commit rate, rate limt or just queue-up messages not to overburden their downstream service.

      I don't think GH has any of those, but just keep scaling, but that scaling failed.

      Just bad architectural decisions from the postmortem.

      --

      It will only get worse due to AIs spawning massive commits, and they don't have unlimited cloud resource.

      They can scale but not scalable in terms of effort, resources, and $

      • jdm2212 1 hour ago
        How would any of what you're saying help with this?

        > The immediate cause of the failure was network saturation on load balancers in Central US due to a new peak in traffic. Originally this was caused by an Istio sidecar pod reaching its concurrency limits and failing to auto scale correctly because of a misconfigured policy that watched host service but not sidecar limits. One failure cascaded to more and eventually four HAProxy nodes exhausted their flow limits, degrading the gateway auth path and causing widespread authentication latency and failures. The problem was worsened by optimistic retry logic which overloaded internal load balancers. Pausing HAProxy on those nodes simultaneously produced immediate broad recovery.

        • yipinwong 35 minutes ago
          load balancer failure? rate limit woudl address concurrency limits? throttle or queue up messages. auto-scale failed cause was misconfiguration policy, which i admit cannot be handled by my suggestions. The cascade? it's downstream service degradation, which I mentione should have had been prevented with queues. One of the jobs that queues/kafka solve is to prevent these downstream outages.
          • jdm2212 31 minutes ago
            If your LB is down, you're just kind of screwed. You can't enqueue things if requests aren't getting through at all. Same deal with authn/authz issues, which they also had. If you can't answer the question "is this message allowed to be added to the queue" you can't enqueue stuff.

            GitHub does use queueing for all kinds of stuff internally, though, because they're not morons.

  • monlockandkey 1 hour ago
    They should rewrite their Ruby code to a performant language.
  • addaon 58 minutes ago
    > What we have done and what comes next

    "You've seen what we've done. The August 21st outage comes next. See you then!"

  • kjuulh 1 hour ago
    Reading this port-mortem / plan shocks me, this doesn't look like a service that has been serving high-throughput services for more than a decade. In fact it is almost like they've barely started. It seems the solution has been capacity, capacity rather than architectural or data changes.

    > Our next milestone is an architecture that scales read capacity linearly with the number of readers, enabling unlimited read operations

    How do you not have read-replicas / read caches at this scale yet? Which is what I am reading from this statement. You can of course get really far with sharding and whatnot. But at some point it might become worth it to engineer your data into a model that scales better.

    • xienze 51 minutes ago
      > this doesn't look like a service that has been serving high-throughput services for more than a decade. In fact it is almost like they've barely started.

      Well that's because in comparison to the absolute flood of traffic brought on by AI, they really haven't been operating on this scale before.

  • ryanisnan 26 minutes ago
    Here's Vladimir Fedorov's GitHub contribution graph, as linked to as the author of this post:

    https://imgur.com/a/zIbT0Gi

    It shows zero contributions in the past year, on this account. This is a huge, huge red flag.

    • reticulates 19 minutes ago
      I strongly disagree. GitHub, a year ago, acknowledged the fundamental problems and began work on them. We all agree with the diagnosis and strategy: stop building new things, bring stability. Why would whether the CTO codes have any bearing on the correctness of this strategy? GitHub’s problem isn’t that leadership don’t understand the product, or that they don’t know what they should be doing, it’s that they’re battling unprecedented demand. If it was a disconnect between users and leadership on what matters, sure, a CTO who doesn’t use the product would be notable, but that isn’t the problem. And that’s all assuming he doesn’t actually use the product, maybe his privacy settings hide private commits.
    • mvdtnz 25 minutes ago
      Mine would look the same if you didn't have access to the private repositories I contribute to at work.
      • ryanisnan 23 minutes ago
        Don't contributions to private repositories simply show as: "N contributions in private repositories"?

        Here's me: https://github.com/ryanisnan

        In other words, I think his private contributions should still manifest on the contribution graph. And for being the CTO of an organization like GitHub, with no open-source contributions... Not a great look.

        • spongebobstoes 15 minutes ago
          you have to opt in to private contributions being visible like that