GitLab Outage

66 pointsposted 13 hours ago
by kunley

33 Comments

davb

12 hours ago

Coincidentally (?) we’ve seen a huge uptick in failed login attempts to our MFA-protected admin accounts on our self-hosted Gitlab CE instance today. They’re coming from thousands of IPs across hundreds of networks (VPS providers and, apparently, residential proxies).

deckar01

12 hours ago

There was a relative lull in GitHub bot activity the last few weeks, but they seem to be back today. I assume the promo token flood gates opened for the new models.

physicallyIllfr

12 hours ago

I dont think bots need bonus/trials. There are lots and lots of ways to get free, or virtually free tokens. Hell half the vibe coded AI chrome extensions send store their openrouter keys client side.

b0afc375b5

13 hours ago

Interesting that the status page was updated immediately. Is this the norm now? I remember back in the day when status pages showed all green even when servers were clearly down for a long time already.

seabrookmx

12 hours ago

As others mentioned, it wasn't that quick.

It's also not accurate. After nearly a half hour the page shows "git operations" as green but I'm not able to push/pull from my repos with SSH or HTTPS (and haven't been able to the whole time).

kunley

42 minutes ago

It was updated at least 5 minutes after I noticed the outage first. Guess it's typical organisation lag

thesh4d0w

13 hours ago

It took at least 5 minutes, closer to 10. I think the outage is so bad, it got pushed fast.

theplumber

3 hours ago

Maybe Sam or Dario is playing hide and seek again with the agents….

hk1337

10 hours ago

I like what tangled seems like it could be but it's still too new to really use. It'd be nice if it was more of an aggregator for git servers where still access a git server whether tangled is up or not.

mitxela

10 hours ago

You don't really need one of these systems. You can just host git.

hk1337

4 hours ago

True, my thought was a site that just makes it easier to see all the various users. Like GitHub but links to users and orgs actually go to each person’s server.

lampcord

11 hours ago

Another day, another reminder why we self-host our GitLab instance. Cloud convenience always has these kinds of trade-offs.

zer0x4d

11 hours ago

We self host ours too. 100% uptime ;)

gib444

5 hours ago

How do you do upgrades?

TZubiri

11 hours ago

what host are you using that gets 100%uptime? A hyperscaler like AWS?

mitxela

10 hours ago

Just means it hasn't crashed yet.

zer0x4d

10 hours ago

I run it on Digital Ocean but AWS should be fine too.

firesteelrain

10 hours ago

VMWare Cloud Foundation with Dell R7725s

nabeards

13 hours ago

Just went to push code and found this out.

nicholasjarnold

13 hours ago

Code review for me... Hit the 503. The status page lagged the event by ~10 mins or so it seems.

git+ssh also seems affected, as I'm unable to push/pull right now.

smalltorch

13 hours ago

Gasp! immediately builds a complete git alternative to never expirence a single second of downtime ever again

JonChesterfield

12 hours ago

Well, git is already distributed, so you could use _any other computer_ instead of gitlab.com...

smalltorch

11 hours ago

I'm only kidding, although it could be a good excersise to learn. I think a pure TUI git front end / back end project would be fun to make.

gblosser

11 hours ago

or go back to Mercurial...

Do you remember Mercurial?

Pepperidge Farm remembers.

mitxela

10 hours ago

Isn't it just git but harder to use?

lemonish97

11 hours ago

Right, on to another alternative now

tibbon

10 hours ago

Seems they can compete with GitHub after all! /s