#Any update on this outage? It's > 24 hours now.

27 messages · Page 1 of 1 (latest)

gloomy monolith
#

I'm a bit amazed at the size of this outage. Any updates? Much of our product has been down and we have lots of customer support inquiries asking about when this will be up.

Nothing on twitter about the outage.

dire parcel
gloomy monolith
#

can you share whats going on?

#

we need to blast our entire userbase at this point

#

so we'd love to give them some info on whats going on

gloomy monolith
#

Images are down for us

#

Do we know why this is happening? This is a pretty major outage, I'd expect a cloudflare twitter announcement

#

there are dozens of services down

#

but nothing on the public threads

dire parcel
dire parcel
#

At least from what i can gather

gloomy monolith
#

wow, good luck restoring this. It's crazy how massive of an outage

blazing minnow
# gloomy monolith Do we know why this is happening? This is a pretty major outage, I'd expect a cl...

Power to Cloudflare’s core North America data center has been partially restored. Cloudflare has failed over some core services to a backup data center, which has partially remediated impact. Cloudflare is currently working to restore the remaining affected services and bring the core North America data center back online.
The closest offical explaination they gave given, datacenter lost power, only partial restored for a while

dire parcel
gloomy monolith
#

im blown away by how large this is

#

and the length its been down

blazing minnow
#

the core indeed has most of their core services, only a few like tunnel api failed over instantly

dire parcel
#

Yea

blazing minnow
# gloomy monolith im blown away by how large this is

yea haven't been too many updates on the dc itself, apparently it was Flexential pdx02 which CF colocates in, rumor mill says the dc lost utility power, and gens failed to fire up, and they got partial power back only after a few hours. I think(?) they have full power now, but guessing other complications are still a factor. That DC as well is the landing for a few submarine cables and other critical infrastructure

strange cave
#

when streaming service will go live?

dire parcel
#

Cloudflare Stream?

blazing minnow
#

#stream message

strange cave
#

yeah We can't upload video ( it big setback and I am afraid if this can happen in future(

dire parcel