Hey guys, we're running into issues with our railway server being overloaded. We keep getting 503 errors Application failed to respond. Is there a way to scale our railway server / enable autoscaling? Thanks!
#Server overloaded -- How to Scale?
lament estuary
plush thunderBOT
proud stumpBOT
lament estuary
82091a0b-2976-40b9-bb0f-784a7f99567f
ocean rampart
elfin quail
are you sure that it's server overloaded thing?
and yes, you can scale using replicas
https://docs.railway.app/develop/services#horizontal-scaling-with-replicas
lament estuary
We're on the Pro plan
Hmm
This is a screenshot of our metrics
Maybe the server isn't overloaded in terms of available CPU / Memory, but it's just that our code (nodejs server) is inefficient at handling many requests at a time, so it simply fails prior to the available CPU / Memory becoming saturated?
Ahh seems like increasing replicas fixed it! Thanks
Though I'd still be curious to know why it didn't autoscale in the default settings, as having to manually manage replicas isn't super convenient haha
elfin quail
Though I'd still be curious to know why it didn't autoscale in the default setti...
autoscaling isn't available in Railway for now, but they've plans to add it
elfin quail
Maybe the server isn't overloaded in terms of available CPU / Memory, but it's j...
probably the CPU is saturated, nodejs is single-thread anyway
fluid plover
@elfin quail I have a question regarding this
How to determine how many replicas would be needed to scale the application