My Appwrite server don't respond

[vagrant zealot]

My Appwrite server not responding last thing I saw at VNC it ran out of memory I restarted the server and still can't access ssh or console of appwrite , I only can access my "Contabo" Server through Secure System SSH , Any suggestion please ??

[low gate]

System specs?

[vagrant zealot]

6 GB Ram
4 vCPU cores
32 GB traffic
Debian appwrite 0.15

[rancid marten]

What are the logs for the appwrite and mariadb containers?

[vagrant zealot]

The VPS not accessible through SSh and it's the problem but last thing was shown on appwrite before restart

[rancid marten]

Why you can't access through SSH?

Do you have tried restarting the entire VPS?

Oh, I see, yes

[vagrant zealot]

I tried restarting VPS yea I can only run it through secure system

[rancid marten]

wdym?

[vagrant zealot]

I am using Contabo Debian Secure System

It makes ur sever accessible to change firewall configration maybe but I can't see anything of my server files , so It's not useful for me

[rancid marten]

So you can't interact in any way with the server? If so, that sounds more like a contabo issue 😓

[vagrant zealot]

I contact them btw and waiting their response , I am just making sure that I can't do nothing from my side , and just waiting ..

[rancid marten]

Do you have some important data on the server and if so, some backups?

[vagrant zealot]

200 GB

they delete the snapshots every 30 days , so I need to re-snap shot and they just deleted it 1 day before the issue , so I am not sure how I can backup it .

must run 1 time before i can backup

[rancid marten]

You mean you don't have backups? 😬

[vagrant zealot]

no , lost back up 24 hours ago ..

[rancid marten]

I think we can't do too much from our side as it's crucial to access the server. Sincerely it's very weird as something unusual needs to happen to make the entire ram being filled quickly and everything crash.
But even in such specific scenario, you should be able to access some way the machine and restarting it usually makes everything work again.

Regarding the snapshots, you mean that Contabo deleted the snapshots without you doing anything?
I think all of this sounds like a contabo issue unrelated to appwrite 😓

Also, maybe your VPS is affected by some maintenance?
https://contabo-status.com/

[vagrant zealot]

the snapshots not is deleted automatically yea , and it's something like a point you can back to after doing action , I mean I think it's not the Out Of Ram issue , I think it's totally another issue from Contabo Side and What I have is just waiting their answer ,

I can Access my server through secure system

[vagrant zealot]

My Server Host ID not listed there but I think it's maybe from it

the maintaince is taking about 10 Hours for now

[rancid marten]

But do you can access the server console at least?

[vagrant zealot]

I can access server SSH in something Called Re-Secure System

but I can't reach files so wasn't useful

VNC Showing nothing just black screen

[rancid marten]

I see. Very weird

For the next time, make sure to make backups, and not snapshots. Always have one in your pc or a different provider (for example Google drive) so in case of a complete disaster you can restore at least data up to a certain point before the provider manages to get back everything

I recommend this method:
https://youtu.be/lM5yZEPtlvg?si=T-c9Ne8KFG0juz4z

[vagrant zealot]

will do for sure it was a big mistake from my side to not have a one in outside area , I will just try to run this for 1 time at least

[vagrant zealot]

@rancid marten
I D5 , how are you hope u having a nice day , server back online again and worked for some hours , but problem occured again ,
that's the VNC , It's storage problem I think ?

[rancid marten]

That look like an issue with a hard drive. Also as you can see it says that a power off occured

If you can access it, make a backup asap and transfer it to your PC

Also an option is using the migrations feature

[vagrant zealot]

Power of maybe cause I restarted it , Hard drive issue cause it's out of storage or what as I can't see the exact issue

[rancid marten]

But the server is working now?

[vagrant zealot]

no, worked for hours then turned off again , then I restarted it and that's the VNC After restart

[rancid marten]

So you don't know the amount of storage being used?

If the data in the server is important, get it out from the server sasp as you can 😅

[vagrant zealot]

the problem that I can't change server in current time as I will force all my users to upgrade , and in real time it's impossible before 1 month , So I need to spend on this server until the month pass ..

in Appwrite Console last time it shows 180 GB my Stroage is 400 GB , I have other small tools not exceed 10 GB Like portainer , Grafana ...

[rancid marten]

You should have all the data in your PC even if you're not going to move. Imagine it doesn't starts again never because Contabo messed up everything...

Anyways If you're using a custom domain you can switch the server instantly by changing the domain record, no need to update

Also, what's the server max storage amount?

[vagrant zealot]

Yea I Know I can switch using domain , but What I mean I have about 200 GB on Appwrite Console , while my server storage is 400 GB , so does the way u sent above compressing the data will be enough for this , That's the point why I didn't take a back up in last hours when server worked again " I am afraid that I run out of storage while doing this and loss accessability again " need to increase storage of my server first to can have a 200 GB Backup so I am waiting Contabo to increase my storage as I can't do it in automated way " need a request takes 24 hours " so they didn't increase it , so need the server to run again first then improve sotrage to take backup .... so ... I am asking about if the VNC Showing any problems related to out of storage or something that cause the server to stops to avoid if the server Started again to can take the Backup

[stoic sphinx]

@vagrant zealot did you try to restart the server?

[vagrant zealot]

for sure restarted 2 or 3 times

it's contabo issue , I made sure from that , their servers go alive and stop alot of times this year especially these days a lot of people complaining from this

[stoic sphinx]

contabo is the cheapest but also the worst hosting... try hetzner or ionos

[vagrant zealot]

I used it for 3 or 4 years , it's the first year I suffer like that , servers back online again And I will search for best way to fastly get my backup , suggestion is approciated , I have another things on my server like ngnix proxy manager , portainer , appwrite , etc .. so I appericate suggestion to maange all of this docker containers in best way

[rancid marten]

What about using the migrations feature? That will replicate the data in another instance and it doesn't needs to use the local storage

[vagrant zealot]

I am using 0.15.3 Appwrite

I think I will use Duplicati to copy all appwrite containers volumes , and will stop Appwrite trafiek first before copying the appwrite_mariadb , I think it's enough right ?

server is running now so I will start

[rancid marten]

Oh, then that's different 😅

You're using local storage to store files?

If so, you can copy the folder that contains all the files to your PC easily with winSPC:
https://winscp.net/eng/index.php