How we can scale on the redis side ?

[near forum]

On my instance, i have really tons of request made each second (see pictures, the blue is because my boss want enterprise color everywhere...)

My problem is that i am bottleneck by the redis, i have tried to setup the redis as a clustered one but it does not seems to work.

Currently i have 2 vps 16vcore and 16go RAM, i would like to scale to be able to take more.

My base idea was to setup the redis as a cluster + the mariadb on one of the VPS and appwrite on the other one.

@tawdry widget here the post

[tawdry widget]

Are you setting a password for the Redis cluster?

[near forum]

No, as we discuss previously you not support password on redis

[tawdry widget]

Also, congratulations. If that's not a DDoS and real/valid requests 🙂

[tawdry widget]

Okay, what error are you getting?

[near forum]

appwrite  | Fatal error: Uncaught RedisException: MOVED 5994 172.18.0.4:7001 in /usr/src/code/vendor/utopia-php/cache/src/Cache/Adapter/Redis.php:39
appwrite  | Stack trace:
appwrite  | #0 /usr/src/code/vendor/utopia-php/cache/src/Cache/Adapter/Redis.php(39): Redis->hGet('default-cache-_...', 'default-cache-_...')
appwrite  | #1 /usr/src/code/vendor/utopia-php/cache/src/Cache/Adapter/Sharding.php(55): Utopia\Cache\Adapter\Redis->load('default-cache-_...', 86400, 'default-cache-_...')
appwrite  | #2 /usr/src/code/vendor/utopia-php/cache/src/Cache/Cache.php(49): Utopia\Cache\Adapter\Sharding->load('default-cache-_...', 86400, 'default-cache-_...')
appwrite  | #3 /usr/src/code/vendor/utopia-php/database/src/Database/Database.php(2925): Utopia\Cache\Cache->load('default-cache-_...', 86400, 'default-cache-_...')
appwrite  | #4 /usr/src/code/vendor/utopia-php/database/src/Database/Database.php(1283): Utopia\Database\Database->getDocument(Object(Utopia\Database\Document), 'audit')
appwrite  | #5 /usr/src/code/vendor/utopia-php/database/src/Database/Database.php(495): Utopia\Database\Database->Utopia\Database\{closure}()
appwrite  | #6 /usr/src/code/vendor/utopia-php/database/src/Database/Database.php(1283): Utopia\Database\Database->silent(Object(Closure))
appwrite  | #7 /usr/src/code/app/http.php(198): Utopia\Database\Database->getCollection('audit')
appwrite  | #8 [internal function]: {closure}()
appwrite  | #9 {main}
appwrite  |   thrown in /usr/src/code/vendor/utopia-php/cache/src/Cache/Adapter/Redis.php on line 39

Sorry, i'm more on the dev side than the admin system side, its the first time i have this kind of problem.

[tawdry widget]

From what I understand, appwrite/utopia doesn't support natively Redis cluster so that's why it throws that error.

Alternatively you will need to use a proxy

Like twemproxy

So it acts as a single Redis instance, but it's actually a cluster

[near forum]

How do you scale on your side I have tried twemproxy but it does not support brpop command. And appwrite seems to use this kind of redis command

[tawdry widget]

Well, I didn't need to scale it horizontally yet. Cloud needed it, but no idea how they handle it.

From what I understand they use a proxy.

Maybe you can try envoy proxy?

[near forum]

i will retry twemproxy, maybe i have not configured it correctly, if its possible could you ask how the cloud version scale ?

[tawdry widget]

I think it doesn't support brpop
cc @fiery kindle do you have some idea about this? 😅

[fiery kindle]

Ya you probably can't connect however you're doing it. It has to look like a regular redis instance to Appwrite

[near forum]

After searching a lot, I goy the same answer. My question is how do you scale on the cloud version. Because there is not a lots of proxy that allow clusters with the possibility to use brpop commande (appwrite use blocking redis command)

[fiery kindle]

Unfortunately, we can't provide details on appwrite's cloud infrastructure, but our VIP users typically have direct access to the Appwrite team to assist with any issues. We can take support requests and customize a solution for you depending on your needs. Let me know if you have time this coming Monday and I can connect you with someone to discuss further.

[near forum]

I’m available on monday to discuss on this further

[fiery kindle]

Great! @lunar night will reach out to you to discuss further!

[lunar night]

Hi @near forum, its great to meet you. Where are you based? Want to make sure I propose some times that work on both ends.

[near forum]

Hello i’m based in France