Serving 12mil pages

[raw kettle]

Hey! I am using fallback: "blocking" with pages router for a lot of pages that are less important but still somewhat important.

The issue I'm having is that every time Google tries to scrape these pages, my more important pages (even the prerendered ones) slow down drastically.

I use 8 instances of the nextjs app with LB so there is some scaling done already.

I suspect that this is because of the fallback blocking behavior, and maybe that nextjs runs the getStaticProps in the main event loop and not in a separate worker?

I've already done some of the low hanging fruits like moving static files to cdn.

Just curious what you would do in this situation. I suspect that one option suggested would be to host a separate nextjs server for these pages, but I would prefer not to because there are a lot of shared logic still.

Thanks in advance.

[cinder eagle]

Post created!

🔎 This post has been indexed in our web forum and will be seen by search engines so other users can find it outside Discord

🕵️ Your user profile is private by default and won't be visible to users outside Discord, if you want to be visible in the web forum you can add the "Public Profile" role in id:customize

✅ You can mark a message as the answer for your post with Right click -> Apps -> Mark Solution
(if you don't see the option, try refreshing Discord with Ctrl + R)

[gaunt lotus]

Are you hosting on Vercel? Given your relatively unique sounding situation + the LB mention, I get a sense that you're not.