frank cairn
Hey everyone! I’m looking for some advice on finding a good performance/cost balance for my setup.
I have a website that, among other things, displays an aggregated Gamma expiration (GEX) graph updated every 10 minutes during market hours. I’ve been storing this data in an Azure SQL Database since 2022, and the table currently has about 24M rows. Now I want to improve the user experience by allowing filtering by expiration date . However, adding this filter significantly increases the data size — to around 400M rows for the same time period.
The idea is to access this data via APIs that serve the front end of the website, so responsiveness and query performance are important.
I’m trying to figure out a cost-effective way to support this scale with good performance for users. I’ve looked into ADX, Synapse, Fabric, etc., but I’m not sure which direction to go. Has anyone implemented something similar or have suggestions on the best path forward in Azure?
Thanks in advance!
desert palm