I need to sync a few MSSQL databases > PostgreSQL databases.
I'm looking for the simplest way to do this. I know there are libraries like asynq, but I'm not sure which one to use, I don't want the library to be abandoned soon. The sync doesn't need to be real-time(it would be nice though), it's enough to do it periodically.
#Looking for a repeating task scheduler library
radiant trench
solar dune
use some cron library
radiant trench
The task needs to be fault tolerant, for example if the process restarts, it should retry the sync. I think simple cron is not enough..
If the sync doesn't happen then it will be a problem for me
solar dune
a task scheduler library shouldn't handle that for you
the job of a task scheduler library should be to schedule tasks. if you want to be tolerant to process restarts and failures, you can write some code to do that
radiant trench
I would like to see the sync jobs on a web ui
solar dune
it looks like you are not really lookign for a repeating task scheduler library, but more of an entire web application that does all of this for you 😛
radiant trench
Yeah, I'm not sure yet.. The sync needs to happen at exactly specified times, and it needs to be quick or it will be a problem. I guess I need to set up some kind of alerting so I know if it fails immediately. There are solutions like https://github.com/PrefectHQ/prefect but the issue is, there is too much of a delay when starting a job. So I'm looking for something simpler but similar
solar dune
it's possible, but pretty unlikely you'll find someone here with that. i'd probably just recommend doing a bit more googling. feels like a pretty niche thing, and honestly, if i was in your position, i wouldn't bother. i would just make a basic api and write it myself 🤷