#Distributed-sytems project ideas

5 messages · Page 1 of 1 (latest)

lucid root
#

Hi all, I'm a software engineer who works in Rust (and some Python).

I've recently (the last year and a bit) become more and more interested in distributed systems.
I'm looking for advice on resources/projects that can help me grow my knolwedge further, with the goal being to transition from a job in the ML space.

I usually pick hobby projects based on solving problems I encouter in my day to day.
However I can't think of any such problems that involve distributed systems (nothing in my day to day requires implementing RAFT and running it on 20 nodes etc).

Things I've done already:
A hobby project of my own idea that allows remote execution of arbritary Rust code on remote machines over TCP with load balancing between nodes.
The fly.io distributed systems challenge (all parts).
The codecrafters.io challenge on building a redis clone.

One idea I have had is to create a generalized testing harness for consensus algorithms.
Such that I could then go about implementing a bunch of papers and comparing the results under different workloads.
However this seems like it might become a bit tedious with no motivating factor/overall project goal.

dull topaz
#

Jon gjengset made a great video about DSs

#

I know long form content might not be for everyone but this guy is great and it was helpful for me ferrisButGrimacing

lucid root
#

Yeah I've already done those challenges (the fly.io ones).