#What are the know issues with MLX community models on EXO Clusters?

1 messages · Page 1 of 1 (latest)

rigid gull
#

I’m trying to set up and RDMA cluster with EXO to run large local models. I believe it has an OpenAI compatible api. Thoughts from the community?