Cant join my friends server?

[brittle scroll]

When me and my friend try to join eachothers servers, we both get put in the same server with random people which we get disconnected from in a matter of seconds, even though he joined a server called
[My name]'s server
and i try to join
[Friend's name]'s server
And well yeah, we both get put in a server with some farmmaster or something and someone else who we never met before