My friend disconnects on my screen and I disconnect on his screen but everyone else is fine.

[astral knot]

Basically when I or my friend join server with eachother in it we both get a bug where we disconnect in eachother's screen. I can't enter a game he is in and he cant enter a game im in. The same issue persists with random players trying to join (only a problem if im not in the lobby). Theres only 1 guy he can play with without having him disconnect. None of us are using mods and all are on PC