Maps not unloading

[tropic salmon]

For me atleast, when I play a map, especially an intensive one such as, slums and i return to the tavern, there is very apperent lag, as if the map wasnt loaded, i go from 60 fps to 20, trying to use the menus feels like im playing on a controller with severe stick drift