Due to the sublevels just not being loaded before they're supposed to, in some cases you can just walk up to the houses (especially Museum) before the sublevel is loaded and see that its just fully empty
A really fast and simple way to fix it is to just put curtains on the windows to cover them up so you cant see the inside before its loaded in