Abandoned houses

[sand loom]

If some houses are abandoned, will residents repopulate them or will I have to destroy them and make new houses?