Separate interact buttons when near a building and a follower

[tidal dagger]

It's impossible for me to cook and harvest devotion from the center building with how many followers I have, so if one of the combat buttons that isn't used at the cult could pop up in addition to the regular interact button that would be helpful