This doesn't seem intended, cards that stay in hand aren't being played so they shouldn't get debuffed by that boss. If it is intended, it should update the moment the last hand ended; I assume taroting a card refreshes the display of your entire drawn hand?