I figured out that the issue was related to the "active color" set by my theme. However, when I go to my profile, I see that I have 2 colors set, and the theme is set to Backend-selected. My configuration.yaml has the frontend: line, and it has themes: !include_dir_merge_named ./themes under that section. In the ./themes folder, I do have a file named google_dark_theme.yaml, and it has what I would think is my theme...
However, I can't seem to find any state-icon-active, or related colors/settings... Can anyone confirm that if it's set to Backend-selected, it's using that line/setting from my configuration.yaml? And if so, do I have to add a specific line setting the --state-icon-active-color: to whatever I want color I want the Active/On/Connected devices to show up as?
EDIT: I stated that completely wrong after looking in so many places. I 100% see a state-icon-active-color: setting, however, it does not match what is getting set on my server. It's showing up as yellow, when the color that is set on that google_dark_theme.yaml file is #5F9BEA, which is blue.
HOWEVER, there is NO state-icon-active-color: setting in my /config/themes.yaml, which makes me think that's what it's using for the front end? Can anyone confirm that though?