I would say a majority of people never play night mode; I haven't played a night game myself in months. It's not that a night mode is necessarily bad but not very good in it's current state. Some night maps are just a murky mess while some are hardly night at all. What I suggest is have the time be randomly assigned between Daytime and Nighttime.
Daytime
Daytime would obviously be the most common, having a high chance of appearing because time changes are supposed to be something special. No changes would really need to be made as it's the default.
Nighttime
Nighttime would be a rare occurrence, a little twist or surprise to spice up the game. A more uniform night effect would be best because as previously stated, sometimes it doesn't feel right sometimes. The focus would force players to get closer and more aggressive in fights by obscuring visibility. A dark haze similar to Dusty would stop long range snipers while encouraging the use of thermal vision. Speaking of which, while the current Night vision is fun, it's flawed by how the players end up using it. Sometimes I never had to take them off, leaving a slight change to infantry gameplay and others I was forced to put them on and off so frequently that became just plan frustrating to use. (All the interactions aside from the flares I consider very well done)
Night Vision
Night Vision goggles should either be removed or turned into a specific piece of gear to equip. The binoculars would be a perfect replacement as I've never once considered or seen someone use them in a round. Making it a piece of equipment would cause the player to have to make a choice whether they want visibility or functionality (Using them would work by switching to them to toggle or as they are now). They would still have the same interactions with flashlights, flashbangs, and other light sources with the only change I suggest is to shorten the lifespan of flares and rework the weird light they give off.