Hello everyone,
I'm working on training a model where the input data varies significantly. Sometimes, I provide arrays that are 90% zeros, while other times, the arrays have large values throughout. The model needs to handle both cases.
The main issue comes when I mask certain layers (which are sometimes already mainly zeros) and try to use them to make decisions. This causes errors during training. Does anyone know a good way to handle situations like this?
Thanks in advance