I inquired within NetApp and here is the response from an SME. I hope this is helpful.
...............................................................
If the OpenShift management network is different from the storage network, and you’re deploying Trident in such an environment, then it is necessary to create a NetworkAttachmentDefinition and reference it via an annotation in the Trident deployment YAML.
• Now, type of NetworkAttachmentDefinition: Use the ‘bridge’ plugin here as your storage network is separated from the management network. We should not use ‘own-k8s-cni-overlay’ here as Trident requires access to external storage endpoints, often on a separate VLAN/subnet, which overlay networks don’t support directly.
• It is not necessary to add NAD to all Trident-related pods.
o NAD is needed for trident-controller pod as it needs access to the storage backend
o NAD is required for trident-node pods. For example, if your storage protocol is NFS or iSCSI, then the node pods need direct access to the storage network to mount volumes
o NAD is not needed for trident operator pod as the operator is only responsible for managing the lifecycle of Trident components, and it does not interact with the storage backends directly.