little coral
We have a Snapmirror relationshipt between
NetappA - Source - AFF900 - 4X40Gbs
NetappB - Dest - FAS8300 - 4X25Gbs
But we cant achieve troughput > 10Gbs
throttle is disabled on both sides.
Network Team statement: No QoS or bottlenecks and no Firewalls between the two Netapps.
sysstat on dest avg 65% CPU and 30% disk util
sysstat on source avg 20% CPU and 5% disk util
What we should check next?
fleet narwhal
Same switch? Or different switches? It could be a link between switches. Remember: A multi link port channel is only as fast as its slowest member. If there is a 4x10gb channel between two switches that works explain it. A host will only use one of the members for communication
little coral
I will ask. But Network Team , if i remember correctly, has denied that any port in between is slower than 40Gbs.
Between Datacenter A and B we have a 4X100Gbs
little coral
Snapmirror troughput not >10Gbs
fleet narwhal
All it takes is one bad route between source and destination!
tidal trail
Run a link test and tell us what you see - https://docs.netapp.com/us-en/ontap-cli-9111/network-test-link-run-test.html
Network people are real good at “not my problem” until you show them it is 😛
little coral
fas----::*> network test-link run-test -node fas---- -vserver fas---- -destination -------
Node: fas-----
Vserver: fas-----
Destination: 10.160.29.103
Time of Test: 9/21/2023 08:39:07
MB/s: 1442.493263768264
fleet narwhal
What is the output of
options -option-name repl*
sturdy saffron
basically 10Gbit/s ... you can trick the system to use multiple physical links by using multiple ip's/lifs ... even mutiple vlans... you just have to set them up as intercluster links
little coral
I have 40Gbs...why should i use multiple 40Gbs ports to get more than 10Gbs?
`fashap13::> port show -node fas----- -port e1a
Node: fas-----
Speed(Mbps) Health
Port IPspace Broadcast Domain Link MTU Admin/Oper Status
e1a Default - up 9000 auto/40000 healthy
Node: fas-----
Speed(Mbps) Health
Port IPspace Broadcast Domain Link MTU Admin/Oper Status
e1a Default - up 9000 auto/40000 healthy
Node: fas-----
Speed(Mbps) Health
Port IPspace Broadcast Domain Link MTU Admin/Oper Status
e1a Default - up 9000 auto/40000 healthy
Node: fas-----
Speed(Mbps) Health
Port IPspace Broadcast Domain Link MTU Admin/Oper Status
e1a Default - up 9000 auto/40000 healthy`
Oh yea..forgot.
It is an 8 node MC
sturdy saffron
net int show -role intercluster
unborn goblet