There are 4 such cards on A400, and configured as 10Gb within LACP group. In order to conver them to 25Gb uninterruptly, what steps or commands I need to perform?
Please advise.
#What commands to convert CX5-Mezz from 10Gb TO 25Gb on A400?
modest wharf
cursive violet
what make/model of the cards are they? X1161A?
If they are running at 10gb and you need to change them to 25gb, are part of an LACP and the switch can do 25gb as well, you 'should' be able to convert one port at a time in the group.
something along the lines of
shut the port down/Remove port from the group?
Shut the port down: net port modify -node node01 -port e0a -up-admin false
Remove port from the ifgrp: net port ifgrp remove-port -node node01 -ifgrp ifgrp01 -port port00
change port speed
net port modify -node node01 -port e0a -speed-admin 25000
Add it back to the group or -up-admin true to bring it back online.
Of course you need to prepare the switch side to do the same
Depending on what switch vendor you are using.. you should be able to just do a port shut on that one port.
It's been a while since i've done anything with LACP/LAG, but if you don't shut the port down and/or remove it from the group and remove it on the storage side you can end up with a loop.
Unless spanning tree is running on your network, removing a port from a trunk can result in a loop. To help prevent a broadcast storm when you remove a port from a trunk where spanning tree is not in use, Hewlett Packard Enterprise recommends that you first disable the port or disconnect the link on that port.
Anyone else, please feel free to correct anything I missed
crisp sinew
In most cases port speed should be auto. I responded to this exact question on Reddit
To convert them, I would do this:
- MIGRATE all LIFs to partner node (net int migrate-all node xx)
- SHUT all the ports down (advanced, net port modify -node xx -port e1|e2|e3|e4 -up-admin false)
- replace all four cables/optics as needed
- NOSUT all the ports (advanced, net port modify -node xx -port e1|e2|e3|e4 -up-admin true)
- Verify the ifgrp is working
- Revert the LIFS (net int revert *)
Of course, you could risk it and simply replace one cable at a time. ONTAP may detect "flapping" and it may take a few minutes for the port to actually be "stable" and ready.
The MEZZANINE cards are absolutely automatic. You just plug in the 10G SFP or the 25G SFP. No reboot needed. I think every single ONTAP device that supports 25G with auto-down to 10G and back up to 25, just depends on the optical transceiver or twinax cable used. Just do NOT use the 10/25G optics in ONTAP. No supported (as far as I remember. Not saying it doesn't work...Not Supported!)
Same goes for all the 100G ports. No ONTAP changes needed to go from 100 to/from 40.
Of course the exception to all the above is if someone hard-coded a speed to an interface, that will need to be undone or changed
modest wharf
@crisp sinew
Just do NOT use the 10/25G optics in ONTAP.
What do you mean by that? I am not clear on what you meant. I thought ONTAP device supports 25G or 10G just depending on what SFP used as you advised.
Thank you!
crisp sinew
@modest wharf There are 10g optics. There are 25g optics. There are also auto-10/25g optics. Don’t use those
modest wharf
I have already been using " Dual 10G/25G Ethernet Controller CX5-Mezz". Is this auto-10/25g optics?
crisp sinew
No
You refer to the mezzanine card
I am referring to the sfps that plug into the mezzanine
Like this:(unsupported in ONTAP)
https://atgbics.com/products/cisco-systems-sfp-sfp-10-25g-sr-s-fibre-optic-transceiver
modest wharf
I see. Thanks
strong sluice
@crisp sinew Hi, i've just received two A400 to replace A300's. They were shipped with 4* 10/25 optics in each node. Our cisco switches will have 10 SFP+. It will not work if i understand you ?
crisp sinew
Last I checked (now) NetApp does not support the 10/25g optics on the Netapp side. ONLY 10g optics and/or 25g optics.
Good luck on the switch side. The last time I saw the 10/25 combined optic it was a long range (LR) and would not work with the Netapp x65404(25g, SR) for obvious reasons.
Pull out an optic and get the Netapp part number or model number from the optic. Better yet, take a picture if you can and post it
If whomever you purchased the Netapp through included 10/25g optics something is wrong.
The ports are capable of 10 or 25 independently
prime trellis
Yeah, x6589 is the 10g part
modest wharf
@crisp sinew ,
To continue on our conversation, as said earlier, I am going to replace 10G SFP to 25 G SFP. Will following SFP work in this case? Please let me know. Thank you!
NETAPP SFP28 25GBE SR
Mfg. Part#: X65404
drifting anvil
looks correct to me, yes
crisp sinew
Yep. That’s the one