Hi... a quick question while we are designing a 4 node MCCIP with C60 nodes... We need the X60130A for HA connection between the two HA nodes.. then we need the MC NIC X60134A, then we have two slots left which we would like to make "card-redundant" and install two X60130A which have two 100G QSFP ports each... but does the system allow you to mix data traffic with NVMe storage trafic? If we would like to expand the system with a shelf in the future? Or do you have to specify one NIC to be NVMe on both ports and the other for data? I am asking because I remember that on older systems there were some thing like this with CNA ports when mixing FC and Ethernet... so just want to make sure 🙂
#Mixing traffic on C60 MCCIP?
steep hare
Bonus question: The X60130A accepts the X65406 QSFP28 optic so that you can use LC cables. It states "Longwave CWDM4" is this a single mode optic? Or which module do I need in the other end (Cisco Nexus) ? We need about 8M of reach so I guess DAG cables are out of the question...
tight sorrel
HA traffic in MC IP goes over the iWARP card. The X60130 is for the Cluster network and it has to be one card in slot 4. For NVMe storage, you need another 60130 card in slot 1 or 3. Mixing cluster network and storage is not supported as the corresponding ports on the switch have completely different configs, so you cannot run both over the same cable
steep hare
Do you know anything about the X65406 QSFP28 optics? is it single mode?
tight sorrel
these are the only two supported configs according to HWU (the other one uses slot 1 instead of 3 for the shelf). Changing ports between storage and cluster network is probably possible and might work, but is not supported
steep hare
hmm OK... it's just because the system need 24 disks 🙂 so the next expansion will involve a shelf
Not is there no multimode QSFP28 optics with LC connector for the X60130 ? We just need that little extra... (more than the 5M with DAG)
tight sorrel
and yes, CWDM4 is Single Mode with 4 "colors"
steep hare
...and not other QSFP28 optics are supported?
tight sorrel
DAC cables only work up to 5m. You can however use the MPO optics and cables, those are multimode (X65405)
steep hare
yeah.. but the Cisco's use LC 😉
tight sorrel
I think Cisco also supports MPO optics, do they not?
steep hare
anyway they will just have to "adapt" their modules in the Nexus then... don't think there is a MPO to LC 😉
tight sorrel
anyway they will just have to "adapt" their modules in the Nexus then... don't t...
that doesn't work since it's multimode vs singlemode and completely different colors (860nm vs 1300nm)
steep hare
MPO it is then 🙂
tight sorrel
yeah, I would feel better with that as well... for the CWDM4 I'm not sure how well the optics take it if you're only 8m apart... you don't want to fry the receiver
also, at least theoretically, an MPO QSFP should be cheaper than a CWDM4 one... but it's Cisco, so you never know
steep hare
I agree.. .but I also think that the later optics can adjust their laser, so that they don't "burn" the other end 🙂
tight sorrel
yeah, I guess for the 2km optics it's not that big of a deal these days