We have a requirement to use multiple subnets for multipathing because we also use XenServer. This is the first time we setup multipathing like this and may be missing a step.
Our host use two physical nics for iscsi traffic connected to 2 switches stacked. We typically bind a kernel port to each vmnic for multipathing. This time I have setup each pnic on its own vswitch and binded to a kernel port with iscsi enabled. The array has 5 nics and I set two ports on one subnet and 3 on the other. The Nimble has a "discovery" ip that is virtual which is what we use for dynamic discovery. The switches are setup with their vlans respectively with routing disabled. I can vmkping all ip’s with no problem.
When I rescan the adapter or refresh the storage I only see 3 paths. When I look at the network config on the iscsi software adaptor, it shows the path status as “Not Used” for the vmk port in question.