We recently moved from our previous product which did Hot Add backups to a newer product called Rubrik which does NBD backups (no negative comments on this please ). We have dedicated 10GbE to our Cisco Nexus core and backend storage is a Pure Storage all flash over 8Gbps FC. We are seeing decent speeds for NBD, although nowhere near previous. However, it still is not hitting even gigabit speeds. On our Cisco UCS, which has 4 blades sharing dual dedicated 10GbE uplinks for management network, its even worse. Its like running 100Mbps!!!
I tested with an HP server (Proliant DL585 Gen 7) with only gigabit links and it was only around 1MB/sec. The UCS is around the same. When I upgraded the HP server to 10GbE, it went to about 125 MB/sec. I have confirmed that it is configured correctly at storage and switching. Any thoughts on this? Why does ESXi seem to be limiting the bandwdith per vm to roughly 10% of bandwidth on the management NIC? vMotion is getting around 300MB/sec. I feel that should be faster as well.
ESXi 6.0 50505093
vCenter 6.0 Build 4541947
Feedback appreciated.