[DRBD-user] Problem with DRBD sync stalling with vmware vmxnet3 10Gb adapter

Lars Ellenberg lars.ellenberg at linbit.com
Sat Nov 20 20:15:40 CET 2010

Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.

On Fri, Nov 19, 2010 at 10:54:20AM -0800, Sean McCreadie wrote:
> Hello,
> I am having issues using the vmware 10Gb virtual adapter with vmxnet
> driver and drbd.  When I go to sync the resources, the sync will
> always stall at some point.  I have confirmed that the vmxnet driver
> is the culprit, as I have no issues using the e1000 NIC and driver on
> the same VMs.

seems that at least you are not alone :-/
(just one of the first hits...)

I suggest you stress test drive the vmxnet3 thingy without DRBD for a while.
Find a simple test case, and take that to your support contact.

> My setup is this:
> -          ESXi 4.1 on new HP DL 380 G7 servers
> -          Onboard Broadcom NC382i gigbit adapter
> -          Add on Emulex OneConnect 10Gb SFP adapter
> -          Two identical fedora 13 VMs setup with drbd version 8.3.7 installed
> -          One SFP+ cable running direct between the two 10Gb NICs on each server, no switch.
> -          One 1Gb CAT6 cable running direct between two 1Gb NICs on each server, no switch.
> When I add a vmxnet3 virtual adapter to the VMs and start drbd, it
> begins syncing and then quickly will stall.  The behavior is identical
> when I map the virtual NIC to either the Emulex 10Gb adapter on the
> ESXi host, or the Broadcom 1Gb adapter. So I know its not the physical
> link that's the issue.
> Conversely when I add the e1000 NIC to the VMs and start drbd,
> everything syncs fine with no issues, and again this is the same no
> matter what physical link I connect the VMs to.
> I installed vmware tools and verified it loaded the vmxnet3 module
> successfully.
> I have looked in the messages log but haven't found anything, is there
> another log I should be reviewing?
> Thanks in advance for any insight into this.
> Sean

: Lars Ellenberg
: LINBIT | Your Way to High Availability
: DRBD/HA support and consulting http://www.linbit.com

DRBD® and LINBIT® are registered trademarks of LINBIT, Austria.
please don't Cc me, but send to list   --   I'm subscribed

More information about the drbd-user mailing list