I am wondering if it could be perhaps the drivers for uplinks... I've seen problems like these in the past due to NIC driver compatibility at the host level (not VM). I am also assuming you used the vendor ESXi image?
Take a look at this link and see if it might be helpful.
