Cloud Director Task Execution is Slow

VMware Cloud Director UI and tasks are slow to load and complete.
The Artemis message bus communication is not working and when you trigger operations from the UI, they can take up to 5 minutes to complete or might time out. The performance issues can affect operations such as powering on VMs and vApps, provider VDC creation, vApp deployment, and so on.

The JMS Artemis communication channel between the Cloud Director cells is responsible for task communication between the cells. If offline then a problem can occur whereby the task status is not fully communicated between cells and this leads to long running tasks and problems with task status messages being dropped and lost. To resolve the issue you need restart the cells in rolling order. This activity will have restored the JMS Artemis communication channels to a healthy state and is the recommended workaround for JMS problems when found. 

Please SSH to all Cloud Director cells and run this command on all of them:

netstat -tanp | grep ESTABLISHED | tr -s ” “| cut -d ” ” -f 5 | grep 61616 | sort | uniq

root@duo-vcd-01 [ ~ ]# netstat -tanp | grep ESTABLISHED | tr -s " "| cut -d " " -f 5 | grep 61616 | sort | uniq
10.10.98.6:61616
10.10.98.7:61616
10.10.98.8:61616
10.10.98.9:61616
10.10.98.10:61616
root@duo-vcd-01 [ ~ ]#

You should see in output all nodes. If not then to get the Artemis JMS online again, a rolling restart of the vmware-vcd service on each cell should be performed one cell at a time.

service vmware-vcd restart

Leave a Reply

Your email address will not be published. Required fields are marked *

I’m Aigars

Welcome to Virtualisation Alley, my cozy corner of the internet dedicated to VMware. Here, I invite you to join me on a journey into virtual world. Let’s go.

Let’s connect