Automation of End-to-End and Full Stack Testing of an OpenStack Cloud

In a large multi-site OpenStack Cloud environment, we have been testing the building blocks in all layers for two year now. We test these blocks individually as well as test end-to-end flows across them. The building blocks that need to be tested include hardware, OS/VMMs, OpenStack, Contrail, other software, and IT tools. These blocks are tested using their APIs, CLIs or GUIs. We have automated a significant part of our testing using open source tools. We leverage Tempest for testing OpenSta