{"id":13084,"date":"2015-07-27T13:12:02","date_gmt":"2015-07-27T17:12:02","guid":{"rendered":"https:\/\/jazz.net\/blog\/?p=13084"},"modified":"2020-03-09T11:37:58","modified_gmt":"2020-03-09T15:37:58","slug":"using-docker-with-rqm","status":"publish","type":"post","link":"https:\/\/jazz.net\/blog\/index.php\/2015\/07\/27\/using-docker-with-rqm\/","title":{"rendered":"Using Docker with RQM"},"content":{"rendered":"

\"\"In our pipeline, we use Rational Quality Manager (RQM) to run a lot of tests using dynamically created RQM adapters. While building the products, we also compile and package the tests to be run. After the tests and products to test are built, we create and start several RQM adapters to run the tests. Here’s how we create the adapters:<\/p>\n

    \n
  1. We create a new VM in the cloud\u2014this takes 5\u201310 minutes (we are requesting about 100 VMs at the same time so it takes longer than it otherwise would).<\/li>\n
  2. We then install the test dependencies such as the test framework and the specific versions of web browsers to be used.<\/li>\n
  3. Next we install the correct version of the packaged tests (we want to use the tests aligned with the software under test).<\/li>\n
  4. Finally we install and run the RQM adapter (in our case the JUnit Selenium adapter).<\/li>\n<\/ol>\n

    \"\"<\/p>\n

    It takes 10\u201320 minutes for the process to run and we invoke it many times in parallel.\u00a0 When it is done, we have about 15 new VMs each with an RQM adapter listening and ready.\u00a0 We then start the tests and, after the tests have been completed, we throw away the VMs.<\/p>\n

    Enter Docker<\/h3>\n

    We modified the build of our tests so that along with compiling and packaging, the build also publishes a Docker image and pushes it to an internal registry. The Dockerfile does a pretty good job of showing what goes into the Docker image:<\/p>\n

    FROM debian:8.0\r\nMaintainer Nathan Bak\r\n\r\n# Install Java, utilities to extract archives, and display packages\r\nRUN \u00a0\u00a0 \u00a0apt-get update && apt-get install -y bzip2 openjdk-7-jre unzip vim wget x11vnc xvfb xfonts-100dpi xfonts-75dpi xfonts-scalable xfonts-cyrillic && rm -rf \/var\/lib\/apt\/lists\/*\r\n\r\n# Install RQM Adapter\r\nENV\u00a0\u00a0 \u00a0\u00a0\u00a0 \u00a0RQM_VERSION 6.0.0.0-RC1-RQMI20150511_1003\r\nRUN\u00a0\u00a0 \u00a0\u00a0\u00a0 \u00a0wget some.server.ibm.com:8125\/rqm\/RQM-Extras-JUnitSeleniumAdapter_$RQM_VERSION.zip \\\r\n && mkdir \/rqm && unzip RQM-Extras-JUnitSeleniumAdapter_$RQM_VERSION.zip -d \/rqm \\\r\n && rm\u00a0 RQM-Extras-JUnitSeleniumAdapter_$RQM_VERSION.zip && unzip \/rqm\/adapters\/RQMJUnitSeleniumAdapter.zip -d \/rqm \\\r\n && rm \/rqm\/adapters\/RQMJUnitSeleniumAdapter.zip && rmdir \/rqm\/adapters && chmod 755 \/rqm\/start.sh\r\n\r\n# Install Firefox\r\nENV\u00a0\u00a0 \u00a0\u00a0\u00a0 \u00a0FIREFOX_VERSION 31.4.0esr\r\nRUN\u00a0\u00a0 \u00a0\u00a0\u00a0 \u00a0wget http:\/\/download.cdn.mozilla.net\/pub\/mozilla.org\/firefox\/releases\/$FIREFOX_VERSION\/linux-x86_64\/en-US\/firefox-$FIREFOX_VERSION.tar.bz2 \\\r\n\u00a0&& tar -jxvf firefox-$FIREFOX_VERSION.tar.bz2 -C \/ && rm firefox-$FIREFOX_VERSION.tar.bz2\r\n\r\n# Install Selenium\r\nENV\u00a0\u00a0 \u00a0\u00a0\u00a0 \u00a0SELENIUM_VERSION 2.45\r\nENV\u00a0\u00a0 \u00a0\u00a0\u00a0 \u00a0SELENIUM_FULL_VERSION 2.45.0\r\nRUN\u00a0\u00a0 \u00a0\u00a0\u00a0 \u00a0wget http:\/\/selenium-release.storage.googleapis.com\/$SELENIUM_VERSION\/selenium-java-$SELENIUM_FULL_VERSION.zip \\\r\n && unzip selenium-java-$SELENIUM_FULL_VERSION.zip -d \/ && mv \/selenium-$SELENIUM_FULL_VERSION \/selenium \\\r\n && rm selenium-java-$SELENIUM_FULL_VERSION.zip && echo \"\" >> \/rqm\/selenium.properties \\\r\n && echo com.ibm.rqm.selenium.seleniumClasspath=\/selenium:\/selenium\/libs >> \/rqm\/selenium.properties\r\n\r\n# Display properties\r\n#  \u00a0\u00a0 \u00a0\u00a0\u00a0 \u00a0GEOMETRY SCREEN_WIDTH x SCREEN_HEIGHT x SCREEN_DEPTH\r\nENV\u00a0\u00a0 \u00a0\u00a0\u00a0 \u00a0GEOMETRY 1200x900x24\r\nENV\u00a0\u00a0 \u00a0\u00a0\u00a0 \u00a0DISPLAY :0\r\nEXPOSE\u00a0\u00a0 \u00a0 5900\r\n\r\n# Install run script\r\nCOPY\u00a0\u00a0 \u00a0\u00a0\u00a0 \u00a0  \/run.sh \/rqm\/\r\nRUN\u00a0\u00a0 \u00a0\u00a0\u00a0 \u00a0\u00a0\u00a0 chmod 755 \/rqm\/run.sh\r\nENTRYPOINT\u00a0\u00a0 \u00a0[ \"\/rqm\/run.sh\" ]\r\n\r\n# Install CSPF Test Asset\r\nRUN\u00a0\u00a0 \u00a0\u00a0\u00a0 \u00a0mkdir \/media\/ibm\r\nCOPY\u00a0\u00a0 \u00a0   \/TestAssets\/ \/media\/ibm\/TestAssets\r\nRUN\u00a0\u00a0 \u00a0\u00a0\u00a0 \u00a0echo \"\" >> \/media\/ibm\/TestAssets\/bootstrap.properties \\\r\n && echo browserPath=\/firefox\/firefox >> \/media\/ibm\/TestAssets\/bootstrap.properties \\\r\n && echo \"\" >> \/rqm\/selenium.properties \\\r\n && echo com.ibm.rqm.junit.classpath=\/media\/ibm\/TestAssets\/org.junit_4.8.1.v4_8_1_v20100427-1100:\/media\/ibm\/TestAssets >> \/rqm\/selenium.properties<\/pre>\n
    The run.sh script used as the entry point simply creates a display and VNC session and then starts up the adapter. Here are the contents of the script:<\/p>\n
    #! \/bin\/sh\r\ncd \/rqm\r\nXvfb $DISPLAY -screen 0 $GEOMETRY &\r\nx11vnc -display $DISPLAY &\r\ncd \/rqm\r\n.\/start.sh -repository $RQM_URL -user $RQM_USER -password $RQM_PASS -adapterName `hostname -f` -projectArea \"$RQM_PROJECT\"<\/pre>\n
    Thanks to the magic of Docker layers and the fact that typically only the packaged tests change, building and pushing the image typically adds only a couple of minutes to the build\u2014sometimes a bit more when the version of the RQM adapter or Selenium changes, but since this happens in parallel with the product code build, the extra time doesn’t matter.<\/p>\n
    As soon as we want to run the tests, the process of creating a new adapter now looks like this:<\/p>\n
    \"\"<\/p>\n
    Since everything we need was packaged up in the Docker image, we simply start as many containers as we need adapters\u2014this takes less than a minute on average.\u00a0 After the tests run, cleanup is simply removing the container.<\/p>\n
    People are always impressed with the fact that using Docker allowed us to go from 10\u201320 minutes to about a minute, but I believe there are other benefits surpassing the performance improvement:<\/p>\n
      \n
    • Better reliability\u2014running a container has fewer points of failure than creating a VM and running setup automation.<\/li>\n
    • Fewer resources needed\u2014instead of creating a VM for each RQM adapter, we can spin up multiple Docker containers on the same machine.<\/li>\n
    • Empowered developers\u2014the test developers have full control over the the environment in which the tests run. Changing the Firefox or Selenium version is as simple as changing a line in the Dockerfile.<\/li>\n<\/ul>\n
      Making the transition to using Docker to run our RQM adapters didn’t take too much effort and we quickly began to benefit from that effort. In future posts I’ll go into more detail about how the builds automatically create Docker images and how we designed our internal Docker registry.<\/p>\n
      Nathan Bak
      \nDevOps Adoption Architect, Master Inventor
      \nIBM Rational<\/p>\n","protected":false},"excerpt":{"rendered":"
      In our pipeline, we use Rational Quality Manager (RQM) to run a lot of tests using dynamically created RQM adapters. While building the products, we also compile and package the tests to be run. After the tests and products to test are built, we create and start several RQM adapters to run the tests. Here’s […]<\/p>\n","protected":false},"author":21140,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[192,472,68],"tags":[431,300,69,265,91],"class_list":["post-13084","post","type-post","status-publish","format-standard","hentry","category-devops","category-engineering-test-management","category-rational-quality-manager","tag-devops","tag-docker","tag-rqm","tag-stickied","tag-testing"],"_links":{"self":[{"href":"https:\/\/jazz.net\/blog\/index.php\/wp-json\/wp\/v2\/posts\/13084","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/jazz.net\/blog\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/jazz.net\/blog\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/jazz.net\/blog\/index.php\/wp-json\/wp\/v2\/users\/21140"}],"replies":[{"embeddable":true,"href":"https:\/\/jazz.net\/blog\/index.php\/wp-json\/wp\/v2\/comments?post=13084"}],"version-history":[{"count":42,"href":"https:\/\/jazz.net\/blog\/index.php\/wp-json\/wp\/v2\/posts\/13084\/revisions"}],"predecessor-version":[{"id":16946,"href":"https:\/\/jazz.net\/blog\/index.php\/wp-json\/wp\/v2\/posts\/13084\/revisions\/16946"}],"wp:attachment":[{"href":"https:\/\/jazz.net\/blog\/index.php\/wp-json\/wp\/v2\/media?parent=13084"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/jazz.net\/blog\/index.php\/wp-json\/wp\/v2\/categories?post=13084"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/jazz.net\/blog\/index.php\/wp-json\/wp\/v2\/tags?post=13084"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}