(r7) RTCEEIncrementalBuildComparisonBetweenReleases < Deployment

Engineering Lifecycle Management Wiki - Deployment

Community information and contribution guidelines

~~EditAttach~~Printable

TWiki > Deployment Web > DeploymentPlanningAndDesign > PerformanceDatasheetsAndSizingGuidelines > RTCSystemZPerformanceTesting > RTCEEPerfTestsData > RTCEEIncrementalBuildComparisonBetweenReleases

Revision 7 - 2014-11-24 - 08:45:19 - Main.cdlweiz

<div id="header-title" style="padding: 10px 15px; border-width:1px; border-style:solid; border-color:#FFD28C; background-image: url(<nop>https://jazz.net/wiki/pub/Deployment/WebPreferences/TLASE.jpg); background-size: cover; font-size:120%">
---+!! <img src="https://jazz.net/wiki/pub/Deployment/WebPreferences/new.png" alt="new.png" width="50" height="50" align="right"> Rational Team Concert For z/OS Incremental Build Performance Comparison Between Releases
%DKGRAY% Authors: Main.SuHui ZhangWei<br>
Date: Nov 24rd, 2014 </br>
Build basis: Rational Team Concert for z/OS from 4.0.2 to 5.0.2
%ENDCOLOR%</div></sticky>

<!-- Page contents top of page on right hand side in box -->
<sticky><div style="float:right; border-width:1px; border-style:solid; border-color:#DFDFDF; background-color:#F6F6F6; margin:0 0 15px 15px; padding: 0 15px 0 15px;">
%TOC{title="Page contents"}%
</div></sticky>

<sticky><div style="margin:15px;"></sticky>

---++ Introduction
This report compares the incremental build performance of RTC for z/OS between releases since v4.0.2 until v5.0.2. 
Generally constant performance improvements are made into releases of RTC for z/OS. The objective of this report is to present the improvements.

The performance data provided is obtained by benchmark test of each release. The report includes build duration and links to the detailed build activities. 

---++ Disclaimer

%INCLUDE{"PerformanceDatasheetDisclaimer"}%

---++ Findings

Based on the test data, incremental build performance of the RTC for z/OS has improved significantly from 4.0.2 to 5.0.2.

From *4.0.2 to 5.0.2*, the overall improvement of the build time is about *30% to 50%* depending on different test scenarios. "Collecting buildable files" and "Updating dependency data" activities during build preprocessing are the main improved activities.

Constant performance enhancements have been made into release 4.0.3, 4.0.5, 4.0.6 and 5.0 to improve the build preprocessing speed.

---++ Topology

The tests are executed in a Single Tier Topology infrastructure like the one in the following diagram:
%INCLUDE{"RTCEETestingTopologies" section="SingleTierZ"}%

The RTC server was set up based on !WebSphere and DB2 on Linux for System z.  The build machine with Rational Build Agent was on zOS.

<table class="gray-table">
 <tr>
  <th><strong>Test Environment</strong></th>
  <th></th>
  <th></th>
 </tr>
 <tr>
  <td><strong>RTC Server</strong></td>
  <td>Operating System & Version: Linux for System z (SUSE Linux Enterprise Server 10 (s390x))</br>
          System Resource : 10 GB Storage, 4 CPs (20000 mips, CPU type : 2097.710, CPU model: E12) </br>
          CLM: from 4.0.2 GA to 5.0.2 GA, 4 GB heap size </br>
          DB2: 9.7.0.5 (from 4.0.2 GA to 4.0.6 GA), 10.1.0.0(5.0 GA to 5.0.2 GA)</br>
          WAS: 8.0.0.3 (from 4.0.2 GA to 4.0.5 GA), 8.5.5.1 (from 4.0.6 GA to 5.0.2 GA)</br>
  </td>
  <tr>
  <td><strong>Build Forge Agent</strong></td>
  <td>Operating System & Version: z/OS 01.12.00</br>
         System Resource: 6 GB Storage, 4 CPs (20000 mips, CPU type : 2097.710, CPU model: E12)</br>
         Build System Toolkit: from 4.0.2 GA to 5.0.2 GA
  </td>
  </tr>
</table>

---++ Methodology
Build time and individual activity time are compared by getting test start date and time. 

The sample projects for the test are:
 
   * Mortgage Application *100 which is 100 duplicates of the [[https://jazz.net/wiki/bin/view/Main/ZOSBuildSamplesV4][Mortgage sample application]]
   * Mortgage Application *1000 which is 1000 duplicates of the [[https://jazz.net/wiki/bin/view/Main/ZOSBuildSamplesV4][Mortgage sample application]]

<table class="gray-table" style="width: 60%">
 <tr>
  <th><strong>Test Data</strong></th>
  <th></th>
  <th></th>
 </tr>
 <tr>
  <td><strong>Sample Project</strong></td>
  <td>Mortgage*100</td>
  <td>Mortgage*1000</td>
</tr>
  <tr>
  <td><strong>Assets</strong></td>
  <td>600 COBOL programs<br/> 400 Copybooks<br/> 200 BMS<br/>3 others<br/>
  </td>
  <td>6000 COBOL programs<br/> 4000 Copybooks<br/> 2000 BMS<br/>3 others<br/>
  </td>
  </tr>
 <tr>
  <td><strong>Total Assets</strong></td>
  <td>1203
  </td>
  <td>12003
  </td>
</tr>
</table>

In the repository the source code is stored in one stream with one single component which includes 5 zComponent Projects. 

Enterprise builds are executed twice against each version.

---+++Test Scenario Description

After a complete build of all the programs, different changes are performed and a rebuild requested. These requests will rebuild the changed programs and impacted ones. 

<table class="gray-table">
	<tbody>
		<tr>
			<th align="center">Test Scenario</th>
			<th align="center">Description</th>
		</tr>
		<tr>
			<td>Incremental Build</td>
			<td>1. Change a copybook (!MortgageApplication-Common\zOSsrc\COPYBOOK\A00MTCOM.cpy) and request build</br>2. Change a COBOL file (!MortgageApplication-EPSCMORT\zOSsrc\COBOL\A00CMORT.cbl) and request build</br>3. Change all copybooks and request build</br>3. Change all COBOL files and request build</td>
		</tr>
	</tbody>
</table>

---++ Results
---+++ Run duration & Build Activities

The charts below show the run duration comparison from 4.0.2 until 5.0.2. Builds are run twice against each release and the average time is taken for comparison.
From *4.0.2 to 5.0.2*, the overall improvement of the build time is from about *30% to 50%*
Links to the individual pages are provided for the detailed build activities.

---++++ Change a copybook file and execute build 
<img src="%ATTACHURLPATH%/onecopybook.gif" alt="onecopybook.gif" width="70%" height="70%" />

<strong>Detailed build activities comparison for this test scenario "Change a copybook file and execute build" can be found [[RTCEEIncrementalBuildActivitiesOneCopybook][here]].</strong>

---++++ Change a COBOL file and execute build 
<img src="%ATTACHURLPATH%/onecobol.gif" alt="onecobol.gif" width="70%" height="70%" />

<strong>Detailed build activities comparison for this test scenario "Change a COBOL file and execute build" can be found [[RTCEEIncrementalBuildActivitiesOneCobol][here]].</strong>

---++++ Change all copybook files and execute build 
<img src="%ATTACHURLPATH%/allcopybook.gif" alt="allcopybook.gif" width="70%" height="70%" />

<strong>Detailed build activities comparison for this test scenario "Change all copybook files and execute build" can be found [[RTCEEIncrementalBuildActivitiesAllCopybook][here]].</strong>

---++++ Change all COBOL files and execute build
This test scenario is designed and executed from 4.0.6 release.
  
<img src="%ATTACHURLPATH%/allcobol.gif" alt="allcobol.gif" width="70%" height="70%" />

<strong>Detailed build activities comparison for this test scenario "Change all COBOL files and execute build" can be found [[RTCEEIncrementalBuildActivitiesAllCobol][here]].</strong>


---++ Appendix A - Key Tuning Parameters 
#AppendixC
<table class="gray-table">
	<tbody>
		<tr>
			<th align="left" width="200"><strong>Product</strong><br></th>
			<th align="left" width="100"><strong>Version</strong></th>
			<th align="left" width="600"><strong>Highlights for configurations under test</strong></th>
		</tr>
		
		<tr>
			<td style="vertical-align: top;">IBM !WebSphere Application Server</td>
			<td style="vertical-align: top;">8.0.0.3 (4.0.2GA to 4.0.5GA),<br> 8.5.5.1 (4.0.6GA to 5.0.2GA)</td>
			<td style="vertical-align: top;"><strong>JVM settings:</strong>

                                     * GC policy and arguments, max and init heap sizes:

 <verbatim>
 -Xmn512m -Xgcpolicy:gencon -Xcompressedrefs -Xgc:preferredHeapBase=0x100000000
 -Xmx4g -Xms4g</verbatim>
                        <strong>OS configuration:</strong>
<verbatim>
* hard nofile 120000                    
* soft nofile 120000</verbatim>                        
Refer to http://pic.dhe.ibm.com/infocenter/clmhelp/v4r0m4/topic/com.ibm.jazz.install.doc/topics/c_special_considerations_linux.html for details
		</td>
		</tr>
		<tr>
			<td>DB2</td>
			<td>DB2 Enterprise Server 9.7.0.5 (4.0.2GA to 4.0.6GA),<br> 10.1.0.0 (5.0GA to 5.0.2GA)</td> 
                        <td>Tablespace is stored on the same machine as IBM !WebSphere Application Server</td>
		</tr>
                <tr>
			<td>License Server</td>
			<td>Same as CLM version</td> 
                        <td>Hosted locally by JTS server</td>
		</tr>
				<tr>
			<td>Network</td>
			<td> </td>
			<td>Shared subnet within test lab</td>
		</tr>
	</tbody>
</table>

---++++!! About the authors

Main.SuHui

--------------------
---+++++!! Questions and comments:
   * What other performance information would you like to see here?
   * Do you have performance scenarios to share? 
   * Do you have scenarios that are not addressed in documentation?
   * Where are you having problems in performance?

%COMMENT{type="below" target="PerformanceDatasheetReaderComments" button="Submit"}%

%INCLUDE{"PerformanceDatasheetReaderComments"}%

<sticky></div></sticky>

Attachments

Topic attachments
I	Attachment	Action	Size	Date	Who
gif	allcobol.gif	manage	11.6 K	2014-11-24 - 08:39	UnknownUser
gif	allcopybook.gif	manage	15.8 K	2014-11-24 - 08:40	UnknownUser
gif	onecobol.gif	manage	15.5 K	2014-11-24 - 08:41	UnknownUser
gif	onecopybook.gif	manage	16.5 K	2014-11-24 - 08:41	UnknownUser

Copyright © by IBM and non-IBM contributing authors. All material on this collaboration platform is the property of the contributing authors.
Contributions are governed by our Terms of Use. Please read the following disclaimer.
Dashboards and work items are no longer publicly available, so some links may be invalid. We now provide similar information through other means. Learn more here.