RationalTeamConcertForIBMiPerformanceComparisonBetweenReleases < Deployment

Engineering Lifecycle Management Wiki - Deployment

Community information and contribution guidelines

TWiki > Deployment Web > DeploymentPlanningAndDesign > PerformanceDatasheetsAndSizingGuidelines > RTCSystemZPerformanceTesting > RTCEEDepBuildTests > RationalTeamConcertForIBMiPerformanceComparisonBetweenReleases

Revision 11 - 2015-12-17 - 09:08:16 - Main.bjsuhui

<div id="header-title" style="padding: 10px 15px; border-width:1px; border-style:solid; border-color:#FFD28C; background-image: url(<nop>https://jazz.net/wiki/pub/Deployment/WebPreferences/TLASE.jpg); background-size: cover; font-size:120%">
---+!!  Rational Team Concert For IBMi Performance Comparison Between Releases
%DKGRAY% Authors: Main.LuLu Main.SuHui</br>
Date: Jun 25th, 2015 </br>
Build basis: Rational Team Concert for IBMi 5.0.2, 6.0, 6.0.1
%ENDCOLOR%</div></sticky>

<!-- Page contents top of page on right hand side in box -->
<sticky><div style="float:right; border-width:1px; border-style:solid; border-color:#DFDFDF; background-color:#F6F6F6; margin:0 0 15px 15px; padding: 0 15px 0 15px;">
%TOC{title="Page contents"}%
</div></sticky>

<sticky><div style="margin:15px;"></sticky>

---++ Introduction
This report compares the performance of RTC for IBMi between releases since v5.0.2 until v6.0.1. 
Generally constant performance improvements are made into releases of RTC on IBMi. The objective of this report is to present the improvements.

The performance data provided is obtained by benchmark test of each release. Currently the report includes only the build information. 

---++ Disclaimer

%INCLUDE{"PerformanceDatasheetDisclaimer"}%

---++ Findings

Based on the test data, build performance of the RTC for IBMi has improved significantly from 5.0.2 to 6.0, based on the new build map mechanism. 

From *5.0.2 to 6.0*, the big improvement is on 'collecting buildable file' activity of 'preprocessing' period, after changing all RPG files of MaillistX100 sample project, 'collecting buildable file' activity takes *5 minutes* in v6.0 which takes *2 hours and 30 minutes* in v5.0.2, improved almost *<bold>95%+</bold>*.

From *6.0 to 6.0.1*,  'Updating dependency data' has an improvement of *more than 60%*. This is a result of performance improvement of source code data scan.

---++ Topology

The tests are executed in a Single Tier Topology infrastructure like the one in the following diagram:
%INCLUDE{"RTCEETestingTopologies" section="SingleTierI"}%

The RTC server was set up based on WebSphere on IBMi.  The build machine with Rational Build Agent was on IBMi.

<table class="gray-table">
 <tr>
  <th><strong>Test Environment</strong></th>
  <th></th>
  <th></th>
 </tr>
 <tr>
  <td><strong>RTC Server</strong></td>
  <td>Operating System & Version: IBMi v7.1</br>
          System Resource : 4 dedicated processors, 30GB memory </br>
          CLM: from 5.0.2 GA to 6.0.1 GA, 6 GB heap size </br>
          DB2: DB2 for IBMi v7.1</br>
          WAS: 8.5.5.3(from 5.0.2 GA to 6.0 GA), 8.5.5.7(from 6.0GA to 6.0.1 GA)</br>
  </td>
  <tr>
  <td><strong>Build Forge Agent</strong></td>
  <td>Operating System & Version: IBMi v7.1</br>
         System Resource: 4 dedicated processors, 30GB memory</br>
         Build System Toolkit: from 5.0.2 GA to 6.0.1 GA
  </td>
  </tr>
</table>

---++ Methodology
Build time and individual activity time are compared by getting test start date and time. 

The sample projects for the test are:
 
   * Maillist Application *100 
   * Maillist Application *1000 

<table class="gray-table" style="width: 60%">
 <tr>
  <th><strong>Test Data</strong></th>
  <th></th>
  <th></th>
 </tr>
 <tr>
  <td><strong>Sample Project</strong></td>
  <td>Maillist *100</td>
  <td>Maillist *1000</td>
</tr>
  <tr>
  <td><strong>Assets</strong></td>
   <td>500 RPGLE<br/> 200 SRVPGM<br/> 100 PGMSRC<br/> 4 DSPF<br/> 4 LF <br/> 2 PF <br/> 6 CLLE <br/> 1 * CLP <br/>
  </td>
   <td>5000 RPGLE<br/> 2000 SRVPGM<br/> 1000 PGMSRC<br/> 4 DSPF<br/> 4 LF <br/> 2 PF <br/> 6 CLLE <br/> 1 * CLP <br/>
  </td>
  </tr>
 <tr>
  <td><strong>Total Assets</strong></td>
  <td>817 buildable file
  </td>
  <td>8017 buildable file
  </td>
</tr>
</table>

In the repository the source code is stored in one stream with one single component. 

Enterprise builds are executed twice against each version.

---++ Results

*Note : since 6.0.1 benchmark , we have replaced our IBMi performance testing LPARs and new performance baselines are created. 6.0 benchmark have been re-run to compare on identical hardware.*

---+++ Run duration

The charts below shows the run duration comparison between v5.0.2 and v6.0, and from v6.0 to v6.0.1. Builds are run twice against each release and the average time is taken for comparison.

Following table displays build test result with release by release comparison:

<img src="%ATTACHURLPATH%/runtime.png" alt="runtime.png" width="70%" height="70%" />

<img src="%ATTACHURLPATH%/runtime_2.png" alt="runtime_2.png" width="70%" height="70%" />

---+++ Build Activities

The chars below display the run times of build activity "Collecting buildable files" and "Compile" which have gained some improvements between releases. Builds are run twice against each release and the average time is taken for comparison.

For the full build activity run time details, please refer to following tables:

<img src="%ATTACHURLPATH%/collectingBuildFile.jpg" alt="collectingBuildFile.jpg" width="70%" height="70%" />

<img src="%ATTACHURLPATH%/collectingBuildFile_2.png" alt="collectingBuildFile_2.png" width="70%" height="70%" />

<img src="%ATTACHURLPATH%/compile.jpg" alt="compile.jpg" width="70%" height="70%" />

<img src="%ATTACHURLPATH%/compile_2.png" alt="compile_2.png" width="70%" height="70%" />

<strong>Detailed build activities comparison can be found [[RTCiFullBuildActivities][here]].</strong>
---++ Appendix A - Key Tuning Parameters 
<table class="gray-table">
	<tbody>
		<tr>
			<th align="left" width="200"><strong>Product</strong><br></th>
			<th align="left" width="100"><strong>Version</strong></th>
			<th align="left" width="600"><strong>Highlights for configurations under test</strong></th>
		</tr>
		
		<tr>
			<td style="vertical-align: top;">IBM !WebSphere Application Server</td>
			<td style="vertical-align: top;">8.5.5.3 (5.0.2GA to 6.0GA), 8.5.5.7(from 6.0GA to 6.0.1 GA)</td>
			<td style="vertical-align: top;"><strong>JVM settings:</strong>

                                     * GC policy and arguments, max and init heap sizes:

 <verbatim>
 -Xmn768m -Xgcpolicy:gencon -Xcompressedrefs -Xgc:preferredHeapBase=0x200000000
 -Xmx6g -Xms6g</verbatim>

		</td>
		</tr>
		<tr>
			<td>DB2</td>
			<td>DB2 Enterprise Server for IBM v7.1</td> 
                        <td>Tablespace is stored on the same machine as IBM !WebSphere Application Server</td>
		</tr>
                <tr>
			<td>License Server</td>
			<td>Same as CLM version</td> 
                        <td>Hosted locally by JTS server</td>
		</tr>
				<tr>
			<td>Network</td>
			<td> </td>
			<td>Shared subnet within test lab</td>
		</tr>
	</tbody>
</table>

---++++!! About the authors

Main.LuLu

--------------------
---+++++!! Questions and comments:
   * What other performance information would you like to see here?
   * Do you have performance scenarios to share? 
   * Do you have scenarios that are not addressed in documentation?
   * Where are you having problems in performance?

%COMMENT{type="below" target="PerformanceDatasheetReaderComments" button="Submit"}%

%INCLUDE{"PerformanceDatasheetReaderComments"}%

<sticky></div></sticky>

Copyright © by IBM and non-IBM contributing authors. All material on this collaboration platform is the property of the contributing authors.
Contributions are governed by our Terms of Use. Please read the following disclaimer.
Dashboards and work items are no longer publicly available, so some links may be invalid. We now provide similar information through other means. Learn more here.