Edit
Attach
P
rintable
r8 - 2014-10-09 - 03:34:17 -
LuLu
You are here:
TWiki
>
Deployment Web
>
DeploymentPlanningAndDesign
>
PerformanceDatasheetsAndSizingGuidelines
>
RTCSystemZPerformanceTesting
>
RTCEEBenchmarkTests
>
RTCEEFeaturePerformanceComparisonBetweenReleases
<div id="header-title" style="padding: 10px 15px; border-width:1px; border-style:solid; border-color:#FFD28C; background-image: url(<nop>https://jazz.net/wiki/pub/Deployment/WebPreferences/TLASE.jpg); background-size: cover; font-size:120%"> ---+!! <img src="https://jazz.net/wiki/pub/Deployment/WebPreferences/new.png" alt="new.png" width="50" height="50" align="right"> Rational Team Concert For z/OS Features Performance Comparison Between Releases %DKGRAY% Authors: Lu Lu</br> Date: Sep 17th, 2014 </br> Build basis: Rational Team Concert for z/OS from 4.0.2, 4.0.3, 4.0.4, 4.0.5, 4.0.6, 5.0, 5.0.1 %ENDCOLOR%</div></sticky> <!-- Page contents top of page on right hand side in box --> <sticky><div style="float:right; border-width:1px; border-style:solid; border-color:#DFDFDF; background-color:#F6F6F6; margin:0 0 15px 15px; padding: 0 15px 0 15px;"> %TOC{title="Page contents"}% </div></sticky> <sticky><div style="margin:15px;"></sticky> ---++ Introduction This report compares the performance of RTC for z/OS features(Package, Deploy and Promotion) between releases since v4.0.2 until v5.0.1. Generally constant performance improvements are made into releases of RTC for z/OS. The objective of this report is to present the improvements. The performance data provided is obtained by benchmark test of each release. Currently the report includes only the build information. ---++ Disclaimer %INCLUDE{"PerformanceDatasheetDisclaimer"}% ---++ Findings Based on following feature test data, we can get following summaries of RTC EE features from 4.0.2 to 5.0.1: 1. Performance of 'Promotion' feature has improved significantly (<strong>80%</strong>). 2. Performance of 'Deploy' feature has improved about 16.9%. 3. Performance of 'Package' feature is stable. From 4.0.2 to 5.0.1, the overall performance improvement of the Promotion feature is about 80%:<br/> <strong><br/> *. From 4.0.3 to 4.0.4, promotion time has improved by 7% ('Generating list of binaries to promote' activity is the most notable improvement of 50% than 4.0.3).<br/> *. From 4.0.5 to 4.0.6, promotion time has improved by 75%('Finalize build maps' activity is a remarkable great improvment of 96% than 4.0.5).</br> *. from 4.0.6 to 5.0.1, promotion time has improved by 6%('Promote' activity is the main improvement of 18.8% than 4.0.6). </strong> ---++ Topology The tests are executed in a Single Tier Topology infrastructure like the one in the following diagram: %INCLUDE{"RTCEETestingTopologies" section="SingleTierZ"}% The RTC server was set up based on !WebSphere and DB2 on Linux for System z. The build machine with Rational Build Agent was on zOS. <table class="gray-table"> <tr> <th><strong>Test Environment</strong></th> <th></th> <th></th> </tr> <tr> <td><strong>RTC Server</strong></td> <td>Operating System & Version: Linux for System z (SUSE Linux Enterprise Server 10 (s390x))</br> System Resource : 10 GB Storage, 4 CPs (20000 mips, CPU type : 2097.710, CPU model: E12) </br> CLM: from 4.0.2 GA to 5.0.1 GA, 4 GB heap size </br> DB2: 9.7.0.5 (from 4.0.2 GA to 4.0.6 GA), 10.1.0.0(5.0 GA to 5.0.1 GA)</br> WAS: 8.0.0.3 (from 4.0.2 GA to 4.0.5 GA), 8.5.5.1 (from 4.0.6 GA to 5.0.1 GA)</br> </td> <tr> <td><strong>Build Forge Agent</strong></td> <td>Operating System & Version: z/OS 01.12.00</br> System Resource: 6 GB Storage, 4 CPs (20000 mips, CPU type : 2097.710, CPU model: E12)</br> Build System Toolkit: from 4.0.2 GA to 5.0.1 GA </td> </tr> </table> ---++ Methodology Build time and individual activity time are compared by getting test start date and time. The sample projects for the test are: * Mortgage Application *100 which is 100 duplicates of the [[https://jazz.net/wiki/bin/view/Main/ZOSBuildSamplesV4][Mortgage sample application]] * Mortgage Application *1000 which is 1000 duplicates of the [[https://jazz.net/wiki/bin/view/Main/ZOSBuildSamplesV4][Mortgage sample application]] <table class="gray-table" style="width: 60%"> <tr> <th><strong>Test Data</strong></th> <th></th> <th></th> </tr> <tr> <td><strong>Sample Project</strong></td> <td>Mortgage*100</td> <td>Mortgage*1000</td> </tr> <tr> <td><strong>Assets</strong></td> <td>600 COBOL programs<br/> 400 Copybooks<br/> 200 BMS<br/>3 others<br/> </td> <td>6000 COBOL programs<br/> 4000 Copybooks<br/> 2000 BMS<br/>3 others<br/> </td> </tr> <tr> <td><strong>Total Assets</strong></td> <td>1203 </td> <td>12003 </td> </tr> </table> In the repository the source code is stored in one stream with one single component which includes 5 zComponent Projects. Enterprise builds are executed twice against each version. ---++ Results ---+++ Run duration Below charts show run duration comparing between 4.0.2 until 5.0.1 of each EE feature, and each feature of EE are run twice against each release and the average time is taken for comparison. <b>Package:</b></br> From below 'Package' feature runtime chart, each release has simliar runtime duration, no big improvement in this feature, but this feature is stable. <img src="%ATTACHURLPATH%/packageRuntime.jpg" alt="package_runtime.jpg" width="70%" height="70%" /> <br/> <b>Deploy:</b><br/> From below 'Deploy' feature runtime chart, it improved about 16.9% from v4.0.2 to v5.0.1 for MortgageApplication x1000. <br/> Note - For v5.0, there was one regression issue but had been fixed quickly. <img src="%ATTACHURLPATH%/deployRuntime.jpg" alt="deploy_runtime.jpg" width="70%" height="70%" /> <br/> <b>Promotion:</b><br/> From below 'Promotion' feature runtime chart, this feature is continous improved release by release, it has been improved <strong>80%</strong>. For the release by release comparison, it improved by 75% from 4.0.5 to 4.0.6 and 6% from 4.0.6 to 5.0.1. <img src="%ATTACHURLPATH%/promotionRuntime.jpg" alt="promotion_runtime.jpg" width="70%" height="70%" /> Below 'Promotion - Single Changes' runtime chart is a special scenario desinged from v4.0.4 release, which shows peformance improvement of 'promotion with change set' feature. <img src="%ATTACHURLPATH%/promotionRuntime2.jpg" alt="promotion_runtime_withChangeSet.jpg" width="70%" height="70%" /> <br/> ---+++ Build Activities Display all feature test results in one comparison table is too large, so seperate into 3 comparison tables and link to other page. For EE feature test results, they are divided inio following 3 comparison tables, please navigate to linked page for detailed results. <strong><red>'Package' Comparison Results [[RTCEEFeaturesPackageComparison][here]]</red></strong> <strong>'Deploy' Comparison Results [[RTCEEFeaturesDeployComparison][here]]</strong> <strong>'Promotion(Full Promotion and Single Changeset)' Comparison Results [[RTCEEFeaturesPromotionComarison][here]]</strong> The chars below display the run times of build activity "Collecting buildable files" and "Compile" which have gained some improvements between releases. Builds are run twice against each release and the average time is taken for comparison. ---++ Appendix A - Key Tuning Parameters #AppendixA <table class="gray-table"> <tbody> <tr> <th align="left" width="200"><strong>Product</strong><br></th> <th align="left" width="100"><strong>Version</strong></th> <th align="left" width="600"><strong>Highlights for configurations under test</strong></th> </tr> <tr> <td style="vertical-align: top;">IBM !WebSphere Application Server</td> <td style="vertical-align: top;">8.0.0.3 (4.0.2GA to 4.0.5GA),<br> 8.5.5.1 (4.0.6GA to 5.0.1GA)</td> <td style="vertical-align: top;"><strong>JVM settings:</strong> * GC policy and arguments, max and init heap sizes: <verbatim> -Xmn512m -Xgcpolicy:gencon -Xcompressedrefs -Xgc:preferredHeapBase=0x100000000 -Xmx4g -Xms4g</verbatim> <strong>OS configuration:</strong> <verbatim> * hard nofile 120000 * soft nofile 120000</verbatim> Refer to http://pic.dhe.ibm.com/infocenter/clmhelp/v4r0m4/topic/com.ibm.jazz.install.doc/topics/c_special_considerations_linux.html for details </td> </tr> <tr> <td>DB2</td> <td>DB2 Enterprise Server 9.7.0.5 (4.0.2GA to 4.0.6GA),<br> 10.1.0.0 (5.0GA to 5.0.1GA)</td> <td>Tablespace is stored on the same machine as IBM !WebSphere Application Server</td> </tr> <tr> <td>License Server</td> <td>Same as CLM version</td> <td>Hosted locally by JTS server</td> </tr> <tr> <td>Network</td> <td> </td> <td>Shared subnet within test lab</td> </tr> </tbody> </table> ---++++!! About the authors Main.Lu Lu -------------------- ---+++++!! Questions and comments: * What other performance information would you like to see here? * Do you have performance scenarios to share? * Do you have scenarios that are not addressed in documentation? * Where are you having problems in performance? %COMMENT{type="below" target="PerformanceDatasheetReaderComments" button="Submit"}% %INCLUDE{"PerformanceDatasheetReaderComments"}% <sticky></div></sticky>
Edit
|
Attach
|
P
rintable
|
V
iew topic
|
Backlinks:
We
b
,
A
l
l Webs
|
H
istory
:
r12
|
r10
<
r9
<
r8
<
r7
|
More topic actions...
Deployment
Deployment web
Planning and design
Installing and upgrading
Migrating and evolving
Integrating
Administering
Monitoring
Troubleshooting
Community information and contribution guidelines
Create new topic
Topic list
Search
Advanced search
Notify
RSS
Atom
Changes
Statistics
Web preferences
NOTE: Please use the Sandbox web for testing
Status icon key:
To do
Under construction
New
Updated
Constant change
None - stable page
Smaller versions of status icons for inline text:
Copyright © by IBM and non-IBM contributing authors. All material on this collaboration platform is the property of the contributing authors.
Contributions are governed by our
Terms of Use.
Please read the following
disclaimer
.
Dashboards and work items are no longer publicly available, so some links may be invalid. We now provide similar information through other means. Learn more
here
.