E
dit
A
ttach
P
rintable
r4 - 2015-12-21 - 06:24:59 - Main.bjsuhui
You are here:
TWiki
>
Deployment Web
>
DeploymentPlanningAndDesign
>
PerformanceDatasheetsAndSizingGuidelines
>
RTCSystemZPerformanceTesting
>
RTCEEBenchmarkTests
>
RTCEEFeaturePerformanceComparisonBetweenReleasesForIBMi
<div id="header-title" style="padding: 10px 15px; border-width:1px; border-style:solid; border-color:#FFD28C; background-image: url(<nop>https://jazz.net/wiki/pub/Deployment/WebPreferences/TLASE.jpg); background-size: cover; font-size:120%"> ---+!! <img src="https://jazz.net/wiki/pub/Deployment/WebPreferences/new.png" alt="new.png" width="50" height="50" align="right"> Rational Team Concert For IBMi Features Performance Comparison Between Releases %DKGRAY% Authors: Main.LuLu Main.SuHui</br> Date: June 30th, 2015 </br> Build basis: Rational Team Concert for IBMi 5.0.2, 6.0, 6.0.1 %ENDCOLOR%</div></sticky> <!-- Page contents top of page on right hand side in box --> <sticky><div style="float:right; border-width:1px; border-style:solid; border-color:#DFDFDF; background-color:#F6F6F6; margin:0 0 15px 15px; padding: 0 15px 0 15px;"> %TOC{title="Page contents"}% </div></sticky> <sticky><div style="margin:15px;"></sticky> ---++ Introduction This report compares the performance of RTC for IBMi features(Package, Deploy and Promotion) between releases since v5.0.2 until v6.0.1. Generally constant performance improvements are made into releases of RTC for IBMi. The objective of this report is to present the improvements. The performance data provided is obtained by benchmark test of each release. Currently the report includes only the build information. ---++ Disclaimer %INCLUDE{"PerformanceDatasheetDisclaimer"}% ---++ Findings Based on following feature test data, we can get following summaries of RTC EE features from 5.0.2 to 6.0: 1. Performance of 'Promotion' feature has improved significantly (<strong>76%</strong>) from v5.0.2 to v6.0. 2. Performance of 'Deploy' feature has improved slightly. 3. Performance of 'Package' feature is stable. From 5.0.2 to 6.0, the overall performance improvement of the Promotion feature is about 76%:<br/> <strong><br/> *From 5.0.2 to 6.0, promotion time has improved by 80% <br/> - 'Generating list of binaries to promote' activity is the most notable improvement of 80% in v6.0.<br/> - 'Promote' activity is improved of 62% in v6.0.<br/> - 'Finalize build maps' is improved of 93% in v6.0. <br/> </strong> From 6.0 to 6.0.1, the performance of RTC EE features is stable. ---++ Topology The tests are executed in a Single Tier Topology infrastructure like the one in the following diagram: %INCLUDE{"RTCEETestingTopologies" section="SingleTierI"}% The RTC server was set up based on !WebSphere and DB2 on IBMi. The build machine with Rational Build Agent was on IBMi. <table class="gray-table"> <tr> <th><strong>Test Environment</strong></th> <th></th> <th></th> </tr> <tr> <td><strong>RTC Server</strong></td> <td>Operating System & Version: IBMi v7.1</br> System Resource : 4 dedicated processors, 30GB memory </br> CLM: from 5.0.2 GA to 6.0.1 GA, 6 GB heap size </br> DB2: DB2 for IBMi v7.1</br> WAS: 8.5.5.3(from 5.0.2 GA to 6.0 GA), 8.5.5.7(from 6.0GA to 6.0.1 GA)</br> </td> <tr> <td><strong>Build Forge Agent</strong></td> <td>Operating System & Version: IBMi v7.1</br> System Resource: 4 dedicated processors, 30GB memory</br> Build System Toolkit: from 5.0.2 GA to 6.0.1 GA </td> </tr> </table> ---++ Methodology Build time and individual activity time are compared by getting test start date and time. The sample projects for the test are: * Maillist Application *100 * Maillist Application *1000 <table class="gray-table" style="width: 60%"> <tr> <th><strong>Test Data</strong></th> <th></th> <th></th> </tr> <tr> <td><strong>Sample Project</strong></td> <td>Maillist *100</td> <td>Maillist *1000</td> </tr> <tr> <td><strong>Assets</strong></td> <td>500 RPGLE<br/> 200 SRVPGM<br/> 100 PGMSRC<br/> 4 DSPF<br/> 4 LF <br/> 2 PF <br/> 6 CLLE <br/> 1 * CLP <br/> </td> <td>5000 RPGLE<br/> 2000 SRVPGM<br/> 1000 PGMSRC<br/> 4 DSPF<br/> 4 LF <br/> 2 PF <br/> 6 CLLE <br/> 1 * CLP <br/> </td> </tr> <tr> <td><strong>Total Assets</strong></td> <td>817 </td> <td>8017 </td> </tr> </table> In the repository the source code is stored in one stream with one single component. Enterprise builds are executed twice against each version. ---++ Results *Note : since 6.0.1 benchmark , we have replaced our IBMi performance testing LPARs and new performance baselines are created. 6.0 benchmark have been re-run to compare on identical hardware.* ---+++ Run duration Below charts show run duration comparing from 5.0.2 to 6.0, and from v6.0 to v6.0.1 of each EE feature, and each feature of EE are run twice against each release and the average time is taken for comparison. <b>Package:</b></br> From below 'Package' feature runtime chart, each release has similar runtime duration, no big improvement in this feature, but this feature is stable. <img src="%ATTACHURLPATH%/package.jpg" alt="package.jpg" width="70%" height="70%" /> <img src="%ATTACHURLPATH%/package_2.png" alt="package_2.png" width="70%" height="70%" /> <b>Deploy:</b><br/> From below 'Deploy' feature runtime chart, it stay consistent from v5.0.2 to v6.0.1. <br/> <img src="%ATTACHURLPATH%/deployment.png" alt="deployment.png" width="70%" height="70%" /> <img src="%ATTACHURLPATH%/deployment_2.png" alt="deployment_2.png" width="70%" height="70%" /> <b>Promotion:</b><br/> From below 'Promotion' feature runtime chart, this feature is continuous improved release by release, it has been improved <strong>80%</strong>. For the release by release comparison, it improved by 80% from 5.0.2 to 6.0. <img src="%ATTACHURLPATH%/promotion.png" alt="promotion.png" width="70%" height="70%" /> <img src="%ATTACHURLPATH%/promotion_2.png" alt="promotion_2.png" width="70%" height="70%" /> <img src="%ATTACHURLPATH%/promotion_with_changeset.png" alt="promotion_with_changeset.png" width="70%" height="70%" /> <img src="%ATTACHURLPATH%/promotion_with_changeset_2.png" alt="promotion_with_changeset_2.png" width="70%" height="70%" /> <br/> ---+++ Build Activities Display all feature test results in one comparison table is too large, so separate into 3 comparison tables and link to other page. For EE feature test results, they are divided into following 3 comparison tables, please navigate to linked page for detailed results. <strong><red>'Package' Comparison Results [[RTCEEFeaturesPackageComparisonForIBMi][here]]</red></strong> <strong>'Deploy' Comparison Results [[RTCEEFeaturesDeployComparisonForIBMi][here]]</strong> <strong>'Promotion(Full Promotion and Single Changeset)' Comparison Results [[RTCEEFeaturesPromotionComarisonForIBMi][here]]</strong> ---++ Appendix A - Key Tuning Parameters #AppendixA <table class="gray-table"> <tbody> <tr> <th align="left" width="200"><strong>Product</strong><br></th> <th align="left" width="100"><strong>Version</strong></th> <th align="left" width="600"><strong>Highlights for configurations under test</strong></th> </tr> <tr> <td style="vertical-align: top;">IBM !WebSphere Application Server</td> <td style="vertical-align: top;">8.5.5.3 (5.0.2GA to 6.0GA), 8.5.5.7(from 6.0GA to 6.0.1 GA)</td> <td style="vertical-align: top;"><strong>JVM settings:</strong> * GC policy and arguments, max and init heap sizes: <verbatim> -Xmn768m -Xgcpolicy:gencon -Xcompressedrefs -Xgc:preferredHeapBase=0x200000000 -Xmx6g -Xms6g</verbatim> </td> </tr> <tr> <td>DB2</td> <td>DB2 Enterprise Server for IBMi v7.1</td> <td>Tablespace is stored on the same machine as IBM !WebSphere Application Server</td> </tr> <tr> <td>License Server</td> <td>Same as CLM version</td> <td>Hosted locally by JTS server</td> </tr> <tr> <td>Network</td> <td> </td> <td>Shared subnet within test lab</td> </tr> </tbody> </table> ---++++!! About the authors Main.LuLu, Main.SuHui -------------------- ---+++++!! Questions and comments: * What other performance information would you like to see here? * Do you have performance scenarios to share? * Do you have scenarios that are not addressed in documentation? * Where are you having problems in performance? %COMMENT{type="below" target="PerformanceDatasheetReaderComments" button="Submit"}% %INCLUDE{"PerformanceDatasheetReaderComments"}% <sticky></div></sticky>
E
dit
|
A
ttach
|
P
rintable
|
V
iew topic
|
Backlinks:
We
b
,
A
l
l Webs
|
H
istory
: r4
<
r3
<
r2
<
r1
|
M
ore topic actions
Deployment
Deployment web
Planning and design
Installing and upgrading
Migrating and evolving
Integrating
Administering
Monitoring
Troubleshooting
Community information and contribution guidelines
Create new topic
Topic list
Search
Advanced search
Notify
RSS
Atom
Changes
Statistics
Web preferences
NOTE: Please use the Sandbox web for testing
Status icon key:
To do
Under construction
New
Updated
Constant change
None - stable page
Smaller versions of status icons for inline text:
Copyright © by IBM and non-IBM contributing authors. All material on this collaboration platform is the property of the contributing authors.
Contributions are governed by our
Terms of Use.
Please read the following
disclaimer
.