-Dcom.ibm.rdm.configcache.size=400Assume that each active entry in the cache will consume 2M of RAM.
DB2 REORGCHK UPDATE STATISTICS ON TABLE ALLOracle
EXEC DBMS_STATS.gather_schema_stats(' JAZZDBUSER' );
RM server hardware and JVM configuration |
Jazz Team Server |
DB2 server |
Number of users supported |
32 GB RAM with 16 GB JVM heap |
32 GB RAM with 16 GB JVM heap |
64 GB RAM |
350 |
64 GB RAM with 24 GB JVM heap |
32 GB RAM with 16 GB JVM heap |
64 GB RAM |
450 |
128 GB RAM with 24 GB JVM heap |
32 GB RAM with 16 GB JVM heap |
64 GB RAM |
450 |
RM server hardware and JVM configuration |
Jazz Team Server |
DB2 server |
Number of users supported |
HDD – 32 GB RAM with 16 GB JVM heap |
32 GB RAM with 16 GB JVM heap |
64 GB RAM |
350 |
SSD – 32 GB RAM with 16 GB JVM heap |
32 GB RAM with 16 GB JVM heap |
64 GB RAM |
400 |
HDD – 64 GB RAM with 24 GB JVM heap |
32 GB RAM with 16 GB JVM heap |
64 GB RAM |
450 |
SSD – 64 GB RAM with 24 GB JVM heap |
32 GB RAM with 16 GB JVM heap |
64 GB RAM |
450 |
HDD – 128 GB RAM with 24 GB JVM heap |
32 GB RAM with 16 GB JVM heap |
64 GB RAM |
450 |
Use case |
Sensitivity to counts |
Upper limit of testing |
Typical response time |
Open configuration UI |
low |
n/a |
2-4 seconds |
Configuration UI: list baselines |
low |
62 baselines |
4 seconds |
Configuration UI: list streams |
low |
33 streams |
2-3 seconds |
Configuration UI: list change sets |
low |
132 change sets |
2-3 seconds |
Open "switch configuration" UI |
low |
n/a |
4 seconds |
Switch configuration: search for baseline |
medium |
328 baselines |
up to 12 seconds |
Switch configuration: search for stream |
medium |
109 streams |
up to 9 seconds |
Switch configuration: search for change sets |
medium |
2508 change sets |
up to 11 seconds |
Compare stream: confirm source/target |
low |
n/a |
2 seconds |
Compare stream: compare project properties |
high |
1300 change sets |
Increases from 3 to 42 seconds |
Compare stream: compare artifacts |
high |
1300 change sets |
Increases from 8 to 62 seconds |
Deliver change set: confirm source/target |
high |
n/a |
Increases from 5 to 20 seconds |
Deliver change set: compare artifacts |
high |
825 changes in change set |
Increases from 8 to 33 seconds |
Deliver change set: Finish |
high |
825 changes in change set |
Increases from 7 to 19 seconds |
Deliver to stream: select menu |
high |
1017 changes delivered |
Increases from 15 to 35 seconds |
Deliver to stream: compare artifacts |
high |
1017 changes delivered | Increases from 5 to 45 seconds |
Deliver to stream: Finish |
high |
1017 changes delivered | Increases from 15 to 25 seconds |
Function |
Number of machines |
Machine type |
Processor/machine |
Total processor cores/machines |
Memory/machine |
Network interface |
OS and version |
|
Proxy Server (IBM HTTP Server and WebSphere Plugin) |
1 |
IBM System x3250 M4 |
1 x Intel Xeon E3-1240v2 3.4 GHz (quad-core) |
8 |
16 GB |
Gigabit Ethernet |
Red Hat Enterprise Linux Server release 6.3 (Santiago) |
|
Jazz Team Server WebSphere Application Server 8.5.5.1 |
1 |
IBM System x3550 M4 |
2 x Intel Xeon E5-2640 2.5 GHz (six-core) |
24 |
32 GB |
Gigabit Ethernet |
Red Hat Enterprise Linux Server release 6.3 (Santiago) |
|
RM server WebSphere Application Server 8.5.5.1 |
1 |
IBM System x3550 M4 |
2 x Intel Xeon E5-2640 2.5 GHz (six-core) |
24 |
Varied, depending on the repository size and hard disk type. 32 GB to 128 GB |
Gigabit Ethernet |
Red Hat Enterprise Linux Server release 6.3 (Santiago) |
|
Database server DB2 10.1.2 |
1 |
IBM System x3650 M4 |
2 x Intel Xeon E5-2640 2.5 GHz (six-core) |
24 |
64 GB |
Gigabit Ethernet |
Red Hat Enterprise Linux Server release 6.3 (Santiago) |
|
Network switches |
N/A |
Cisco 2960G-24TC-L |
N/A |
N/A |
|
Gigabit Ethernet |
24 Ethernet 10/100/1000 ports |
Artifact type |
Number |
Large modules (10,000 artifacts) |
2 |
Medium modules (1500 artifacts) |
40 |
Small modules (500 artifacts) |
10 |
Folders |
119 |
Module artifacts |
85000 |
Non-module artifacts |
1181 |
Comments |
260582 |
Links |
304029 |
Collections |
14 |
Public tags |
300 |
Private tags |
50 |
Views |
200 |
Terms |
238 |
Streams |
15 |
Baselines |
15 |
Change sets |
600 |
Artifact type |
500,000-artifact |
1-million-artifact |
2-million-artifact |
Projects |
6 |
12 |
24 |
Large modules (10,000 artifacts) |
12 |
24 |
48 |
Medium modules (1500 artifacts) |
240 |
480 |
960 |
Small modules (500 artifacts) |
60 |
120 |
240 |
Folders |
714 |
1428 |
2856 |
Module artifacts |
510,000 |
1,020,000 |
2,040,000 |
Non-module artifacts |
7086 |
14,172 |
28344 |
Comments |
1,563,492 |
3,126,984 |
6,253,968 |
Links |
1,824,174 |
3,648,348 |
7,296,696 |
Collections |
84 |
168 |
336 |
Public tags |
1800 |
3600 |
7200 |
Private tags |
300 |
600 |
1200 |
Views |
1200 |
2400 |
4800 |
Terms |
1428 |
2856 |
5712 |
Streams |
90 |
180 |
360 |
Baselines |
90 |
180 |
360 |
Change sets |
600 |
1200 |
3600 |
Index size on disk |
39 GB |
75 GB |
157 GB |
Use case |
Description |
Number of users |
---|---|---|
Edit stream |
Select the default configuration. Navigate to the streams, baselines, and change set tabs.. |
2% |
Create stream/baseline |
Create a stream and a baseline as children of the default stream. Runs 5 times per hour per user. |
1% |
Select random baseline |
Open the Switch configuration UI; select a random baseline and switch to it. |
1% |
Select random stream |
Open the Switch configuration UI; select a random stream and switch to it. |
1% |
Copy/Paste/Move/Delete |
Create a change set. Open a module that contains 1500 artifacts, select 25 artifacts, move them by using the copy and paste functions, and then delete the copied artifacts. Deliver the change set. |
1% |
Create an artifact |
Create a change set. Create non-module artifacts. Deliver the change set. |
3% |
Create a collection |
Create a change set. Create collections that contain 10 artifacts. Deliver the change set. |
4% |
Create a module artifact end-to-end scenario |
Create a change set. Open a medium module that contains 1500 artifacts, create a module artifact, edit the new artifact, and delete the new artifact. Deliver the change set 75% of the time; discard the change set 25% of the time. |
12% |
Create a small module artifact end-to-end scenario |
create a change set. Open a small module that contains 500 artifacts, create a module artifact, edit that new artifact, and delete the new artifact. Deliver the change set 50% of the time; discard the change set 50% of the time. |
6% |
Create a comment in a module artifact |
Create a change set. Open a medium module that contains 1500 artifacts, open an artifact that is in the module, expand the Comments section of the artifact, and create a comment. Deliver the change set 83% of the time; discard the change set 17% of the time. |
18% |
Hover over a module artifact and edit it |
Create a change set. Open a module that contains 1500 artifacts and hover over an artifact. When the rich hover is displayed, edit the artifact text. Deliver the change set. |
2% |
Hover over and open a collection |
Display all of the collections, hover over a collection, and then open it. |
1% |
Manage folders |
Click “Show Artifacts” to display folder tree and then create a folder. Move the new folder into another folder and then delete the folder that you just created. |
1% |
Open the project dashboard |
Open a dashboard that displays the default dashboard. |
5% |
Search by ID and string |
Open a project, select a folder, search for an artifact by its numeric ID, and click a search result to display an artifact. Search for artifacts by using a generic string search that produces about 50 results. |
9% |
Scroll 20 pages in a module |
Open a module that contains 1500 artifacts and then scroll through 20 pages. |
16% |
Switch the module view |
Open a module that contains 1500 artifacts and then change the view to add columns that display user-defined attributes. |
14% |
Upload a 4 MB file as a new artifact |
Upload a file and create an artifact. |
4% |
Server activity |
100 users in 1 hour |
100 users in 8 hours |
400 users in 8 hours |
Number of artifacts created |
369 |
2952 |
11808 |
Number of artifacts opened |
280 |
2240 |
8960 |
Number of artifacts edited or deleted |
308 |
2464 |
9856 |
Display a list of modules |
591 |
4728 |
18912 |
Comments created |
162 |
1296 |
5184 |
Modules opened |
588 |
4704 |
18816 |
Search by ID and open the artifact |
133 |
1064 |
4256 |
Search by string |
132 |
1056 |
4224 |
Switch module view to filter by attribute |
270 |
2160 |
8640 |
Number of module pages scrolled |
834 |
6672 |
26688 |
Create stream |
8 |
64 |
256 |
Create baseline |
8 |
64 |
256 |
Switch to a stream |
104 |
832 |
3328 |
Switch to a baseline |
80 |
640 |
2560 |
Browse the current configuration |
101 |
808 |
3232 |
Create change set |
360 |
2880 |
11520 |
Discard change set |
68 |
544 |
2176 |
Deliverchange set |
290 |
2320 |
9280 |
-Xgcpolicy:gencon –Xmx16g –Xms16g –Xmn4G -Xcompressedrefs -Xgc:preferredHeapBase=0x100000000For the DNG server, we used a nursery (-Xmn) of 1/3 the maximum heap size.
Repository |
Combined hard disk usage of the Jazz Team Server and RM databases |
Hard disk size |
Up to 500,000 artifacts |
~100 GB |
300 GB |
Up to1 million artifacts |
~150 GB |
400 GB |
Up to 2 million artifacts |
~300 GB |
700 GB |
ThreadLimit | 25 |
ServerLimit | 100 |
StartServers | 2 |
MaxClients | 2500 |
SpareThreads | 25 |
MaxSpareThreads | 500 |
ThreadsPerChild | 25 |
MaxRequestsPerChild | 0 |
[root@rtpclmperf54 ~]# sysbench --test=cpu --cpu-max-prime=20000 --num-threads=2 run sysbench 0.4.12: multi-threaded system evaluation benchmark Running the test with following options: Number of threads: 2 Doing CPU performance benchmark Threads started! Done. Maximum prime number checked in CPU test: 20000 Test execution summary: total time: 14.1474s total number of events: 10000 total time taken by event execution: 28.2911 per-request statistics: min: 2.81ms avg: 2.83ms max: 4.57ms approx. 95 percentile: 2.83ms Threads fairness: events (avg/stddev): 5000.0000/6.00 execution time (avg/stddev): 14.1456/0.00
[root@rtpclmperf54 ~]# sysbench --test=threads --thread-locks=1 --max-time=20s run sysbench 0.4.12: multi-threaded system evaluation benchmark Running the test with following options: Number of threads: 1 Doing thread subsystem performance test Thread yields per test: 1000 Locks used: 1 Threads started! Done. Test execution summary: total time: 2.4065s total number of events: 10000 total time taken by event execution: 2.4051 per-request statistics: min: 0.24ms avg: 0.24ms max: 0.66ms approx. 95 percentile: 0.25ms Threads fairness: events (avg/stddev): 10000.0000/0.00 execution time (avg/stddev): 2.4051/0.00
[root@rtpclmperf54 ~]# sysbench --test=mutex --num-threads=64 run sysbench 0.4.12: multi-threaded system evaluation benchmark Running the test with following options: Number of threads: 64 Doing mutex performance test Threads started! Done. Test execution summary: total time: 1.7035s total number of events: 64 total time taken by event execution: 105.7884 per-request statistics: min: 1526.68ms avg: 1652.94ms max: 1701.69ms approx. 95 percentile: 1699.11ms Threads fairness: events (avg/stddev): 1.0000/0.00 execution time (avg/stddev): 1.6529/0.04
[root@rtpclmperf54 ~]# sysbench --test=memory --num-threads=4 run sysbench 0.4.12: multi-threaded system evaluation benchmark Running the test with following options: Number of threads: 4 Doing memory operations speed test Memory block size: 1K Memory transfer size: 102400M Memory operations type: write Memory scope type: global Threads started! Done. Operations performed: 104857600 (1279460.43 ops/sec) 102400.00 MB transferred (1249.47 MB/sec) Test execution summary: total time: 81.9545s total number of events: 104857600 total time taken by event execution: 161.3530 per-request statistics: min: 0.00ms avg: 0.00ms max: 2.03ms approx. 95 percentile: 0.00ms Threads fairness: events (avg/stddev): 26214400.0000/947576.28 execution time (avg/stddev): 40.3383/0.67
[root@rtpclmperf54 home]# sysbench --test=fileio --file-total-size=150G --file-test-mode=rndrw --max-time=300 --max-requests=0 run sysbench 0.4.12: multi-threaded system evaluation benchmark Running the test with following options: Number of threads: 1 Extra file open flags: 0 128 files, 1.1719Gb each 150Gb total file size Block size 16Kb Number of random requests for random IO: 0 Read/Write ratio for combined random IO test: 1.50 Periodic FSYNC enabled, calling fsync() each 100 requests. Calling fsync() at the end of test, Enabled. Using synchronous I/O mode Doing random r/w test Threads started! Time limit exceeded, exiting... Done. Operations performed: 83823 Read, 55882 Write, 178816 Other = 318521 Total Read 1.279Gb Written 873.16Mb Total transferred 2.1317Gb (7.2762Mb/sec) 465.67 Requests/sec executed Test execution summary: total time: 300.0057s total number of events: 139705 total time taken by event execution: 292.0346 per-request statistics: min: 0.00ms avg: 2.09ms max: 116.53ms approx. 95 percentile: 5.80ms Threads fairness: events (avg/stddev): 139705.0000/0.00 execution time (avg/stddev): 292.0346/0.00
[root@rtpclmperf54 data]# sysbench --test=fileio --file-total-size=150G --file-test-mode=rndrw --max-time=300 --max-requests=0 run sysbench 0.4.12: multi-threaded system evaluation benchmark Running the test with following options: Number of threads: 1 Extra file open flags: 0 128 files, 1.1719Gb each 150Gb total file size Block size 16Kb Number of random requests for random IO: 0 Read/Write ratio for combined random IO test: 1.50 Periodic FSYNC enabled, calling fsync() each 100 requests. Calling fsync() at the end of test, Enabled. Using synchronous I/O mode Doing random r/w test Threads started! Time limit exceeded, exiting... Done. Operations performed: 1039203 Read, 692802 Write, 2216960 Other = 3948965 Total Read 15.857Gb Written 10.571Gb Total transferred 26.428Gb (90.209Mb/sec) 5773.35 Requests/sec executed Test execution summary: total time: 300.0002s total number of events: 1732005 total time taken by event execution: 197.4660 per-request statistics: min: 0.00ms avg: 0.11ms max: 9.51ms approx. 95 percentile: 0.25ms Threads fairness: events (avg/stddev): 1732005.0000/0.00 execution time (avg/stddev): 197.4660/0.00
I | Attachment | Action | Size | Date | Who | Comment |
---|---|---|---|---|---|---|
png | TestTopology.png | manage | 21.5 K | 2015-05-11 - 17:50 | VaughnRokosz | TestTopology |
png | CompareStream.png | manage | 8.1 K | 2015-05-12 - 16:32 | VaughnRokosz | Response times: compare streams |
png | DeliverChangeSet.png | manage | 8.3 K | 2015-05-12 - 16:31 | VaughnRokosz | Response times: deliver change set |
png | DeliverToStream.png | manage | 8.0 K | 2015-05-12 - 17:54 | VaughnRokosz | Response times: deliver between streams |
png | Switch_FindBaselines.png | manage | 7.0 K | 2015-05-12 - 17:55 | VaughnRokosz | Response times: switch configuration -> search for baseline |
png | Switch_FindChangeSets.png | manage | 6.9 K | 2015-05-12 - 17:55 | VaughnRokosz | Response times: switch configuration -> search for change sets |
png | Switch_FindStreams.png | manage | 6.8 K | 2015-05-12 - 17:56 | VaughnRokosz | Response times: switch configuration -> search for streams |
png | 1MResults.png | manage | 51.6 K | 2015-05-28 - 15:14 | UnknownUser | Test results for 1M repository |
png | 500KResults.png | manage | 24.1 K | 2015-05-28 - 15:15 | UnknownUser | Test results for 500K repository |
png | SummaryTable.png | manage | 31.7 K | 2015-05-28 - 15:16 | UnknownUser | Summary of test results across all configurations |