*TC: Test Case, TER: Test Case Execution Record. Every 100k Test Cases denotes 1M Test Artifacts in total. |
**TC: Test Case, TS: Test Script |
**TC: Test Case, TP: Test Plan |
Function | Number of Machines | Machine Type | CPU / Machine | Total # of CPU vCores/Machine | Memory/Machine | Disk | Disk capacity | Network interface | OS and Version |
---|---|---|---|---|---|---|---|---|---|
Proxy Server (IBM HTTP Server and WebSphere Plugin) | 1 | IBM System x3250 M4 | 1 x Intel Xeon E3-1240 3.4GHz (quad-core) | 8 | 16GB | RAID 1 -- SAS Disk x 2 | 299GB | Gigabit Ethernet | Red Hat Enterprise Linux Server release 6.5 |
JTS Server | 1 | IBM System x3550 M4 | 2 x Intel Xeon E5-2640 2.5GHz (six-core) | 24 | 32GB | RAID 5 -- SAS Disk x 2 | 897GB | Gigabit Ethernet | Red Hat Enterprise Linux Server release 6.5 |
QM Server | 1 | IBM System x3550 M4 | 2 x Intel Xeon E5-2640 2.5GHz (six-core) | 24 | 32GB | RAID 5 -- SAS Disk x 2 | 897GB | Gigabit Ethernet | Red Hat Enterprise Linux Server release 6.5 |
Database Server | 1 | IBM System x3650 M4 | 2 x Intel Xeon E5-2640 2.5GHz (six-core) | 24 | 64GB | RAID 5 -- SAS Disk x 2 | 2.4TB | Gigabit Ethernet | Red Hat Enterprise Linux Server release 6.1 |
RPT workbench | 1 | IBM System x3550 M4 | 2 x Intel Xeon E5-2640 2.5GHz (six-core) | 24 | 32GB | RAID 5 -- SAS Disk x 2 | 897GB | Gigabit Ethernet | Red Hat Enterprise Linux Server release 6.4 |
RPT Agents | 6 | VM image | 4 x Intel Xeon X5650 CPU (1-Core 2.67GHz) | 1 | 2GB | N/A | 30GB | Gigabit Ethernet | Red Hat Enterprise Linux Server release 6.5 |
Network switches | N/A | Cisco 2960G-24TC-L | N/A | N/A | N/A | N/A | N/A | Gigabit Ethernet | 24 Ethernet 10/100/1000 ports |
Use role | % of Total | Related Actions |
---|---|---|
QE Manager | 8 | Test plan create, Browse test plan and test case, Browse test script, Simple test plan copy, Defect search, View dashboard |
Test Lead | 19 | Edit Test Environments, Edit test plan, Create test case, Bulk edit of test cases, Full text search, Browse test script, Test Execution, Defect search |
Tester | 68 | Defect create, Defect modify, Defect search, Edit test case, Create test script, Edit test script, Test Execution, Browse test execution record |
Dashboard Viewer | 5 | View dashboard(with login and logout) |
Use Role | Percentage of the user role | Sequence of Operations |
---|---|---|
QE Manager | 1 | Test plan create:user creates test plan, then adds description, business objectives, test objectives, 2 test schedules, test estimate quality objectives and entry and exit criteria. |
26 | Browse test plans and test cases: user browses assets by: View Test Plans, then configure View Builder for name search; open test plan found, review various sections, then close. Search for test case by name, opens test case found, review various sections, then close. | |
26 | Browse test script: user search for test script by name, open it, reviews it, then closes. | |
1 | Simple test plan copy: user search test plan by name, then select one, then make a copy. | |
23 | Defect search: user searches for specific defect by number, user reviews the defect (pause), then closes. | |
20 | View Dashboard: user views dashboard | |
Test Lead | 8 | Edit Test Environment: user lists all test environments, and then selects one of the environments and modifies it. |
15 | Edit test plan: list all test plans; from query result, open a test plan for editing, add a test case to the test plan, a few other sections of the test plan are edited and then the test plan is saved. | |
4 | Create test case: user create test case by: opening the Create Test Case page, enters data for a new test case, and then saves the test case. | |
1 | Bulk edit of test cases: user searches for test cases with root name and edits all found with owner change. | |
3 | Full text search: user does a full text search of all assets in repository using root name, then opens one of found items. | |
32 | Browse test script: user search for test script by name, open it, reviews it, then closes. | |
26 | Test Execution: selects “View Test Execution Records”, by name, starts execution, enters pass/fail verdict, reviews results, sets points then saves. | |
11 | Defect search: user searches for specific defect by number, user reviews the defect (pause), then closes. | |
Tester | 8 | Defect create: user creates defect by: opening the Create Defect page, enters data for a new defect, and then saves the defect. |
5 | Defect modify: user searches for specific defect by number, modifies it then saves it. | |
14 | Defect search: user searches for specific defect by number, user reviews the defect (pause), then closes. | |
6 | Edit test case: user searches Test Case by name, the test case is then opened in the editor, then a test script is added to the test case (user clicks next a few times (server size paging feature) before selecting test script), The test case is then saved. | |
4 | Create test script: user creates test case by: selecting Create Test Script page, enters data for a new test script, and then saves the test script. | |
8 | Edit test script: user selects Test Script by name. test script then opened for editing, modified and then saved. | |
42 | Test Execution: selects “View Test Execution Records”, by name, starts execution, enters pass/fail verdict, reviews results, sets points then saves. | |
7 | Browse test execution record: user browses TERs by: name, then selects the TER and opens the most recent results. | |
Dashboard Viewer | 100 | View dashboard(with login and logout): user logs in, views dashboard, then logs out. This user provides some login/logout behavior to the workload |
*Page will be improved in 604, see Performance enhancement highlights in 604
Back to Test Cases & workload characterization Browse Test Scripts Back to Test Cases & workload characterization Test Execution Record Browsing Back to Test Cases & workload characterization Create Defect Back to Test Cases & workload characterization Create Test Plan*Page will be improved in 604, see Performance enhancement highlights in 604
Back to Test Cases & workload characterization Create Test Case Back to Test Cases & workload characterization Create Test Script Back to Test Cases & workload characterization Edit Test Case*Page will be improved in 604, see Performance enhancement highlights in 604
Back to Test Cases & workload characterization Edit Test Environment Back to Test Cases & workload characterization Edit Test Plan Back to Test Cases & workload characterization Edit Test Script Back to Test Cases & workload characterization Test Execution For 4 Steps Back to Test Cases & workload characterization Simple Test Plan Copy Back to Test Cases & workload characterization Bulk Edit of Test Cases Back to Test Cases & workload characterization Full Text Search*Page will be improved in 604, see Performance enhancement highlights in 604
Back to Test Cases & workload characterization Defect Search Back to Test Cases & workload characterization Defect Modify Back to Test Cases & workload characterizationTest scenario | Average execution counts per load test | |
---|---|---|
Execute the TER | 1,459 | |
Browse TER | 907 | |
Search Defect | 602 | |
Browse Test Script | 501 | |
Edit Test Script | 205 | |
Create Defect | 193 | |
Edit Test Plan | 160 | |
Modify Defect | 158 | |
Edit Test Case | 153 | |
Browse Test Plans And Test Cases | 96 | |
Create Test Script | 90 | |
Edit Test Environment | 71 | |
Create Test Case | 45 | |
Full Text Search and Open Test Suite | 32 | |
Bulk Edit of Test Cases | 15 | |
Create Test Plan | 2 | |
Simple Test Plan Copy | 2 |
1000users performance load against 100kTestCases vs 1mTestCases based repository | |||
CPU | Disk | ||
Memory | Network |
1000users performance load against 100kTestCases vs 1mTestCases based repository | |||
CPU | Disk | ||
Memory | Network |
same load against 1mTestCases vs 100kTestCases based repository | |
QM | |
JTS |
Product |
Version | Highlights for configurations under test |
---|---|---|
IBM HTTP Server for WebSphere Application Server | 8.5.5.9 | IBM HTTP Server functions as a reverse proxy server implemented via Web server plug-in for WebSphere Application Server.
Configuration details can be found from the CLM infocenter.
HTTP server (httpd.conf):
|
IBM WebSphere Application Server Base | 8.5.5.9 | JVM settings:
-Xgcpolicy:gencon -Xmx8g -Xms8g -Xmn2g -Xss786K -Xcompressedrefs -Xgc:preferredHeapBase=0x100000000 -verbose:gc -Xverbosegclog:gc.log -XX:MaxDirectMemorySize=1GSDK version:
|
DB2 | ESE 10.1.0.5 | |
LDAP server | ||
License server | N/A | |
RPT workbench | 8.3.0.3 | Defaults |
RPT agents | 8.3.0.3 | Defaults |
Network | Shared subnet within test lab |