(r38) DeploymentExampleIBMJazznetEnvironment < Deployment

~~EditAttach~~Printable

r38 - 2019-08-07 - 14:56:16 - Main.dishigakiYou are here: TWiki >

Deployment Web > DeploymentPlanningAndDesign > DeploymentExampleIBMJazznetEnvironment

<div id="header-title" style="padding: 10px 15px; border-width:1px; border-style:solid; border-color:#FFD28C; background-image: url(<nop>https://jazz.net/wiki/pub/Deployment/WebPreferences/TLASE.jpg); background-size: cover; font-size:120%">
---+!! Deployment example: IBM Jazz.net environment
%DKGRAY% Authors: Main.DougIshigaki <br>
Build basis: The Rational solution for Collaborative Lifecycle Management (CLM) 6.0.6.1 Sprint Milestones <br>
%ENDCOLOR%</div></sticky>


<!-- Page contents top of page on right hand side in box -->
<sticky><div style="float:right; border-width:1px; border-style:solid; border-color:#DFDFDF; background-color:#F6F6F6; margin:0 0 15px 15px; padding: 0 15px 0 15px;">
%TOC{title="Page contents"}%
</div></sticky>

<sticky><div style="margin:15px;"></sticky>

This article describes the architecture, topology, and specification of the Jazz.net environment.

The Jazz development team's production CLM system is "JazzDev." It provides Change and Configuration Management (CCM) using Rational Team Concert (RTC), Quality Management (QM) using Rational Quality Manager (RQM), Requirements Management (RM) using Rational DOORS Next Generation (RDNG), Global Configurations (GC) using Global Configuration Management (GCM), Report Builder (RB) using Jazz Report Service (JRS), Data Collection Component (DCC), Indexed data for reporting using Lifecycle Query Engine (LQE), and Linked Indexes using Link Index Provider (LDX) applications to the development teams. 

There are two staging environments for Jazz.net/Jazzdev. The first -- also known as "BluesDev" -- is for continuous daily sprint milestone CLM builds and is available for the development teams to test daily builds in a Jazzdev staging environment.  The second staging environment -- also known as "SoulDev" -- is used for staging and testing the final declared milestone CLM build before deploying to production JazzDev.

---++ Jazz Application servers - nine

Application server hardware/system - Eight separate servers

Server 1: Primary CLM Server - Jazz Team Server (JTS), Clustered Configuration and Change Management (Rational Team Concert (RTC)) primary node (Jazzdev), Requirements Management (Rational DOORS Next (RDNG)), Clustered Quality Management (Rational Quality Manager (RQM)) primary node applications
   * Virtual machine (host name: jazzclm01)
   * 64-bit x86; Intel (R) Xeon(R) CPU E5-2665 0 @ 2.40GHz; 20 cores; 48 GB RAM
   * Red Hat Enterprise Linux Server release 7.6 (Maipo)
   * WebSphere Liberty Server 19.0.0.4

Server 2: CLM Server - Data Collection Component (DCC) and Global Configuration Management (GCM) applications on separate Liberty profiles
   * Virtual machine (host name: jazzclm02)
   * 64-bit x86; Intel (R) Xeon(R) CPU E5-2665 0 @ 2.40GHz; 16 cores; 20 GB RAM
   * Red Hat Enterprise Linux Server release 7.6 (Maipo)
   * WebSphere Liberty Server 19.0.0.4

Server 3: Jazz Report Server (JRS) - Report Builder application on Liberty profile
   * Virtual machine (host name: jazzclm03)
   * 64-bit x86; Intel (R) Xeon(R) CPU E5-2665 0 @ 2.40GHz; 4 cores; 12 GB RAM
   * Red Hat Enterprise Linux Server release 7.6 (Maipo)
   * WebSphere Liberty Server 19.0.0.4

Server 4: CLM Server - JTS (Liberty profile) and three instances of CCM (RTC) applications  (Jazzdev02, Jazzdev03, and Jazzdev04) on three separate Liberty profiles
   * Virtual Machine (host name: jazzclm04) 
   * 64-bit x86; Intel (R) Xeon(R) CPU E5-2665 0 @ 2.40GHz; 8 cores; 36 GB RAM
   * Red Hat Enterprise Linux Server release 7.6 (Maipo)
   * WebSphere Liberty Server 19.0.0.4

Server 5: CLM Server - JTS and Lifecycle Query Engine (LQE) application on separate Liberty profiles
   * Physical machine (host name: jazzclm09)
   * 64-bit x86; Intel (R) Xeon(R) Gold CPU @ 2.10GHz; 64 cores; 1056 GB (1 TB) RAM
   * Red Hat Enterprise Linux Server release 7.6 (Maipo)
   * WebSphere Liberty Server 19.0.0.4

Server 6: CLM Server for Clustered CCM - Clustered CCM (RTC) secondary node application (Jazzdev02, Jazzdev03, and Jazzdev04) on three separate WebSphere Liberty profiles
   * Virtual machine (host name: jazzclm06)
   * 64-bit x86; Intel (R) Xeon(R) CPU E5-2665 0 @ 2.40GHz; 20 cores; 32 GB RAM
   * Red Hat Enterprise Linux Server release 7.6 (Maipo)
   * WebSphere Liberty Server 19.0.0.4

Server 7: CLM Server for Clustered CCM - Clustered CCM (RTC) secondary node (Jazzdev) Clustered QM (RQN) secondary node applications on Liberty profiles
   * Virtual machine (host name: jazzclm07)
   * 64-bit x86; Intel (R) Xeon(R) CPU E5-2665 0 @ 2.40GHz; 6 cores; 24 GB RAM
   * Red Hat Enterprise Linux Server release 7.6 (Maipo)
   * WebSphere Liberty Server 19.0.0.4

Server 8: CLM Server - Link Index Provider (LDX) application on Liberty profile
   * Virtual machine (host name: jazzclm08)
   * 64-bit x86; Intel (R) Xeon(R) CPU E5-2665 0 @ 2.40GHz; 6 cores; 40 GB RAM
   * Red Hat Enterprise Linux Server release 7.6 (Maipo)
   * WebSphere Liberty Server 19.0.0.4

Server 9: Jazz Authorization Server (JAS) - Single Sign-On (SSO) LDAP service on Liberty profile
   * Virtual machine (host name: jazzauth01)
   * 64-bit x86; Intel (R) Xeon(R) CPU E5-2665 0 @ 2.40GHz; 2 cores; 4 GB RAM
   * Red Hat Enterprise Linux Server release 7.6 (Maipo)
   * WebSphere Liberty Server 19.0.0.4


WebSphere Liberty server JVM settings:

   * Verbose Garbage Collection: enabled on all servers</br>

   * Primary CLM Server (jazzclm01):
      * Initial heap (Xms): JTS: 8GB, CCM: 12GB, QM: 8GB, RM: 6GB
      * Max heap (Xmx): JTS: 8GB, CCM: 12GB, QM: 8GB, RM: 6GB
      * Generic JVM arguments
         * -Xgcpolicy:gencon 
         * -Xcompressedrefs 
         * -Xgc:preferredHeapBase=0x100000000 
         * - XX:MaxDirectMemorySize=2G   _Increases native memory (java/nio) to avoid explicit gc()_

   * DCC server (jazzclm02):
      * Initial heap (Xms): DCC: 8GB, GC: 4GB
      * Max heap (Xmx): DCC: 8GB, GC: 4GB
      * Generic JVM arguments
         * -Xgcpolicy:gencon
         * -Xcompressedrefs
         * -Xgc:preferredHeapBase=0x100000000
         * - XX:MaxDirectMemorySize=1G

   * JRS server (jazzclm03):
      * Initial heap (Xms): 8GB
      * Max heap (Xmx): 8GB
      * Generic JVM arguments
         * -Xgcpolicy:gencon
         * -Xcompressedrefs
         * -Xgc:preferredHeapBase=0x100000000
         * - XX:MaxDirectMemorySize=1G

   * CLM server (jazzclm04):
      * Initial heap (Xms): 6GB for each profile (JTS and clustered CCM nodes: jazzdev02, jazzdev03, jazzdev04)
      * Max heap (Xmx): 6GB for each profile (JTS and clustered CCM nodes: jazzdev02, jazzdev03, jazzdev04)
      * Generic JVM arguments
         * -Xgcpolicy:gencon
         * -Xcompressedrefs
         * -Xgc:preferredHeapBase=0x100000000
         * - XX:MaxDirectMemorySize=1G

   * LQE server (jazzclm09):
      * Initial heap (Xms): 48GB for LQE profile (-Xms48g)
      * Max heap (Xmx): 48GB for LQE profile  (-Xmx48g)
      * Nursery heap=12GB for LQE profile  (-Xmn12g)
      * Generic JVM arguments
         * -Xgcpolicy:gencon
         * -Xcompressedrefs  </br>
         * -Xgc:preferredHeapBase=0x100000000  </br>
         * - XX:MaxDirectMemorySize=1G </br>

   * CLM server (jazzclm06):
      * Initial heap (Xms): 6GB for each profile (clustered CCM nodes: jazzdev02, jazzdev03, jazzdev04)
      * Max heap (Xmx): 6GB for each profile (clustered CCM nodes: jazzdev02, jazzdev03, jazzdev04)
      * Generic JVM arguments
         * -Xgcpolicy:gencon
         * -Xcompressedrefs
         * -Xgc:preferredHeapBase=0x100000000
         * - XX:MaxDirectMemorySize=1G

   * CLM server (jazzclm07):
      * Initial heap (Xms): CCM (Clustered Node 2): 12GB
      * Max heap (Xmx): CCM (Clustered Node 2): 12GB
      * Generic JVM arguments
         * -Xgcpolicy:gencon
         * -Xcompressedrefs  </br>
         * -Xgc:preferredHeapBase=0x100000000  </br>
         * - XX:MaxDirectMemorySize=1G </br>

   * LDX server (jazzclm08):
      * Initial heap (Xms): LDX: 12GB
      * Max heap (Xmx): CCM (Clustered Node 2): 12GB
      * Generic JVM arguments
         * -Xgcpolicy:gencon
         * -Xcompressedrefs  </br>
         * -Xgc:preferredHeapBase=0x100000000  </br>
         * - XX:MaxDirectMemorySize=1G </br>

   * JAS server (jazzauth01):
      * Initial heap (Xms): 1536 MB
      * Max heap (Xmx): 1536 MB
      * Generic JVM arguments
         * Defaults (none set)

---++ Database servers - two

DB server hardware/system:

   * Two virtual machines (jazzdb01, jazzdb02)
   * Red Hat Enterprise Linux Server 7.6 (Maipo)
   * x86_64 bit OS; Intel (R) Xeon(R) CPU E5-2665 0 @ 2.40GHz, 16 cores each; 64 GB RAM each
   * 4.0 TB local RAID 5 array for data, 100 GB for "/" partition, mirrored

DB2 (jazzdb01, jazzdb02):

   * DB2 11.1.4.4 with Fix Pack 4
   * "Automatic" settings, except automatic table space growth is not allowed. You can monitor disk usage and not get caught short of disk space
   * Monitor regularly for sufficient disk space and table space
   * Daily online backups using IBM Spectrum Protect (formerly Tivoli Storage Manager)

---++ Load balancers - two

Load balancer hardware/system:

   * Two virtual machines (jazzdispatch1, jazzdispatch2)
   * Red Hat Enterprise Linux 7.6 (Maipo)
   * x86_64 bit OS; Intel (R) Xeon(R) CPU E5-2683 v3 @ 2.00GHz; 2 cores each; 8 GB RAM each 

IBM HTTPS Server (IHS) load balancer:

   * WebSphere Edge Load Balancer
   * Setup as provided in the CLM documentation

---++ Reverse proxy - two

Reverse proxy hardware/system:

   * Two virtual machines (jazzproxy1, jazzproxy2)
   * Red Hat Enterprise Linux 7.6 (Maipo)
   * x86_64 bit OS; Intel (R) Xeon(R) CPU E5-2683 v3 @ 2.00GHz (one VM), Intel (R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz (one VM); 4 cores each VM; 8 GB RAM each VM
   * Active/Active configuration

Reverse proxy:
   * HAProxy(Red Hat Enterprise Linux)

---++ MQTT Broker - one

MQTT server hardware/system for Clustered CCM:

   * One virtual machines (jazzmqtt01)
   * Red Hat Enterprise Linux 7.6 (Maipo)
   * x86_64 bit OS; Intel (R) Xeon(R) CPU E5-2683 v3 @ 2.00GHz (one VM), Intel (R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz (one VM); 2 cores; 12 GB RAM
   * Active configuration

MQTT message broker:
   * IBM IoT Message Sight Server V2.0.0.1

---++ Apache Web Servers - four

Apache server hardware/system:
   * Four virtual machines (jazzweb1, jazzweb2, jazzweb3, jazzweb4)
   * Red Hat Enterprise Linux 7.6 (Maipo)
   * x86_64 bit OS; Intel (R) Xeon(R) CPU E5-2683 v3 @ 2.00GHz (on two VMs) and  Intel (R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz (on two VMs); 8 cores each VM; 32 GB RAM each VM


Apache servers:

   * Apache 2.4.6 (Red Hat Enterprise Linux)
   * Apache Tomcat/7.0.69
      * JVM Settings
         * Initial heap=2048 MB
         * Max heap=8192 MB
   * mod_proxy module to handle reverseProxy configuration
   * Apache is shared with other applications.

---++ Firewall and VPN host servers (two):

   * Two virtual machines (jazzgate01, jazzgate02)
   * SoftLayer Vyatta 5600
   * x86_64 bit OS; Intel(R) Xeon(R) CPU E3-1270 V2 @ 3.50GHz (two VM), 8 cores each VM; 8 GB RAM each VM
   * Active/Active configuration
   * Provides virtual firewall across all zones
   * Provides Virtual Private Network (VPN) for tunneling between SoftLayer and RTP

---++ Architecture Diagrams (February 2019)
<br />

   * 2019 FEB Jazz.net JazzDev environment: <br />
     <img src="%ATTACHURLPATH%/Jazz_Infrastructure_Self_Host_Environment-2019.JPG" alt="Jazz_Infrastructure_Self_Host_Environment-2019.JPG" width="1004" height="570" />

   * 2019 FEB Staging "BluesDev" environment for continuous daily CLM builds: <br />
     <img src="%ATTACHURLPATH%/Jazz_Infrastructure_Bluesdev_Environment-2019.JPG" alt="Jazz_Infrastructure_Bluesdev_Environment-2019.JPG" width="1057" height="600" />

   * 2019 FEB Staging "SoulDev" environment for Jazzdev milestone upgrades: <br />
     <img src="%ATTACHURLPATH%/Jazz_Infrastructure_Souldev_Environment-2019.JPG" alt="Jazz_Infrastructure_Souldev_Environment-2019.JPG" width="1057" height="599" />

   * 2019 FEB Jazz.net environment LDAP Authentication: <br />
     <img src="%ATTACHURLPATH%/Jazz_Infrastructure_Self_Host_Environment-LDAP-2019.JPG" alt="Jazz_Infrastructure_Self_Host_Environment-LDAP-2019.JPG" width="1057" height="599" />


---+++++!! Related topics: None

---+++++!! External links:          

   * None

---+++++!! Additional contributors: None

<sticky></div></sticky>

Attachments

Topic attachments
I	Attachment	Action	Size	Date	Who	Comment
jpg	Jazz_Infrastructure_Bluesdev_Environment-2017.JPG	manage	147.2 K	2017-02-22 - 18:47	UnknownUser	2017 Staging environment for continuous daily CLM builds
jpg	Jazz_Infrastructure_Bluesdev_Environment-2018.JPG	manage	116.6 K	2018-12-11 - 00:30	UnknownUser	2018 DEC Staging environment for Jazzdev milestone upgrades
jpg	Jazz_Infrastructure_Bluesdev_Environment-2019.JPG	manage	113.6 K	2019-02-04 - 23:06	UnknownUser	2019 FEB Staging BluesDev environment for continuous daily CLM builds
jpg	Jazz_Infrastructure_Self_Host_Environment-2017.JPG	manage	169.8 K	2017-02-22 - 18:51	UnknownUser	2017 Jazz.net Environment System Topology Architecture
jpg	Jazz_Infrastructure_Self_Host_Environment-2018.JPG	manage	139.6 K	2018-12-11 - 00:30	UnknownUser	2018 DEC Jazz.net Environment System Topology Architecture
jpg	Jazz_Infrastructure_Self_Host_Environment-2019.JPG	manage	136.0 K	2019-02-04 - 23:13	UnknownUser	2019 FEB Jazz.net JazzDev Environment System Topology Architecture
jpg	Jazz_Infrastructure_Self_Host_Environment-LDAP-2018.JPG	manage	114.9 K	2018-12-11 - 00:32	UnknownUser	2018 DEC Jazz.net Environment System Topology LDAP Architecture
jpg	Jazz_Infrastructure_Self_Host_Environment-LDAP-2019.JPG	manage	110.6 K	2019-02-04 - 22:54	UnknownUser	2019 FEBJazz.net Environment System Topology LDAP Architecture
jpg	Jazz_Infrastructure_Souldev_Environment-20170127.JPG	manage	91.1 K	2017-01-27 - 19:12	UnknownUser	2017 Staging environment for Jazzdev milestone upgrades
jpg	Jazz_Infrastructure_Souldev_Environment-2018.JPG	manage	95.3 K	2018-12-11 - 00:33	UnknownUser	2018 DEC Staging environment for Jazzdev milestone upgrades
jpg	Jazz_Infrastructure_Souldev_Environment-2019.JPG	manage	99.3 K	2019-02-04 - 22:57	UnknownUser	2019 FEB Staging SoulDev environment for Jazzdev milestone upgrades

Deployment

Community information and contribution guidelines

Status icon key:

To do
Under construction
New
Updated
Constant change
None - stable page

Smaller versions of status icons for inline text:

Copyright © by IBM and non-IBM contributing authors. All material on this collaboration platform is the property of the contributing authors.
Contributions are governed by our Terms of Use. Please read the following disclaimer.
Dashboards and work items are no longer publicly available, so some links may be invalid. We now provide similar information through other means. Learn more here.