(r25) JTSMonFAQ < Deployment

Engineering Lifecycle Management Wiki - Deployment

Community information and contribution guidelines

~~EditAttach~~Printable

TWiki > Deployment Web > DeploymentMonitoring > JTSMonFAQ

Revision 25 - 2015-06-15 - 14:18:54 - SkyeBischoff

<div id="header-title" style="padding: 10px 15px; border-width:1px; border-style:solid; border-color:#FFD28C; background-image: url(<nop>https://jazz.net/wiki/pub/Deployment/WebPreferences/TLASE.jpg); background-size: cover; font-size:120%">
---+!! <img src="https://jazz.net/wiki/pub/Deployment/WebPreferences/updated.png" alt="updated.png" width="50" height="50" align="right"> !JTSMon FAQs
%DKGRAY% Authors: Main.SkyeBischoff<br>
Build basis: CLM
%ENDCOLOR%</div></sticky>

<!-- Page contents top of page on right hand side in box -->
<sticky><div style="float:right; border-width:1px; border-style:solid; border-color:#DFDFDF; background-color:#F6F6F6; margin:0 0 15px 15px; padding: 0 15px 0 15px;">
%TOC{title="Page contents"}%
</div></sticky>

<sticky><div style="margin:15px;"></sticky>

---++ Q: What is !JTSMon?

!JTSMon is an internal, unsupported tool that will help you make more sense out of Jazz server traffic patterns based on web service reports. It takes a series of snapshots then turns them into time trend spreadsheets so you can sort, filter, recombine, and graph the data to actually see what sort of traffic is hitting your server day by day and week by week. For more details see [[JTSMonTool][JTSMon - Seeing what your server is up to]].

---++ Q: Can I use !JTSMon in production systems?

No.   JTSMon is provided as-is, without support.    It uses private interfaces to CLM servers which may change between releases.    It may stop working in future releases without notice.    JTSMon should not be used to maintain production systems.

---++ Q: Where do I get !JTSMon?

!JTSMon can be downloaded at the [[JTSMonFAQ#Download_JTSMon][bottom of this page]]. The package includes all you need to get started including documentation and release notes.
The latest is JTSMon 6.0.

Older versions are available at [[JTSMonOlderDistributions]].

---++ Q: Where do I ask questions about !JTSMon?

Use the questions and comments box at the bottom of this page or the Jazz.net forums with the tag "jtsmon" to ask questions about how to use !JTSMon and interpret the data it provides.

---++ Q: Is there a quick, easy way to get up and running?

There is a one-page !JTSMon Quick Start guide inside the !JTSMon package. It will summarize all you need to know to install, configure, run, and analyze your results.

A 60-second practical hands on [[%ATTACHURL%/JazzMon1.4.0_in_60sec_Demo.zip][demonstration video]] of the basics of configuring and running !JTSMon is attached below. (This is a demo for an older version, but it still presents the basics and is valid.)

A 10-minute [[%ATTACHURL%//JazzMon1.4.0_10min_Demo.mp4][demonstration video]] attached below provides a brief walk-through from the !QuickStart to Visualization. (This is a demo for an older version, but it still presents the basics and is valid.)

---++ Q: What is preferred for sample intervals and run durations?

   1 *PREFERRED:* Experiment with !JTSMon for a few hours but it's preferable that you run it for a week (SEQ_RUN_LENGTH_ARG=7d) at hourly intervals (default PARM_COUNTER_RATE_MINS value). It works best to record a full week Monday - Monday because that will be the most obvious to everyone - Friday through Monday will tell you very little. A week can give you some idea what is happening day to day and over nights and weekends and will help you identify what seems like an "average" day to use for a baseline. From a separate command line window you can run the gather and analyze commands at any time so you can see initial data after a few hours even while running. 
   1 *SHORT TERM:* If you are going to run it for just a day or two you might want to set PARM_COUNTER_RATE_MINS for 15-minute intervals but analyze it initially at 60 minutes (default for ANALYSIS_SAMPLE_TIME). This lets you drill in for more detail if needed. But 15 minutes will collect a lot of data over a longer period running into weeks or months, so if it's more than a few days use 60-minute data collection intervals. 
   1 *LONGER TERM:* Longer-term monitoring of a month makes sense to keep gathering data and seeing longer-term patterns. It helps to track when there are user complaints to identify "sore points" for closer investigation. If hourly data is too much over a month, you can change the analyzer to output results in 4-hour or 24-hour periods if needed. It's probably best to do one month segments at a time; too much more and the data gets to be pretty large and time-consuming to analyze.
   1 *DON'T DO SNIPPETS:* Don't run it in segments and then try to make sense of disjointed pieces if you can avoid it. It's easier to delete excess files than to join segments with gaps between them. Baselines can be taken from any isolated stretch of time (i.e. last Tuesday 9-5). 
   1 *ANALYZE ANY TIME:* The commands are separated. So, while you have an ongoing monitoring session running for days in one command shell, you can run the gather/analyze commands at any time from another command shell to look at results at any time you want. There will be a warning if you try to copy data over an existing "gather" directory: you can either agree to overwrite it or just stop and adjust the RUN_ID to write to another directory. 
   1 *LET IT KEEP RUNNING:* As long as the server is up when you start the run, it will continue even if the server is down or restarted. It will mark time by copying the last good period as placeholders and then flag those time columns as suspect ("?") in the analysis output so the number spike when the server comes back up makes sense. It is best to get long continuous stretches so you can see the ebb and flow of users and types of activities and keep the data on a regular hourly clock than to deal with gaps.

---++ Q: Where can I find workload samples from IBM internal deployments like Jazz.net?

After extracting the !JTSMon package, look for the directory named Data. This directory has sample workloads collected from Jazz.net. It looks like the following example:

   * Data/JazzDev_3.0.1_111107__200users_24hrs
      * jazz.ccm__200users_24hrs.txt
      * jazz.jazz__200users_24hrs.txt
      * jazz.jts__200users_24hrs.txt
      * jazz.qm__1users_24hrs.txt

   * Data/JazzDev_3.0.1_111107__200users_8hrs
      * jazz.ccm__200users_8hrs.txt
      * jazz.jazz__200users_8hrs.txt
      * jazz.jts__200users_8hrs.txt
      * jazz.qm__200users_8hrs.txt

The 200 users in the file names represent a rough estimate of the number of concurrent users that are active on average.

---++ Q: Is there any quick way to convert the !JTSMon CSV file output into charts and tables? 

The !JTSMon Visualizer Excel macro automatically converts nearly all the CSV output into Microsoft Excel workbooks that contain data, charts. and a table of contents for easy navigation. 

---++ Q: What do all those web service components mean?

This is a short summary of what the different system components (com.ibm.team.<component Name>.<service>) do:
   * *apt* - Agile Planning and Tracking
   * *build* - Support for Build Engines to access and process build requests
   * *calm* - Collaborative Application Lifecycle Management (C/ALM) specific operations
   * *com.ibm.debug.team* - internal debugging
   * *com.ibm.teami* - I-System specific operations
   * *com.ibm.teamz* - Z-System specific operations
   * *dashboard* - Support for web browser dashboard presentations showing mix of reports and queries
   * *datawarehouse* - Services unique to managing meta-data about the repository
   * *enterprise* - Enterprise extensions
   * *filesystem* - Manage versioned file artifacts between local workspaces and repository
   * *fulltext* - Full text search capabilities
   * *interop* - SCM integrations between Jazz and external systems, including work item synchronization with !ClearQuest
   * *jfs* – Jazz Foundation Services - Resource based storage and query services providing access to the JFS repository and user information, also used by JFS-based fronting applications
   * *links* - Access and manage links between different types of artifacts such as work items and change sets
   * *process* - Process definition controlling activity flow, roles, and permissions with customization
   * *reports* - Reports provide data about activities and artifacts over time in the repository
   * *repository* - User, license, and server administration services along with modeled storage services for persistent and query
   * *rtc* – Rational Team Concert (one lone operation)
   * *scm* – Source Code Management - basic change set management operations – check ins, accept/deliver, suspend/discard/resume, workspace management
   * *social* - Support for Open Social integration
   * *vs* - Visual Studio client platform support
   * *workitem* – Work item operations - define/create/edit/delete/query work items
(Extracted from the !JTSMon.pdf in the !JTSMon distribution.)

---++ Q: How do I find out what's in my repository?

!JTSMon offers a repository report tool. Repository reports use an internal API to collect data about the contents of the Jazz repository itself, providing insight into the distribution of different types of artifacts in the repository, based either on the component level (=repoReport.n.txt=) or, in the more detailed report, by individual types of artifacts in the component namespace (=repoReport.n.itemized.txt=). Data is returned in columnar format. The columns of greatest interest are the number of items (unique artifacts) and states (changes to those artifacts). Other columns show what percentage a namespace is compared to the overall total or additional information about storage size.

For more information see the !JTSMon.pdf in the !JTSMon distribution.

-----------

---+++++!! Related topics:

   * [[JTSMonTool][JTSMon]]
   * [[JTSMonOlderDistributions][Older versions of JTSMon]]
   * [[JazzMetronomeToolKeepsUsHonest][The Jazz metronome tool keeps us honest]]

---+++++!! Additional contributors: Main.StevenBeard, Main.GrantCovell

---+++++!! Questions and comments:

%COMMENT{type="below" target="JTSMonFAQComments" button="Submit"}%

%INCLUDE{"JTSMonFAQComments"}%

---++ Download JTSMon
*NOTE*: The latest version of JTSMon is the 6.0 release which is required for working with CLM 6.0 because of changes in the data output. This will work with CLM 4.0.2 and CLM 5.x systems.    However, the behavior of the floating license counters has changed as of the 4.0.6 release;   the counters are now reset hourly as part of the License ETL job.

<sticky></div></sticky>

Attachments

Topic attachments
I	Attachment	Action	Size	Date	Who	Comment
zip	JTSMon_4.0_RTC3.0GA_withoutJTSMonPDF.zip	manage	24730.4 K	2013-10-28 - 19:00	UnknownUser	JTSMon package (without doc) for RTC 3.x and 4.x users based on RTC 3.0GA
zip	JTSMon_5.0.2_RTC4.0.2GA.zip	manage	3036.5 K	2014-12-05 - 21:13	UnknownUser	JTSMon 5.0.2 distribution, file is actually 31,264 KB
zip	JTSMon_6.0_RTC5.0GA.zip	manage	2994.0 K	2015-06-10 - 15:11	SkyeBischoff	JTSMon 6.0 distribution
mp4	JazzMon1.4.0_10min_Demo.mp4	manage	10773.2 K	2013-05-05 - 10:43	UnknownUser	10 minute demonstration video of JazzMon 1.4.0 from QuickStart to Visualization
zip	JazzMon1.4.0_in_60sec_Demo.zip	manage	3110.6 K	2013-05-05 - 10:43	UnknownUser	60 sec covering the practical basics of configuring and running JazzMon

Deployment.JTSMonFAQ moved from Deployment.JazzMonFAQ on 2013-10-06 - 15:14 by Main.gcovell -

Copyright © by IBM and non-IBM contributing authors. All material on this collaboration platform is the property of the contributing authors.
Contributions are governed by our Terms of Use. Please read the following disclaimer.
Dashboards and work items are no longer publicly available, so some links may be invalid. We now provide similar information through other means. Learn more here.