E
dit
A
ttach
P
rintable
r15 - 2019-10-03 - 11:58:17 -
PaulEllis
You are here:
TWiki
>
Deployment Web
>
DeploymentPlanningAndDesign
>
DatabaseGrowth
<div id="header-title" style="padding: 10px 15px; border-width:1px; border-style:solid; border-color:#FFD28C; background-image: url(<nop>https://jazz.net/wiki/pub/Deployment/WebPreferences/TLASE.jpg); background-size: cover; font-size:120%"> ---+!! Database Growth - Strategies for minimizing the growth of repository databases <img src="https://jazz.net/wiki/pub/Deployment/WebPreferences/new.png" alt="new.png" width="50" height="50" align="right"> %DKGRAY% Authors: Main.RosaNaranjo <br> Build basis: None %ENDCOLOR%</div></sticky> <!-- Page contents top of page on right hand side in box --> <sticky><div style="float:right; border-width:1px; border-style:solid; border-color:#DFDFDF; background-color:#F6F6F6; margin:0 0 15px 15px; padding: 0 15px 0 15px;"> %TOC{title="Page contents"}% </div></sticky> <sticky><div style="margin:15px;"></sticky> In planning or maintaining your CLM deployment, you may ask yourself these questions: "How do I ensure that my database size will not spiral out of control?", "Are there any strategies I can put in place to help with this in the beginning?", "Are there objects I should avoid storing in my repository?". There are some recommendations that will be captured in this page as well as some links to content that will help you understand <...> ---++ Engineering Workflow Management/Rational Team Concert In Engineering Workflow Management, formerly Rational Team Concert, there are several items that can contribute greatly to database growth if not kept in check. These items are build results, workitem attachments, and binary content in SCM as versioned content. There are several articles and presentations that have been written on this topic. * [[MovingAComponentToANewServer][Moving An Source Code Management Component To A New Server]] * [[https://trfeeney.wordpress.com/2014/12/09/help-my-rtc-database-is-getting-big/][Help! My RTC Database is getting big!]] * [[DataDeletionRTC][Deleting data in Engineering Workflow Management]] * [[https://jazz.net/library/article/1459][Reducing the size of the Rational Team Concert repository database]] * [[https://jazz.net/library/article/1006][Deleting content in RTC]] ---++ Engineering Test Management/Rational Quality Manager For QM, there are some usages that can drive repository db growth. For example, automations generating Execution Results and attachments on the test artifacts such as HTML, images, etc. attached to either scripts or results. QM does have some ability to permanently delete content. See [[https://www.ibm.com/support/knowledgecenter/SSYMRC_6.0.3/com.ibm.rational.test.qm.doc/topics/c_deleting_artifacts.html][Deletion and restoration of test artifacts]]. ---++ DOORS Next Generation The "safest" way to reduce DB size is to archive projects and use the repotools -deleteJFSResources [[https://jazz.net/help-dev/clmindex.jsp?topic=%2Fcom.ibm.jazz.install.doc%2Ftopics%2Fr_repotools_deleteprojectarearesources.html][command]] Note that this can have consequences, for example, what if you have cross project links from other projects?. You can also run that command against unarchived projects to clean up artifacts in that project which have been deleted, but that may affect baselines and history that may be important. One thing changed between 5.x and 6.x though, which is you can no longer run deleteJFSResources without the "force" parameter which deletes everything in the specified project. This is due to the way resources are unmapped versus archived, so running without "force" in 6.x seems to not find anything to delete. Otherwise, there is one other task, <b>com.ibm.team.jfs.indexing.service.internal.CompactIndexesTask</b> that can be scheduled daily/weekly to help manage the index size. See this [[https://jazz.net/downloads/jazz-foundation/releases/5.0?p=news#jfs_index_compaction][page]] for details. <br /> [[http://www-01.ibm.com/support/docview.wss?uid=swg21458233][Deleting data permanently from a DOORS Next Generation project]] *UPDATE*: Prior to DOORS Next Generation 6.0.6, this task should NOT be enabled, <b>com.ibm.team.jfs.indexing.service.internal.CleanUpUnusedIndexesVersionsTask</b> See [[https://jazz.net/jazz/resource/itemName/com.ibm.team.workitem.WorkItem/434658][CleanUpUnusedIndexesVersionsTask incorrectly cleans up versions still in use]] defect for details. <br /> If you are using 6.0.6, then the task is automatically set to run daily. See the following guidance issued on this task and the related repair command. i. [[https://www-01.ibm.com/support/docview.wss?uid=ibm10796082][OutOfMemoryException errors and performance degradation caused by the CleanUpUnusedReferences task for DOORS Next Generation]]<br /> ii. [[http://www.ibm.com/support/docview.wss?uid=ibm10796118][Upgrading DOORS Next Generation to 6.0.6 requires that repairUnreferencedVersions is run before running a reindex]] The CleanUpUnusedIndexesVersionsTask is an important part of maintaining a reduced index size and optimize DNG performance. The guidance above will allow you to utilise this daily feature. ---+++Data Warehouse [[http://www-01.ibm.com/support/docview.wss?uid=swg21986358][Data warehouse database size is huge and growing fast]] ---+++Jazz.net forum resources The forum contains many good suggestions from CLM Administrators who are maintaining CLM deployments. <b>Question:</b> I want to store binaries in RTC. Does RTC SCM support delta compression? <b>Answer:</b> Yes. RTC SCM supports delta compression of files, including binary files. In fact, one of the properties you can change in advanced properties is whether to enable or disable delta compression. If delta compression results in larger gains than other compression types it will be used to compress a given binary. <b>Question:</b> Can I prevent binaries from being checked-in to RTC? <b>Answer:</b> Yes, you can implement file limits in RTC. <b>Question:</b>Does RTC store all versioned elements in the database? <b>Answer:</b>Yes, RTC-SCM stores all versioned elements in the database. <b>Question:</b>What can I do to monitor db growth and what does RTC do on its own? <b>Answer:</b> * RTC will run item cleanups daily (sometimes frequently throughout the day) to help clean stale data. You can investigate increasing this task, or the expiration time of these items (located in Advanced Properties) * You can also run the [[https://jazz.net/wiki/bin/view/Main/L3DevTool][onlineverify]] to ensure the consistency of the data and that there is no corruption which may be preventing the item clean up from running. * ensure all your builds are being pruned and any results cleaned up *Question* How can you scrub !ChangeEvents from the repository database using IBM Rational Team Concert? *Answer* http://www-01.ibm.com/support/docview.wss?rs=3488&uid=swg21390701 [[https://jazz.net/forum/questions/92505/data-warehouse-db-sizing][https://jazz.net/forum/questions/92505/data-warehouse-db-sizing]] [[https://jazz.net/forum/questions/20098/are-there-ant-way-for-me-to-reduce-size-of-the-rtc-db][https://jazz.net/forum/questions/20098/are-there-ant-way-for-me-to-reduce-size-of-the-rtc-db]] [[https://jazz.net/forum/questions/73442/rtc-compression-for-binary-files-vs-clearcase][https://jazz.net/forum/questions/73442/rtc-compression-for-binary-files-vs-clearcase]] [[https://jazz.net/forum/questions/66014/rtc-large-history-complexity-and-archiving-questions][https://jazz.net/forum/questions/66014/rtc-large-history-complexity-and-archiving-questions]] [[https://jazz.net/forum/questions/128039/what-is-the-latest-metrics-by-namespace-report-means][https://jazz.net/forum/questions/128039/what-is-the-latest-metrics-by-namespace-report-means]] [[https://jazz.net/forum/questions/19251/rather-surprising-db2-growth][https://jazz.net/forum/questions/19251/rather-surprising-db2-growth]] ---++ References [[https://jazz.net/wiki/bin/view/Main/DatabaseMaintenanceFAQ][DatabaseMaintenanceFAQ]] [[https://jazz.net/forum/questions/61330/expected-database-growth-when-versioning-binary-data][expected database growth when versioning binary data]] [[https://jazz.net/forum/questions/65323/versioning-binary-artifacts#page=0&type=&q=database%2Bgrowth][Versioning binary artifacts]] ---+++++!! Related topics: [[DeploymentPlanningAndDesign][Deployment Planning and Design]], [[WhyIsMyDatabaseConsumingSoManyResources][Why is my database consuming so many resources?]] ---+++++!! Additional contributors: TimFeeney, StefVanDijk, BenjaminSilverman, KrzysztofKazmierczyk <sticky></div></sticky>
Attachments
Attachments
Topic attachments
I
Attachment
Action
Size
Date
Who
Comment
gif
RDNG.gif
manage
18.2 K
2016-07-07 - 17:21
RosaNaranjo
E
dit
|
A
ttach
|
P
rintable
|
V
iew topic
|
Backlinks:
We
b
,
A
l
l Webs
|
H
istory
: r15
<
r14
<
r13
<
r12
<
r11
|
M
ore topic actions
Deployment
Deployment web
Planning and design
Installing and upgrading
Migrating and evolving
Integrating
Administering
Monitoring
Troubleshooting
Community information and contribution guidelines
Create new topic
Topic list
Search
Advanced search
Notify
RSS
Atom
Changes
Statistics
Web preferences
NOTE: Please use the Sandbox web for testing
Status icon key:
To do
Under construction
New
Updated
Constant change
None - stable page
Smaller versions of status icons for inline text:
Copyright © by IBM and non-IBM contributing authors. All material on this collaboration platform is the property of the contributing authors.
Contributions are governed by our
Terms of Use.
Please read the following
disclaimer
.
Dashboards and work items are no longer publicly available, so some links may be invalid. We now provide similar information through other means. Learn more
here
.