CCM export process as part of DB migration - badly defragments the disk. Any root cause known?
![]() We are preparing for our upgrade from SQL Server to DB2 and from 6061 to 702. We are using the "repotools-xxx -exportConcurrent" and "repotools-xxx -importConcurrent" commands to transfer the data from the existing SQL Server databases to the new DB2 databases.
We have also replaced the disk and tried with a brand new one. The issue still occurs. Looks like the export process, especially for a large DB, is causing the target disk to badly defragment. The server where the disk is mounted, runs on Windows2016.
Does anyone have any experience on this issue?
|
2 answers
![]()
Ralph Schoon (63.3k●3●36●46)
| answered Apr 24 '23, 4:37 a.m.
FORUM ADMINISTRATOR / FORUM MODERATOR / JAZZ DEVELOPER I would suggest to open a case with support. They can get the logs and details about the error message.
" is causing the target disk to badly defragment"
Being defragmented is a good thing - being fragmentated is slightly worse, but should also not be an issue here. See https://en.wikipedia.org/wiki/Defragmentation for what this actually means.
As far as I can tell, the fragmentation of the file system is nothing that should be of any interest or impact. Any disk that is used with random read/write operations will have a certain fragmentation. This can make read/write operations a tiny bit slower, because not all blocks of a file are in sequence on disk, but should have no other impact. You do not have to replace drives just because of fragmentation.
Comments Thank you Ralph for your answer. We did open a case with support and awaiting a feedback.
One clarification first -"is causing the target disk to badly defragment" had a typo in there. It would read " is causing the target disk to badly fragment".
Well the issue here is not that fragmentation is our main worry. But that the export command fails after completing ~90%, throwing a file system limitation error. At that point we find that the disk is badly fragmented. Last time, we had defragmented and ran the process again, it failed, and again, then it succeeded i.e. completed export successfully.
This week we are running the export again and the same issues are coming. The export fails.
It is necessary to work with support to find out what the root cause of the file system limitation error is. I am pretty sure that the fragmentation is of no concern. From my experience with disk fragmentation this should not cause anything. If you would use an SSD for the drive it would even not consider fragmentation a thing. Thank you for sharing your experience and thought. It gave me another perspective.
We know for a fact that A. CCM export is failing, and B. Disk fragmentation is occurring. And then we infer that A is caused by B. Now that cause-effect relation may be our assumption, and these two incidences might be independent of each other.
On SSDs, fragmentation is largely irrelevant. On hard disks backed up by SSD caches (such as Optane) or large memory caches, the effects of fragmentation are usually mild.
|
![]() Do you use the external storage option for the SCM data?
So you can activate/use this feature to store files bigger than 1 MB on local storage, start the database export from a database which should be lots of GB smaller.
After the db migration you can use the external storage or you can revert the changes. greetings georg. |
Your answer
Dashboards and work items are no longer publicly available, so some links may be invalid. We now provide similar information through other means. Learn more here.