It's all about the answers!

Ask a question

Reports showing execution time > 5 HOURS


Kevin Ramer (4.5k8178197) | asked Dec 06 '11, 6:29 a.m.
Hi,

RTC Upgraded from v2 to 3.0.1. Observed high plateau on the CPU profile for the application server. Took a look and determined which application then looked at the active services, here's one but there are several more with times 3H or more.

by marenfu, 05:12:24:947 running time
com.ibm.team.reports.service.internal.ReportViewerService.service

com.ibm.team.reports.common.oda.generic.GenericResultSet.getObject(GenericResultSet.java:132)
com.ibm.team.reports.common.oda.generic.GenericResultSet.getString(GenericResultSet.java:103)
org.eclipse.datatools.connectivity.oda.consumer.helper.OdaResultSet.getString(OdaResultSet.java:246)
org.eclipse.birt.data.engine.odaconsumer.ResultSet.getString(ResultSet.java:267)
org.eclipse.birt.data.engine.odaconsumer.ResultSet.fetch(ResultSet.java:180)
org.eclipse.birt.data.engine.executor.cache.OdiAdapter.fetch(OdiAdapter.java:153)
org.eclipse.birt.data.engine.executor.cache.RowResultSet.next(RowResultSet.java:105)
org.eclipse.birt.data.engine.executor.cache.ExpandableRowResultSet.next(ExpandableRowResultSet.java:63)
org.eclipse.birt.data.engine.executor.cache.disk.DiskDataExport.innerExportRestData(DiskDataExport.java:131)
org.eclipse.birt.data.engine.executor.cache.disk.DiskDirectExport.exportRestDataToDisk(DiskDirectExport.java:58)
org.eclipse.birt.data.engine.executor.cache.disk.DiskCacheResultSet.processRestResultObjects(DiskCacheResultSet.java:81)
org.eclipse.birt.data.engine.executor.cache.disk.DiskCache.(DiskCache.java:111)
org.eclipse.birt.data.engine.executor.cache.SmartCacheHelper.populateData(SmartCacheHelper.java:351)
org.eclipse.birt.data.engine.executor.cache.SmartCacheHelper.initInstance(SmartCacheHelper.java:283)
org.eclipse.birt.data.engine.executor.cache.SmartCacheHelper.initOdaResult(SmartCacheHelper.java:152)
org.eclipse.birt.data.engine.executor.cache.SmartCacheHelper.getResultSetCache(SmartCacheHelper.java:77)
org.eclipse.birt.data.engine.executor.cache.SmartCache.(SmartCache.java:53)
org.eclipse.birt.data.engine.executor.transform.pass.PassUtil.populateOdiResultSet(PassUtil.java:99)
org.eclipse.birt.data.engine.executor.transform.pass.PassUtil.pass(PassUtil.java:62)
org.eclipse.birt.data.engine.executor.transform.pass.PassManager.populateResultSetCacheInResultSetPopulator(PassManager.java:340)
org.eclipse.birt.data.engine.executor.transform.pass.PassManager.doPopulation(PassManager.java:294)
org.eclipse.birt.data.engine.executor.transform.pass.PassManager.doMultiPass(PassManager.java:230)
org.eclipse.birt.data.engine.executor.transform.pass.PassManager.pass(PassManager.java:97)
org.eclipse.birt.data.engine.executor.transform.pass.PassManager.populateResultSet(PassManager.java:74)
org.eclipse.birt.data.engine.executor.transform.ResultSetPopulator.populateResultSet(ResultSetPopulator.java:196)
org.eclipse.birt.data.engine.executor.transform.CachedResultSet.(CachedResultSet.java:90)
org.eclipse.birt.data.engine.executor.DataSourceQuery.execute(DataSourceQuery.java:848)
org.eclipse.birt.data.engine.impl.PreparedOdaDSQuery$OdaDSQueryExecutor.executeOdiQuery(PreparedOdaDSQuery.java:399)
org.eclipse.birt.data.engine.impl.QueryExecutor.execute(QueryExecutor.java:1045)
org.eclipse.birt.data.engine.impl.ServiceForQueryResults.executeQuery(ServiceForQueryResults.java:232)
org.eclipse.birt.data.engine.impl.QueryResults.getResultIterator(QueryResults.java:158)
org.eclipse.birt.data.engine.impl.PreparedJointDataSourceQuery$JointDataSetQueryExecutor.executeOdiQuery(PreparedJointDataSourceQuery.java:642)
org.eclipse.birt.data.engine.impl.QueryExecutor.execute(QueryExecutor.java:1045)
org.eclipse.birt.data.engine.impl.ServiceForQueryResults.executeQuery(ServiceForQueryResults.java:232)
org.eclipse.birt.data.engine.impl.QueryResults.getResultIterator(QueryResults.java:158)
org.eclipse.birt.report.engine.data.dte.QueryResultSet.(QueryResultSet.java:98)
org.eclipse.birt.report.engine.data.dte.DteDataEngine.doExecuteQuery(DteDataEngine.java:168)
org.eclipse.birt.report.engine.data.dte.AbstractDataEngine.execute(AbstractDataEngine.java:265)
org.eclipse.birt.report.engine.executor.ExtendedGenerateExecutor.executeQueries(ExtendedGenerateExecutor.java:205)
org.eclipse.birt.report.engine.executor.ExtendedGenerateExecutor.execute(ExtendedGenerateExecutor.java:65)
org.eclipse.birt.report.engine.executor.ExtendedItemExecutor.execute(ExtendedItemExecutor.java:62)
org.eclipse.birt.report.engine.internal.executor.dup.SuppressDuplicateItemExecutor.execute(SuppressDuplicateItemExecutor.java:43)
org.eclipse.birt.report.engine.internal.executor.wrap.WrappedReportItemExecutor.execute(WrappedReportItemExecutor.java:46)
org.eclipse.birt.report.engine.internal.executor.l18n.LocalizedReportItemExecutor.execute(LocalizedReportItemExecutor.java:34)
org.eclipse.birt.report.engine.layout.html.HTMLBlockStackingLM.layoutNodes(HTMLBlockStackingLM.java:65)
org.eclipse.birt.report.engine.layout.html.HTMLPageLM.layout(HTMLPageLM.java:90)
org.eclipse.birt.report.engine.layout.html.HTMLReportLayoutEngine.layout(HTMLReportLayoutEngine.java:99)
org.eclipse.birt.report.engine.api.impl.RunAndRenderTask.doRun(RunAndRenderTask.java:170)
org.eclipse.birt.report.engine.api.impl.RunAndRenderTask.run(RunAndRenderTask.java:75)
com.ibm.team.reports.service.birt.internal.BirtReportEngineService.rawRenderReport(BirtReportEngineService.java:458)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:79)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

Statistics:

Web ServicesLongest Average Time
Seconds Name
10,722.1151 com.ibm.team.reports.common.internal.service.IReportRestService.postRenderReport()
1,548.9301 com.ibm.team.reports.service.internal.IReportViewerService.GET()
59.4640 com.ibm.team.scm.common.IScmService.acceptCombined()
34.7170 com.ibm.team.workitem.common.internal.rest.IAttachmentRestService.GET()
10.6394 com.ibm.team.filesystem.common.IFilesystemService.compareWorkspaces()




DB2 server CPU load:

Tue Dec 6 06:23:11 2011 Interval: 2

Kernel 1.2 |#
User 1.3 |#
Wait 2.7 |#
Idle 94.8 |########################### |

App Server CPU Load:

Tue Dec 6 06:25:02 2011 Interval: 2

Kernel 0.6 |#
User 67.3 |####################
Wait 0.0 |
Idle 32.0 |##########


Prior to this I've only observed this behavior on RQM server. (High app server CPU, little or none on the database server). Can anything be done to improve the run-time durations ? There are 7 or 8 active services executing.

Kevin

One answer



permanent link
Kevin Ramer (4.5k8178197) | answered Dec 07 '11, 3:14 p.m.
Lots of window shoppers, but no one's coming into the store...

Hi,

RTC Upgraded from v2 to 3.0.1. Observed high plateau on the CPU profile for the application server. Took a look and determined which application then looked at the active services, here's one but there are several more with times 3H or more.

by marenfu, 05:12:24:947 running time
com.ibm.team.reports.service.internal.ReportViewerService.service

com.ibm.team.reports.common.oda.generic.GenericResultSet.getObject(GenericResultSet.java:132)
com.ibm.team.reports.common.oda.generic.GenericResultSet.getString(GenericResultSet.java:103)
org.eclipse.datatools.connectivity.oda.consumer.helper.OdaResultSet.getString(OdaResultSet.java:246)
org.eclipse.birt.data.engine.odaconsumer.ResultSet.getString(ResultSet.java:267)
org.eclipse.birt.data.engine.odaconsumer.ResultSet.fetch(ResultSet.java:180)
org.eclipse.birt.data.engine.executor.cache.OdiAdapter.fetch(OdiAdapter.java:153)
org.eclipse.birt.data.engine.executor.cache.RowResultSet.next(RowResultSet.java:105)
org.eclipse.birt.data.engine.executor.cache.ExpandableRowResultSet.next(ExpandableRowResultSet.java:63)
org.eclipse.birt.data.engine.executor.cache.disk.DiskDataExport.innerExportRestData(DiskDataExport.java:131)
org.eclipse.birt.data.engine.executor.cache.disk.DiskDirectExport.exportRestDataToDisk(DiskDirectExport.java:58)
org.eclipse.birt.data.engine.executor.cache.disk.DiskCacheResultSet.processRestResultObjects(DiskCacheResultSet.java:81)
org.eclipse.birt.data.engine.executor.cache.disk.DiskCache.(DiskCache.java:111)
org.eclipse.birt.data.engine.executor.cache.SmartCacheHelper.populateData(SmartCacheHelper.java:351)
org.eclipse.birt.data.engine.executor.cache.SmartCacheHelper.initInstance(SmartCacheHelper.java:283)
org.eclipse.birt.data.engine.executor.cache.SmartCacheHelper.initOdaResult(SmartCacheHelper.java:152)
org.eclipse.birt.data.engine.executor.cache.SmartCacheHelper.getResultSetCache(SmartCacheHelper.java:77)
org.eclipse.birt.data.engine.executor.cache.SmartCache.(SmartCache.java:53)
org.eclipse.birt.data.engine.executor.transform.pass.PassUtil.populateOdiResultSet(PassUtil.java:99)
org.eclipse.birt.data.engine.executor.transform.pass.PassUtil.pass(PassUtil.java:62)
org.eclipse.birt.data.engine.executor.transform.pass.PassManager.populateResultSetCacheInResultSetPopulator(PassManager.java:340)
org.eclipse.birt.data.engine.executor.transform.pass.PassManager.doPopulation(PassManager.java:294)
org.eclipse.birt.data.engine.executor.transform.pass.PassManager.doMultiPass(PassManager.java:230)
org.eclipse.birt.data.engine.executor.transform.pass.PassManager.pass(PassManager.java:97)
org.eclipse.birt.data.engine.executor.transform.pass.PassManager.populateResultSet(PassManager.java:74)
org.eclipse.birt.data.engine.executor.transform.ResultSetPopulator.populateResultSet(ResultSetPopulator.java:196)
org.eclipse.birt.data.engine.executor.transform.CachedResultSet.(CachedResultSet.java:90)
org.eclipse.birt.data.engine.executor.DataSourceQuery.execute(DataSourceQuery.java:848)
org.eclipse.birt.data.engine.impl.PreparedOdaDSQuery$OdaDSQueryExecutor.executeOdiQuery(PreparedOdaDSQuery.java:399)
org.eclipse.birt.data.engine.impl.QueryExecutor.execute(QueryExecutor.java:1045)
org.eclipse.birt.data.engine.impl.ServiceForQueryResults.executeQuery(ServiceForQueryResults.java:232)
org.eclipse.birt.data.engine.impl.QueryResults.getResultIterator(QueryResults.java:158)
org.eclipse.birt.data.engine.impl.PreparedJointDataSourceQuery$JointDataSetQueryExecutor.executeOdiQuery(PreparedJointDataSourceQuery.java:642)
org.eclipse.birt.data.engine.impl.QueryExecutor.execute(QueryExecutor.java:1045)
org.eclipse.birt.data.engine.impl.ServiceForQueryResults.executeQuery(ServiceForQueryResults.java:232)
org.eclipse.birt.data.engine.impl.QueryResults.getResultIterator(QueryResults.java:158)
org.eclipse.birt.report.engine.data.dte.QueryResultSet.(QueryResultSet.java:98)
org.eclipse.birt.report.engine.data.dte.DteDataEngine.doExecuteQuery(DteDataEngine.java:168)
org.eclipse.birt.report.engine.data.dte.AbstractDataEngine.execute(AbstractDataEngine.java:265)
org.eclipse.birt.report.engine.executor.ExtendedGenerateExecutor.executeQueries(ExtendedGenerateExecutor.java:205)
org.eclipse.birt.report.engine.executor.ExtendedGenerateExecutor.execute(ExtendedGenerateExecutor.java:65)
org.eclipse.birt.report.engine.executor.ExtendedItemExecutor.execute(ExtendedItemExecutor.java:62)
org.eclipse.birt.report.engine.internal.executor.dup.SuppressDuplicateItemExecutor.execute(SuppressDuplicateItemExecutor.java:43)
org.eclipse.birt.report.engine.internal.executor.wrap.WrappedReportItemExecutor.execute(WrappedReportItemExecutor.java:46)
org.eclipse.birt.report.engine.internal.executor.l18n.LocalizedReportItemExecutor.execute(LocalizedReportItemExecutor.java:34)
org.eclipse.birt.report.engine.layout.html.HTMLBlockStackingLM.layoutNodes(HTMLBlockStackingLM.java:65)
org.eclipse.birt.report.engine.layout.html.HTMLPageLM.layout(HTMLPageLM.java:90)
org.eclipse.birt.report.engine.layout.html.HTMLReportLayoutEngine.layout(HTMLReportLayoutEngine.java:99)
org.eclipse.birt.report.engine.api.impl.RunAndRenderTask.doRun(RunAndRenderTask.java:170)
org.eclipse.birt.report.engine.api.impl.RunAndRenderTask.run(RunAndRenderTask.java:75)
com.ibm.team.reports.service.birt.internal.BirtReportEngineService.rawRenderReport(BirtReportEngineService.java:458)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:79)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

Statistics:

Web ServicesLongest Average Time
Seconds Name
10,722.1151 com.ibm.team.reports.common.internal.service.IReportRestService.postRenderReport()
1,548.9301 com.ibm.team.reports.service.internal.IReportViewerService.GET()
59.4640 com.ibm.team.scm.common.IScmService.acceptCombined()
34.7170 com.ibm.team.workitem.common.internal.rest.IAttachmentRestService.GET()
10.6394 com.ibm.team.filesystem.common.IFilesystemService.compareWorkspaces()




DB2 server CPU load:

Tue Dec 6 06:23:11 2011 Interval: 2

Kernel 1.2 |#
User 1.3 |#
Wait 2.7 |#
Idle 94.8 |########################### |

App Server CPU Load:

Tue Dec 6 06:25:02 2011 Interval: 2

Kernel 0.6 |#
User 67.3 |####################
Wait 0.0 |
Idle 32.0 |##########


Prior to this I've only observed this behavior on RQM server. (High app server CPU, little or none on the database server). Can anything be done to improve the run-time durations ? There are 7 or 8 active services executing.

Kevin

Comments
Anurag Rajput commented Sep 04 '14, 4:44 a.m.

Hi,
Even i am facing same issue. Did you get any solution?Apart from restarting JTS,CCM  services, Is there any other way to kill these active services?

Thanks


Ralph Schoon commented Sep 04 '14, 6:09 a.m.
FORUM ADMINISTRATOR / FORUM MODERATOR / JAZZ DEVELOPER

I don't think it makes sense to comment on a question that is 3 years old. Please create a new question with what you need to do and some more information e.g. version of the tool. This question should be closed as too old.


Kevin Ramer commented Sep 04 '14, 8:43 a.m.

To answer Anurag:  RTC >= 4.0.5 allows 2 things: 

  1. Setting a time-limit on report execution
  2. Terminating long running report activies
Other than that, RTC must be restarted or the reports allowed to exhaust the JVM.   I am still in a pitched conversation with the writers of the reports that originated this concern and after 3y, 2 PMR a solution for those reports is yet to be found.

Your answer


Register or to post your answer.