Why does RTC SCM data collection job fail with '500' HTTP status code

'500' HTTP status code, as you may know means Internal Server Error but unfortunately, this error code is of very less use in getting to the particular cause/reason...

My suggestion would be to enable further logging on the ETL jobs, re-run the ETL jobs and look at the ccm-etl-driver.log for more insight.

to enable the ETL logging, get to the log4j.properties file from your server/conf/ccm directory and look for the section :

################################
#            ETL's             #
################################

here you would have to comment a few lines and uncomment a few others as instructed below :

#Comment the above 2 lines and uncomment the lines below to turn on logging
#log4j.logger.com.ibm.rational.drivers.jdbc.xml=INFO, etlDriver
#log4j.logger.com.ibm.rational.etl=INFO, etlDriver
log4j.additivity.com.ibm.rational.drivers.jdbc.xml=false
log4j.additivity.com.ibm.rational.etl=false

then the ccm-etl-driver.log is generated in the server/logs directory and would have additional debug info.

please paste the error from that log and the experts out here may be able to guide you further, if its not already obvious enough for you to resolve..

hope this helps..

Hi Bill,

Yes, a license is required for certain data collection jobs (including SCM).  RTC comes with a built-in license ("CCM Data Collector") that can be used for this.  If you set up your data collection jobs using the default consumer key and secret, this license should have been assigned automatically to the appropriate user (the Data Collection User).  However, if you're using a different user to run the jobs, just make sure that user has the data collector license.