Jazz Forum Welcome to the Jazz Community Forum Connect and collaborate with IBM Engineering experts and users

RRC Server "Appears" Offline

We have a full distributed deployment of RRC/RTC/RQM where each instance is hosted in a different server. They are running on Linux x86_64 servers, each with 4GB memory. In the beginning we have version 3.0.1.3, and recently we upgraded all instances to version 4.0.

After upgrading to version 4.0, we noticed a strange indication. We can go successfully to any instance of the deployment:
  • https://server1:9443/jts
  • https://server2:9443/rm
  • https://server3:9443/ccm
  • https://server4:9443/qm

However from each of these instances (in the web browser), including from the RM instance itself, when you click the drop down next to the "Home" button to try to navigate to various projects, the RM instance would appear offline with a message: "This server is offline or unreachable".

Any advice on what may have went wrong and how to troubleshoot and fix this issue?

0 votes


Accepted answer

Permanent link
Can you reach RRC directly? Are there any and hints in the log files?

Another approach you could try is checking if the server/conf/friendsconfig.rdf file is correct. See: https://jazz.net/forum/questions/80867/why-does-lifecycle-project-administration-hang-after-upgrading-a-clm-301-repository-to-clm-40
Ketut Mahaindra selected this answer as the correct answer

1 vote

Comments

Yes, we can reach the server directly. I will put the suspicious log entry after this.

Here is what we see in the log that will provide some clue.

java.lang.NullPointerException at com.ibm.rdm.fronting.server.services.discovery.internal.DiscoveryServiceInternal.buildHomeMenuDocument(DiscoveryServiceInternal.java:387) ... 2012-07-09 16:28:02,932 [http-bio-9443-exec-27] ERROR ibm.rdm.fronting.server.headers.services.LinkTypes - CRRRS4120I << HTTP/1.1 500 Internal Error 2012-07-09 16:28:02,933 [http-bio-9443-exec-27] ERROR ibm.rdm.fronting.server.headers.services.LinkTypes - CRRRS4120I << [Request >>] GET https://server2:9443/rm/discovery/home-menu HTTP/1.1

Hi Ketut,

I would 1. Check if the friends and registration information is correct. Especially check the friendsconfig.rdf file for suspicious entries. 2. Create a PMR with support if you have support or a work item if not. Please feel free to subscribe me if you create a work item.

HI Ralph,

Thanks for the help and advise. We found the problem and fixed it.

We checked the friends, fronting, and registration information on RRC. We found that there is setting for RDMWebAppFoundationProjectDashboard that is not defined. We found that it's not defined after comparing it with the manual upgrade guide at https://jazz.net/help-dev/clm/index.jsp?topic=%2Fcom.ibm.jazz.install.doc%2Ftopics%2Ft_upgrading_40.html.
When we made our upgrade, we had used the automatic upgrade script, but somehow it seems the automatic upgrade script does not defined this particular value.

Hi Ketut, thanks for sharing!


One other answer

Permanent link
Hi Ketut,

In an experimental upgrade I saw an effect like this, but it disappeared. Not sure why, maybe after a reboot.
Have you checked the application diagnostics and the registered applications? Are there any indications in the logs? Could there be a certificate issue between the servers?

If you can't get an answer soon. I would consider to call support. 

0 votes

Comments

Hi,

An application reboot and a server reboot does not seem to help, the problem persists. The diagnostics also did not show anything wrong, everything looks OK from the diagnostic result. I will need to scour the logs to find out.

Your answer

Register or log in to post your answer.

Dashboards and work items are no longer publicly available, so some links may be invalid. We now provide similar information through other means. Learn more here.

Search context
Follow this question

By Email: 

Once you sign in you will be able to subscribe for any updates here.

By RSS:

Answers
Answers and Comments
Question details

Question asked: Jul 06 '12, 3:01 a.m.

Question was seen: 4,840 times

Last updated: Jul 11 '12, 7:04 a.m.

Confirmation Cancel Confirm