Jazz Forum Welcome to the Jazz Community Forum Connect and collaborate with IBM Engineering experts and users

ETL Data update problem

Questions
Tags
Users
Badges
VK L
(817●7●157●159) retagged
May 10 '13, 9:40 a.m.
Noticed that data is not getting updated into the DW past 2 days. Till then it was running fine.

Jobs are completing and no errors - but the changes made in RTC are not reflecting in the Warehouse tables. Even when queried from DW with modified_since parameter, it is giving 0 rows. What could be the issue?

How to check whether any changes have gone in?

Thanks.

0 votes

3 answers
8,932 views
0 votes

3 answers

Permanent link
Indradri Basu
(1.8k●1●5●14) May 10 '13, 10:40 a.m.
Hi Valli, you should check the <app>_etl.log file. If data is coming over to the DW database then you should find some similar entries in the log as shown below

ETL: Records Selected: 7
ETL: Records Inserted: 7
ETL: Records Updated: 0
ETL: Records Ignored: 0

0 votes

Permanent link
VK L
(817●7●157●159) May 10 '13, 10:44 a.m.
 Hi Indrani,
                    The Logs are showing 0 inserts, 0 updates. But the problem is that there is data in the source, modified in the past-2 days for example, but somehow the ETL is not picking up these. It was working well earlier though.

Scenario:
The values for some attributes are changed in RTC Workitem. Insight DW is still showing data as of May 7th. the last 2 days Changes are not getting updated through the ETL 

0 votes

Comments
Indradri Basu
May 10 '13, 10:58 a.m.

The next thing I would probably check is if anything has changed in the Datawarehouse connection page. I would also check the systemout.log and etl logs for any errors. See if the password of the etl_user has expired or not. Try running the Full Data collection jobs manually and check the logs again and see if you can spot an error or a  problem

VK L
May 10 '13, 11:08 a.m.

  Are you mentioning about datawarehouse connection page on RTC-Admin part?

Indradri Basu
May 10 '13, 1:13 p.m.

Yes, and you can also see if your teamserver.properties files  has been modified recently.

VK L
May 11 '13, 4:43 a.m.

 Full Load is also not making any updates. There are a few connection errors on the database log - but not sure if its related to this. I am able to connect to the database through the DB2 Admin center.

There are no related errors in systemout.log, cognos logs. no changes to teamserver file, dw connections.

Permanent link
VK L
(817●7●157●159) May 10 '13, 10:48 a.m.
 ri_jdbc.log doesnt give any errors as such - but, when i try in data manager -> querying on data source, its retrieving o rows suddenly for past dates as well. Not sure what has changed. Any ideas on what could be the cause and how to go about it?

0 votes

Comments
Indradri Basu
May 10 '13, 11:00 a.m.

If you can't spot any problem based on my comment above, I would suggest to check your database logs for any errors.

VK L
May 13 '13, 12:55 a.m.

Is it required that clmdwadmin id should be present in JazzAdmin group for the ETL Jobs to be able to retrieve data from RTC? Recently i had removed the mapping from JazzAdmin group on the assumption that only JazzDWAdmin privilege is required. As per my checks, this looks to have caused the issue.

Mapped it to JazzAdmin group again and its working fine now.

Indradri Basu
May 13 '13, 2:36 a.m.

You got it right. the etl_user must be in JazzAdmin group and I suppose subscription in JazzDWAdmin is no longer mandatory. Check this infocenter link
However this should have reflected in the logs but glad to know things are on track now.

VK L
May 13 '13, 2:40 a.m.

 Thanks. Is this the case in 3.0.1.1 as well? I was of the idea that JazzDWAdmin is the group related to Data warehouse [Jobs,etc].

Your answer

Register or log in to post your answer.

Dashboards and work items are no longer publicly available, so some links may be invalid. We now provide similar information through other means. Learn more here.

Ask a question
Guidelines
FAQ
Search context
Follow this question

By Email: 

Once you sign in you will be able to subscribe for any updates here.

By RSS:

Answers
Answers and Comments
Question details

Question asked: May 10 '13, 9:22 a.m.

Question was seen: 8,932 times

Last updated: May 13 '13, 2:40 a.m.

Confirmation Cancel Confirm