Jazz Forum Welcome to the Jazz Community Forum Connect and collaborate with IBM Engineering experts and users

Running DW jobs more than once a day

Hi,

we have a need to run DW ETL jobs for our CCM servers more frequently than once a day. Currently the jobs not including the STAR, take about 5 hours to run. Occasionally a user or two will complain about the charts/reports not be in sync with the recent srum changes and/or what Eclipse may show.

In many cases it happens when the project is new and they want to run a report after they have entered all their data and/or had a large migration/import from another tool.

I'm aware that we can run the ETL jobs manually and it would refresh the data. But with the many projects having resources spread across the world, as one team makes all their updates, the next shift may not see the results until the jobs execute.

From the configurations I see two settings: Snapshot Time (1-24) and Task Delay under "Remote Data Collection Job Manager Task" and it is set to 86400 sec but the tooltip note is asking to Not change this.

If we don't overlap the jobs, would it be OK to change the task Delay to 8hours so that we have three full runs a day? is there another way to accomplish the same?

Thank you

Anatole

0 votes



2 answers

Permanent link
Yes, you can change that to 8 hours, if the ETL finishes in 5 hours you can have 3 runs a day. Keep in mind that the server will be doing a lot of processing so your users may complain that it is slow.

0 votes


Permanent link
also, there is a fix for long DW etl jobs in 3.0.1.4.. Ours went from 13 hours to 1 hour. (once a day).  We have the same discussion going on, about having a shorter cycle time.

Sam

0 votes

Your answer

Register or log in to post your answer.

Dashboards and work items are no longer publicly available, so some links may be invalid. We now provide similar information through other means. Learn more here.

Search context
Follow this question

By Email: 

Once you sign in you will be able to subscribe for any updates here.

By RSS:

Answers
Answers and Comments
Question details
× 6,122
× 53
× 26
× 2

Question asked: Sep 14 '12, 5:46 p.m.

Question was seen: 6,345 times

Last updated: Sep 16 '12, 7:10 a.m.

Confirmation Cancel Confirm