It's all about the answers!

Ask a question

Running DW jobs more than once a day


anatole farci (11133) | asked Sep 14 '12, 5:46 p.m.

Hi,

we have a need to run DW ETL jobs for our CCM servers more frequently than once a day. Currently the jobs not including the STAR, take about 5 hours to run. Occasionally a user or two will complain about the charts/reports not be in sync with the recent srum changes and/or what Eclipse may show.

In many cases it happens when the project is new and they want to run a report after they have entered all their data and/or had a large migration/import from another tool.

I'm aware that we can run the ETL jobs manually and it would refresh the data. But with the many projects having resources spread across the world, as one team makes all their updates, the next shift may not see the results until the jobs execute.

From the configurations I see two settings: Snapshot Time (1-24) and Task Delay under "Remote Data Collection Job Manager Task" and it is set to 86400 sec but the tooltip note is asking to Not change this.

If we don't overlap the jobs, would it be OK to change the task Delay to 8hours so that we have three full runs a day? is there another way to accomplish the same?

Thank you

Anatole

2 answers



permanent link
sam detweiler (12.5k6195201) | answered Sep 16 '12, 7:10 a.m.
also, there is a fix for long DW etl jobs in 3.0.1.4.. Ours went from 13 hours to 1 hour. (once a day).  We have the same discussion going on, about having a shorter cycle time.

Sam

permanent link
Sandy Grewal (1.6k1223) | answered Sep 14 '12, 6:37 p.m.
JAZZ DEVELOPER
Yes, you can change that to 8 hours, if the ETL finishes in 5 hours you can have 3 runs a day. Keep in mind that the server will be doing a lot of processing so your users may complain that it is slow.

Your answer


Register or to post your answer.