[DCC] Strategy for scheduling ODS jobs and Data Mart jobs
What is the best strategy for scheduling the ODS jobs and Data Mart jobs in DCC? The way I see it, there basically two approaches, but I'm not sure which one is the best.
1 - Schedule ODS jobs and Data Mart jobs to start at the same time (i.e. every 4 hours).
2 - Schedule ODS jobs and Data Mart jobs to start at different times (i.e. ODS jobs start at 2 AM and 2 PM and Data Mart jobs start at 6 AM and 6 PM). If this is the best approach, which set of jobs should run first? ODS or Data Mart?
If there is any other approach besides these two, please feel free to share it.
Thanks!!
1 - Schedule ODS jobs and Data Mart jobs to start at the same time (i.e. every 4 hours).
2 - Schedule ODS jobs and Data Mart jobs to start at different times (i.e. ODS jobs start at 2 AM and 2 PM and Data Mart jobs start at 6 AM and 6 PM). If this is the best approach, which set of jobs should run first? ODS or Data Mart?
If there is any other approach besides these two, please feel free to share it.
Thanks!!
Accepted answer
Hi Andre,
In DCC 5.0.2 and 6.0, the ODS jobs became much more efficient so they could be scheduled to run multiple times during the same day. E.g., you could schedule them to run every 4 hours. In our jazz.net production server, we schedule the ODS job to run every 30 minutes.
The datamart jobs must be scheduled to run only once a day. We schedule those to run at 3:15 AM. The reason for that, is the datamart jobs are not delta jobs and most of the metric tables can only collect one metric per day as the date dimension is a date and not a timestamp.
In DCC 5.0.2 and 6.0, the ODS jobs became much more efficient so they could be scheduled to run multiple times during the same day. E.g., you could schedule them to run every 4 hours. In our jazz.net production server, we schedule the ODS job to run every 30 minutes.
The datamart jobs must be scheduled to run only once a day. We schedule those to run at 3:15 AM. The reason for that, is the datamart jobs are not delta jobs and most of the metric tables can only collect one metric per day as the date dimension is a date and not a timestamp.