• Design a custom process to
detect new and modified records.
• The process should be
designed to load only changed data.
• If data is loaded without
an incremental process, the previously loaded data will be updated again.
• Example logic in
preconfigured SIL mappings:
1. A mapping looks up
destination tables based on INTEGRATION_IDand DATASOURCE_NUM_ID.
2. If the combination exists,
ROW_WIDis returned and the record is updated.
3.
If the combination does not exist, lookup returns NULL and a record is
inserted.
For loading new fact and
dimension tables, design a custom process on the source side to detect the new
and modified records. The SDE process should be designed to load only the
changed data (new and modified). If the data is loaded without the
incrementalprocess, the data that was previouslyloaded will be erroneously
updated again.
For
example, the logic in the preconfiguredSIL mappings looks up the destination
tables based on the INTEGRATION_IDand DATASOURCE_NUM_IDand returns the
ROW_WIDif the combination exists, in which case it updates the record. If the
lookup returns NULL, it inserts the record instead. In some cases, last update
date(s) stored in target tables are also compared in addition to the columns
specified above to determine insert or update. Look at the similar mappings in
the preconfiguredfolder for more details.
No comments:
Post a Comment