Data Lineage :Setup Step: Configure ODI Topology and Load Plan



The ODI Work Repository comes preconfigured with required topology and environment settings to support data lineage data extraction from the dashboards' five sources. During initial setup, you configure prebuilt data lineage sources in the ODI topology so that ODI, Configuration Manager, and Oracle Business Intelligence Enterprise (OBIEE) data can be sourced during data lineage ETL. You then configure a prebuilt data lineage home directory variable which provides access to extracted metadata files and configure an adaptor list variable.
The data lineage ETL uses the following connections to extract metadata from its sources and load it into the data warehouse:
  • BIAPPS_ODIREP: Used to extract ODI Metadata from ODI schema where SNP_*** tables are located.
  • BIAPPS_BIACOMP: Used to extract configuration metadata from the Configuration Manager schema where C_*** tables are located.
  • BIAPPS_DW: Used to load data lineage tables located in the OBAW.
  • BIAPPS_DW_FILE: Used to extract Oracle Business Intelligence Enterprise (OBIEE) metadata from files. This connection should point to the BIA_11 location (<source file home>/biapps/etl/data_files/src_files/BIA_11)
Configure Data Lineage Source and Target Connections
To configure the data lineage source and target connections:
  1. In ODI Studio, navigate to the Physical Architecture view of the Topology Navigator's tree view, and search for the prebuilt BIAPPS_BIACOMP Data Server. The BIAPPS_BIACOMP connection to the Configuration Manager database may already have been configured during BI Applications installation and configuration.
  1. In the Definition tab of the editor, verify or enter the correct connection details for the server, including the instance name and a correctly privileged ODI user and password.
  1. In the JDBC tab of the editor, verify the JDBC Driver and verify or specify a valid JDBC URL for the connection.
  1. Click Test Connection to verify that the connection details you have entered are correct.
  2. In the Search pane, double-click the physical schema to open it in the editor.
  1. Configure or confirm the Schema and Work Schema.
  1. Repeat the above steps to configure the other connections:
    • Configure the BIAPPS_ODIREP connection with ODI Repository database and schema details.
    • Configure the BIAPPS_DW connection with OBAW warehouse database and schema details. This connection may already have been configured while installing and configuring BIApps Product. 

    • Configure LoadPlan Variables
      The following Loadplan variables must be configured in the Data Lineage Extract and Load Loadplan.
      • "DL_HOME: Location of data lineage source files. Configure to <source file home>/biapps/etl/data_files/src_files/BIA_11, the same as the BIAPPS_DW_FILE configured in a previous step.
      • ADAPTOR_LIST - List of required Source Adaptor Names.
      Based on your source system, one or more values can be selected from the following list:
      'SDE_ORA11510_Adaptor','SDE_ORAR1212_Adaptor','SDE_PSFT_90_Adaptor','SDE_OP_V1_Adaptor','SDE_ORAR1211_Adaptor','SDE_PSFT_91_Adaptor','SDE_SBL_822_Adaptor','SDE_SBL_811_Adaptor','SDE_ORAR12_Adaptor', 'SDE_ORAR1213_Adaptor','SDE_JDEE1_91_Adaptor','SDE_JDEE1_90_Adaptor','SDE_Universal_Adaptor','SDE_FUSION_V1_Adaptor'
      The Adaptor Name has to be enclosed in single quotes. If you want to enter multiple adaptors, use commas as separators between multiple adaptor names.
      • ADAPTOR_LIST1 - This is the same as ADAPTOR_LIST. If you want to configure multiple adaptors and ADAPTOR_LIST value has reached limits, use ADAPTOR_LIST1. Otherwise, copy the ADAPTOR_LIST value to ADAPTOR_LIST1.
      Note:Do not leave ADAPTOR_LIST1 value empty. If the variable is empty, it will cause ETL failure
    • To configure the LoadPlan variable:
      1. In ODI Designer's tree view, navigate to the Load Plans and Scenarios view and open the Data Lineage Extract and Load load plan under Predefined Load Plans > Data Lineage.
      1. In the Steps tab, click the root step, DATA_LINEAGE.
      1. The Property Inspector window lists all variables. Enable the Overwrite option and type a value for DL_HOME, ADAPTOR_LIST and ADAPTOR_LIST1. Enclose Adaptor Names in single quotes and, if you want to enter multiple adaptors, use commas as separators between multiple adaptor names.

No comments:

Post a Comment