Data Import

Key terms

Concept	Description
Import source	A record specifying what data an import set should import.
Import set	A record containing references to raw data uploaded to the staging location. Also, this record returns information about this import attempt state.
Import set table	A table that is used as a staging location for records importing from a data source before transforming them. Field in these tables are generated automatically based on imported data.
Transformation	The conversion of data from an import set table to another table according to the rules defined in a transform map.
Transform Map	A set of field map specifying the relationships between a field in an import set table and a field in a target table.
Field Map	A relationship between a field in an import set table and a field in a target table.

Import Sources

To create an import source, please complete the steps below:

Navigate to the Import -> Import Sources;
Click New, fill in the form and click Save.

Field	Description
Name	Displayed import source name.
Import set table name	Displayed import set table name.
Type	Type of external data source. Available choice options: File; JDBC; LDAP; Text.
File retrieval method	Choose the method of the file adding to the import source (if relevant Type was chosen earlier). Available choice options: Attachment; HTTPS; FTP(S): SFTP; SCP.
Format	Choose the file format (if the relevant Type was chosen earlier). Available choice options: CSV; Excel; JSON; XML.

After you are done with an Import Source, click Load All Records in the Related Links area, and an import set will be created.

Import Sets

To create an import set, please complete the steps below:

Navigate to Import - Import Sets;
Click New, fill in the form and click Save.

Import Set field description

Field	Description
Number	Import set unique number.
State	Import set loading state. This field is populated automatically and always read-only. Available options: Loading; Loaded; Processed; Cancelled.
Import Source	Select the import source to use in this import set.
Import Set Table	Select the import set table to use in this import set.
Short Description	Describe your import set in a simple manner.

Running a transformation

Navigate to the Import → Import Sets;
Open an import set you want to transform;
Click Transform.

Transform Maps

To create a transform map, please complete the steps below:

Navigate to the Import → Transform Maps;
Click New, fill in the form and click Save.

Transform Maps field description

Field	Description
Name	Displayed transform map name.
Active	Select this checkbox to make the transform map available to use.
Source table	Select the table containing the import set data.
Target table	Select the table where you want imported data to be placed.
Silent load	Select this checkbox to ignore business rules, client-side scripts, and other additives while the transformation inserts or updates data in the target table.
Ignore mandatory fields	Select this checkbox to ignore mandatory fields on the target table.
Use script	Select this checkbox to display the Script field.
Script

Field Sets

To create a field set, please complete the steps below:

Navigate to the Import → Transform Maps;
Open a transform map you want to configure;
In the sys_field_map related list, click New, fill in the fields and click Save.
Repeat the previous step for each field mapping.

Field set fields description

Field	Description
Transform map	Displays the transform map using this field set. This field is populated automatically.
Source field	Select the field of the source table to be transformed. This field is mandatory.
Target field	Select the field of the target table where the values from the source table should be stored.
Coalesce	When selected, the import set application attempts to match source values to records with values from an existing record. If a match is found, the transform map updates the record instead of creating a new record. When false, the import set application is always creating new records for each transformation.
Use source script	Select this checkbox to display the Script field.
Script	Enter a script to determine the source instead of the Source field.

When creating a field sets, create a first linkage for the sys_id fields of the source and the target tables with using Coalesce option. It will tie the tables with each other for further importing. After that, create other pairs for all the fields you want to transform.

Page tree