Versions Compared

Old Version 32

changes.mady.by.user Igor Shakhbazyan

Saved on

compared with

New Version 33

changes.mady.by.user Igor Shakhbazyan

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Key terms

ConceptDescription
Import sourceA record specifying what data an import set should import. 
Import set

A record containing references to raw data uploaded to the staging location. Also, this record returns information about this import attempt state.

Import set tableA table that is used as a staging location for records importing from a data source before transforming them. The fields in these tables are generated automatically based on imported data.
TransformationThe conversion of data from an import set table to another table according to the rules defined in a transform map.
Transform MapA set of field map specifying the relationships between a field in an import set table and a field in a target table.
Field MapA relationship between a field in an import set table and a field in a target table.

General import procedure description

  1. Prepare raw data;
  2. Create an import source;
  3. Create an import set;
  4. Create a transform map;
  5. Create field sets;
  6. Run transformation.

Import Sources

To create an import source, please complete the steps below:

  1. Navigate to the Import -> Import Sources;
  2. Click New, fill in the form, and click Save.
FieldDescription
NameDisplayed import source name.
Import set table nameDisplayed import set table name.

Type

Type of external data source. Available choice options:

  • File;
  • JDBC;
  • LDAP;
  • Text.
File retrieval method

Choose the method of the file adding to the import source (if relevant Type was chosen earlier). Available choice options:

  • Attachment;
  • HTTPS;
  • FTP(S):
  • SFTP;
  • SCP.
Format

Choose the file format (if the relevant Type was chosen earlier). Available choice options:

  • CSV;
  • Excel;
  • JSON;
  • XML.

After you are done with an Import Source, click Load All Records in the Related Links area, and an import set will be created.

Import Sets


To create an import set, please complete the steps below:

  1. Navigate to Import - Import Sets;
  2. Click New, fill in the form, and click Save.

Import Set field description

FieldDescription
NumberImport set unique number.
State

Import set loading state. This field is populated automatically and always read-only. Available options:

  • Loading;
  • Loaded;
  • Processed;
  • Cancelled.
Import SourceSelect the import source to use in this import set.
Import Set TableSelect the import set table to use in this import set.
Short DescriptionDescribe your import set.


Running a transformation

  1. Navigate to the Import → Import Sets;
  2. Open an import set you want to transform;
  3. Click Transform.

Transform Maps

To create a transform map, please complete the steps below:

  1. Navigate to the Import → Transform Maps;
  2. Click New, fill in the form, and click Save.

Transform Maps field description

FieldDescription
NameDisplayed transform map name.
ActiveSelect this checkbox to make the transform map available to use.
Source tableSelect the table containing the import set data.
Target tableSelect the table where you want imported data to be placed.
Silent loadSelect this checkbox to ignore business rules, client-side scripts, and other additives while the transformation inserts or updates data in the target table.

Ignore mandatory fields

Select this checkbox to ignore mandatory fields on the target table.
Use scriptSelect this checkbox to display the Script field.

Field Sets

To create a field set, please complete the steps below:

  1. Navigate to the Import → Transform Maps;
  2. Open a transform map you want to configure;
  3. In the sys_field_map related list, click New, fill in the fields and click Save.
  4. Repeat the previous step for each field mapping.

Field set fields description

FieldDescription
Transform mapDisplays the transform map using this field set. This field is populated automatically.
Source fieldSelect the field of the source table to be transformed. This field is mandatory.
Target fieldSelect the field of the target table where the values from the source table should be stored.
CoalesceWhen selected, the import set application attempts to match source values to records with values from an existing record. If a match is found, the transform map updates the record instead of creating a new record. When false, the import set application is always creating new records for each transformation. 
Use source script

Select this checkbox to display the Script field.


ScriptEnter

Insert a script to determine the source instead of the Source field.

Note

Do not unselect the Use source script checkbox after inserting a script, otherwise it will not be executed.



Note

When creating a field sets, create the first linkage for the sys_id fields of the source and the target tables using the Coalesce option. It will tie the tables with each other for further importing. After that, create other pairs for all the fields you want to transform.



Table of Contents
absoluteUrltrue
classfixedPosition