Data Import

Prev Next

This job imports data from an XML or CSV file into a related data set. Single and multiple files can be imported from a zip archive.

When a data set is imported from a CSV file, the columns (structure) must already exist in the related data set. With an XML file, both the structure (i.e., the columns of the table) and the data can be added during import.

Configuration

Setting

Description

Import type

This drop-down menu defines the related data set into which the data is imported:

  • Abandoned Cart

  • Coupon List

  • Related data

  • Transactions

  • Wishlist

Import Mode

This drop-down list defines how the records are imported from the source file. The following options are available:

  • Add: This option saves new records from the import file to the data set without changing any existing records. If the data set is created with unique keys, records with keys that match existing records are not imported.

  • Replace: This option overwrites all of the existing records in the data set with the records from the import file.

  • Update and Add: This option replaces existing records in the data set with the corresponding record from the import file and adds new records to the data set. Existing records in the data set that do not correspond to any records in the import file remain unchanged. Records with new keys are added to the data set.

Error Mode

This drop-down list defines how errors in the source file are handled during data import. The following options are available:

  • Skip Value: If an error is encountered in a certain row in the import file, only the value that contains the error is not imported. If there are other values in the data set that can be imported, they are imported.

  • Skip Row: If an error is encountered in a certain row in the import file, the entire row that contains the error is not imported.

Missing File

Engage doesn’t consider a missing import file as an error. The Whiteboard will continue executing subsequent steps even if there is no file to process.

Encoding

Defines the character encoding of the source file. The character encoding ensures that the imported text is displayed correctly. The  symbol opens a pop-up window. In the window, it is possible to select from a list of all available types of character encoding.

File Type:

This drop-down list selects the file type of the import data. The following options are available:

  • XML: Indicates that the data to be imported is an XML file format. 

  • CSV: Indicates that the data to be imported is in CSV file format. 

Source File

Displays the extension of the selected file type.

Credential Store Record

This input field defines the location where the import file is stored. A connection can be established with the server over FTP (FTP, PFTP (passive FTP), AFTP (active FTP), SFTP, FTPS, SCP, and HTTP (HTTP, HTTPS).

This address has the following format: ​protocol://user:password@host.port/url-path.

Example: ​

ftp://joesample:1password@ftp.mapp.com/import​

The server account credentials can be encrypted with Transfer Security records. The placeholders for Transfer Security records specify the user name, password, or complete user account. For more information, see Credential Store Options.

Send Import Summary


Sends an XML version of the import report to the specified email addresses.

Activate using the toggle switch. 

File separator


Let’s you change the file separator in a CSV file.

A standard CSV export has either a comma or a tab as a separator. The parameter separator defines a different separator.

File compression

Lets you unzip zip and gzip files.

If the file to be imported is in a compressed format, the type of compression must be specified.

Source Backup

Saves a backup copy of the imported data in the data system or on a server

As a general rule, Engage deletes the imported file as soon as the import is complete. If the imported data cannot be reproduced from a CRM or shop system, it is a good idea to make a backup copy when the import is finished. When this parameter is used, a default number of five backup files are saved at the specified address.

Max number of backups

Defines the number of backups.

This option limits the number of backups saved. If the number of saved files exceeds the limit, Engage replaces the oldest file. No other files should be saved in the specified directory because the backup process manages all the files located there.

Credential Store Record

Defines where the backups are saved.