Set Up Data Imports (Data Feeds)

Data Feeds are a powerful tool for syncing data from external sources into your Mapp Engage system. This article explains how to set up Data Feeds in Mapp Engage step by step.

Prerequisites

To set up Data Feeds, you need to configure your FTP connections (including path and regex) in the Credentials section.

Common Use Cases

• Add contacts to Mapp Engage

• Update contact attributes in Mapp Engage

• Remove users from Mapp Engage

• Send an email (prepared message) with parameters to contacts

• Add data to your custom Related Data tables where their email is the key attribute

• Add multiple location data to your location database

• Add data to predefined Related Data: Transactions, Wish List, and Abandoned Cart

Procedure

A) Create a generic integration via Mapp Connect

Data feeds are set up like a generic integration in Mapp Connect. To see the setup steps, visit Create an Integration.

B) Set up an import job

With one job you can import a few files that fit the regex expression and are of the same data type (e.g. user, transaction, email, abandoned cart, wish list, location).

1. Go to the Data Import tab and click Add New Import.

2. The Import Configuration tab opens. Here, you can define all the details of the import job:

   1. Add job name. The name has to be unique.

   2. Runs every. Here, you can specify a detailed schedule for your job. 

      

   3. Set job status. Select Enabled or Disabled here.

      Only set the job status to Enabled when all columns for incoming data are mapped.

C) Define import steps

1. Import from FTP/SFTP.
   Select the connection from the drop-down list and click Test Connection. If the connection test fails, you will receive an alert.

   

2. (optional) Unarchive file. To remove this step from the import workflow, click the minus icon:  

   

   
   Supported formats are .zip, .tar, .gz, .tar, and .gz. If a password protects the archived file, you can enter it here. This option is only available for the .zip format.

   

3. (optional) Convert file. To remove this step from the import workflow, click the minus icon:

   

   Note that if you import multiple files, encoding and delimiter must be the same for all the files.

   

4. Upload to S3. This is when the data is uploaded to Mapp's S3 server. This step cannot be configured.

5. Create event. This step allows you to define what happens with the data upon import.

   

6. This step provides an import report from Mapp Engage.

   

7. Update mapping. Click on Edit Mapping and adjust it as needed. For more details about mapping, visit Edit Mapping.

   

8. (optional) Add monitoring users. Here, you can add the email addresses of people who should be receiving error logs from the system.

   

9. Click Save.

D) View imports & monitor import progress

You can see all the created imports on the Data Import tab.

Click the plus icon next to the Log Report label to check the import status.