Contents x
      Raw Data Export File
      • 12 Minutes to read
      • Print
      • Dark
        Light
      Contents

      Raw Data Export File

      • 12 Minutes to read
      • Print
      • Dark
        Light
      Article summary

      Raw Data Export Overview

      Mapp Engage stores large amounts of data related to email marketing campaigns. The Raw Data Export feature allows you to extract unprocessed raw data for further processing and analysis. This data is not filtered or interpreted, giving a full view of all events, such as bounces, conversions, and more. Exports can be scheduled or done on demand.

      Key Features:

      • File Formats: XML or CSV

      • Maximum File Size: 10 GB (can be split into multiple files)

      • Message Export Limit: 10,000 message IDs per export (does not apply to the Export All Messages option)

      • Data from archived messages is not included

      For more information about export settings, refer to Export Configuration.

      Available Data Types

      To ensure clarity, the following fields should be included in your export configuration:

      • User ID or Email

      • Message ID

      • Event Timestamp

      • Event Type

      If exporting data for one event or message, the inclusion of Event Type or Message ID is optional.

      Data from archived messages is never included in the export.

      Event Categories and Descriptions

      Sent to MTA​

      Labeled SentToMTA in the record.type column of the export file.

      Metric/Event

      Field Name

      Description

      Content Type/Max Length

      ​Timestamp​

      sentToMTA.Timestamp

      Shows when the message was transferred to the Mapp MTA for sendout.

      ISO 8601 timestamp / 20 characters

      ​Transactional Message ID​

      sentToMTA.ExternalTransactionId

      Shows the transactional message ID (TMID). If no TMID is used, this field is empty.

      String / Unlimited

      ​Sendout Channel​

      sentToMTA.SendoutChannel

      Indicates the sendout channel (Email, Mobile, Fax).

      String / 6 characters

      ​Subject (with personalization)​

      sendout.Subject.Resolved

      Shows the personalized subject line (e.g., "Happy Birthday, Sam").

      String / Unlimited

      Skips​

      Labeled Skip in the record.type column of the export file.

      Metric/Event

      Field Name

      Description

      Content Type/Max Length

      ​Timestamp​

      skip.Timestamp

      Shows when a recipient was skipped before message sendout.

      ISO 8601 timestamp / 20 characters

      ​Category​

      skip.Category

      Indicates the reason for skipping (e.g., CHANNEL_NO_ADDRESS, SYS_BLACKLIST_ROBINSON). See ​Skip Categories in Exports​.

      String / 26 characters

      ​Transactional Message ID​

      skip.ExternalTransactionId

      Shows the transactional message ID if one was used.

      String / Unlimited

      Bounces​

      Labeled Bounce in the record.type column of the export file.

      Metric/Event

      Field Name

      Description

      Content Type/Max Length

      ​Timestamp​

      bounce.Timestamp

      Shows when a message generates a bounce (failure to deliver).

      ISO 8601 timestamp / 20 characters

      ​Category​

      bounce.Category

      Provides detailed information about the type of bounce (Transient, Blocked, Rejected).

      String / 9 characters

      ​Text​

      bounce.Text

      Shows the automated notification from the mail server about the delivery issue (if available).

      String / 1000 characters

      Feedback​

      Labeled Feedback in the record.type column of the export file.

      Metric/Event

      Field Name

      Description

      Content Type/Max Length

      ​Timestamp​

      feedback.Timestamp

      Shows when feedback (spam complaint or auto-reply) was received.

      ISO 8601 timestamp / 20 characters

      ​Category​

      feedback.Category

      Indicates feedback type (e.g., Complaint, Autoresponder).

      String / 13 characters

      Renders​

      Labeled Render in the record.type column of the export file.

      • A render takes place when a tracking pixel is downloaded from the Mapp server.

      • A number of factors can manipulate geolocation data, such as the use of VPNs. These may cause issues with the data you receive.

      Metric/Event

      Field Name

      Description

      Content Type / Max Length

      ​Timestamp​

      render.Timestamp

      Shows when the recipient opened the message (tracked via pixel download or link click).

      ISO 8601 timestamp / 20 characters

      ​Country​

      render.GeoLocation.ISOCountryCode

      Shows the recipient's country code (based on IP address).

      String / 2 characters

      ​Region​

      render.GeoLocation.RegionCode

      Shows the region code (see ISO-3166-2 for the US and Canada and FIPS 10-4 for other countries).

      String / 2 characters

      ​City​

      render.GeoLocation.City

      Shows the city based on the recipient's IP address.

      String / Unlimited

      ​Latitude​

      render.GeoLocation.Latitude

      Shows the latitude based on the recipient's IP address.

      String / Unlimited

      ​Longitude​

      render.GeoLocation.Longitude

      Shows the longitude based on the recipient's IP address.

      String / Unlimited

      ​Platform​

      render.UserAgent.Platform

      Shows the type of device used to open the message (e.g., mobile, desktop, tablet).

      String / Unlimited

      ​Operating System Name​

      render.UserAgent.OperatingSystemName

      Shows the name of the operating system to open the message (e.g., iOS, Windows).

      String / Unlimited

      ​Operating System Version​

      render.UserAgent.OperatingSystemVersion

      Shows the version of the operating system to open the message (e.g., 10, 11).

      String / Unlimited

      ​Email Client Name​

      render.UserAgent.ClientName

      Shows the name of the email client (e.g., Microsoft Outlook).

      String / Unlimited

      ​Email Client Version​

      render.UserAgent.ClientVersion

      Shows the email client version (e.g., 2016, 2019).

      String / Unlimited

      Clicks​

      Labeled Click in the record.type column of the export file.

      Prerequisite

      Link tracking is activated in the group settings of the Engage system before message sendout.

      Metric/Event

      Field Name

      Description

      Content Type/Max Length

      ​Timestamp​

      click.Timestamp

      Shows the time of the link click.

      ISO 8601 timestamp / 20 characters

      ​Link ID​

      click.Link.Id

      Shows the link ID of the clicked link.

      Number / 10 digits

      ​Link Category Name​

      click.Link.Category.Name

      Shows the category name of the clicked link. See ​Link Categories​.

      String / 20 characters

      ​Link Category ID​

      click.Link.Category.Id

      Shows the category ID of the clicked link. See ​Link Categories​.

      Number / 10 digits

      ​URL​

      click.Link.URL

      Shows the full URL of the clicked link, including any resolved personalizations.

      String / Unlimited

      ​Link Type​

      click.Link.Type

      Shows the type of link that was clicked (normal, individual/personalized, system).

      String / 10 characters

      ​Type of System Link​

      click.Link.SystemLinkType

      Shows the type of system link that was clicked.

      Possible values

      • read_message: Opens the message in the web browser. This method bypasses display problems in the email client.

      • profile_edit: Opens a form in the web browser where the contact can edit their profile data.

      • forward_message: Opens a form to forward the message with the Engage forward feature.

      • subscribe: Opens a website where the contact can subscribe to the group.

      • unsubscribe: Opens a website where the contact can unsubscribe from the group.

      String / 15 characters

      ​Country​

      click.GeoLocation.ISOCountryCode

      Shows the recipient's ISO country code (based on IP address).

      String / 2 characters

      ​Region​

      click.GeoLocation.RegionCode

      Shows the region code (see ISO-3166-2 for the US and Canada and FIPS 10-4 for other countries).

      String / 2 characters

      ​City​

      click.GeoLocation.City

      Shows the city based on the recipient's IP address.

      String / Unlimited

      ​Latitude​

      click.GeoLocation.Latitude

      Shows the latitude based on the recipient's IP address.

      String / Unlimited

      ​Longitude​

      click.GeoLocation.Longitude

      Shows the longitude based on the recipient's IP address.

      String / Unlimited

      ​Platform​

      click.UserAgent.Platform

      Shows the type of device used to open the message (e.g., mobile, desktop, tablet).

      String / Unlimited

      ​Operating System Name​

      click.UserAgent.OperatingSystemName

      Shows the name of the operating system to open the message (e.g., iOS, Windows).

      String / Unlimited

      ​Operating System Version​

      click.UserAgent.OperatingSystemVersion

      Shows the version of the operating system to open the message (e.g., 10, 11).

      String / Unlimited

      ​Email Client Name​

      click.UserAgent.ClientName

      Shows the name of the email client (e.g., Microsoft Outlook).

      String / Unlimited

      ​Email Client Version​

      click.UserAgent.ClientVersion

      Shows the email client version (e.g., 2016, 2019).

      String / Unlimited

      Unsubscribes​

      Labeled Unsubscribe in the record.type column of the export file.

      Metric/Event

      Field Name

      Description

      Content Type/Max Length

      ​Timestamp​

      unsubscribe.Timestamp

      Shows the time when a contact unsubscribed via a message link.

      ISO 8601 timestamp / 20 characters

      Forwards​

      Labeled Forward in the record.type column of the export file.

      For legal reasons, only the forward event is recorded. No information is available about the recipients of forwarded messages or their activities.

      Metric/Event

      Field Name

      Description

      Content Type/Max Length

      ​Timestamp​

      Forward.Timestamp

      Shows the time when the message was forwarded.

      ISO 8601 timestamp / 20 characters

      Conversions​

      Labeled Conversion in the record.type column of the export file.

      A conversion is attributed to a message based on the last click activity. If no clicks occur within the past 30 days, the conversion is calculated using the most recent activity recorded by Engage, such as a render. For more details, refer to ​Calculation of Conversions​.

      Metric/Event

      Field Name

      Description

      Content Type/Max Length

      ​Timestamp​

      conversion.cp.Timestamp

      Shows the time of the conversion.

      Shows the time of the conversion.

      ​ID​

      conversion.cp.Id

      Shows the ID of the conversion.

      Number / 10 digits

      ​Name​

      conversion.cp.Name

      Shows the name of the conversion.

      String / 200 characters

      ​Order ID​

      conversion.cp.OrderId

      Shows the order ID.

      The shop system or website must communicate this information to Engage.

      String / 30 characters

      ​Number​

      conversion.cp.ItemCount

      Shows the number of items that were ordered.

      The shop system or website must communicate this information to Engage.

      Number / 9 characters

      ​Amount​

      conversion.cp.Amount

      Shows the value of the total sales.

      The shop system or website must communicate this information to Engage.

      Number / 12 characters

      ​Additional Parameters​

      conversion.cp.RequestParameters

      Shows more parameters, if the shop system or website communicates this information to Engage.

      String / Unlimited

      Identifiers​

      If you want to evaluate the export on the contact level, select the ​User ID​ or ​Email Address​. If you do not select at least one of these items, include a custom attribute that identifies your contacts clearly.

      Metric/Event

      Field Name

      Description

      Content Type/Max Length

      ​User ID​

      user.Id

      Shows the unique ID for the recipient, assigned by Engage upon creation.

      Number / 10 digits

      ​Email​

      user.Email

      Shows the recipient’s email address.

      String / 129 Characters

      ​Mobile Number​

      user.MobileNumber

      Shows the mobile phone number of the recipient.

      String / 18 characters

      ​App Alias​

      user.AppAlias

      Shows the mobile app ID assigned to the recipient by the app provider.

      String / Unlimited

      ​Identifier​

      user.Identifier

      Shows an additional identifier for the contact in the Engage system (e.g., the ID of an external CRM system).

      String / Unlimited

      ​Alternate Email​

      user.AlternateEmail

      Based on the system configuration, shows the actual email address of the contact.

      String / 129 characters

      ​Alternate Mobile​

      user.AlternateMobile

      Based on the system configuration, shows the actual mobile phone number of the contact.

      String / 18 characters

      Group​

      Metric/Event

      Field Name

      Description

      Content Type/Max Length

      ​ID​

      group.Id

      the unique group ID assigned by Engage during creation.

      Number / 10 digits

      ​Name​

      group.Name

      Shows the name of the group.

      String / 150 characters

      ​Email​

      group.Email

      Shows the group’s email address.

      String / 129 characters

      ​Category ID​

      group.Category.Id

      Shows the ID of the category to which the group is assigned.

      Number / 10 digits

      ​Category Name​

      group.Category.Name

      Shows the group category name.

      String / 250 characters

      Message​

      When you select ​Export Specific Messages​, the maximum number of message IDs per data export is 10,000. This limitation does not apply to the ​Export All Messages option.

      Metric/Event

      Field Name

      Description

      Content Type/Max Length

      ​ID​

      message.Id

      Shows the unique message ID assigned by Engage during creation.

      Number / 10 digits

      ​Name​

      message.Name

      Shows the name of the message.

      String / 250 characters

      ​Category ID​

      message.Category.Id

      Shows the message category ID.

      Number / 10 digits

      ​Category Name​

      message.Category.Name

      Shows the message category name.

      String / 250 characters

      ​Subject (Not Personalized)​

      message.Subject.Unresolved

      Shows the message subject, including any personalization placeholders. Personalisations appear as unresolved placeholders in this field. For example, Happy Birthday, <%${user['FirstName']}%>!).

      String / Unlimited

      ​External Message ID​

      message.ExternalId

      Shows the external message ID of the message. The external message ID is an extra reference number that can be manually added to a message during creation.

      String / 250 characters

      ​Type​

      message.Type

      Shows the type of message (e.g., normal, test, system).

      String / 15 characters

      ​Variation ID​

      message.Variation.Id

      The variation ID of the message. Engage assigns a variation ID automatically when the variants are created. For more information, see ​Variation Analysis (tab).

      String / Unlimited

      Segment

      Metric/Event

      Field Name

      Description

      Content Type/Max Length

      ​ID​

      selection.Id

      Shows the segment ID. Engage assigns the ID automatically when the segment is created. The ID is used for internal identification and is unique in the system. Applying a segment is optional.

      Number / 10 digits

      ​Name​

      selection.Name

      Shows the segment name. The creator of the segment defines the name. The name must be unique in the system but can be edited.

      String / 100 characters

      General Information​

      This area provides basic information about the data that is selected in the ​Events​ area.

      The ​Event Timestamp​,​ Event Type​, and ​Sendout Type​ fields are useful. If you select this information individually for each event, the information appears in different columns for different events. To facilitate further processing of the data, Engage combines the information during export and adds an extra column in each row for the export file.

      Metric/Event

      Field Name

      Description

      Content Type/Max Length

      ​Event Timestamp​

      record.Timestamp

      Shows the timestamp of the event. This field is always a duplicate of the column that contains the specific timestamp. For example, the render timestamp or click timestamp.

      With the field ​Event Type​, this field facilitates the processing and analysis of data.

      ISO 8601 timestamp / 20 characters

      ​Event Type​

      record.Type

      Shows the type of event.

      The following types are possible:

      • SentToMTA

      • Skips

      • Bounces

      • Feedback

      • Renders

      • Clicks

      • Forwards

      • Conversions

      • Unsubscribes

      For more information, see ​Message Sendout Process​, ​KPIs - Group Messages​, and ​KPIs - Single Messages​.

      For more information, see ​Skip Categories in Exports​.

      String / 24 characters

      ​Sendout Type​

      sendout.Type

      Shows the type of sendout.

      The following types are possible:

      • MAJOR: The message was sent as a group message.

      • SINGLE: The message was sent as a single message.

      • WELCOME: The message was sent as a welcome message.

      • SYSTEM: The message was sent as a system message.

      String / 7 characters

      ​Timestamp​

      record.sentToMTA.Timestamp

      Shows the sent to MTA timestamp of the message to which the event belongs.

      For example, if the event is a link click in message A, this field shows the sent to MTA timestamp of message A.

      This information uniquely identifies single messages. The sent to MTA timestamp is available for all group and single messages.

      ISO 8601 timestamp / 20 characters

      ​Transactional Message ID​

      record.ExternalTransactionID

      Shows the transactional message ID (TMID) of the message to which the event belongs. If no TMID was used for sendout, this column is empty.

      A transactional message includes a unique ID for every contact. This ID lets you track every message individually and confirm that the contact receives and opens the message. You create a pattern for the TMID in the group settings. For more information, see ​Add a TMID to Messages​.

      String / Unlimited

      Addressee Role​

      sendout.AddresseeRole

      Shows the role of the addressee.

      The following values are possible:

      • NORMAL

      • CONTROL

      String / 7 characters

      Standard Attributes​

      The export shows the attribute value at the time of export, not at the time of sendout. The value of the attribute can update between the time of the sendout and the time of the export. If the value updated, the exported attribute value can differ from the attribute value at the time of the sendout.

      The availability of the attributes depends on your system configuration.

      Metric/Event

      Field Name

      Description

      Content Type/Max Length

      ​Date of Birth​

      user.DateOfBirth

      Shows the date of birth of the contact.

      Date / 28 characters

      ​First Name​

      user.FirstName

      Shows the first name of the contact.

      String / 50 characters

      ​Last Name​

      user.LastName

      Shows the last name of the contact.

      String / 50 characters

      Gender

      user.Gender

      Shows the gender of the contact:

      • unset

      • male

      • female

      • undisclosed

      Number

      ​Nickname​

      user.NickName

      Shows the preferred name of the contact.

      String / 50 characters

      ​Zip Code​

      user.ZipCode

      Shows the postal code of the contact.

      String / 10 characters

      ​Country Code​

      user.ISOCountyCode

      Shows the ISO 3166 country code that is saved in the profile of the contact. This value is not based on an IP location.

      For more information, see http://en.wikipedia.org/wiki/ISO_3166-1_alpha-2.

      String / 2 characters

      ​Language Code​

      user.ISOLanguageCode

      Shows the ISO 639 language code that is saved in the profile of the contact.

      For more information, see http://en.wikipedia.org/wiki/ISO_639.

      String / 2 characters

      ​Time Zone​

      user.TimeZone

      Shows a number that represents the time zone that is saved in the profile of the contact.

      Number / 3 digits

      ​Title​

      user.Title

      Shows a number that represents the gender of the contact. When the gender is unknown, this field is empty.

      The following values are possible:

      • 1 = male

      • 2 = female

      String / 1 character

      ​Source ID​

      user.PartnerId

      Shows an ID which identifies the source of the address (for example, an agency or a company website).

      Number / 5 digits

      Custom Attributes​

      The export shows the attribute value at the time of export, not at the time of sendout. The value of the attribute can update between the time of the sendout and the time of the export. If the value updated, the exported attribute value can differ from the attribute value at the time of the sendout.

      The availability of the attributes depends on your system configuration.

      Metric/Event

      Field Name

      Description

      Name of the attribute

      CSV-Export: user.CustomAttribute['attributename']

      Example:

      user.CustomAttribute['hobby']

      Contains a custom attribute.

      XML-Export: <field name="user.CustomAttribute['attributename']">value</field>

      Example:

      <field name="user.CustomAttribute['hobby']">soccer</field>

      Contains a custom attribute.

      Member Attributes​

      The export shows the attribute value at the time of export, not at the time of sendout. The value of the attribute can update between the time of the sendout and the time of the export. If the value updated, the exported attribute value can differ from the attribute value at the time of the sendout.

      Metric/Event

      Field Name

      Description

      Name of the attribute

      CSV-Export: user.MemberAttribute['attributename']

      Example:

      user.MemberAttribute['hobby']

      Contains a member attribute.

      XML-Export: <field name="user.MemberAttribute['attributename']">value</field>

      Example:

      <field name="user.MemberAttribute['hobby']">soccer</field>

      Contains a member attribute.

      Group Attributes​

      The export shows the attribute value at the time of export, not at the time of sendout. The value of the attribute can update between the time of the sendout and the time of the export. If the value updated, the exported attribute value can differ from the attribute value at the time of the sendout.

      Metric/Event

      Field Name

      Description

      Name of the attribute

      CSV-Export: group.CustomAttribute['attributename']

      Example:

      group.CustomAttribute['communicationID']

      Contains a group attribute.

      XML-Export: <field name="group.CustomAttribute['atributensme']">value</field>

      Example:

      <field name="group.CustomAttribute['communicationID']">12345</field>

      Contains a group attribute.

      Was this article helpful?
      Related articles
      What's Next