Documentation

Contact Us

If you still have questions or prefer to get help directly from an agent, please submit a request.
We’ll get back to you as soon as possible.

Please fill out the contact form below and we will reply as soon as possible.

  • Talk To sales
  • Start Trial

Advanced Configurations

Daton supports a variety of loading modes across its connectors, and this documentation provides a brief overview of them.

Contact Us

If you still have questions or prefer to get help directly from an agent, please submit a request.
We’ll get back to you as soon as possible.

Please fill out the contact form below and we will reply as soon as possible.

  • Saras Pulse

    • Saras Daton

      • Saras IQ

        Need help with something?

        Talk to data expert

        Advanced Configurations

        Daton supports a variety of loading modes across its connectors, and this documentation provides a brief overview of them.

        Loading Mode Overview

        The loading mode of an integration determines how data is structured, staged, and sized in the data warehouse. There are two primary loading modes, and choosing the appropriate one depends on your specific data needs.

        1. Append Mode

        In Append mode, data is added (appended) to the existing dataset in the warehouse without needing a primary key. This mode preserves the historical data and increases the size of the table over time.
        • Key Benefit: It helps in tracking the history of changes. For example, different stages of an order can be tracked by appending each stage into the warehouse.
        • Drawback: Over time, the table size grows significantly.

        2. Upsert Mode

        In Upsert mode, the data is inserted or updated based on a set of primary keys defined during the integration setup.
        • If the primary key exists: The corresponding record is updated.
        • If the primary key does not exist: A new record is inserted.
        • Key Benefit: This mode ensures that only the latest information is stored, based on the defined primary keys.
        • Drawback: You cannot preserve historical data since only the latest record is retained.

        Unnesting Modes

        Unnesting determines how RECORD-type columns (nested data) are stored in the warehouse. The choice of unnesting mode depends on your query and data structure needs.

        1. Do Not Unnest

        This mode stores nested data as a single RECORD column in the warehouse, keeping the data in its original nested format.
        • Use Case: When you want to maintain the original structure of the nested data and access it directly as a single column.

        2. Up to One Level

        In this mode, the first level of the RECORD column is split into a separate child table, while deeper nested records remain in their original form.
        • Use Case: When you want partial unnesting, splitting off the first level but keeping deeper levels of nesting intact.

        3. Up to Two Levels

        Here, the nested RECORD columns are split into child tables up to two levels of depth.
        • Use Case: When you need more detailed unnesting, separating data across two levels.
        changes records

        Was this article helpful?

        Yes
        No
        Give feedback about this article

        Related Articles

        • How to Integrate SFTP(SSH File Transfer Protocol) with Daton
        • About SFTP(SSH File Transfer Protocol)
        • How to Integrate Amazon MWS with Daton

        Table of Contents

        Loading Mode Overview 1. Append Mode 2. Upsert Mode Unnesting Modes 1. Do Not Unnest 2. Up to One Level 3. Up to Two Levels

        Get Started on your Data Journey Today!

        Get a free 14-day trial of Daton today, no credit card is required.

        Start Free Trial
        Talk To Experts
        • Quick & Easy Setup
        • Secure & Reliable
        • No-Code Platform
        • Auto Updates
        • 24/7 Support

        Follow Us

        Linkedin Youtube

        Company

        • Customers
        • Partner With Us
        • Contact Us

        Culture

        • About
        • People
        • Careers

        Offerings

        • Daton
        • For Brands
        • For Agencies

        Policies

        • Terms of Service
        • Privacy Policy
        • MSA

        Follow Us

        Linkedin Youtube

        DISCLAIMER: Various trademarks are held by their respective owners

        © 2023 sarasanalytics.com

        Sitemap

        Get Started on your Data Journey Today!

        Get a free 14-day trial of Daton today, no credit card is required.

        Start Free Trial
        Talk To Sales
        DISCLAIMER: Trademarks are held by their respective owners
        • Quick & Easy Setup
        • Secure & Reliable
        • No-Code Platform
        • Auto Updates
        • 24/7 Support

        Company

        • Customers
        • Partners
        • About
        • People
        • Careers
        • Contact Us

        Offerings

        • Daton
        • Solution for Brands
        • Solution for Agencies
        • Dashboards
        • Founder's Note
        • Status

        Policies

        • Terms of Service
        • Privacy Policy
        • MSA
        • Sitemap

        © 2023 sarasanalytics.com

        Linkedin Youtube

        Knowledge Base Software powered by Helpjuice

        Expand