Advanced

Data Stagers - Support

This document provides general troubleshooting guidance for Matillion’s Data Loading components. It focuses on Orchestration jobs which use Load/Unload components to copy data from a source system into your target database. To...

Variables

Overview Note: Matillion ETL supports Environment Variables (+Automatic Variables), Job Variables and Grid Variables. For detailed information on each type, please visit the below links. For more general information on variables in...

Manage CDC

Overview Note: This feature is currently only available to AWS-hosted Matillion ETL instances CDC (Change Data Capture) allows users to synchronise their RedshiftSnowflake data with their own database, ensuring the former is...

Schemas

Overview Matilion ETL is aware that you may have multiple schemas. Each Matillion ETL environment specifies a default schema. The default schema is used by Matillion ELT in the following ways: It...

Facebook Data Model

Connection String Options Aggregate Format Authenticate As Page Auto Cache Batch Size Cache Connection Cache Driver Cache Location Cache Metadata Cache Query Result Cache Tolerance Callback URL Connection Life Time Connect On...

Triggering ETL from an S3 Event via AWS Lambda

Overview This example links the arrival of a new object in S3 and automatically triggers a Matillion ETL job to load it, transform it and append the transformed data to a fact...

Expression Editor

Overview The Expression Editor in Matillion ETL allows the user create expressions in the Calculate and Join components. From the editor, users can browse from lists of available functions (dependent on platform)...

Securing Matillion ETL

Overview By default Matillion ETL users are authenticated against an internal user file however it is possible to authenticate users against an Active Directory or other LDAP directory server, turn on and...

API v1 - Tasks

Commands Below we list some common API commands for Task management in Matillion ETL by way of an example use with cURL. These commands should be immediately usable with cURL when the...

Type 6 Slowly Changing Dimensions Example

Overview Here we outline Matillion's approach to maintaining slowly changing dimension data using Matillion ETL by way of an extended example. Often when using Matillion ETL, a customer requires the ability to...