Transformation Components

merging tables in snowflake

Our use case: 1. Create a copy of all the tables in staging schema(basically cloning tables from production). 2. Compare the cloned tables with the new tables(From source) a. if...

netsuite 2 factor auth

I am testing Matillion against netsuite but get a 2 factor authentication error. The Netsuite support team say they have disabled 2 factor. Another developer has switched to using Del...

S3 unload - filename

Hi, Is there a way to freeze/lock the filename in S3? S3 rename the file depending on node this was unloded from. I want a file with a name like...

How to Cancel / Kill job?

When i tried to kill / Cancel job by right clicking it isn't cancelling the job. How to Kill or Cancel running job in Matillion Snowflake ?

Load -part0 format to csv

Hi, Q1. I use database query transformation to load sql server table data in S3 staging , while loading in S3 bucket it is in -part0 file, it tried opening...

Materialize/Persist data in a Transformation Job

Hi, A transformation job generates a single SQL script to run in Snowflake. The SQL generated can be quite big and the performance of the query can improve significantly in...

start at - timezone information

In my start component I am exporting "started to" a timestamp variable. Subsequently in an API component in Advanced mode my SQL Query has: ... cast('${timestamp}' as timestamp) as thetime...

Pass value from Transformation to Orchestration Component

I would like a transformation component to return some manner of value to its parent orchestration component. To my understanding, transformation jobs cannot affect variable values (unless I'm mistaken); are...

Pick aggregated value using Aggregate component and use it as a new expression

I am trying to take max value of a column based on an aggregated column and apply it as a new column (static value) across all records excluding aggregation. I...

Except Component Problems

This has three parts: 1) The actual description of what the Except component does seems to be backwards. What the help says is "Compares two input flows and outputs any...