Manage Stages

Manage Stages

When configuring the Create External Table component, users must manually configure the "Stages" property. This can be done via the Manage Stages feature in Matillion ETL.

In the "Environments" panel (bottom left of the Matillion ETL interface), right click on one of your Environments, and then click Manage Stages. The Manage Stages window will then appear.

 

Click the + button, as in the screenshot below, to add a new external stage.

 

1. Create Stage
  • Method: In creating your new stage, choose one of: "Create"; "Create if not exists"; or "Create or replace".
  • Schema: Select an Environment Schema for your stage.
  • Name: Give your schema a descriptive name.

Then, click Next.

 

2. Create Stage Type
  • Type: For the stage to correctly interact with an external table, set the type as External.
  • S3 URL: Select the S3 URL you wish to point the created stage at.
  • Credentials: Set your credentials. For help with the "Manage Credentials" feature, click here.
  • Encryption: Decide how the files are encrypted inside the S3 Bucket.
    • Client Side Encryption: Encrypt the data within the Matillion ETL client. Users will also need to provide a Master Key in the following field.
    • SSE S3: Encrypt the data according to a key stored on an S3 bucket
    • SSE KMS: Encrypt the data according to a key stored on KMS. Users will also need to provide a KMS Key ID in the next field.
    • None: No encryption.

Click Finish to create or replace the stage.

 

Next, click OK to return to the Matillion ETL canvas.

Go into the "Stage" property on the Create External Table component, and find your new stage.

Note: Staging areas can also be created through Snowflake using the CREATE STAGE command.