Manage Backups

Overview

This feature is only available for instances hosted on AWS.

 

Matillion ETL does NOT automatically backup any of your work without proper configuration of the service described in this article. Before making any changes to the instance, including running an update process, it is STRONGLY recommended that you perform a backup before upgrading the instance. (This can also be performed manually.)

Users can set up automated backups through Matillion ETL such that the entire instance is backed up once daily at a specified time. Note that this generates a snapshot of the entire instance at the time of backing up. 

In rare cases it may be necessary to perform this process manually. Instructions to do so can be found here. We recommend users use the built-in backup system described in this article when possible.

To set up an automated backup, use the 'Admin' dropdown menu at the top left of the Matillion ETL tool and select 'Manage Backups'. This will bring up a new window to enter backup details.


The backup can be named anything the user pleases but note that the time and date will be appended to the name at the time of backing up. This way, automated backups can run indefinitely without overwriting one another. Users can specify a time of their choosing for the backup to occur. It is suggested to pick a time where jobs will not currently be running on the instance.#

Finally, users must input their credentials for permission to back up the instance. For more information on credentials, visit the Managing Credentials documentation.

The 'Test' button can be used to check the input fields and ensure information is entered correctly. The test will also check the credentials to ensure a backup is possible. Should each section of the test return successfully, the user can press 'OK' to close the window and the backup information will be saved.

To activate the backup process, the 'Activate EBS Backups' checkbox at the top left of the Manage Backupds window must be checked. Elastic Block Storage is the default method of storage on AWS and will grow according to your needs. As such, it is important to remember that storing backups can incur additional costs as the storage demand increases. 

Without 'Activate EBS Backups' checked, no automated backups will occur.

Note: (AWS Only) Scheduled backups created in Matillion ETL are governed by the Instance and do not create a backup schedule in AWS. Equally, backups are not created with a lifecycle policy and so have no set retention time. It is up to the user to manage these snapshots appropriately.
 

Matillion ETL does NOT automatically backup any of your work without proper configuration of the service described in this article. Before making any changes to the instance, including running an update process, it is STRONGLY recommended that you perform a backup before upgrading the instance.

To backup your Matillion ETL instance, you will need to take a snapshot of the appropriate disk on your Compute Engine. To begin this, log into your GCP Console and use the search function to find Snapshots.

On the Snapshots screen, click CREATE SNAPSHOT.

Give this new snapshot a Name and Description (if wanted) and select the Source disk to take a snapshot of (the one holding your Matillion ETL instance).

Your new Snapshot will now be created.

 

Restoring backups

The Matillion backup system will create an EBS Snapshot. To restore from this snapshot, it is recommended that you:

1. Restore the backed-up snapshot to an EBS Volume.
2. Attach that volume to an EC2 instance.

You can select an existing snapshot and click Create Instance to restore from this point.