Integrating Matillion ETL with Secret Managers
    • Dark
      Light

    Integrating Matillion ETL with Secret Managers

    • Dark
      Light

    Article Summary

    Overview

    Matillion ETL Secrets Manager lets you connect to one or more secret managers, which will directly reference passwords, API tokens, keys, and secrets stored in third party secret manager platforms.

    As of version 1.56.x of Matillion ETL, the following secret managers are supported:

    1. AWS Secrets Manager
    2. Azure Key Vault
    3. GCP Secret Manager

    Any password/key rotation within your organization can be maintained externally from Matillion ETL.

    Please Note

    This feature cannot be used with OAuth configurations.



    Linking your project group to a secret manager

    1. Click Project and then click Manage Project Group Passwords. The Manage Passwords dialog will open.


    2. In Manage Passwords, click the Secret Managers tab.

    3. To connect to your secret manager, click in Manage Passwords. A two-page Add Secret Manager wizard will open.


    4. Complete the first page of the wizard: Information.

    PropertyDescription
    NameA descriptive name for your secret manager. The name can contain alphanumerics, underscores, single space characters, parentheses, and hyphens. You cannot use single space characters as the first (leading) or last (trailing) character.
    TypeThe type of secret manager to connect to.

    When you are ready, click Next.


    5. Complete the second page of the wizard: Configuration.

    PropertyDescription
    CredentialsYour cloud provider credentials. This dropdown menu should be autopopulated by the credentials created in Manage Credentials. To learn more, read Manage Credentials.
    Region(AWS Secrets Manager only) Select your AWS region within which the secrets manager resource has been created.
    Key Vault(Azure Key Vault only) Select a key vault from the drop-down list. The list will be populated based on the Azure credentials in Manage Credentials. To learn how to create a key vault, read Quickstart: Create a key vault using the Azure portal.
    Project(GCP Secret Manager only) Select a GCP project from the drop-down list. The list will be populated based on the GCP credentials in Manage Credentials. To learn how to create a project, read Creating and managing projects.

    When you are ready, click Finish to complete the secret manager integration.


    Once you complete the setup, the wizard will close, and your connection to your secret manager will be displayed in the Secret Managers tab within Manage Passwords.




    Using Passwords from your connected secret managers

    To use a secret from your newly connected secret manager, follow the below steps.

    1. In Manage Passwords, click the Passwords tab.

    2. Click to create a new password. This will open Create Password.

    3. Complete the Create Password form. The table below describes the relevant properties for adding a password to a secret manager. For passwords of an Internal type, read Manage Passwords.

    PropertyDescription
    Password NameAn identifier for your password entry.
    Password TypeSelect External to choose a secret from a connected secret manager.
    Secret ManagerSelect a connected secret manager.
    Secret NameChoose a secret from the selected secret manager. The dropdown menu will autopopulate based on the secrets stored in the selected secret manager and the credentials used to connect to it.
    Secret KeySelect a secret key from within your chosen secret.
    DescriptionA contextual description for your password.

    4. Click OK to create the password, which will directly reference the value in the secret manager at the moment it is resolved.

    Your newly created password will then be ready to use in Matillion ETL.