Orchestration Components

S3 Get Object

S3 Get Object Note: This feature is only available for instances hosted on AWS. Transfer a file from Amazon S3 to a remote host. This component can use a number of common...

Storage Load Generator

Overview S3 Load Generator is a tool that helps users load delimited data from public objects in an S3 Bucket (Amazon Simple Storage Service). Cloud Storage Load Generator is a tool that...

Cassandra Query

Cassandra Query This component retrieves data on a Cassandra server and loads it into a table. This stages the data, so the table is reloaded each time. You may then use transformations to enrich...

Couchbase Query

Couchbase Query This component retrieves data on a Couchbase server and loads it into a table. This stages the data, so the table is reloaded each time. You may then use transformations...

Cloud Storage Load

Cloud Storage Load Allows a user to load data stored on the Google Cloud Storage service into an existing BigQuery table. Many of the configuration settings on this component have sensible defaults,...

Cloud Storage Put Object

Cloud Storage Put Object Transfer a file from a remote host onto a Google Cloud Platform Bucket. This component can use a number of common network protocols to transfer data to a Google...

Cloud Storage Unload

Cloud Storage Unload Creates files on a specified Google Cloud Storage Bucket, and loads them with data from an Google Cloud Platform table. Properties Property Setting Description Name Text The descriptive name...

External Table

Create External Table Create a table that references data stored in an external storage system, such as Google Cloud Storage. For full information on working with tables on Google Cloud Platorm, see...

Youtube Query

YouTube Query This component integrates with the 'YouTube Data API' (https://developers.google.com/youtube/v3/docs/) to retrieve data from YouTube and load it into a table. Warning: This component is destructive as it truncates or recreates its target table...

Google Drive Table Component

Google Drive Table Create a table that references data stored in Google Drive. Note that the Matillion ETL instance must have access to this data; that is, the GCP credentials used in...