Transformation Components

"An error occurred while staging" occurs in "Database Query"

I want to synchronize the data stored in SQLServer to Bigquery using "Database Query". I entered and executed necessary items for "Database Query", but an error message "An error occurred...

Table input - Partition table

Hi! I'm trying to read from a partitioned table with the component "Table Input". There's an option "Include partition time" = yes/no. How should I use this? I don't understand...

Appending data to a table

Hi All, I'm new to Matillion and I'm experiencing a temporary brain freeze... :) I need to append data (tbl1) to a table (tbl2). The thing is that the data...

Priviliges Error on Table Input component

We have a simple transformation job which is reading data from a Snowflake table, via a Table Input component. This job isn't new, and no changes have been made since...

Apply function on variable in calculator

Hi All! I do option 1 here in this example: https://bigquerysupport.matillion.com/customer/portal/articles/2951841?b_id=8914 I'm trying to create yet another column from the same variable and thus applying a string function on the...

Temporary tables?

Hi All, Any good examples of when to use the "Rewrite table component"? I'm loading csv files to a table and I add two columns through the calculator component. The...

Passing a job variable to transformation

Hi all, I have an orchestration job with a job variable that I would like to pass onto the transformation job. How can I do this? The job variable is...

UDF Function in Matillion

we can use functions and User Defined function in calculator component, but How can we create UDF function in Matillion?

How to add _FILE_NAME pseudo column in Table Input component?

I'm using BigQuery external table as Table Input, how can I include the _FILE_NAME pseudo column? I tried using the Calculator component but it does not recognize the _FILE_NAME expression....