We have Matillion set up to work with BigQuery, I want to move an entire data set to another dataset, but do not see Schema Copy in the components. If I cannot use Schema Copy is there another way to do this?
Thank you in advance
1 Community Answers
Paul Johnson —
You can copy tables from one schema to another using a transformation job and using a table input component and a Rewrite Table OR Table output component.
If you have a large number of tables, you can use grid variables to make the job dynamic and reusable. Please note there have been some performance improvements made in later versions to the grid variable components.
One of my colleagues has an example which is compatible with version 1.36 of matillion, we can share if you want to upgrade the instance. Remeber to always backup before an in-place upgrade.