Name is required.
Email address is required.
Invalid email address
Answer is required.
Exceeding max length of 5KB

Table input - Partition table

Hi!
I'm trying to read from a partitioned table with the component "Table Input". There's an option "Include partition time" = yes/no. How should I use this? I don't understand the help here.

My table is partitioned by day on a field called "Date" and the partition filter is required. The table is also clustered by a column.

If I choose "no" in "include partition time" I get an error (cannot query over table).
If I use "yes" I have to add a "Partition time alias" and it doesn't matter what I use here. I get an error anyway (Unrecognized name). I cant use a field already present in the table.

Any ideas?

Br
Cris

3 Community Answers

Matillion Agent  

Laura Malins —

Hi Cris

Thanks for highlighting this. I’ve managed to recreate this with a table partitioned on date. If I set Include partition time to be no it works ok however if I set include partition time to yes I get an error. I don’t think this option should be available for tables with a date partition whereas it should be available for a table with a partition by ingestion time. I will raise this with the developers.

Can you try a SQL component with SELECT * FROM table to see if that works for you please?

Thanks
Laura


Cristian Ivanoff —

Hi Laura,
This works fine:
SELECT * FROM `myproject.dataset1.part_table` WHERE Date = date("2018-12-06")

The filter is required.


Matillion Agent  

Laura Malins —

Hi Cris

Thanks for confirming. I’ve raised to our development team to get this bug fixed.

Thanks
Laura

Post Your Community Answer

To add an answer please login