Fixed Flow
    • Dark
      Light

    Fixed Flow

    • Dark
      Light

    Article Summary

    This article is specific to the following platforms - Snowflake - Redshift - BigQuery - Synapse.

    Fixed Flow Component

    The Fixed Flow component allows you to generate lines of fixed input, or input from variables. This component is useful for simple static mappings

    Properties

    Snowflake Properties

    PropertySettingDescription
    NameStringA human-readable name for the component.
    ColumnsNameThe name of the input column.
    TypeVARCHAR: This type is suitable for strings and text. More...
    NUMBER: This type is suitable for whole-number types (no decimals). More...
    FLOAT: This type is suitable for numeric types, with or without decimals. More...
    BOOLEAN: This type is suitable for data that is either 'true' or 'false'. More...
    DATE: This type is suitable for dates without times. More...
    TIMESTAMP: This type is a timestamp left unformatted (exists as Unix/Epoch Time). More...
    TIME: A formatted time object without date. More...
    VARIANT: A flexible type that can be used for any purpose.
    ValuesText, Numeric, or DateTimeA dynamic table of values with one column for each column created above.
    Note: Variables can be used in this component. See Variables for additional help.

    Redshift Properties

    PropertySettingDescription
    NameStringA human-readable name for the component.
    ColumnsNameThe name of the input column.
    TypeText: This type can hold any type of data, subject to a maximum size. More...
    Integer: This type is suitable for whole-number types (no decimals). More...
    Numeric: This type is suitable for numeric types, with or without decimals. More...
    Boolean: This type is suitable for data that is either 'true' or 'false'. More...
    Date: This type is suitable for dates without times. More...
    DateTime: This type is suitable for dates, times, or timestamps (both date and time). More...
    SUPER: use the SUPER data type to store semi-structured data or documents as values. More...
    ValuesText, Numeric, or DateTimeA dynamic table of values with one column for each column created above.
    Note: Variables can be used in this component. See Variables for additional help.

    BigQuery Properties

    PropertySettingDescription
    NameStringA human-readable name for the component.
    ColumnsNameThe name of the input column.
    Data TypeFor more information on available BQ data types please refer to the Google Cloud documentation.
    String: This type can hold any type of data, subject to a maximum size.
    Integer: This type is suitable for whole-number types (no decimals).
    Float: This type is suitable for numeric types, with or without decimals.
    Boolean: This type is suitable for data that is either "true" or "false".
    Date: A formatted date object without time. See the Official GCP documentation
    Time: A formatted time object without date. See the Official GCP documentation
    DateTime: A formatted timestamp containing both date and time that is easily readable by the user. See the Official GCP documentation
    Timestamp: This type is a timestamp left unformatted (exists as Unix/Epoch Time).
    ValuesText, Numeric, or DateTimeA dynamic table of values with one column for each column created above.
    Note: Variables can be used in this component. See Variables for additional help.

    Synapse Properties

    PropertySettingDescription
    NameStringA human-readable name for the component.
    ColumnsColumn NameSpecify the name of the input column.
    Data TypeSelect the data type. The available data types are:
    DATE: this data type is suitable for dates without times. More...
    DATETIME: this data type is suitable for timestamps. More...
    TIME: this data type is suitable for times target="_blank">More...
    INTEGER: this data type is suitable for whole number types (no decimals). More...
    NUMERIC: this data type is suitable for numeric types, with or without decimals. More...
    TEXT: this data type is suitable for text types. More...
    FLOAT: this data type is suitable for approximate number data types for use with floating point numeric data. More...
    BOOLEAN: this data type is suitable for data whether values are either "true" or "false". More...
    SizeThe size column sets the size, except for the data types BOOLEAN, DATE, DATETIME, and TIME.
    For more information about DATE, read date (Transact-SQL).

    For DATETIME, the size column sets the precision of the datetime offset, and accepted values range from 0-7, ranging from 0-9999999, that represent the fractional seconds.
    If the DATETIME size is set to 0, the returned datetime will be 26 positions (YYYY-MM-DD hh:mm:ss {+|-}hh:mm).
    If the DATETIME size is set to a precision of 1, the returned datetime will be 28 positions (26 + precision + 1) (YYYY-MM-DD hh:mm:ss.n {+|-}hh:mm).
    If the DATETIME size is set to a precision of 7, the returned datetime will be 34 positions (26 + precision + 1) (YYYY-MM-DD hh:mm:ss.nnnnnnn {+|-}hh:mm).
    For more information, read datetime (Transact-SQL).

    For TIME, the size column sets the precision of the time offset, and accepted values range from 0-7, ranging from 0 to 9999999, that represent the fractional seconds.
    If the TIME size is set to 0, the returned time will be 8 positions (hh:mm:ss).
    If the TIME size is set to 1, the returned time will be 10 positions (8 + precision + 1) (hh:mm:ss.n).
    If the TIME size is set to 7, the returned time will be 16 positions (8 + precision + 1) (hh:mm:ss.nnnnnnn).
    ScaleDefine the scale. More...
    ValuesText, Numeric, or DateTimeA dynamic table of values with one column for each column created above.
    Note: Variables can be used in this component. See Variables for additional help.

    Delta Lake Properties

    PropertySettingDescription
    NameStringA human-readable name for the component.
    ColumnsNameSpecify the name of the input column.
    Data TypeSelect from INTEGER, NUMBER, FLOAT, TEXT, TIMESTAMP, DATE, BOOLEAN, BINARY as the data type for this column.
    SizeSet the data type size.
    ScaleSet the data type scale.
    ValuesData Type DependentA dynamic table of values with one column for each column created above.
    Note: Variables can be used in this component. See Variables for additional help.

    Strategy

    Generates a series of static select statements that return the entered values.

    Date, DateTime, Time, and Timestamp Validation

    Matillion ETL accepts a variety of date, time, datetime, and timestamp values. Some of the most common values accepted are listed below.

    Note

    • The list of examples below is not exhaustive, but covers many of the most commonly accepted formats.
    • In applicable examples below, the number 13 is used as the value for day, to avoid confusion with month values.
    • Please note that the backslash character can be replaced by a dash, underscore, full stop, or colon.
    • Dates cannot contain time values.
    • Times cannot contain date values.
    • The datetime/timestamp values listed below can be just the date, but not just the time.
    • The datetime/timestamp values accepted combine certain date patterns with all the time patterns, split by either a whitespace character or a T character.
    • There are a number of exceptions that are accepted, such as BC dates, negative dates, and also month values greater than 12. None of these are listed below, and we advise caution when using these values.

    The following date values are accepted:

    • 13/01/2021
    • 01/13/2021
    • 2021/1/13
    • 13/JAN/2021
    • 2021
    • JAN 13 2021
    • 13 January, 2021
    • January 13, 2021

    The following time values are accepted:

    • 23:12
    • 23:12:59
    • 23:12:59.123456 (milli/micro/nano are all supported)

    The following time values (with offset) are accepted:

    • 23:12 +01:00
    • 23:12:59 +01:00
    • 23:12:59.123456 +01:00 (milli/micro/nano are all supported)

    The following datetime and timestamp values are accepted:

    • 13-01-2021 23:12:59.123456 +01:00
    • 2021-01-13 23:12:59.123456 +01:00