Optional Syntax Elements for TD_TextParser - Teradata VantageCloud Lake

ON clause: Accept the StopWordsTable clause.
ConvertToLowerCase: Convert the text in the input table column name to lowercase.; Default value: true
StemTokens: Convert the text in the input table column name to their root forms.; Default value: false
Delimiter: Specify single-character delimiter values to apply to the text in the specified column in the TextColumn element.; Default values: ' \t\n\f\r'
RemoveStopWords: Specify the value, true to remove the stop words before parsing the text in the specified column in the TextColumn element.; Default value: false
Punctuation: Specify the punctuation characters that you want to replace in the text of the specified column in the TextColumn element with space.
Accepted characters are any printable char up to Extended Latin 255 or U+00FF.; Default values: ‘!#$%&()*+,-./:;?@\^_`{|}~’
TokenColName: Specify a name for the output column that contains the individual words from the text of the specified column in the TextColumn element.; Default value: token
Accumulate: Specify the input table column names to copy to the output table.