1.1 - 8.10 - TextTokenizer Output - Teradata Vantage

Teradata Vantage™ - Machine Learning Engine Analytic Function Reference

Product
Teradata Vantage
Release Number
1.1
8.10
Release Date
October 2019
Content Type
Programming Reference
Publication ID
B700-4003-079K
Language
English (United States)

The output table schema depends on the OutputByWord syntax element.

Output Table Schema, OutputByWord ('true')

Column Data Type Description
accumulate_column Same as in input table [Column appears once for each specified accumulate_column.] Column copied from InputTable.
sn VARCHAR Serial number, in input text, of extracted token.
token VARCHAR Extracted token.

Output Table Schema, OutputByWord ('false')

Column Data Type Description
accumulate_column Same as in input table Column copied from InputTable.
token CLOB Tokens in text, separated by specified delimiter.