1.0 - 8.00 - TextTokenizer Output - Teradata Vantage

Teradata® Vantage Machine Learning Engine Analytic Function Reference

Product
Teradata Vantage
Release Number
1.0
8.00
Release Date
May 2019
Content Type
Programming Reference
Publication ID
B700-4003-098K
Language
English (United States)

The output table schema depends on the OutputByWord argument.

Output Table Schema, OutputByWord ('true')

Column Data Type Description
accumulate_column Same as in input table [Column appears once for each specified accumulate_column.] Column copied from input table.
sn VARCHAR Serial number, in input text, of extracted token.
token VARCHAR Extracted token.

Output Table Schema, OutputByWord ('false')

Column Data Type Description
accumulate_column Same as in input table Column copied from input table.
token CLOB Tokens in text, separated by specified delimiter.