TextTokenizer Output - Teradata Vantage

Machine Learning Engine Analytic Function Reference

Product
Teradata Vantage
Release Number
8.00
1.0
Published
May 2019
Language
English (United States)
Last Update
2019-11-22
dita:mapPath
blj1506016597986.ditamap
dita:ditavalPath
blj1506016597986.ditaval
dita:id
B700-4003
lifecycle
previous
Product Category
Teradata Vantageā„¢

The output table schema depends on the OutputByWord argument.

Output Table Schema, OutputByWord ('true')

Column Data Type Description
accumulate_column Same as in input table [Column appears once for each specified accumulate_column.] Column copied from input table.
sn VARCHAR Serial number, in input text, of extracted token.
token VARCHAR Extracted token.

Output Table Schema, OutputByWord ('false')

Column Data Type Description
accumulate_column Same as in input table Column copied from input table.
token CLOB Tokens in text, separated by specified delimiter.