7.00.02 - TextTokenizer Syntax - Aster Analytics

Teradata Aster® Analytics Foundation User GuideUpdate 2

Product
Aster Analytics
Release Number
7.00.02
Release Date
September 2017
Content Type
Programming Reference
User Guide
Publication ID
B700-1022-700K
Language
English (United States)
Version 3.2
SELECT * FROM TextTokenizer (
  ON input_table PARTITION BY ANY
  [ ON dict_table AS dict DIMENSION ]
  TextColumn ('text_column') ]
  [ Language ({ 'en' | 'zh_CN' | 'zh_TW' | 'jp' | }) ]
  [ Model ('model_file') ]
  [ OutputDelimiter ('delimiter') ]
  [ OutputByWord ({'true'|'t'|'yes'|'y'|'1'|'false'|'f'|'no'|'n'|'0'}) ]
  [ Accumulate ({ 'accumulate_column' | accumulate_column_range }[,...]) ]
  [ UserDictionaryFile ('user_dictionary_file') ]
);