1.1 - 8.10 - Teradata Scoring SDK Text Tokenizer Additional Notes - Teradata Vantage

Teradata Vantage™ - Machine Learning Engine Analytic Function Reference

Product
Teradata Vantage
Release Number
1.1
8.10
Release Date
October 2019
Content Type
Programming Reference
Publication ID
B700-4003-079K
Language
English (United States)

If the function uses a dictionary table, specify it with the ModelTable and ModelTag syntax elements of AMLGenerator. If the function uses a dictionary file or CRF model file, specify it with the InstalledFile and InstalledFileTag syntax elements of AMLGenerator. If you specify no tables, the function uses the default embedded dictionaries for English or Chinese text.

Example 1: Chinese

InstalledFile ('crf_model_file')
InstalledFileTag ('CRF')

Example 2: Chinese

ModelTable ('dict_table')
ModelTableTag ('DICT')
InstalledFile ('crf_model_file')
InstalledFileTag ('CRF')
InstalledFile2 ('dict_file')
InstalledFile2Tag ('DICT')

Example 3: English or Japanese

CRF file is not supported.

ModelTable('dict_table')
ModelTableTag('DICT')
InstalledFile ('dict_file')
InstalledFileTag ('DICT')