This is the Teradata Scoring SDK version of the function TextParser (ML Engine).
Model Format
Syntax Element | Description |
---|---|
ModelType | tparser, text parser |
InstalledFile | stop words file, stemming exceptions file |
InstalledFileTag | STOPWORDS, STEMEXCEPTIONWORDS |
Request Definition
Same as TextParser Input.
Parameters
Parameter | Supported | Comments |
---|---|---|
TextColumn | Yes | |
ToLowerCase or ConvertToLowerCase | Yes | |
Stemming or StemTokens | Yes | |
Delimiter | Yes | |
TotalWordsNum or OutputTotalWords | Yes | |
Punctuation | Yes | |
RemoveStopWords | Yes | |
ListPositions | Yes | |
OutputByWord | Yes | |
TokenColumn or TokenColName | Yes | |
PositionColumn or PositionColName | Yes | |
Accumulate | Yes | |
FrequencyColumn or FrequencyColName | Yes | |
TotalColumn | Yes | |
ON table_name | No | Provided using Request. |
StemmingExceptions | No | Populated in AML file. |
StopWords | No | Populated in AML file. |