TextParser Example 1: StopWords without StemmingExceptions - Teradata Vantage

Input

• InputTable: complaints, a log of vehicle complaints.

  The category column indicates whether the vehicle was in a crash.

• Stop words file: stopwords.txt, which is preinstalled on the ML Engine (shown in TextClassifierTrainer Example)

SQL Call

SELECT * FROM TextParser (
  ON complaints
  USING
  TextColumn ('text_data')
  ToLowerCase ('true')
  Stemming ('false')
  OutputByWord ('true')
  Punctuation ('\[.,?\!\]')
  RemoveStopWords ('true')
  ListPositions ('true')
  Accumulate ('doc_id', 'category')
  StopWords ('stopwords.txt')
) AS dt ORDER BY doc_id;

Output