| Table |
Description |
|---|
| Input table |
Contains text with words to tokenize.. |
| StopWordsTable |
[Optional, disallowed with StopWordsList.] Contains stop words (words to ignore when parsing text). Alternatively, you can specify StopWordsList. |
Input Table Schema
If you include the PARTITION BY clause, the function treats all rows in the same partition as a single document. If you omit the PARTITION BY clause, the function treats each row as a single document.
| Column |
Data Type |
Description |
|---|
| text_column |
VARCHAR |
Text to parse. |
| accumulate_column |
Any |
[Column appears once for each specified accumulate_column.] Column to copy to output table. |
StopWordsTable
| Column |
Data Type |
Description |
|---|
| word |
VARCHAR |
Stop words. |