NGramSplitter Function Example | Teradata Vantage - Example: Omit Accumulate - Teradata Vantage

Teradata® VantageCloud Lake
Deployment
VantageCloud
Edition
Lake
Product
Teradata Vantage
Published
January 2023
Language
English (United States)
Last Update
2024-04-03
dita:mapPath
phg1621910019905.ditamap
dita:ditavalPath
pny1626732985837.ditaval
dita:id
phg1621910019905

NGramSplitter SQL Call

SELECT * FROM NGramSplitter (
  ON paragraphs_input
  USING
  TextColumn ('paratext')
  Grams ('4-6')
  OutputTotalGramCount ('true')
) AS dt;

NGramSplitter Output

paraid paratopic paratext ngram n frequency totalcnt
1 Decision Trees Decision tree lear... a decision tree as 4 1 73
2 Simple Regression In statistics, simp... a linear regression model 4 1 55
1 Decision Trees Decision tree lear... a decision tree as 5 1 66
2 Simple Regression In statistics, simp.. a linear regression model with 5 1 52
1 Decision Trees Decision tree lear... a decision tree as a predictive 6 1 60
2 Simple Regression In statistics, simp... a linear regression model with a 6 1 49
1 Decision Trees Decision tree lear... a finite set of 4 1 73
1 Simple Regression In statistics, simp... a single explantory variable 4 1 55
... ...   ... ... ... ...