TextTokenizer Syntax Elements - Teradata Vantage
Machine Learning Engine Analytic Function Reference
Product
Teradata Vantage
Release Number
9.02
9.01
2.0
1.3
Published
February 2022
Language
English (United States)
Last Update
2022-02-10
dita:mapPath
rnn1580259159235.ditamap
dita:ditavalPath
ybt1582220416951.ditaval
dita:id
B700-4003
lifecycle
previous
Product Category
Teradata Vantage™
Introduction to Teradata Vantage
Machine Learning Engine
Machine Learning Engine Functions by Category
Statistical Analysis
Path and Pattern Analysis
Data Preparation and Transformation
Cluster Analysis
Time Series Analysis
Predictive Modeling
Text Analysis
Graph Analysis
Association and Recommendations
Teradata Scoring SDK
Usage Notes
Preinstalled Files That Functions Use
Using a Custom File
Function Versions
Function Name Changes for Vantage 1.1
Argument Name Changes for Vantage 1.1 and Above
Functions with Both ML Engine and Advanced SQL Engine Versions
Queries
Function Syntax Descriptions
Case in Column Names
Special Characters in Column Names
Column Specification Syntax Elements
Variable Names in Syntax Elements
Regular Expressions in Syntax Elements
Comments in Queries
Queries That Include Non-Latin Characters
Query Output Alias Limitations
Setting Teradata Studio to Create and Run Queries
Data Types
Input Column Data Types
DATE Columns
BC/BCE Timestamps
Partition Key
Incompatible Data Type Error Message
CLOB/BLOB Size Data Size Limit
General Data Science Information
Nondeterministic Results and UniqueID Syntax Element
UniqueID Syntax Element
Ways to Create Unique Identifier Column
New Table
Existing Table
Determining if Data Skew Might Impact Performance
RowDistribution Function (ML Engine)
Identification of Numeric and Categorical Columns
Sparse Tables and Dense Tables
Normalized Input
Input Table Schemas
Output
Where Functions Save Output Files
Output Tables
Argument in Function Output
Error Messages
Table Aliases and Syntax Elements in Error Messages
Input Table Aliases
Output Table Syntax Elements
Other Syntax Elements
Function Examples
Displaying Online Help for ML Engine Analytic Functions
Statistical Analysis
Approximate Cardinality (ML Engine)
Approximate Cardinality Syntax
Approximate Cardinality Syntax Elements
Approximate Cardinality Input
Approximate Cardinality Output
Approximate Cardinality Example
Approximate Percentile (ML Engine)
Approximate Percentile Syntax
Approximate Percentile Syntax Elements
Approximate Percentile Input
Approximate Percentile Output
Approximate Percentile Example
ConfusionMatrix (ML Engine)
ConfusionMatrix Syntax
ConfusionMatrix Syntax Elements
ConfusionMatrix Input
ConfusionMatrix Output
ConfusionMatrix Calculated Quantities
ConfusionMatrix Example
Correlation (ML Engine)
Correlation Syntax
Correlation Syntax Elements
Correlation Input
Correlation Output
Correlation Examples
Correlation Example: VIF ('false'), Include PartitionColumns
Correlation Example: VIF ('false'), Omit PartitionColumns
Correlation Example: VIF ('true'), OutputSummary ('true')
Correlation Example: VIF ('true'), ExceptionAttribute, OutputSummary ('true')
Correlation Example: VIF ('true'), ExceptionAttribute, OutputSummary ('false')
CrossValidation (ML Engine)
CrossValidation Syntax
CrossValidation Syntax Elements
CrossValidation Input
CrossValidation Output
CrossValidation Example
CrossValidation2 (ML Engine)
CrossValidation2 Syntax
CrossValidation2 Syntax Elements
CrossValidation2 Input
CrossValidation2 Output
CrossValidation2 Examples
CrossValidation2 Example: Regression Models
CrossValidation2 Example: Classification Models
Distribution Matching (ML Engine)
Hypothesis-Test Mode (ML Engine)
Hypothesis-Test Mode Syntax
Hypothesis-Test Mode Syntax (Continuous Distributions)
Multiple-Node Data Sets
Single-Node Data Sets
Hypothesis-Test Mode Syntax (Discrete Distributions)
Multiple-Node Data Sets
Single-Node Data Sets and Any CvM Test
Hypothesis-Test Mode Syntax Elements
Hypothesis-Test Mode Input
Hypothesis-Test Mode Output
Results (statistics and p-values)
Hypothesis-Test Mode Examples
Hypothesis-Test Mode Example: Omit GroupByColumns
Hypothesis-Test Mode Example: Include GroupByColumns
Best-Match Mode (ML Engine)
Best-Match Mode Syntax (DOUBLE PRECISION Input)
Best-Match Mode Syntax (INTEGER Input)
Best-Match Mode Syntax Elements
Best-Match Mode Input
Best-Match Mode Output
Best-Match Mode Examples
Best-Match Mode Example: DOUBLE PRECISION Input
Best-Match Mode Example: INTEGER Input
FMeasure (ML Engine)
FMeasure Syntax
FMeasure Syntax Elements
FMeasure Input
FMeasure Output
FMeasure Examples
FMeasure Example: Output All Classes
FMeasure Example: Output Specified Classes
Histogram (ML Engine)
Histogram Syntax
Histogram Syntax Elements
Histogram Input
Histogram Output
Histogram Examples
Histogram Example: AutoBin ('Sturges')
Histogram Example: AutoBin ('Scott')
Histogram Example: BinSize, StartValue, EndValue
Histogram Example: CustomBinTable
LikelihoodRatioTest (ML Engine)
LikelihoodRatioTest Syntax
LikelihoodRatioTest Syntax Elements
LikelihoodRatioTest Input
LikelihoodRatioTest Output
LikelihoodRatioTest Example
Percentiles (ML Engine)
Percentiles Syntax
Percentiles Syntax Elements
Percentiles Input
Percentiles Output
Percentiles Example
Receiver Operating Characteristic (ROC) (ML Engine)
ROC Syntax
ROC Syntax Elements
ROC Input
ROC Output
ROC Output with OutputTable
ROC Output with ROCTable
ROC Examples
ROC Example: Use Input from Predictor Function
ROC Example: OutputTable, Default Values
ROC Example: OutputTable, AUC ('true')
ROC Example: OutputTable, AUC ('true'), Gini ('true')
UnivariateStatistics (ML Engine)
UnivariateStatistics Syntax
UnivariateStatistics Syntax Elements
UnivariateStatistics Input
UnivariateStatistics Output
UnivariateStatistics Examples
UnivariateStatistics Example: ExcludeColumns, All Statistics
UnivariateStatistics Example: TargetColumns, PartitionColumns
UnivariateStatistics Example: StatisticsGroups ('basic')
VectorDistance (ML Engine)
VectorDistance Syntax
VectorDistance Syntax Elements
VectorDistance Input
VectorDistance Output
VectorDistance Examples
VectorDistance Examples Sparse Input
VectorDistance Example: Sparse-Format Input and Output, Default Thresholds
VectorDistance Example: Sparse-Format Input and Output, Nondefault Thresholds
VectorDistance Example: Dense-Format Input, Sparse-Format Output, Default Thresholds
VectorDistance Example: Sparse-Format Input and Output, InputTablesSame ('true')
Principal Component Analysis (PCA) Functions (ML Engine)
PCA (ML Engine)
PCA Syntax
PCA Syntax Elements
PCA Input
PCA Output
PCA Example
PCAScore (ML Engine)
PCAScore Syntax
PCAScore Syntax Elements
PCAScore Input
PCAScore Output
PCAScore Example
Step 1: Create Smaller Data Set
Step 2: Show How PCR Works
Path and Pattern Analysis
Attribution_MLE (ML Engine)
Models
Attribution Model Specification
Multiple-Input Attribution_MLE (ML Engine)
Attribution_MLE Syntax (Multiple Inputs)
Attribution_MLE Syntax Elements (Multiple Inputs)
Attribution_MLE Input (Multiple Inputs)
Attribution_MLE Output (Multiple Inputs)
Attribution_MLE Example (Multiple Inputs)
Single-Input Attribution_MLE (ML Engine)
Attribution_MLE Syntax (Single Input)
Attribution_MLE Syntax Elements (Single Input)
Attribution_MLE Input (Single Input)
Attribution_MLE Output (Single Input)
Attribution_MLE Examples (Single Input)
Attribution_MLE Example (Single Input): One Regular Model, Multiple Optional Models
Attribution_MLE Example (Single Input): Multiple Regular Models, One Optional Model
Attribution_MLE Example (Single Input): Dynamic Weighted Distribution Models
Attribution_MLE Example (Single Input): Window Models
Attribution_MLE Example (Single Input): Single-Window Model
Attribution_MLE Example (Single Input): Unused Segment Windows
FrequentPaths (ML Engine)
FrequentPaths Syntax
FrequentPaths Syntax Elements
FrequentPaths Input
FrequentPaths Output
FrequentPaths Examples
FrequentPaths Example: ItemColumn
FrequentPaths Example: ItemDefinitionTable
FrequentPaths Example: GroupByColumns
FrequentPaths Example: SeqPatternTable
FrequentPaths Example: PathFilters
FrequentPaths Example: ClosedPattern ('true')
FrequentPaths Example: Use with nPath to Select Sequences
nPath® (ML Engine)
Introduction to nPath
nPath Syntax
nPath Syntax Elements
nPath Input
nPath Output
nPath Symbols
LAG and LEAD Expressions in Symbol Predicates
LAG and LEAD Expressions Example: Input Query with Alias
LAG and LEAD Expressions Example: First and Most Expensive Purchases
nPath Patterns
nPath Greedy Pattern Matching
nPath Filters
nPath Filters Example
nPath Results
nPath Results Examples
nPath Results Example: FIRST, LAST_NOTNULL, MAX_CHOOSE, MIN_CHOOSE
nPath Results Example: FIRST, ACCUMULATE
nPath Results Example: FIRST, ACCUMULATE, COUNT, NTH
nPath Examples
nPath Example: Pages Visited in Each Session
nPath Example: Sessions Start at Home and Visit Page1
nPath Example: Checkout Paths for Purchases Over $200
nPath Example: Mode (OVERLAPPING)
nPath Example: First Product with Multiple Referrers
nPath Example: Sessions that Checked 3-6 Products
nPath Example: Sessions that Checked at Least 3 Products
nPath Example: Multiple Partitioned Input Tables and Dimension Input Table
Sessionize_MLE (ML Engine)
Sessionize_MLE Syntax
Sessionize_MLE Syntax Elements
Sessionize_MLE Input
Sessionize_MLE Output
Sessionize_MLE Example
Hidden Markov Model Functions (ML Engine)
Introduction to Hidden Markov Models
HMMUnsupervised (ML Engine)
HMMUnsupervised Syntax
HMMUnsupervised Syntax Elements
HMMUnsupervised Input
HMMUnsupervised Output
HMMUnsupervised Example: Loan Default Prediction
HMMSupervised (ML Engine)
HMMSupervised Syntax
HMMSupervised Syntax Elements
HMMSupervised Input
HMMSupervised Output
HMMSupervised Example: Customer Loyalty Prediction
HMMEvaluator (ML Engine)
HMMEvaluator Syntax
HMMEvaluator Syntax Elements
HMMEvaluator Input
HMMEvaluator Output
HMMEvaluator Example: Loan Default Prediction
HMMDecoder (ML Engine)
HMMDecoder Syntax
HMMDecoder Syntax Elements
HMMDecoder Input
HMMDecoder Output
HMMDecoder Examples
HMMDecoder Example: Loan Default Prediction, Unsupervised Learner
HMMDecoder Example: Customer Loyalty Prediction, Supervised Learner
HMMDecoder Example: Part-of-Speech Tagging
HMMDecoder Example: Bank Customer Churn
Path Analysis Functions (ML Engine)
PathGenerator (ML Engine)
PathGenerator Syntax
PathGenerator Syntax Elements
PathGenerator Input
PathGenerator Output
PathGenerator Example
PathSummarizer (ML Engine)
PathSummarizer Syntax
PathSummarizer Syntax Elements
PathSummarizer Input
PathSummarizer Output
PathSummarizer Example
PathStart (ML Engine)
PathStart Syntax
PathStart Syntax Elements
PathStart Input
PathStart Output
PathStart Example
PathAnalyzer (ML Engine)
PathAnalyzer Syntax
PathAnalyzer Syntax Elements
PathAnalyzer Input
PathAnalyzer Output
PathAnalyzer Example
Shapley Value Functions (ML Engine)
ShapleyGenerateCombination (ML Engine)
ShapleyGenerateCombination Syntax
ShapleyGenerateCombination Input
ShapleyGenerateCombination Output
ShapleySortCombinations (ML Engine)
ShapleySortCombinations Syntax
ShapleySortCombinations Syntax Elements
ShapleySortCombinations Input
ShapleySortCombinations Output
ShapleyAddOnePlayer (ML Engine)
ShapleyAddOnePlayer Syntax
ShapleyAddOnePlayer Syntax Elements
ShapleyAddOnePlayer Input
ShapleyAddOnePlayer Output
SQL Statements to Compute the Shapley Value
Shapley Value Functions Examples
Shapley Value Functions Example: ShapleyGenerateCombination, ShapleyAddOnePlayer
Shapley Value Functions Example: ShapleyGenerateCombination, ShapleyAddOnePlayer; Input
Shapley Value Functions Example: ShapleyGenerateCombination, ShapleyAddOnePlayer; Step 1
Shapley Value Functions Example: ShapleyGenerateCombination, ShapleyAddOnePlayer; Step 2
Shapley Value Functions Example: ShapleyGenerateCombination, ShapleyAddOnePlayer; Step 3
Shapley Value Functions Example: nPath Creates ShapleyGenerateCombination
Shapley Value Functions Example: nPath Creates ShapleyGenerateCombination; Input
Shapley Value Functions Example: nPath Creates ShapleyGenerateCombination; Step 1
Shapley Value Functions Example: nPath Creates ShapleyGenerateCombination; Step 2
Shapley Value Functions Example: nPath Creates ShapleyGenerateCombination; Step 3
Shapley Value Functions Example: nPath Creates ShapleyGenerateCombination; Step 4
Shapley Value Functions Example: nPath Creates ShapleyGenerateCombination; Step 5
Data Preparation and Transformation
Antiselect_MLE (ML Engine)
Antiselect_MLE Syntax
Antiselect_MLE Syntax Elements
Antiselect_MLE Input
Antiselect_MLE Output
Antiselect_MLE Example
ApacheLogParser (ML Engine)
ApacheLogParser Syntax
ApacheLogParser Syntax Elements
ApacheLogParser Input
ApacheLogParser Output
ApacheLogParser Examples
ApacheLogParser Example: Default LogFormat
ApacheLogParser Example: Common LogFormat
ConvertToCategorical (ML Engine)
ConvertToCategorical Syntax
ConvertToCategorical Syntax Elements
ConvertToCategorical Input
ConvertToCategorical Output
ConvertToCategorical Example
IPGeo (ML Engine)
IPGeo Syntax
IPGeo Syntax Elements
IPGeo Input
IPGeo Output
IPGeo Examples
IPGeo Example: IP Database Stored as ML Engine File
IPGeo Example: Default Maxmind Geolite Database
JSONParser (ML Engine)
JSONParser Syntax
JSONParser Syntax Elements
JSONParser Input
JSONParser Output
JSONParser Examples
JSONParser Example: Nondefault Values
JSONParser Example: Default Values
JSONParser Example: Parse with Ancestor
JSONParser Example: ERROR_HANDLER
MultiCaseMatch (ML Engine)
MultiCaseMatch Syntax
MultiCaseMatch Syntax Elements
MultiCaseMatch Input
MultiCaseMatch Output
MultiCaseMatch Example
MurmurHash (ML Engine)
MurmurHash Syntax
MurmurHash Syntax Elements
MurmurHash Input
MurmurHash Output
MurmurHash Examples
MurmurHash Example: 32-Bit Hash Value (by Default)
MurmurHash Example: 64-Bit Value (Specified)
OutlierFilter (ML Engine)
OutlierFilter Syntax
OutlierFilter Syntax Elements
OutlierFilter Input
OutlierFilter Output
OutlierFilter Examples
OutlierFilter Example: OutlierMethod ('percentile'), ReplacementValue ('null')
OutlierFilter Example: OutlierMethod ('MAD-median'), ReplacementValue ('median')
Pack_MLE (ML Engine)
Pack_MLE Syntax
Pack_MLE Syntax Elements
Pack_MLE Input
Pack_MLE Output
Pack_MLE Examples
Pack_MLE Example: Default Values
Pack_MLE Example: Nondefault Values
Pivoting (ML Engine)
Pivoting Syntax
Pivoting Syntax Elements
Pivoting Input
Pivoting Output
Pivoting Examples
Pivoting Example: NumberOfRows
Pivoting Example: PivotKeys
Pivoting Example: DefaultPivotValues
RandomSample (ML Engine)
RandomSample Syntax
RandomSample Syntax Elements
RandomSample Input
RandomSample Output
RandomSample Examples
RandomSample Example: SamplingMode ('basic'), Weighted
RandomSample Example: SamplingMode ('kmeans++')
RandomSample Example: SamplingMode ('kmeans||')
Sampling (ML Engine)
Sampling Syntax
Unconditional Sampling, Single Sample Rate
Unconditional Sampling, Approximate Sample Size
Conditional Simple Sampling, Single Sample Rate
Conditional Sampling, Variable Sample Rates
Conditional Sampling, Approximate Sample Size
Conditional Sampling, Variable Approximate Sample Sizes
Sampling Syntax Elements
Sampling Input
Sampling Output
Sampling Examples
Sampling Example: Unconditional, Single Sample Rate
Sampling Example: Conditional, Variable Sample Rates
Sampling Example: Unconditional, Approximate Sample Size
Sampling Example: Conditional, Variable Approximate Sample Sizes
Unpack_MLE (ML Engine)
Unpack_MLE Syntax
Unpack_MLE Syntax Elements
Unpack_MLE Input
Unpack_MLE Output
Unpack_MLE Examples
Unpack_MLE Example: Delimiter for Virtual Columns
Unpack_MLE Example: No Delimiter for Virtual Columns
Unpivoting (ML Engine)
Unpivoting Syntax
Unpivoting Syntax Elements
Unpivoting Input
Unpivoting Output
Unpivoting Examples
Unpivoting Example: Specified Target Columns, Default Optional Values
Unpivoting Example: Specified Target Columns, Specified Optional Values
Unpivoting Example: Specified Target Range, Default Optional Values
URIPack (ML Engine)
URIPack Syntax
URIPack Syntax Elements
URIPack Input
URIPack Output
URIPack Example
URIUnpack (ML Engine)
URIUnpack Syntax
URIUnpack Syntax Elements
URIUnpack Input
URIUnpack Output
URIUnpack Example
XMLParser (ML Engine)
XMLParser Syntax
XMLParser Syntax Elements
XMLParser Input
XMLParser Output
XMLParser Examples
XMLParser Example: Sibling and Sibling_Delimiter
XMLParser Example: Ancestor
XMLParser Example: Expressions in Nodes and Ancestor
XMLParser Example: ErrorHandler
XMLParser Example: Grandparent, Parent, and Child Nodes
XMLRelation (ML Engine)
XMLRelation Syntax
XMLRelation Syntax Elements
XMLRelation Input
XMLRelation Output
XMLRelation Examples
XMLRelation Example: OutputType ('fulldata')
XMLRelation Example: OutputType ('parentchild')
XMLRelation Example: OutputType ('fullpath')
XMLRelation Example: Output Attributes as Nodes
XMLRelation Example: ErrorHandler
Geometry Functions (ML Engine)
PointInPolygon (ML Engine)
PointInPolygon Syntax
Small Polygon Count and Large Point Count
Large Polygon Count and Small Point Count
Only to Determine Relations of Points and Polygons in Same Group
PointInPolygon Syntax Elements
PointInPolygon Input
PointInPolygon Output
PointInPolygon Examples
PointInPolygon Example: OutputAll ('true')
PointInPolygon Example: OutputAll ('false')
PointInPolygon Example: Passenger Coordinates in Columns
GeometryOverlay (ML Engine)
GeometryOverlay Syntax
UNION, INTERSECTION, DIFFERENCE and SYMDIFFERENCE
CONVEXHULL
BUFFER
GeometryOverlay Syntax Elements
GeometryOverlay Input
GeometryOverlay Output
GeometryOverlay Examples
GeometryOverlay Example: Intersection
GeometryOverlay Example: Union
GeometryOverlay Example: Buffer (Single Input)
Scale Functions (ML Engine)
ScaleMap (ML Engine)
ScaleMap Syntax
ScaleMap Syntax Elements
ScaleMap Input
ScaleMap Output
ScaleMap Examples
Scale (ML Engine)
Scale Syntax
Scale Syntax Elements
Location and Scale for Statistical Methods
Scale Input
Scale Output
Scale Examples
Scale Example: ScaleMethod ('midrange')
Scale Example: ScaleMethod ('midrange'), Intercept (-min)
Scale Example: Use Training Data to Scale Test Data
Scale Example: Multiple Methods
Scale Example: Use Scale Output in KMeans
ScaleSummary (ML Engine)
ScaleSummary Syntax
ScaleSummary Input
ScaleSummary Output
ScaleSummary Example
ScaleByPartition (ML Engine)
ScaleByPartition Syntax
ScaleByPartition Syntax Elements
ScaleByPartition Input
ScaleByPartition Output
ScaleByPartition Example
Cluster Analysis
Cluster Analysis
Canopy (ML Engine)
Canopy Syntax
Canopy Syntax Elements
Canopy Input
Canopy Output
Canopy Example
MinHash (ML Engine)
MinHash Background
MinHash Syntax
MinHash Syntax Elements
MinHash Input
MinHash Output
MinHash Example
Modularity (ML Engine)
Modularity Background
Resolution
Modularity Syntax
Modularity Syntax Elements
Modularity Input
Modularity Output
Modularity Examples
Modularity Examples Input
Modularity Example: Unweighted Edges
Modularity Example: Weighted Edges, Community Edge Table
Modularity Tips
Modularity Troubleshooting
Gaussian Mixture Model Functions (ML Engine)
GMM (ML Engine)
GMM Syntax
GMM Syntax Elements
GMM Input
GMM Output
GMM Examples
GMM Examples Input
GMM Example: Basic GMM, Spherical Covariance, Packed Output
GMM Example: Basic GMM, Diagonal Covariance, Unpacked Output
GMM Example: DP-GMM, Full Covariance, Unpacked Output
GMMPredict (ML Engine)
GMMPredict Syntax
GMMPredict Syntax Elements
GMMPredict Input
GMMPredict Output
GMMPredict Example
GMMProfile (ML Engine)
GMMProfile Syntax
GMMProfile Input
GMMProfile Output
GMMProfile Examples
GMMProfile Example: Basic GMM, Spherical Covariance, Packed Output
GMMProfile Example: Basic GMM, Diagonal Covariance, Unpacked Output
GMMProfile Example: DP-GMM, Full Covariance, Unpacked Output
KMeans Functions (ML Engine)
KMeans (ML Engine)
KMeans Syntax
KMeans Syntax Elements
KMeans Input
KMeans Output
KMeans Examples
KMeans Example: NumClusters, UnpackColumns ('false')
KMeans Example: NumClusters, UnpackColumns ('true')
KMeans Example: InitialSeeds, ClusterAssignmentTable
KMeans Example: CentroidsTable, ClusterAssignmentTable
KMeansPredict (ML Engine)
KMeansPredict Syntax
KMeansPredict Syntax Elements
KMeansPredict Input
KMeansPredict Output
KMeansPredict Example
KModes Functions (ML Engine)
KModes (ML Engine)
KModes Syntax
KModes Syntax Elements
Ways to Create Multiple Models
KModes Input
KModes Output
KModes Examples
KModes Example: InitialSeedTable
KModes Example: NumClusters
KModesPredict (ML Engine)
KModesPredict Syntax
KModesPredict Syntax Elements
KModesPredict Input
KModesPredict Output
KModesPredict Example
Time Series Analysis
Burst (ML Engine)
Burst Syntax
Burst Syntax Elements
Burst Input
Burst Output
Burst Examples
Burst Example: TimeInterval, SplitCriteria ('nosplit')
Burst Example: TimeInterval, SplitCriteria ('proportional')
Burst Example: TimeInterval, SplitCriteria ('gaussian')
Burst Example: TimeIntervalTable File
DTW (ML Engine)
DTW Syntax
DTW Syntax Elements
DTW Input
DTW Output
DTW Example
Interpolator (ML Engine)
Interpolator Syntax
Interpolator Syntax Elements
Interpolator Input
Interpolator Output
Interpolator Examples
Interpolator Examples Input
Interpolator Example: Aggregation
Interpolator Example: Constant Interpolation
Interpolator Example: Linear Interpolation
Interpolator Example: Median Interpolation
Interpolator Example: Spline Interpolation
Interpolator Example: LOESS Interpolation
SAX (ML Engine)
SAX Syntax (Single Input)
SAX Syntax (Multiple Inputs)
SAX Syntax Elements
SAX Input
SAX Output
SAX Examples
SAX Example: Global Window, Default Output
SAX Example: Sliding Window, Default Output
SAX Example: Sliding Window, Bitmap Output
SAX Example: Sliding Window, Character Output
SAX Example: Multiple-Input Version
SeriesSplitter (ML Engine)
SeriesSplitter Syntax
SeriesSplitter Syntax Elements
SeriesSplitter Input
SeriesSplitter Output
SeriesSplitter Example: Partition Splitter
SeriesSplitter Troubleshooting
TimeSeriesOrders (ML Engine)
TimeSeriesOrders Syntax
TimeSeriesOrders Syntax Elements
TimeSeriesOrders Input
TimeSeriesOrders Output
TimeSeriesOrders Examples
TimeSeriesOrders Example: PartitionColumns
TimeSeriesOrders Example: No PartitionColumns
VARMAX (ML Engine)
VARMAX Syntax
VARMAX Syntax Elements
VARMAX Input
VARMAX Output
VARMAX Examples
VARMAX Example: No Exogenous Model
VARMAX Example: Exogenous Model
VARMAX Example: Seasonal Model, No Exogenous Model
VARMAX Example: Exogenous and Seasonal Models
VARMAX Example: Orders Table, One Time Series
VARMAX Example: Orders Table, Two Time Series
VARMAX Example: Existing Orders Table
VWAP (ML Engine)
VWAP Syntax
VWAP Syntax Elements
VWAP Input
VWAP Output
VWAP Example
ARIMA Functions (ML Engine)
ARIMA (ML Engine)
ARIMA Syntax
ARIMA Syntax Elements
ARIMA Input
ARIMA Output
ARIMA Examples
ARIMA Example: OrdersTable, PartitionColumns, No Seasonality
ARIMA Example: Orders, No PartitionColumns, No Seasonality
ARIMA Example: No PartitionColumns, Seasonality
ARIMAPredict (ML Engine)
ARIMAPredict Syntax
ARIMAPredict Syntax Elements
ARIMAPredict Input
ARIMAPredict Output
ARIMAPredict Example
Change-Point Detection Functions (ML Engine)
ChangePointDetection (ML Engine)
ChangePointDetection Syntax
ChangePointDetection Syntax Elements
ChangePointDetection Input
ChangePointDetection Output
ChangePointDetection Examples
ChangePointDetection Example: Two Series, Default Options
ChangePointDetection Example: One Series, Default Options
ChangePointDetection Example: One Series, VERBOSE Output
ChangePointDetection Example: One Series, Cost 10
ChangePointDetection Example: One Series, SEGMENT Output, Cost 10
ChangePointDetection Example: One Series, Cost 20, Linear Regression
ChangePointDetection Example: One Series, Granularity (5)
ChangePointDetectionRT (ML Engine)
ChangePointDetectionRT Syntax
ChangePointDetectionRT Syntax Elements
ChangePointDetectionRT Input
ChangePointDetectionRT Output
ChangePointDetectionRT Examples
ChangePointDetectionRT Example: ChangePointThreshold 10, Window Size 3, Default Output
ChangePointDetectionRT Example: ChangePointThreshold 20, Window Size 3, VERBOSE Output
ChangePointDetectionRT Example: ChangePointThreshold 100, Window Size 3, Default Output
Convergent Cross-Mapping Functions (ML Engine)
CCMPrepare (ML Engine)
CCMPrepare Syntax
CCMPrepare Input
CCMPrepare Output
CCMPrepare Example
CCM (ML Engine)
CCM Syntax
CCM Syntax Elements
CCM Input
CCM Output
CCM Example: Simulated Data
Fast Fourier Transform Functions (ML Engine)
FFT (ML Engine)
FFT Syntax
FFT Syntax Elements
FFT Input
FFT Output
FFT Examples
FFT Example: 1D Signal
FFT Example: 2D Signal
FFT Example: 3D Signal
IFFT (ML Engine)
IFFT Syntax
IFFT Syntax Elements
IFFT Input
IFFT Output
IFFT Examples
IFFT Example: 1D Signal
IFFT Example: 2D Signal
IFFT Example: 3D Signal
Moving Average Functions (ML Engine)
CumulativeMovAvg (ML Engine)
CumulativeMovAvg Syntax
CumulativeMovAvg Syntax Elements
CumulativeMovAvg Input
CumulativeMovAvg Output
CumulativeMovAvg Example
ExponentialMovAvg (ML Engine)
ExponentialMovAvg Syntax
ExponentialMovAvg Syntax Elements
ExponentialMovAvg Input
ExponentialMovAvg Output
ExponentialMovAvg Example
SimpleMovAvg (ML Engine)
SimpleMovAvg Syntax
SimpleMovAvg Syntax Elements
SimpleMovAvg Input
SimpleMovAvg Output
SimpleMovAvg Example
WeightedMovAvg (ML Engine)
WeightedMovAvg Syntax
WeightedMovAvg Syntax Elements
WeightedMovAvg Input
WeightedMovAvg Output
WeightedMovAvg Example
Shapelet Functions (ML Engine)
ShapeletUnsupervised (ML Engine)
ShapeletUnsupervised Syntax
ShapeletUnsupervised Syntax Elements
ShapeletUnsupervised Input
ShapeletUnsupervised Output
ShapeletUnsupervised Example
ShapeletUnsupervised Troubleshooting
ShapeletSupervised (ML Engine)
ShapeletSupervised Syntax
ShapeletSupervised Syntax Elements
ShapeletSupervised Input
ShapeletSupervised Output
ShapeletSupervised Example
ShapeletSupervised Troubleshooting
ShapeletSupervisedClassifier (ML Engine)
ShapeletSupervisedClassifier Syntax
ShapeletSupervisedClassifier Syntax Elements
ShapeletSupervisedClassifier Input
ShapeletSupervisedClassifier Output
ShapeletSupervisedClassifier Example
Wavelet Transform Functions (ML Engine)
DWT (ML Engine)
DWT Syntax
DWT Syntax Elements
DWT Input
DWT Output
DWT Example
DWT2D (ML Engine)
DWT2D Syntax
DWT2D Syntax Elements
DWT2D Input
DWT2D Output
DWT2D Example
IDWT (ML Engine)
IDWT Syntax
IDWT Syntax Elements
IDWT Input
IDWT Output
IDWT Example
IDWT2D (ML Engine)
IDWT2D Syntax
IDWT2D Syntax Elements
IDWT2D Input
IDWT2D Output
IDWT2D Example
Predictive Modeling
KNN (ML Engine)
KNN Syntax
KNN Syntax Elements
KNN Input
KNN Output
KNN Examples
KNN Examples Input
KNN Example: OutputProb ('true'), Responses Omitted
KNN Example: OutputProb ('true'), Responses Specified
AdaBoost Functions (ML Engine)
AdaBoost (ML Engine)
AdaBoost Syntax
AdaBoost Syntax Elements
AdaBoost Input
AdaBoost Output
AdaBoost Examples
AdaBoost Example: Create Model to Predict Home Style
AdaBoost Example: OutputProb
AdaBoostPredict (ML Engine)
AdaBoostPredict Syntax
AdaBoostPredict Syntax Elements
AdaBoostPredict Input
AdaBoostPredict Output
AdaBoostPredict Examples
AdaBoostPredict Example: Use Model to Predict Home Style
AdaBoostPredict Example: OutputProb, Responses
Cox Functions (ML Engine)
CoxPH (ML Engine)
CoxPH Syntax
CoxPH Syntax Elements
CoxPH Input
CoxPH Output
CoxPH Example
CoxHazardRatio (ML Engine)
CoxHazardRatio Syntax
CoxHazardRatio Syntax Elements
CoxHazardRatio Input
CoxHazardRatio Output
CoxHazardRatio Examples
CoxHazardRatio Example: No Reference Values
CoxHazardRatio Example: No Reference Values, Partition by Name and ID
CoxHazardRatio Example: Reference Values
CoxHazardRatio Example: RefFeatureColumns, Partition by ID
CoxHazardRatio Example: Units Values
CoxSurvival (ML Engine)
CoxSurvival Syntax
CoxSurvival Syntax Elements
CoxSurvival Input
CoxSurvival Output
CoxSurvival Example
Decision Forest Functions (ML Engine)
DecisionForest (ML Engine)
DecisionForest Syntax
DecisionForest Syntax Elements
DecisionForest Input
DecisionForest Output
DecisionForest Examples
DecisionForest Example: TreeType ('classification'), OutOfBag ('false')
DecisionForest Example: TreeType ('classification'), OutOfBag ('true')
DecisionForest Example: TreeType ('regression'), OutOfBag ('true')
DecisionForestPredict_MLE (ML Engine)
DecisionForestPredict_MLE Syntax
DecisionForestPredict_MLE Syntax Elements
DecisionForestPredict_MLE Input
DecisionForestPredict_MLE Output
DecisionForestPredict_MLE Examples
DecisionForestPredict_MLE Example: Omit Responses
DecisionForestPredict_MLE Example: Responses and OutputProb
DecisionForestPredict_MLE Example: CategoricalEncoding ('Hashing')
DecisionForestPerSegment (ML Engine)
DecisionForestPerSegment Syntax
DecisionForestPerSegment Syntax Elements
DecisionForestPerSegment Input
DecisionForestPerSegment Output
DecisionForestPerSegment Examples
DecisionForestPerSegment Example: Omit AttributeTable or ParameterTable
DecisionForestPerSegment Example: Specify AttributeTable or ParameterTable
DecisionForestPredictPerSegment (ML Engine)
DecisionForestPredictPerSegment Syntax
DecisionForestPredictPerSegment Syntax Elements
DecisionForestPredictPerSegment Input
DecisionForestPredictPerSegment Output
DecisionForestPredictPerSegment Examples
DecisionForestPredictPerSegment Example
DecisionForestPredictPerSegment Example
DecisionForestEvaluator (ML Engine)
DecisionForestEvaluator Syntax
DecisionForestEvaluator Syntax Elements
DecisionForestEvaluator Input
DecisionForestEvaluator Output
DecisionForestEvaluator Examples
DecisionForestEvaluator Example: Evaluate Model
DecisionForestEvaluator Example: Variable Importance
Best Practices
Decision Tree Functions (ML Engine)
DecisionTree (ML Engine)
DecisionTree Syntax
DecisionTree Syntax Elements
DecisionTree Input
DecisionTree Output
DecisionTree Examples
DecisionTree Example: Create Model
DecisionTree Example: Alternate Input Format
DecisionTree Example: OutputProb
DecisionTreePredict_MLE (ML Engine)
DecisionTreePredict_MLE Syntax
DecisionTreePredict_MLE Syntax Elements
DecisionTreePredict_MLE Input
DecisionTreePredict_MLE Output
DecisionTreePredict_MLE Examples
DecisionTreePredict_MLE Example: Apply Model to Test Data
DecisionTreePredict_MLE Example: OutputProb, Responses
Generalized Linear Model (GLM) Functions (ML Engine)
GLM (ML Engine)
GLM Syntax
GLM Syntax Elements
Supported Family/Link Function Combinations
GLM Input
GLM Output
GLM Onscreen Output
GLM OutputTable
GLM StepTable
Odds Ratio and Confidence Intervals
Goodness-of-Fit Tests
Deviance
Wald Test
Pearson’s Chi-squared Statistic
GLM Examples
GLM Example: Logistic Regression Analysis with Intercept
GLM Example: Gaussian Distribution Analysis
GLM Example: Step ('true') with StepTable
GLMPredict_MLE (ML Engine)
GLMPredict_MLE Syntax
GLMPredict_MLE Syntax Elements
GLMPredict_MLE Input
GLMPredict_MLE Output
GLMPredict_MLE Examples
GLMPredict_MLE Example: Logistic Distribution Prediction
GLMPredict_MLE Example: Gaussian Distribution Prediction
GLML1L2 (ML Engine)
GLML1L2 Syntax
GLML1L2 Syntax Elements
GLML1L2 Input
GLML1L2 Output
GLML1L2 Examples
GLML1L2 Example: Ridge Regression, Family ('BINOMIAL')
GLML1L2 Example: Factor Table as InputTable
GLML1L2 Example: LASSO, Family ('GAUSSIAN')
GLML1L2Predict (ML Engine)
GLML1L2Predict Syntax
GLML1L2Predict Syntax Elements
GLML1L2Predict Input
GLML1L2Predict Output
GLML1L2Predict Examples
GLML1L2Predict Example: Ridge Regression, Family ('BINOMIAL')
GLML1L2Predict Example: LASSO, Family ('GAUSSIAN')
GLMPerSegment (ML Engine)
GLMPerSegment Syntax
GLMPerSegment Syntax Elements
GLMPerSegment Input
GLMPerSegment Output
GLMPerSegment Examples
GLMPerSegment Example: Regression, Family ('GAUSSIAN')
GLMPerSegment Example: Regression, AttributeTable, ParameterTable
GLMPerSegment Example: Logical Regression, Family ('BINOMIAL')
GLMPredictPerSegment (ML Engine)
GLMPredictPerSegment Syntax
GLMPredictPerSegment Syntax Elements
GLMPredictPerSegment Input
GLMPredictPerSegment Output
GLMPredictPerSegment Examples
GLMPredictPerSegment Example: Regression, Family ('GAUSSIAN')
GLMPredictPerSegment Example: Regression
GLMPredictPerSegment Example: Logistic Regression, Family ('BINOMIAL')
Least Angle Regression (LAR) Functions (ML Engine)
LAR (ML Engine)
LAR Syntax
LAR Syntax Elements
LAR Input
LAR Output
LAR Examples
LAR Example: FitMethod ('lar')
LAR Example: FitMethod ('lasso')
LARPredict (ML Engine)
LARPredict Syntax
LARPredict Syntax Elements
LARPredict Input
LARPredict Output
LARPredict Examples
LARPredict Example: Model ('diabetes_lars')
LARPredict Example: Model ('diabetes_lasso')
Linear Regression Functions (ML Engine)
Linear Regression (ML Engine)
Linear Regression Syntax
Linear Regression Syntax Elements
Linear Regression Input
Linear Regression Output
Linear Regression Example
LinRegPredict (ML Engine)
LinRegPredict Syntax
LinRegPredict Syntax Elements
LinRegPredict Input
LinRegPredict Output
LinRegPredict Example
Naive Bayes Functions (ML Engine)
NaiveBayes (ML Engine)
NaiveBayes Syntax
NaiveBayes Syntax Elements
NaiveBayes Input
NaiveBayes Output
NaiveBayes Example
NaiveBayesPredict_MLE (ML Engine)
NaiveBayesPredict_MLE Syntax
NaiveBayesPredict_MLE Syntax Elements
NaiveBayesPredict_MLE Input
NaiveBayesPredict_MLE Output
NaiveBayesPredictPerSegment Example
Support Vector Machine (SVM) Functions (ML Engine)
SVMSparse Functions
SVMSparse (ML Engine)
SVMSparse Syntax
SVMSparse Syntax Elements
SVMSparse Input
SVMSparse Output
SVMSparse Example
SVMSparsePredict_MLE (ML Engine)
SVMSparsePredict_MLE Syntax
SVMSparsePredict_MLE Syntax Elements
SVMSparsePredict_MLE Input
SVMSparsePredict_MLE Output
Calculation of prob_response and predict_confidence
SVMSparsePredict_MLE Example
SVMSparseSummary (ML Engine)
SVMSparseSummary Syntax
SVMSparseSummary Syntax Elements
SVMSparseSummary Input
SVMSparseSummary Output
SVMSparseSummary Examples
SVMSparseSummary Example: OutputSummary ('true')
SVMSparseSummary Example: OutputSummary ('false')
SVMDense Functions
SVMDense (ML Engine)
SVMDense Syntax
SVMDense Syntax Elements
SVMDense Input
SVMDense Output
SVMDense Examples
SVMDense Examples Input
SVMDense Example: Linear Model
SVMDense Example: Polynomial Model
SVMDense Example: Radial Basis Model (RBF) Model
SVMDense Example: Sigmoid Model
SVMDensePredict (ML Engine)
SVMDensePredict Syntax
SVMDensePredict Syntax Elements
SVMDensePredict Input
SVMDensePredict Output
Calculation of prob_response and predict_confidence
SVMDensePredict Examples
SVMDensePredict Example: Linear Model
SVMDensePredict Example: Polynomial Model
SVMDensePredict Example: Radial Basis Model (RBF) Model
SVMDensePredict Example: Sigmoid Model
SVMDenseSummary (ML Engine)
SVMDenseSummary Syntax
SVMDenseSummary Syntax Elements
SVMDenseSummary Input
SVMDenseSummary Output
SVMDenseSummary Examples
SVMDenseSummary Example: OutputSummary ('true')
SVMDenseSummary Example: OutputSummary ('false')
XGBoost Functions (ML Engine)
XGBoost Background
XGBoost (ML Engine)
XGBoost Syntax
XGBoost Syntax Elements
XGBoost Input
XGBoost Output
XGBoost Examples
XGBoost Example: Binary Classification, Dense Format
XGBoost Example: Binary Classification, Sparse Format
XGBoost Example: Multiple-Class Classification
XGBoost Example: Regression, Dense Format
XGBoost Example: Regression, Sparse Format
XGBoost Troubleshooting
XGBoostPredict (ML Engine)
XGBoostPredict Syntax
XGBoostPredict Syntax Elements
XGBoostPredict Input
XGBoostPredict Output
XGBoostPredict Examples
XGBoostPredict Example: Binary Classification, Dense Format
XGBoostPredict Example: Binary Classification, Sparse Format
XGBoostPredict Example: Multiple-Class Classification
XGBoostPredict Example: Regression, Dense Format
XGBoostPredict Example: Regression, Sparse Format
XGBoostPredict Troubleshooting
Text Analysis
IdentityMatch (ML Engine)
IdentityMatch Syntax
When Reference Data Fits in Memory
When Reference Data Does Not Fit in Memory
IdentityMatch Syntax Elements
IdentityMatch Input
IdentityMatch Output
IdentityMatch Example
LevenshteinDistance (ML Engine)
LevenshteinDistance Syntax
LevenshteinDistance Syntax Elements
LevenshteinDistance Input
LevenshteinDistance Output
LevenshteinDistance Example
NGramSplitter_MLE (ML Engine)
NGramSplitter_MLE Syntax
NGramSplitter_MLE Syntax Elements
NGramSplitter_MLE Input
NGramSplitter_MLE Output
NGramSplitter_MLE Examples
NGramSplitter_MLE Example: Overlapping ('true'), OutputTotalGramCount ('true')
NGramSplitter_MLE Example: Overlapping ('false'), OutputTotalGramCount ('false')
POSTagger (ML Engine)
POSTagger Syntax
POSTagger Syntax Elements
POSTagger Input
POSTagger Output
POSTagger Example
SentenceExtractor (ML Engine)
SentenceExtractor Syntax
SentenceExtractor Syntax Elements
SentenceExtractor Input
SentenceExtractor Output
SentenceExtractor Example
StringSimilarity_MLE (ML Engine)
StringSimilarity_MLE Syntax
StringSimilarity_MLE Syntax Elements
StringSimilarity_MLE Input
StringSimilarity_MLE Output
StringSimilarity_MLE Examples
StringSimilarity_MLE Example: Compare src_text1 to tar_text
StringSimilarity_MLE Example: Compare src_text2 to tar_text
TextChunker (ML Engine)
TextChunker Syntax
TextChunker Syntax Elements
TextChunker Input
TextChunker Output
TextChunker Examples
TextChunker Example: POSTagger Output as Input
TextChunker Example: SentenceExtractor and POSTagger Output as Input
TextMorph (ML Engine)
TextMorph Syntax
TextMorph Syntax Elements
TextMorph Input
TextMorph Output
TextMorph Examples
TextMorph Example: SingleOutput ('true')
TextMorph Example: SingleOutput ('false')
TextMorph Example: POS ('noun', 'verb'), SingleOutput ('false')
TextMorph Example: POS ('noun', 'verb'), SingleOutput ('true')
TextMorph Example: TextMorph with POSTagger and TextTagger
TextParser (ML Engine)
TextParser Syntax
TextParser Syntax Elements
TextParser Input
TextParser Output
TextParser Examples
TextParser Example: StopWordsList, No StemTokens
TextParser Example: StemTokens, No StopWordsList
TextParser Example: StopWordsTable, No StemTokens
TextTagger (ML Engine)
TextTagger Syntax
TextTagger Syntax Elements
Defining Tagging Rules
TextTagger Input
TextTagger Output
TextTagger Examples
TextTagger Example: TaggingRules
TextTagger Example: Rules Table
TextTagger Example: TaggingRules, Dictionary File
TextTagger Example: TaggingRules, Superdist
TextTagger Example: Text, Unicode Emoticons (Emojis)
TextTokenizer (ML Engine)
TextTokenizer Syntax
TextTokenizer Syntax Elements
TextTokenizer Input
TextTokenizer Output
TextTokenizer Examples
TextTokenizer Example: Chinese Tokenization
TextTokenizer Example: Japanese Tokenization
TextTokenizer Example: English Tokenization
TFIDF (ML Engine)
TFIDF Syntax
TFIDF Syntax Elements
TFIDF Input
TFIDF Output
TFIDF Examples
TFIDF Example: Tokenized Training Document Set
TFIDF Example: Tokenized Test Set
Fellegi-Sunter Functions (ML Engine)
FellegiSunter (ML Engine)
FellegiSunter Syntax
FellegiSunter Syntax Elements
FellegiSunter Input
FellegiSunter Output
FellegiSunter Examples
FellegiSunter Example: Unsupervised Learning
FellegiSunter Example: Supervised Learning
FellegiSunterPredict (ML Engine)
FellegiSunterPredict Syntax
FellegiSunterPredict Syntax Elements
FellegiSunterPredict Input
FellegiSunterPredict Output
FellegiSunterPredict Examples
FellegiSunterPredict Example: Unsupervised Learning Model
FellegiSunterPredict Example: Supervised Learning Model
Latent Dirichlet Allocation (LDA) Functions (ML Engine)
LDA (ML Engine)
LDA Syntax
LDA Syntax Elements
LDA Input
LDA Output
LDA Example
LDAInference (ML Engine)
LDAInference Syntax
LDAInference Syntax Elements
LDAInference Input
LDAInference Output
LDAInference Example
LDATopicSummary (ML Engine)
LDATopicSummary Syntax
LDATopicSummary Syntax Elements
LDATopicSummary Input
LDATopicSummary Output
LDATopicSummary Examples
LDATopicSummary Example: SummaryOutput ('true')
LDATopicSummary Example: OutputByWord ('false')
LDATopicSummary Example: WordWeight ('true'), WordCount ('true')
Naive Bayes Text Classifier Functions (ML Engine)
NaiveBayesTextClassifierTrainer2 (ML Engine)
NaiveBayesTextClassifierTrainer2 Syntax
NaiveBayesTextClassifierTrainer2 Syntax Elements
NaiveBayesTextClassifierTrainer2 Input
NaiveBayesTextClassifierTrainer2 Output
NaiveBayesTextClassifierTrainer2 Examples
NaiveBayesTextClassifierTrainer2 Example: IsTokenized ('false')
NaiveBayesTextClassifierTrainer2 Example: IsTokenized ('true')
NaiveBayesTextClassifierPredict_MLE (ML Engine)
NaiveBayesTextClassifierPredict_MLE Syntax
NaiveBayesTextClassifierPredict_MLE Syntax Elements
NaiveBayesTextClassifierPredict_MLE Input
NaiveBayesTextClassifierPredict_MLE Output
NaiveBayesTextClassifierPredict_MLE Examples
NaiveBayesTextClassifierPredict_MLE Example: TopK Specified, IsTokenized ('false')
NaiveBayesTextClassifierPredict_MLE Example: TopK Omitted, IsTokenized ('true')
Named Entity Recognition (NER) Functions (ML Engine)
NER Functions (CRF Model Implementation)
NERTrainer (ML Engine)
NERTrainer Syntax
NERTrainer Syntax Elements
NERTrainer Feature Template
Part 1 of the Example Template File
Part 2 of the Example Template File
NERTrainer Input
NERTrainer Output
NERTrainer Example
NERExtractor (ML Engine)
NERExtractor Syntax
NERExtractor Syntax Elements
NERExtractor Input
NERExtractor Output
NERExtractor Examples
NERExtractor Example: Specify Rules
NERExtractor Example: Specify Dictionary
NEREvaluator (ML Engine)
NEREvaluator Syntax
NEREvaluator Syntax Elements
NEREvaluator Input
NEREvaluator Output
NEREvaluator Example
NER Functions (Maximum Entropy Model Implementation)
NamedEntityFinderTrainer (ML Engine)
NamedEntityFinderTrainer Syntax
NamedEntityFinderTrainer Syntax Elements
NamedEntityFinderTrainer Input
NamedEntityFinderTrainer Output
NamedEntityFinderTrainer Example
NamedEntityFinder (ML Engine)
NamedEntityFinder Syntax
NamedEntityFinder Syntax Elements
Creating the Table of Default Models
NamedEntityFinder Input
NamedEntityFinder Output
NamedEntityFinder Example
Named Entity Finder Evaluator (ML Engine)
Named Entity Finder Evaluator Syntax
Named Entity Finder Evaluator Syntax Elements
NamedEntityFinderEvaluatorMap Input
NamedEntityFinderEvaluatorReduce Output
Named Entity Finder Evaluator Example
Sentiment Extraction Functions (ML Engine)
SentimentTrainer (ML Engine)
SentimentTrainer Syntax
SentimentTrainer Syntax Elements
SentimentTrainer Input
SentimentTrainer Output
SentimentTrainer Example
SentimentExtractor (ML Engine)
SentimentExtractor Syntax
SentimentExtractor Syntax Elements
SentimentExtractor Input
SentimentExtractor Output
SentimentExtractor Examples
SentimentExtractor Examples Prerequisites
SentimentExtractor Example: InputModelFile ('dictionary'), AnalysisType ('document')
SentimentExtractor Example: InputModelFile ('dictionary'), AnalysisType ('sentence')
SentimentExtractor Example: InputModelFile ('classification:default_sentiment_classification_model.bin')
SentimentExtractor Example: InputModelFile ('classification:sentimentmodel1.bin')
SentimentExtractor Example: Dictionary Table Instead of Model File
SentimentExtractor Example: Dictionary Table and Model File
SentimentEvaluator (ML Engine)
SentimentEvaluator Syntax
SentimentEvaluator Syntax Elements
SentimentEvaluator Input
SentimentEvaluator Output
SentimentEvaluator Examples
SentimentEvaluator Example: Model ('dictionary')
SentimentEvaluator Example: Model ('classification:default_sentiment_classification_model.bin')
SentimentEvaluator Example: Model ('classification:sentimentmodel1.bin')
SentimentEvaluator Example: Dictionary Table Instead of Model File
Text Classifier Functions (ML Engine)
TextClassifierTrainer (ML Engine)
TextClassifierTrainer Syntax
TextClassifierTrainer Syntax Elements
TextClassifierTrainer Input
TextClassifierTrainer Output
TextClassifierTrainer Example
TextClassifier (ML Engine)
TextClassifier Syntax
TextClassifier Syntax Elements
TextClassifier Input
TextClassifier Output
TextClassifier Example
Graph Analysis
AllPairsShortestPath (ML Engine)
AllPairsShortestPath Syntax
AllPairsShortestPath Syntax Elements
AllPairsShortestPath Input
Deleting Duplicate Edges Table Rows
AllPairsShortestPath Output
AllPairsShortestPath Examples
AllPairsShortestPath Example: Unweighted, Unbounded Graph
AllPairsShortestPath Example: Weighted, Unbounded Graph
AllPairsShortestPath Example: Weighted, Bounded Graph with Sources
Betweenness (ML Engine)
Betweenness Syntax
Betweenness Syntax Elements
Betweenness Input
Betweenness Output
Betweenness Example
EigenvectorCentrality (ML Engine)
Centrality Formulas
Eigenvector and Eigenvalue
Power Iteration
Centrality Calculation
EigenvectorCentrality Syntax
EigenvectorCentrality Syntax Elements
EigenvectorCentrality Input
EigenvectorCentrality Output
EigenvectorCentrality Examples
EigenvectorCentrality Example: Eigenvector Centrality
EigenvectorCentrality Example: Katz Centrality
EigenvectorCentrality Example: Bonacich Centrality
GTree (ML Engine)
GTree Syntax
GTree Syntax Elements
GTree Input
GTree Output
GTree Examples
GTree Example: All Paths from Root Nodes
GTree Example: Paths That Cycle or End at Leaves
LocalClusteringCoefficient (ML Engine)
LocalClusteringCoefficient Background
Unweighted, Undirected Network (BUN)
Unweighted, Directed Network (BDN)
Weighted, Directed Network (WDN)
Weighted, Undirected Network (WUN)
LocalClusteringCoefficient Syntax
LocalClusteringCoefficient Syntax Elements
LocalClusteringCoefficient Input
LocalClusteringCoefficient Output
LocalClusteringCoefficient Examples
LocalClusteringCoefficient Example: WUN
LocalClusteringCoefficient Example: WUN, DegreeRange 3+
LocalClusteringCoefficient Example: WDN
LoopyBeliefPropagation (ML Engine)
LoopyBeliefPropagation Background
LoopyBeliefPropagation Syntax
LoopyBeliefPropagation Syntax Elements
LoopyBeliefPropagation Input
LoopyBeliefPropagation Output
LoopyBeliefPropagation Examples
LoopyBeliefPropagation Example: Equally Weighted Edges
LoopyBeliefPropagation Example: Unequally Weighted Edges
Modularity (ML Engine)
Modularity Background
Resolution
Modularity Syntax
Modularity Syntax Elements
Modularity Input
Modularity Output
Modularity Examples
Modularity Examples Input
Modularity Example: Unweighted Edges
Modularity Example: Weighted Edges, Community Edge Table
Modularity Tips
Modularity Troubleshooting
NTree (ML Engine)
NTree Syntax
NTree Syntax Elements
Cycles in NTree
NTree Input
NTree Output
NTree Examples
NTree Example: Find Employee Reports
NTree Example: Find Employee Management Chain
NTree Example: Show Reporting Structure by Department
PageRank (ML Engine)
PageRank Syntax
PageRank Syntax Elements
PageRank Input
PageRank Output
PageRank Example
PSALSA (ML Engine)
PSALSA Background
SALSA
PSALSA
PSALSA Syntax
PSALSA Syntax Elements
PSALSA Input
PSALSA Output
PSALSA Examples
PSALSA Example: Similar Users, No Edge Weight
PSALSA Example: Similar Users, Edge Weight
PSALSA Example: Product Recommendation for Similar Users
PSALSA Example: Sources and Targets Tables as Inputs
RandomWalkSample (ML Engine)
RandomWalkSample Background
RandomWalkSample Syntax
RandomWalkSample Syntax Elements
RandomWalkSample Input
RandomWalkSample Output
RandomWalkSample Example
Closeness Functions
Closeness (ML Engine)
Closeness Syntax
Closeness Syntax Elements
Closeness Input
Closeness Output
Closeness Examples
Closeness Example: Unweighted, Unbounded Graph
Closeness Example: Weighted, Bounded Graph, MaxDistance=12
Closeness Example: Weighted, Bounded Graph, MaxDistance=8
ApproximateCloseness (ML Engine)
ApproximateCloseness Syntax
ApproximateCloseness Syntax Elements
ApproximateCloseness Input
ApproximateCloseness Output
ApproximateCloseness Examples
ApproximateCloseness Example
Association and Recommendations
BasketGenerator (ML Engine)
BasketGenerator Syntax
BasketGenerator Syntax Elements
BasketGenerator Input
BasketGenerator Output
BasketGenerator Examples
BasketGenerator Example: Partition by player, Default BasketSize
BasketGenerator Example: Partition by player, Increase BasketSize
CFilter (ML Engine)
CFilter Syntax
CFilter Syntax Elements
CFilter Input
CFilter Output
Deleting Duplicate Output Table Rows
CFilter Example
FPGrowth (ML Engine)
FPGrowth Background
FPGrowth Syntax
FPGrowth Syntax Elements
FPGrowth Input
FPGrowth Output
FPGrowth Examples
FPGrowth Example: Sports
FPGrowth Example: Sports Grouped by League
IdentityMatch (ML Engine)
IdentityMatch Syntax
When Reference Data Fits in Memory
When Reference Data Does Not Fit in Memory
IdentityMatch Syntax Elements
IdentityMatch Input
IdentityMatch Output
IdentityMatch Example
Fellegi-Sunter Functions (ML Engine)
FellegiSunter (ML Engine)
FellegiSunter Syntax
FellegiSunter Syntax Elements
FellegiSunter Input
FellegiSunter Output
FellegiSunter Examples
FellegiSunter Example: Unsupervised Learning
FellegiSunter Example: Supervised Learning
FellegiSunterPredict (ML Engine)
FellegiSunterPredict Syntax
FellegiSunterPredict Syntax Elements
FellegiSunterPredict Input
FellegiSunterPredict Output
FellegiSunterPredict Examples
FellegiSunterPredict Example: Unsupervised Learning Model
FellegiSunterPredict Example: Supervised Learning Model
Recommender Functions (ML Engine)
KNNRecommender (ML Engine)
KNNRecommender Syntax
KNNRecommender Syntax Elements
KNNRecommender Input
KNNRecommender Output
KNNRecommender Example
KNNRecommenderPredict (ML Engine)
KNNRecommenderPredict Syntax
KNNRecommenderPredict Syntax Elements
KNNRecommenderPredict Input
KNNRecommenderPredict Output
KNNRecommenderPredict Example
WSRecommender (ML Engine)
WSRecommender Syntax
WSRecommender Syntax Elements
WSRecommender Input
WSRecommender Output
WSRecommender Example
Teradata Scoring SDK
Introduction to Teradata Scoring SDK
Using Teradata Scoring SDK
AMLGenerator (ML Engine)
AMLGenerator Syntax
AMLGenerator Syntax Elements
AMLGenerator Output
AMLGenerator Example
Scorer (ML Engine)
Scorer Package
Scorer Installation
Scorer Functional Support
Scorer Input Formats
Scorer Data Types
Scorer Output Formats
Scoring API
Scorer Class Javadoc
Scorer Examples
Scorer Logging Support
Scorer Compatibility
Scorer Performance
Teradata Scoring SDK Functions
Teradata Scoring SDK Cox Hazard Ratio (ML Engine)
Teradata Scoring SDK Decision Forest (ML Engine)
Teradata Scoring SDK Decision Tree (ML Engine)
Teradata Scoring SDK Generalized Linear Model (ML Engine)
Teradata Scoring SDK LDA Inference (ML Engine)
Teradata Scoring SDK Naïve Bayes (ML Engine)
Teradata Scoring SDK Naïve Bayes Text Classifier (ML Engine)
Teradata Scoring SDK Sentiment Extractor (ML Engine)
Teradata Scoring SDK Sentiment Extractor Additional Notes
Teradata Scoring SDK Sparse SVM (ML Engine)
Teradata Scoring SDK Text Parser (ML Engine)
Teradata Scoring SDK Text Parser Additional Notes
Teradata Scoring SDK Text Tagger (ML Engine)
Teradata Scoring SDK Text Tagger Additional Notes
Teradata Scoring SDK Text Tokenizer (ML Engine)
Teradata Scoring SDK Text Tokenizer Additional Notes
Teradata Scoring SDK TFIDF (ML Engine)
Teradata Scoring SDK FAQ
List of Functions and Their Syntax
Organization of List of Functions
Statistical Analysis Functions
Approximate Cardinality Syntax
Approximate Percentile Syntax
ConfusionMatrix Syntax
Correlation Syntax
CrossValidation Syntax
CrossValidation2 Syntax
Distribution Matching
Best-Match Mode Syntax (DOUBLE PRECISION Input)
Best-Match Mode Syntax (INTEGER Input)
Hypothesis-Test Mode Syntax (Continuous Distributions)
Multiple-Node Data Sets
Single-Node Data Sets
Hypothesis-Test Mode Syntax (Discrete Distributions)
Multiple-Node Data Sets
Single-Node Data Sets and Any CvM Test
FMeasure Syntax
Histogram Syntax
LikelihoodRatioTest Syntax
PCA Syntax
PCAScore Syntax
Percentiles Syntax
ROC Syntax
UnivariateStatistics Syntax
VectorDistance Syntax
Path and Pattern Analysis Functions
Attribution_MLE Syntax (Single Input)
Attribution_MLE Syntax (Multiple Inputs)
FrequentPaths Syntax
HMMDecoder Syntax
HMMEvaluator Syntax
HMMSupervised Syntax
HMMUnsupervised Syntax
nPath Syntax
PathAnalyzer Syntax
PathGenerator Syntax
PathStart Syntax
PathSummarizer Syntax
Sessionize_MLE Syntax
ShapleyAddOnePlayer Syntax
ShapleyGenerateCombination Syntax
ShapleySortCombinations Syntax
Data Preparation and Transformation Functions
Antiselect_MLE Syntax
ApacheLogParser Syntax
ConvertToCategorical Syntax
GeometryOverlay Syntax
UNION, INTERSECTION, DIFFERENCE and SYMDIFFERENCE
CONVEXHULL
BUFFER
IPGeo Syntax
JSONParser Syntax
MultiCaseMatch Syntax
MurmurHash Syntax
OutlierFilter Syntax
Pack_MLE Syntax
Pivoting Syntax
PointInPolygon Syntax
Small Polygon Count and Large Point Count
Large Polygon Count and Small Point Count
Only to Determine Relations of Points and Polygons in Same Group
RandomSample Syntax
Sampling Syntax
Unconditional Sampling, Single Sample Rate
Unconditional Sampling, Approximate Sample Size
Conditional Simple Sampling, Single Sample Rate
Conditional Sampling, Variable Sample Rates
Conditional Sampling, Approximate Sample Size
Conditional Sampling, Variable Approximate Sample Sizes
Scale Syntax
ScaleByPartition Syntax
ScaleMap Syntax
ScaleSummary Syntax
Unpack_MLE Syntax
Unpivoting Syntax
URIPack Syntax
URIUnpack Syntax
XMLParser Syntax
XMLRelation Syntax
Cluster Analysis Functions
Canopy Syntax
GMM Syntax
GMMPredict Syntax
GMMProfile Syntax
KMeans Syntax
KMeansPredict Syntax
KModes Syntax
KModesPredict Syntax
MinHash Syntax
Modularity Syntax
Time Series Analysis Functions
ARIMA Syntax
ARIMAPredict Syntax
Burst Syntax
CCM Syntax
CCMPrepare Syntax
ChangePointDetection Syntax
ChangePointDetectionRT Syntax
CumulativeMovAvg Syntax
DTW Syntax
DWT Syntax
DWT2D Syntax
ExponentialMovAvg Syntax
FFT Syntax
IDWT Syntax
IDWT2D Syntax
IFFT Syntax
Interpolator Syntax
SAX Syntax (Multiple Inputs)
SAX Syntax (Single Input)
SeriesSplitter Syntax
ShapeletSupervised Syntax
ShapeletSupervisedClassifier Syntax
ShapeletUnsupervised Syntax
SimpleMovAvg Syntax
TimeSeriesOrders Syntax
VARMAX Syntax
VWAP Syntax
WeightedMovAvg Syntax
Predictive Modeling Functions
AdaBoost Syntax
AdaBoostPredict Syntax
CoxHazardRatio Syntax
CoxPH Syntax
CoxSurvival Syntax
DecisionForest Syntax
DecisionForestEvaluator Syntax
DecisionForestPerSegment Syntax
DecisionForestPredictPerSegment Syntax
DecisionForestPredict_MLE Syntax
DecisionTree Syntax
DecisionTreePredict_MLE Syntax
GLM Syntax
GLML1L2 Syntax
GLML1L2Predict Syntax
GLMPerSegment Syntax
GLMPredictPerSegment Syntax
GLMPredict_MLE Syntax
KNN Syntax
LAR Syntax
LARPredict Syntax
Linear Regression Syntax
LinRegPredict Syntax
NaiveBayes Syntax
NaiveBayesPerSegment Syntax
NaiveBayesPredict_MLE Syntax
NaiveBayesPredictPerSegment Syntax
SVMDense Syntax
SVMDensePredict Syntax
SVMDenseSummary Syntax
SVMSparse Syntax
SVMSparsePredict_MLE Syntax
SVMSparseSummary Syntax
XGBoost Syntax
XGBoostPredict Syntax
Text Analysis Functions
FellegiSunter Syntax
FellegiSunterPredict Syntax
IdentityMatch Syntax
When Reference Data Fits in Memory
When Reference Data Does Not Fit in Memory
LDA Syntax
LDAInference Syntax
LDATopicSummary Syntax
LevenshteinDistance Syntax
NaiveBayesTextClassifierPredict_MLE Syntax
NaiveBayesTextClassifierTrainer2 Syntax
Named Entity Finder Evaluator Syntax
NamedEntityFinder Syntax
NamedEntityFinderTrainer Syntax
NEREvaluator Syntax
NERExtractor Syntax
NERTrainer Syntax
NGramSplitter_MLE Syntax
POSTagger Syntax
SentenceExtractor Syntax
SentimentEvaluator Syntax
SentimentExtractor Syntax
SentimentTrainer Syntax
StringSimilarity_MLE Syntax
TextChunker Syntax
TextClassifier Syntax
TextClassifierTrainer Syntax
TextMorph Syntax
TextParser Syntax
TextTagger Syntax
TextTokenizer Syntax
TFIDF Syntax
Graph Analysis Functions
AllPairsShortestPath Syntax
ApproximateCloseness Syntax
Betweenness Syntax
Closeness Syntax
EigenvectorCentrality Syntax
GTree Syntax
LocalClusteringCoefficient Syntax
LoopyBeliefPropagation Syntax
Modularity Syntax
NTree Syntax
PageRank Syntax
PSALSA Syntax
RandomWalkSample Syntax
Association and Recommendations Functions
BasketGenerator Syntax
CFilter Syntax
FellegiSunter Syntax
FellegiSunterPredict Syntax
FPGrowth Syntax
IdentityMatch Syntax
When Reference Data Fits in Memory
When Reference Data Does Not Fit in Memory
KNNRecommender Syntax
KNNRecommenderPredict Syntax
WSRecommender Syntax
Teradata Scoring SDK
AMLGenerator Syntax
Scorer
Additional Information
Changes and Additions
Teradata Links
Related Documentation
TextColumn
Specify the name of the InputTable column that contains the text to tokenize.
InputLanguage
[Optional] Specify the language of the text in text_column :
Option
Description
'en' (Default)English
'zh_CN' Simplified Chinese
'zh_TW' Traditional Chinese
'jp' Japanese
InputModelFile
[Optional] Specify the name of model file that the function uses for tokenizing. The model must be a conditional random-fields model and input_model_file must already be installed on ML Engine . If you omit this syntax element, or if input_model_file is not installed, then the function uses white spaces to separate English words and an embedded dictionary to tokenize Chinese text.
If you specify InputLanguage('jp') , the function ignores this syntax element.
OutputDelimiter
[Optional] Specify the delimiter, a string, for separating tokens in the output.
Default: '/' (slash)
OutputByWord
Specify whether to output one token in each row.
Default: 'false' (Output one line of text in each row.)
Accumulate
[Optional] Specify the names of the InputTable columns to copy to the output table.
UserDictionaryFile
[Optional] Specify the name of the user dictionary to use to correct results specified by the model. If you specify both this syntax element and a dictionary table (Dict), then the function uses the union of user_dictionary_file and Dict as its dictionary. TextTokenizer Input describes the format of user_dictionary_file and Dict.
If the function finds more than one matched term, it selects the longest term for the first match.