1.1 - 8.10 - When Reference Data Does Not Fit in Memory - Teradata Vantage

Teradata Vantage™ - Machine Learning Engine Analytic Function Reference

Product
Teradata Vantage
Release Number
1.1
8.10
Release Date
October 2019
Content Type
Programming Reference
Publication ID
B700-4003-079K
Language
English (United States)

Use this syntax when neither input fits in memory. Partition the data by categorical attribute (for example, age range), thereby distributing the records to workers by the specified attribute and reducing the comparison times. If the categorical attribute has n values and each range has same size, the comparison times are reduced to 1/n. In the syntax, a and b refer to the SourceTable and ReferenceTable, respectively.

Version 1.11

SELECT * FROM IdentityMatch (
  ON source_input_table AS SourceTable PARTITION BY key 
  ON reference_input_table AS ReferenceTable PARTITION BY key
  USING
  IDColumn (a.id_column: b.id_column')
  { NominalMatchColumns ('a.columnX: b.columnY' [,...]) |
    FuzzyMatchColumns ('a.columnX: b.columnY, match_metricmatch_weight [, synonym_file ]' [,...])
  }
  [ Accumulate ('{a|b}.accumulate_column' [,...]')]
  [ ThresholdScore (threshold) ]
) AS alias;