ONNXSeq2Seq Syntax Elements | Vantage BYOM - ONNXSeq2Seq Syntax Elements - Teradata Vantage

Teradata Vantage™ - Bring Your Own Model User Guide

Deployment
VantageCloud
VantageCore
Edition
VMware
Enterprise
IntelliFlex
Lake
Product
Teradata Vantage
Release Number
7.0
Published
October 2025
ft:locale
en-US
ft:lastEdition
2025-11-07
dita:mapPath
fee1607120608274.ditamap
dita:ditavalPath
ayr1485454803741.ditaval
dita:id
fee1607120608274
Accumulate
Specify one or more column names to add to the output table in a comma-separated list. Use an asterisk (*) to specify all columns.
An accumulate_column cannot specify column Ids as integers, ranges, or allow the data type BLOB or CLOB.
ModelOutputTensor
Specify which tensor model to use for output.
EncodedMaxLength
[Optional] Enter a value to set the encoded tokenizer maximum length for the output tokens.
Only available for models that do not have fixed dimensions.
Default: 512
ShowModelProperties
[Optional] Display the input and output tensor properties of the model as a varchar column.
When set to true, scoring is not run and only the current model properties are shown.
Default: False
OutputLength
[Optional] The output length for the model sequence output.
The integer value is the number of characters for the VARCHAR output.
Maximum Unicode VARCHAR size is 32000. When value is exceeded, a CLOB is created automatically.
Default: 1000
OverwriteCachedModel
[Optional] Valid values are: 'current_cached_model', '*', 'true', 't', 'yes', '1', 'false', 'f', 'no', 'n', or '0'. All of these values are equivalent as this argument applies only to the model specified in the model ON clause, which is assumed to be in the cache.
Important: Do not use the OverwriteCachedModel argument except when you are trying to replace a previously cached model. This applies to all models supported by BYOM. Using the argument in other cases, including in concurrent queries or multiple times within a short period of time, may lead to an OOM error from garbage collection not being fast enough.
If a model loaded into the memory of the node fits in the cache, it stays in the cache until being evicted to make space for another model that needs to be loaded or after 7 days if not used. Therefore, a model can remain in the cache after the query that loaded it completes. Other queries that use the same model can use it, saving the cost of reloading it into memory.
You want to overwrite a cached model only when it has been updated, to make sure that the Predict function uses the updated model instead of the cached model.
Default behavior: The function does not overwrite cached models.
UseCache
[Optional] When true, this statement loads or uses the model from the cache.
When false, the model is loaded into a temporary cache that is cleared once the query completes.
String enclosed in single quotes 'false' or 'true'.
Default: False
EnableMemoryCheck
[Optional] When true, enables the memory check for large models to verify there is enough native memory.
Only valid with ModelType ONNX.
Default: True
SkipSpecialTokens
[Optional] When true, special tokens in the output are not added. When false, special tokens are provided in the output.
Default: True
Const_NAME
[Optional] Allows the addition of constant value for use in the model input.
Allowing the constant values in the parameters reduces system overhead since the value will not be added to every row being scored..