The following examples use .set width 175, unless overridden in the query:
.set width 500
SELECT
top 1 *
from mldb.ONNXSeq2Seq(
on (SELECT id, content AS txt FROM JulesBelvezeDummyData WHERE id <= 5)
on (SELECT model_id, model FROM onnx_models WHERE model_id = 't5-small-headline-generator') DIMENSION
on (SELECT tokenizer FROM sequence_tokenizers WHERE model_id = 't5-small-headline-generator') DIMENSION
USING
Accumulate('id')
ModelOutputTensor('sequences')
ShowModelProperties('True')
) as td
order by id
;
*** Query completed. One row found. One column returned.
*** Total elapsed time was 1 second.
ModelProperties
----------------------------------------------------------------------------
Input(s): {name: input_ids, tensor: INT32[batch_size, 512]}, {name: num_beams, tensor: INT32[1]}, {name: min_length, tensor: INT32[1]}, {name: attention_mask, tensor: INT32[batch_size, 512]}, {name: num_return_sequences, tensor: INT32[1]}, {name: length_penalty, tensor: FLOAT32[1]}, {name: repetition_penalty, tensor: FLOAT32[1]}, {name: max_length, tensor: INT32[1]} Output(s): {name: sequences, tensor: INT32[batch_size, 1, 100]}