Limitations and Considerations | Teradata pyspark2teradataml - Limitations and Considerations - Teradata VantageCloud Lake

Lake - Analyze Your Data with ClearScape Analytics™
Deployment
VantageCloud
Edition
Lake
Product
Teradata VantageCloud Lake
Release Number
Published
February 2025
ft:locale
en-US
ft:lastEdition
2026-02-20
dita:mapPath
tcl1683670667798.ditamap
dita:ditavalPath
pny1626732985837.ditaval
dita:id
tcl1683670667798

Limitations and considerations when using the teradatamlspk package.

  • PySpark Resilient Distributed Dataset (RDD) based APIs are not applicable for Teradata Vantage.

    Because PySpark stores data in RDD format and Vantage stores in different format.

  • PySpark streaming APIs are not supported.
  • pandas style DataFrame APIs offered by PySpark are not supported.