Limitations and Considerations | Teradata pyspark2teradataml - Limitations and Considerations - Teradata Vantage

Teradata® VantageCloud Lake
Deployment
VantageCloud
Edition
Lake
Product
Teradata Vantage
Published
January 2023
ft:locale
en-US
ft:lastEdition
2024-12-11
dita:mapPath
phg1621910019905.ditamap
dita:ditavalPath
pny1626732985837.ditaval
dita:id
phg1621910019905

Limitations and considerations when using the teradatamlspk package.

  • PySpark Resilient Distributed Dataset (RDD) based APIs are not applicable for Teradata Vantage.

    Because PySpark stores data in RDD format and Vantage stores in different format.

  • PySpark streaming APIs are not supported.
  • pandas style DataFrame APIs offered by PySpark are not supported.