Limitations and Considerations | Teradata pyspark2teradataml - Limitations and Considerations - Teradata Package for Python

Teradata® pyspark2teradataml User Guide

Deployment
VantageCloud
VantageCore
Edition
Enterprise
IntelliFlex
VMware
Product
Teradata Package for Python
Release Number
20.00
Published
December 2024
ft:locale
en-US
ft:lastEdition
2024-12-18
dita:mapPath
oeg1710443196055.ditamap
dita:ditavalPath
ayr1485454803741.ditaval
dita:id
oeg1710443196055
Product Category
Teradata Vantage

Limitations and considerations when using the teradatamlspk package.

  • PySpark Resilient Distributed Dataset (RDD) based APIs are not applicable for Teradata Vantage.

    Because PySpark stores data in RDD format and Vantage stores in different format.

  • PySpark streaming APIs are not supported.
  • pandas style DataFrame APIs offered by PySpark are not supported.