User Guide Changes and Additions | Teradata pyspark2teradataml 20.00.00.02 - Changes and Additions - Teradata Package for Python

Teradata® pyspark2teradataml User Guide

Deployment
VantageCloud
VantageCore
Edition
Enterprise
IntelliFlex
VMware
Product
Teradata Package for Python
Release Number
20.00
Published
December 2024
ft:locale
en-US
ft:lastEdition
2024-12-18
dita:mapPath
oeg1710443196055.ditamap
dita:ditavalPath
ayr1485454803741.ditaval
dita:id
oeg1710443196055
Product Category
Teradata Vantage
The table lists changes and additions in this release of the Teradata pyspark2teradataml User Guide.
Date Release Description
December 2024 20.00.00.02
  • PySpark to Vantage Migration updates:
    • Two new examples added to support script directory and notebooks
    • All examples moved to a examples_pyspark2teradataml_migration.zip file, available as an attachment to this guide
  • Examples updates:
    • Example added for cast, write orc File, write json File, writeTo create, writeTo createOrReplace, writeTo replace, writeTo append, writeTo partitionedBy, and RegexTokenizer
    • Examples removed for contains, endswith, startswith, ilike, like, isNotNull, isNull functions
  • Supportability matrix updates:
    • SparkSQL:
      • New UDF functions added
      • Support updates
    • MLLib (DataFrame-Based) API: RegexTokenizer marked as Supported
August 2024 20.00.00.01
  • Examples updates:
    • Examples for write saveAsTable and write insertInto were added
    • Examples for agg were updated
  • Supportability matrix updates:
    • Input information added for DataFrameWriter and DataFrameWriterV2 classes
    • Column APIs cast and alias updated with support information
    • GroupedData.agg updated with support information
    • DataFrame APIs fillna, DataFrameFunctions.fill, and agg updated with support information
    • MLLib (DataFrame-Based) API: metricName attribute for MulticlassClassificationEvaluator updated with support metric information
    • MLLib (DataFrame-Based) APIs: weightedFalsePositiveRate and weightedTruePositiveRate attributes marked as Supported for the following APIs:
      • LinearSVCSummary
      • LinearSVCTrainingSummary
      • LogisticRegressionSummary
      • LogisticRegressionTrainingSummary
      • BinaryLogisticRegressionSummary
      • BinaryLogisticRegressionTrainingSummary
      • MultilayerPerceptronClassificationSummary
      • MultilayerPerceptronClassificationTrainingSummary
      • RandomForestClassificationSummary
      • RandomForestClassificationTrainingSummary
      • BinaryRandomForestClassificationSummary
      • BinaryRandomForestClassificationTrainingSummary
March 2024 20.00.00.00 Initial release.