Compatibility Matrix
The following tables compares teradatamlspk Column APIs with PySpark Column APIs.
teradatamlspk columns are case sensitive. You must convert the column names to the appropriate case while converting the code.
| API Name | Supported | Notes |
|---|---|---|
| isNull | ||
| isNotNull | ||
| like | ||
| ilike | ||
| rlike | Regex pattern varies from pyspark to teradatamlspk as Teradata uses posix for regex match. | |
| substr | ||
| startswith | ||
| endswith | ||
| contains | ||
| bitwiseAND | ||
| bitwiseOR | ||
| bitwiseXOR | ||
| between | ||
| isin | ||
| cast | Not Supported types are [BooleanType, BinaryType, TimestampNTZType, ArrayType, StructType, MapType]. Accepts format argument while casting character data to TimestampType. |
|
| astype | Not Supported types are [BooleanType, BinaryType, TimestampNTZType, ArrayType, StructType, MapType]. Accepts format argument while casting character data to TimestampType. |
|
| alias | ||
| desc | ||
| over | ||
| name | ||
| asc | ||
| when | ||
| otherwise | ||
| asc_nulls_first | ||
| asc_nulls_last | ||
| desc_nulls_first | ||
| desc_nulls_last | ||
| eqNullSafe |