- Except for CSV, DataFrameReader will read the files from cloud storage only. Reading the files from local is not supported for files other than CSVs. DataFrameReader uses ReadNos from teradataml to load the data to DataFrame.
All the arguments for teradataml ReadNos can be passed as options.
- DataFrameReader.csv can read the file either from local file system or from cloud storage. If the specified CSV exists in local file system, DataFrameReader uses teradataml read_csv to load the data in to a DataFrame. Else, DataFrameReader.csv considers the file is in a cloud storage and uses teradataml ReadNos.
- DataFrameWriter can store data in any cloud storage with correct id and password.
Once uploaded, there are no options to delete, overwrite, or append. You must update data at a new path.
| Function Name | Supported | Notes |
|---|---|---|
| DataFramerReader.csv | ||
| DataFramerReader.format | ||
| DataFramerReader.json | ||
| DataFramerReader.load | ||
| DataFramerReader.option | ||
| DataFramerReader.parquet | ||
| DataFramerReader.schema | ||
| DataFramerReader.table | ||
| DataFramerWriter.csv | Doesn't support mode parameter. | |
| DataFramerWriter.parquet | Doesn't support mode parameter. | |
| DataFramerWriter.save | ||
| DataFramerWriter.format | ||
| DataFramerWriter.options | options is same as teradataml WriteNOS function. | |
| DataFramerWriter.option | option is same as teradataml WriteNOS function. | |
| DataFramerWriter.insertInto | ||
| DataFramerWriter.saveAsTable | ||
| DataFramerWriterV2.append | ||
| DataFramerWriterV2.create | ||
| DataFramerWriterV2.replace | ||
| DataFramerWriterV2.createOrReplace |