The Aster Spark API helps you write wrappers for functions to use in RunOnSpark queries. The API provides AsterSparkFunction abstract base classes and subclasses that encapsulate implementation details.
You can write processing code by extending an abstract base class, using the Scala programming language. You can derive functions to use with the RunOnSpark function from AsterSparkFunction subclasses. These subclasses encapsulate and hide the complexities of Aster-Spark interaction and data transfers. Tasks that these subclasses perform include:
- Processing arguments
- Connecting to RunOnSpark instances to get data and, if necessary, persist it
- Converting data types
- Connecting to RunOnSpark instances and returning results