load_into_imdc - Aster Execution Engine

The load_into_imdc function loads data from its input into an IMDC, which it creates, and reports the number of rows loaded into each partition.

Syntax

SELECT * FROM load_into_imdc (
  input
  imdc (imdc_name)
  [ imdcInMemSizeInMB ('memory_size') ]
);

Input

One or more sources of data to load into the IMDC. The inputs must meet the Semantic Requirements for SQL-MapReduce Functions.

Arguments

imdc

Specifies the name of the IMDC to create and load with data. If an IMDC with the specified name already exists, the function throws the exception InMemoryDataCollectionAlreadyExistsException.

imdcInMemSizeInMB

[Optional] Specifies amount of memory (MB) for the IMDC to use for each partition. If the IMDC data exceeds this amount, the extra data overflows to the disk. Default: 10 MB.

Schema of Created IMDC