Teradata Package for R Function Reference | 17.00 - tdFillNa - Teradata Package for R - Look here for syntax, methods and examples for the functions included in the Teradata Package for R.

FillNa

Description

tdFillNa() allows user to perform missing value/null replacement transformations.
Note:

• Object of this class is passed to "fillna" argument of td_transform_valib().

Usage

tdFillNa(columns=NULL, datatype=NULL, style="mean", value=NULL)

Arguments

columns	Optional Argument. Specifies name(s) of column(s) containing the input and output column names, where key is the name of the column to perform transformation on and value contains the name of the transformed output column. When only key is specified then output column name is the name of input column. Types: character OR list of Strings (character)
datatype	Optional Argument. Specifies the name of the intended datatype of the output column. Intended data types for the output column can be specified using the permitted strings below: ------------------------------------ --------------------------------------- If intended SQL Data Type is Permitted Value to be passed is ------------------------------------ --------------------------------------- bigint bigint byteint byteint char(n) char,n date date decimal(m,n) decimal,m,n float float integer integer number(*) number number(n) number,n number(*,n) number,*,n number(n,n) number,n,n smallint smallint time(p) time,p timestamp(p) timestamp,p varchar(n) varchar,n Notes: Argument is ignored if "columns" argument is not used. char without a size is not supported. number(*) does not include the * in its datatype format. Examples: If intended datatype for the output column is 'bigint', then pass string 'bigint' to the argument as shown below: datatype="bigint" If intended datatype for the output column is 'decimal(3,5)', then pass string 'decimal,3,5' to the argument as shown below: datatype="decimal,3,5" Types: character
style	Optional Argument. Specifies the nullstyle for missing value/null value replacement. A literal value, the mean, median, mode, or an imputed value joined from another object of class tbl_teradata can be used as the replacement value. The median value can be requested with or without averaging of two middle values when there is an even number of values. Literal value replacement is supported for numeric, character, and date data types. Mean value replacement is supported for columns of numeric type or date type. Median without averaging, mode, and imputed value replacement are valid for any supported type. Median with averaging is supported only for numeric and date type. Permitted Values: 'literal', 'mean', 'median', 'mode', 'median_wo_mean', 'imputed' Default Value: 'mean' Types: character
value	Optional Argument. Required when "style" is 'literal' or 'imputed'. Specifies the value to be used for null replacement transformations. Notes: When "style" is 'imputed', "value" must be an object of class tbl_teradata. When "style" is 'literal', "value" can be of any type. If date values are entered, the keyword 'DATE' must precede the date value, and cannot be enclosed in single quotes. For example, value='DATE 1987-06-09' Types: tbl_teradata, logical, integer, numeric, character

Value

An object of tdFillNa class.

Examples

# Notes:
# 1. To run any transformation, user needs to use td_transform_valib()
#    function.
# 2. To do so set option 'val.install.location' to the database name
#    where Vantage analytic library functions are installed.
# 3. Datasets used in these examples can be loaded using Vantage Analytic
#    Library installer.

# Get the current context/connection
con <- td_get_context()$connection

# Set the option 'val.install.location'.
options(val.install.location = "SYSLIB")

# Create object(s) of class "tbl_teradata".
sales <- tbl(con, "sales")
sales

employee_info <- tbl(con, "employee_info")
employee_info

# Example 1: Replace missing values in columns 'Jan' and 'Mar', with
#            a literal value 0. Output columns are named as 'january' and
#            'march' respectively.
#            Perform the missing value transformation using
#            td_transform_valib() function from Vantage Analytic Library.

# Create tdFillNa object.
fillna_literal <- tdFillNa(style="literal", value=0,
                           columns=list("Jan"="january", "Mar"="march"))

# Perform the missing value transformation using td_transform_valib().
obj <- td_transform_valib(data=sales, fillna=fillna_literal,
                          key.columns="accounts")
obj$result

# Example 2: Replace missing values in column 'Jan' with 'median' value from
#            that column. Output column produced in the output is named as
#            'Jan2'.
#            Perform the missing value transformation using
#            td_transform_valib() function from Vantage Analytic Library.

# Create tdFillNa object.
fillna_median <- tdFillNa(style="median", columns=list("Jan"="Jan2"))

# Perform the missing value transformation using td_transform_valib().
obj <- td_transform_valib(data=sales, fillna=fillna_median,
                          key.columns="accounts")
obj$result

# Example 3: Replace missing values in column 'Apr' with a median value
#            without mean from that column.
#            Perform the missing value transformation using
#            td_transform_valib() function from Vantage Analytic Library.

fillna_mwm <- tdFillNa(style="median_wo_mean", columns="Apr")

# Perform the missing value transformation using td_transform_valib().
obj <- td_transform_valib(data=sales, fillna=fillna_mwm,
                          key.columns="accounts")
obj$result

# Example 4: Replace missing values in column 'Apr' with 'mode' value from
#            that column. Output column produced in the output is named as
#            'Apr2000'.
#            Perform the missing value transformation using
#            td_transform_valib() function from Vantage Analytic Library.

fillna_mode <- tdFillNa(style="mode", columns=list("Apr"="Apr2000"))

# Perform the missing value transformation using td_transform_valib().
obj <- td_transform_valib(data=sales, fillna=fillna_mode,
                          key.columns="accounts")
obj$result

# Example 5: Replace missing values in columns 'masters' and 'programming'
#            using 'imputed' style.
#            Perform the missing value transformation using
#            td_transform_valib() function from Vantage Analytic Library.

# Create object(s) of class "tbl_teradata".
admissions_train_nulls <- tbl(con, "admissions_train_nulls")
admissions_train_nulls

admissions_train <- tbl(con, "admissions_train")
admissions_train

# Replace NULL values in the columns 'masters' and 'programming'
# in admissions_train_nulls dataframe with the values in the corresponding
# column's values in admissions_train dataframe.
fillna_imputed <- tdFillNa(style="imputed", value=admissions_train,
                           columns=c("masters", "programming"))

# Perform the missing value transformation using td_transform_valib().
obj <- td_transform_valib(data=admissions_train_nulls, fillna=fillna_imputed,
                          key.columns="id")
obj$result

# Example 6: This example shows how one can operate on date and character
#            columns. Example also showcases using multiple missing value
#            treatment techniques in one single call for variable
#            transformation.

# Create object(s) of class "tbl_teradata".
employee_info <- tbl(con, "employee_info")

# Using literal style for missing value treatment on a date type
# column 'joined_date.'
fillna_1 <- tdFillNa(style="literal", value="DATE 1995-12-23",
                     columns=list("joined_date"="date1"))

# Using literal style for missing value treatment on a character type
# column 'first_name'. Replace missing values with 'FNU', i.e.,
# First Name Unknown.
fillna_2 <- tdFillNa(style="literal", value="FNU",
                     columns=list("first_name"="char1"))

# Using mean value for missing value treatment on a date type
# column 'joined_date'.
fillna_3 <- tdFillNa(style="mean", columns=list("joined_date"="date2"))


# Using median value for missing value treatment on a date type
# column 'joined_date'.
fillna_4 <- tdFillNa(style="median", columns=list("joined_date"="date2A"))

# Using median value without mean for missing value treatment on a date type
# column 'joined_date'.
fillna_5 <- tdFillNa(style="median_wo_mean",
                     columns=list("joined_date"="date3"))
# Using mode value for missing value treatment on a date type
# column 'joined_date'.
fillna_6 <- tdFillNa(style="mode", columns=list("joined_date"="date4"))

# Using median value without mean for missing value treatment on a character
# type column 'first_name'.
fillna_7 <- tdFillNa(style="median_wo_mean",
                     columns=list("first_name"="char2"))

# Using mode value for missing value treatment on a character type column
# 'first_name'.
fillna_8 <- tdFillNa(style="mode", columns=list("first_name"="char3"))

# Perform the missing value transformations using td_transform_valib().
obj <- td_transform_valib(data=employee_info,
                          fillna=c(fillna_1, fillna_2, fillna_3, fillna_4,
                                   fillna_5, fillna_6, fillna_7, fillna_8),
                          key.columns="employee_no")
obj$result