Data Collector Sample Rates - Teradata Ecosystem Manager

Teradata Ecosystem Manager Installation, Configuration, and Upgrade Guide for Customers

Product
Teradata Ecosystem Manager
Release Number
15.11
Published
May 2016
Language
English (United States)
Last Update
2018-05-03
dita:mapPath
may1467305870890.ditamap
dita:ditavalPath
3203_ICUCustomer_em_1511.ditaval.ditaval
dita:id
B035-3203
lifecycle
previous
Product Category
Analytical Ecosystem
Teradata Viewpoint uses a sample rate to collect data from the system and uses a retention policy to keep the collected data for a time period or up to a certain size. The sample rate and retention policy vary for each data collector and most can be adjusted as needed.

Not applicable under the Initial Retention Policy column indicates that data collector does not store data.

Teradata Data Collectors

Teradata Data Collector Recommended Sample Rate Initial Retention Policy
Account Info 12 hours 1 week
Alert Request 5 minutes Not applicable
AWT Info 60 seconds 1 year
Database Space 1 day 10 GB
Dictionary 1 hour Not applicable
Disk Space 1 hour 1 year
Elastic Limit 60 seconds 1 year
Elastic Usage 1 hour 1 year
Lock Info 1 hour 10 GB
Query Count DBQLFlushRate value from the DBS Control utility display command, otherwise 1 hour 10 GB
Query Log Within an hour after the PDCR daily job completes
  • 2 years for summary data
  • 14 days for detail data
Resource Usage Node/Vproc logging rate as set in Monitor Rates, otherwise 1 hour 10 GB
Sessions Session sampling rate as set in Monitor Rates, otherwise 30 seconds 10 GB
Stats Manager 1 hour 3 months
System Config 12 hours 1 week
System Stats Node/vproc collection as set in Monitor Rates, otherwise 30 seconds 1 year
Table Space 1 day 10 GB
TASM Config 10 minutes None (both disabled)
TASM Distribution 60 seconds 1 year
TASM Exception Sample rate returned by PM/API TDWM Summary, otherwise 60 seconds 1 year
TASM State 60 seconds 1 year
TASM Summary Sample rate returned by PM/API TDWM Summary, otherwise 60 seconds 1 year
Virtual Storage 12 hours 1 year

Aster Data Collectors

Aster Data Collector Recommended Sample Rate Initial Retention Policy
Cluster Status 10 seconds 1 year
Component Stats 30 seconds 1 year
Nodes 5 minutes 1 year
Processes 10 seconds 10 GB
Rulesets (Database 15.0 and later) 10 minutes Not applicable
Space Usage 1 day 10 GB
System Config 12 hours 10 GB
Workloads 1 hour 1 year

Teradata Hadoop Data Collectors

The range of allowed values for the sample rate of the Hadoop data collectors are 15-3600 seconds.

Teradata Hadoop Data Collector Recommended Sample Rate Initial Retention Policy
HBase 60 seconds 1 year
HDFS 60 seconds 10 GB
MapReduce (HDP 1.3) 60 seconds 10 GB
Services 60 seconds 10 GB
System Config 5 minutes Not applicable
System Stats 60 seconds 10 GB
YARN (CDH and HDP 2.1 and later) 60 seconds 10 GB

Teradata Presto Data Collectors

Teradata Presto Data Collector Recommended Sample Rate Initial Retention Policy
Queries 30 seconds 1 year or 10 GB

Teradata QueryGrid Data Collectors

Teradata QueryGrid Data Collector Recommended Sample Rate Initial Retention Policy
Issues 30 seconds 1 year or 10 GB
Queries Query summary frequency as set in Managers > Settings in the QueryGrid portlet, otherwise 30 seconds 1 year or 10 GB
System Config 12 hours Not applicable

RainStor Data Collectors

RainStor Data Collector Recommended Sample Rate Initial Retention Policy
Archives refreshRate as reported by the RainStor zone metrics API 10 GB
Components refreshRate as reported by the RainStor components API 10 GB
Nodes refreshRate as reported by the RainStor hosts API 10 GB
Storage 1 hour 1 GB
System Config 12 hours 1 year
Tasks refreshRate as reported by the RainStor tasks API 10 GB