Installing and Configuring LZO Compression - Hortonworks Data Platform

Hortonworks Data Platform for Teradata® Installation, Configuration, and Upgrade Guidefor Customers

Product
Hortonworks Data Platform
Release Number
SLES 12
3.1.4
3.0.1
Published
November 30, 2019
Language
English (United States)
Last Update
2019-11-25
dita:mapPath
sxd1534538710975.ditamap
dita:ditavalPath
hdp_Hortonworks.ditaval.ditaval
dita:id
B035-6098
lifecycle
previous
Product Category
Open Source

The following procedure installs and configures the LZO compression libraries on Hortonworks Data Platform 3.1.4.

  1. Download the SLES 12 HDP-GPL tarball from the repository and copy to Master Node #1:
    The customer (NOT a Teradata representative) must download the HDP-GPL tarball. Teradata representatives may not download, install, or otherwise distribute software issued under the GPL license. Teradata representatives may assist customers who are installing (but not downloading or otherwise distributing) GPL licensed software by providing documentation, scripts, and even over-the shoulder guidance. Failure to abide by this directive can lead to disciplinary action. This directive is in effect so long as this tarball includes any component governed by the GPL license.
    1. Go to: https://docs.cloudera.com/HDPDocuments/Ambari-2.7.4.0/bk_ambari-installation/content/hdp_314_repositories.html.
    2. Look under SLES 12 for the URL for the tarball.
    3. Download the tarball.
    4. Copy the tarball to Master Node #1.
  2. From Master Node #1, extract the tarball to /data/htdocs. tar xvzf <tarball filename> -C /data/htdocs
  3. To enable and configure LZO compression, use the Hortonworks documentation and follow the instructions for these steps: https://docs.cloudera.com/HDPDocuments/Ambari-2.7.4.0/administering-ambari/content/amb_configuring_lzo_compression.html
    1. Enable LZO compression This step includes setting the location of the HDP-GPL repository. You need to update the base URL for the HDP-GPL repository in Ambari to point to the correct location on Master Node #1, created when you extracted the tarball. For example:

      http://Master_Node_#1_FQDN/HDP-GPL/sles12/HDP_Version-Build_Number

    2. Configure core-site.xml for LZO The last step in this section restarts Hadoop services. If the restart fails, run this command on Master Node #1 to restart the Ambari Agents, and try restarting the Hadoop services again:

      hcli node runonall 'ambari-agent restart'