Using the LZO Parcel
This section describes how to install and use the LZO parcel in Cloudera Manager 4.6 or later.
The Repository
Add the appropriate repository to Cloudera Manager’s list of parcel repositories. The HADOOP_LZO parcel will then become available on the parcel management screen. If required, the repository can be mirrored in the same way as the CDH repo.
The public customer repository can be found at: http://archive.cloudera.com/gplextras/parcels/latest.
Activation
The HADOOP_LZO parcel can be downloaded/distributed/activated in the same way as the CDH parcel. Once activated, it will be necessary to reconfigure and restart services that intend to use LZO functionality.
MapReduce
- Add the following entries to the MapReduce Client Environment Safety
valve:
- Under the Configuration > View and Edit tab, search for "MapReduce Client Safety".
- In the MapReduce Client Environment Safety Valve, enter the following two lines:
- HADOOP_CLASSPATH=$HADOOP_CLASSPATH:/opt/cloudera/parcels/HADOOP_LZO/lib/hadoop/lib/*
- JAVA_LIBRARY_PATH=$JAVA_LIBRARY_PATH:/opt/cloudera/parcels/HADOOP_LZO/lib/hadoop/lib/native
- Add the LZO codecs to the io.compression.codecs property under the MapReduce Service:
- Save your configuration changes.
- Restart MapReduce.
- Redeploy MapReduce Client Configuration.
Oozie
- Go to /var/lib/oozie on each Oozie server and
symlink the hadoop lzo jar.
- /opt/cloudera/parcels/HADOOP_LZO/lib/hadoop/lib/hadoop-lzo-cdh4-0.4.15-gplextras.jar
- Restart Oozie.

Note
Any service that does not require the use of LZO need not be configured. For example, if you are not using HBase, you do not need to do anything to the safety valve.