Monday, 1 August 2016

LzoCodec Not Found: NiFi Accesses HDFS Issue

NiFi can read HDFS by GetHDFS, and write to HDFS by PutHDFS.

In both Configure, set /etc/hadoop/conf/hdfs-site.xml and core-site.xml and separated by comma.



Compression codec com.hadoop.compression.lzo.LzoCodec not found:

Actually, lzo is located in 


Check to see if the following line exists in “io.compression.codecs” property,
and if it does remove it from the “core-site.xml” file:


Or set LD_LIBRARY_PATH to include the location of the .so files for the LZO codec, before starting NiFi service

export LD_LIBRARY_PATH=/usr/hdp/ 
bin/ start


No comments:

Post a Comment