Monday 23 June 2014

Oozie Configuration

For CDH5.1 using MRv2

ERROR: HadoopAccessorException: E0900: Jobtracker [mymachine:8032] not allowed, not in Oozies whitelist

nameNode=hdfs://localhost.localdomain:8020
jobTracker=localhost.localdomain:8032

1. When you open Hue in Cloudera training VM, and find below error for Oozie,
/user/oozie/share/lib oozie sharelib not installed in default location

Configure Oozie share lib as following:

Installing the Oozie ShareLib in Hadoop HDFS

The Oozie installation bundles Oozie ShareLib, which contains all of the necessary JARs to enable workflow jobs to run streaming, DistCp, Pig, Hive, and Sqoop actions.
The Oozie installation bundles two shared libraries, one for MRv1 and one for YARN. Make sure you install the right one for the MapReduce version you are using:
  • The shared library file for MRv1 is oozie-sharelib.tar.gz.
  • The shared library file for YARN is oozie-sharelib-yarn.tar.gz.

$ hadoop fs -mkdir  /user/oozie
$ hadoop fs -chown training:training /user/oozie
$ mkdir /tmp/ooziesharelib
$ cd /tmp/ooziesharelib
$ tar xzf /usr/lib/oozie/oozie-sharelib.tar.gz
$ hadoop fs -put share /user/oozie/share
$ sudo service oozie start

Then, login Hue again, the error disappears.

2. Enable Oozie web console

Extract ext-2.2.zip into: /var/lib/oozie
Then, open http://localhost:11000/oozie


Reference:
http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/4.2.1/CDH4-Installation-Guide/cdh4ig_topic_17_6.html

http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH5/latest/CDH5-Installation-Guide/cdh5ig_oozie_install.html

No comments:

Post a Comment