Tuesday 11 November 2014

Permission denied: access=WRITE, inode="/tmp/hive-yarn"

INSERT INTO TABLE session1 PARTITION(year, month)

SELECT * FROM session2

FAILED: RuntimeException org.apache.hadoop.security.AccessControlException: Permission denied: user=a, access=WRITE, inode="/tmp/hive-yarn":b:supergroup:drwxr-xr-x
  at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkFsPermission(FSPermissionChecker.java:271)


Solution: 
SET hive.exec.scratchdir = /tmp/hive-${user.name}

Scratch space for Hive jobs, otherwise it will run as yarn.

If pig inserts to Hive table with this issue:
set hive.exec.scratchdir  /tmp/hive-${user.name}


Reference:
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties


10 comments:

  1. Greens Technology's. the leading software Training & placement centre Chennai & (Adyar)
    apple-ios training in chennai

    ReplyDelete
  2. • Article is good and interesting
    also visit my site.

    qtp training in chennai

    ReplyDelete
  3. • can any one suggest me about testing training institute with 100 % placement in adyar.
    oracle training inchennai

    ReplyDelete
  4. I want to encourage that you continue your great posts, have a nice weekend!
    iosh course in chennai

    ReplyDelete
  5. Thanks for making me this article. You have done a great job by sharing this content in here. Keep writing article like this.

    Cloud Training
    Cloud Training in Chennai

    ReplyDelete

  6. It’s great to come across a blog every once in a while that isn’t the same out of date rehashed material. Fantastic read.
    Machine Learning Training in Chennai |Machine Learning Training Institute in Chennai

    ReplyDelete