authorize.AuthorizationException: User: livy is not allowed to impersonate

部署參考 livy安裝:https://cloud.tencent.com/developer/article/1349537

此外需要在hdfs core-site.xml 配置如下代理:

 
<property>
<name>hadoop.proxyuser.livy.groups</name>
<value>*</value>
<description>Allow the superuser livy to impersonate any members of the group group1 and group2</description>
</property>
<property>
<name>hadoop.proxyuser.livy.hosts</name>
<value>*</value>
<description>The superuser can connect only from host1 and host2 to impersonate a user</description>
</property>

如果不配置的話,會有
ERROR: org.apache.hadoop.security.authorize.AuthorizationException: User: livy is not allowed to impersonate xxx

該警告會影響任務的提交.

配置完成後,別忘了重啓hdfs,livy,yarn等

測試代碼參考:
https://mp.weixin.qq.com/s?__biz=MzI4OTY3MTUyNg==&mid=2247487686&idx=1&sn=2d64bcdb7cced159508fd98b7e1ad623&chksm=ec2ac0cfdb5d49d944bcb74173c8914c8a9fbda3743cde459aeb053253237875101558a8147e&scene=21#wechat_redirect

    String  user = "livy";
    HashMap<String, String> headers = new HashMap<>();
    headers.put("Content-Type", "application/json");
    headers.put("Accept", "application/json");
    headers.put("X-Requested-By", user);
    //創建一個交互式會話

// String kindJson = “{“kind”: “spark”, “proxyUser”:“livy”}”;
// HttpUtils.postAccess(LIVY_HOST + “/sessions”, headers, kindJson);

    //執行code
    String code = "{\"code\":\"sc.parallelize(1 to 2).count()\"}";
    HttpUtils.postAccess(LIVY_HOST + "/sessions/0/statements", headers, code);