hadoop - Unable to run hive queries using spark engine -
i have set below properties in hive shell
set hive.execution.engine=spark; set spark.home=/home/kiran/spark-1.5.1-bin-hadoop2.6; set spark.master = spark://acd-kiran:7077; set spark.eventlog.enabled = true; set spark.eventlog.dir=/home/kiran/spark-1.5.1-bin-hadoop2.6/spark-events; set spark.executor.memory=512m; set spark.serialzer = org.apache.spark.serializer.kryoserializer;
when trying execute query includes map reduce job, getting error
failed execute spark task, exception 'java.lang.illegalstateexception(rpc channel closed.)' failed: execution error, return code 1 org.apache.hadoop.hive.ql.exec.spark.sparktask
can help?
Comments
Post a Comment