Zeppelin-with-R on Mesos

[janduracz]

Hi, wondering about the Mesos support in the current master HEAD.

Built with -Dspark-1.6 and configured zeppelin-env.sh as follows:

MASTER as the mesos/zk quorum
SPARK_HOME as an unpacked spark-1.6.0-bin-hadoop2.6
SPARK_EXECUTOR_URI as an hdfs hosted tar of the former

When running the first spark demo note:

%spark.r

When R returns a data.frame, it will be displayed using Zeppelin's built-in interactive visualizations.

data(faithful)
faith <- createDataFrame(sqlContext, faithful)
registerTempTable(faith, "faithful")
ed <- sql(sqlContext, "SELECT * from faithful")
SparkR:::head(ed)

I get this error:

data(faithful)

faith <- createDataFrame(sqlContext, faithful)

registerTempTable(faith, "faithful")

<simpleError in registerTempTable(faith, "faithful"): error in evaluating the argument 'x' in selecting a method for function 'registerTempTable': Error: object 'faith' not found

ed <- sql(sqlContext, "SELECT * from faithful")

SparkR:::head(ed)

<simpleError in SparkR:::head(ed): error in evaluating the argument 'x' in selecting a method for function 'head': Error: object 'ed' not found

Is this expected or am I perhaps missing something in the configuration?

Thanks for reporting! That's definitely not the expected behavior. To repeat from the other thread, I'd appreciate if you could run each of those commands in a separate cell, and report the result along with the log for the session.

[elbamos]

@janduracz I wanted to follow-up and see if you could provide the logging information I'd asked for, or if you'd manage to resolve this issue otherwise? Thanks.