Zeppelin

General

• apache incubator: zeppelin
• ZeppelinHub
• Moon’s email: moon@nflabs.com
• IBM Data Scientist Workbench - Support

Configuration

If you wish to configure Zeppelin option (like port number), configure the following files:

• ./conf/zeppelin-env.sh
• ./conf/zeppelin-site.xml

Interpreters

rinterpreter

• blog.sparkiq-labs.com: Interactive Data Science with R in Apache Zeppelin Notebook
• github.com: elbamos: incubator-zeppelin (rinterpreter)

install

mvn clean package -Pspark-1.5 -Phadoop-2.4 -Pyarn -Ppyspark -DskipTests

Zeppelin-R

• stackoverflow.com: Anyone tried to add R interpreter onto Apache Zeppelin?
• github: datalayer: zeppelin-R

install

mvn install -DskipTests

run

bin/zeppelin.sh start

Docker

• registry.hub.docker.com: datalayer: zeppelin-rserve

Build Docker Image

• github: zeppelin-docker

start docker daemon

$ sudo service docker start

run after building

navigate to folder zeppelin-rscala and run $ ./zeppelin-docker-start

stop container before restart

$ sudo docker rm zeppelin-rscala > /dev/null (included in zeppelin-docker-start script but not executing properly)

Pre-build Docker Image

• docker pull epahomov/docker-zeppelin hub.docker.com: epahomov/docker-zeppelin
• hub.docker.com: datalayer: zeppelin-rscala

start docker daemon

$ sudo service docker start

install

sudo docker pull datalayer/zeppelin-rserve

run zeppelin-rserve

sudo docker run -it -p 2222:22 -p 8080:8080 -p 4040:4040 datalayer/zeppelin-rserve
open browser at localhost:8080

run zeppelin-rscala

sudo docker run -it -p 2222:22 -p 8080:8080 -p 4040:4040 datalayer/zeppelin-rscala

run with data volume mounted

sudo docker run -it -p 2222:22 -p 8080:8080 -p 4040:4040 --privileged=true -v ~/Downloads/ML_for_Hackers:/home/dataayer/ML_for_Hackers:ro datalayer/zeppelin-rscala
need --privileged==true option to access mounted files

connect from shell

$ sshpass -p datalayer ssh root@localhost -p 2222 or use R program /Dropbox/Programming/R/programs/ML_for_Hackers/zeppelin/init.R

specify mirror to install packages

> install.packages("tm", repos = "http://cran.us.r-project.org")

Helium

%helium run

Status: Undergoing Incubation

Apache Zeppelin is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.

---

---

Published

29 October 2015

Category

datascience