Category Archives: apache-zeppelin

Apache Zeppelin 0.7.0 on Windows 10 – Issue with interpreters

  1. I downloaded the binary package with all interpreters.
  2. I then unzipped the filed and opened a command prompt, cd'd into the folder and typed bin\zeppelin.cmd because I'm using Windows 10.
  3. The zeppelin server starts and I navigate to http:localhost:8080/ and can see the introductions and tutorials.
  4. I go to create a new note and see that spark is listed as an interpreter binding for the note - great!
  5. I type in sc.version and click run and I get 'error' with no output.
  6. I get errors on the tutorials as well....nothing works.

The looked in the logs folder and there is no file found. The error no longer shows on the screen so I don't know what my error is. The Jobs section has a red dot for the job but no additional details. I'm not getting anything useful in the command line output.

What am I missing? I have generally always had issues with the interpreters, either on linux or windows. I've tried Windows 7 SP1 and Linux Ubuntu 14, as well as EMR with a reverse proxy and had interpreter connection issues in every case. Do I need to set my JAVA_HOME or any other environment variable in Windows 10? Is there an instruction missing in the quick start? How are you guys getting this up and running in any OS! Any help would be great!

Apache zeppelin unable to fetch URL from Amazon S3 notebook json file

Hi I am unable to import a notebook from amazon S3 after following tutorials and instructions on AWS site. Specifically, 1. I have a notebook created by Zeppelin in S3, 2. I have spun up a cluster with Zepplin, Spark, etc. installed 3. I provided a JSON configuration file on creating the EC2 clusters so that Zeppelin would save files to my S3 bucket:

[ { "Classification": "zeppelin-env", "Properties": {

},
"Configurations": [
  {
    "Classification": "export",
    "Properties": {
    "ZEPPELIN_NOTEBOOK_STORAGE":"org.apache.zeppelin.notebook.repo.S3NotebookRepo",
      "ZEPPELIN_NOTEBOOK_S3_BUCKET":"bucket-name",
      "ZEPPELIN_NOTEBOOK_USER":"user-name"
    },
    "Configurations": [

    ]
  }
]

} ]

  1. When I try to import a note on Zeppelin using the note URL provided by Amazon I get the error "Unable to fetch URL".

How to assigne roles to user in Zeppelin Notebook while using AD integration for login?

I am able to configure AD integration for user login to Hortonworks version of Zeppelin- Notebook. However, I am not sure as to how to assign admin privileges to certain user and some other privilege to certain.
eg. I want to limit some user to have only hive access to zeppelin and another user to have only Spark.
Zeppelin version 0.6.0 HDP version 2.5.0

Install Apache Zeppelin binary on Ubuntu Linux

I'm trying to install Apache Zeppelin and various interpreters on Ubuntu Linux using AWS EC2. Below are my steps for the binary and from source.

SSH through Putty as [email protected]

wget http://mirrors.gigenet.com/apache/zeppelin/zeppelin-0.6.2/zeppelin-0.6.2.tgz sudo tar -zxf zeppelin-0.6.2.tgz cd zeppelin-0.6.2 sudo bin/zeppelin-daemon.sh start

It gives me the following status in the cli

Zeppelin start [OK] Zeppelin process died [FAILED]

I then tried to install build from source using the following:

sudo apt-get update sudo apt-get install git sudo apt-get install openjdk-7-jdk sudo apt-get install npm sudo apt-get install libfontconfig git clone https://github.com/apache/zeppelin.git apt-cache search maven sudo apt-get install maven export MAVEN_OPTS="-Xmx2g -XX:MaxPermSize=1024m" mvn -version

I use the java home directory and set the environment variable for JAVA_HOME by

export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64/jre

cd into zeppelin folder and then run

mvn clean package -Pspark-2.0 -Phadoop-2.4 -Pyarn -Ppyspark -Psparkr -Pscala-2.11

And it builds Zeppelin but fails at the next Zeppelin: Interpreter

How do I get her to work without going to AWS EMR? Thanks in advance.

Install Apache Zeppelin on Linux

I have been trying to configure Apache Zeppelin on my Ubuntu 16.04.1 LTS over 15 times now without success. I even reinstalled the whole OS and tried again. Initially I was trying to build it from binary files but using a custom Spark and Scala version, but although I was following all the steps in the tutorial I wasn't able to do so as the interpreters were not being configured properly.

Afterwards I tried following the readme file from here https://github.com/apache/zeppelin. and build it from source using:

mvn clean package -DskipTests -Pspark-2.0 -Phadoop-2.6 -Pscala-2.10 -Pyarn -Ppyspark -Psparkr -Pr 

but when I was going to my local host the status appeared to be disconnected, so I tried again and again.

1) Currently I am getting a build fail error stating that

npm WARN unmet dependency which is version 2.2.1

although my current version of npm is 3.5.1

Additionally I have to admit that I am a complete beginner in Linux OS, and through out the configuration process I think I:

2) installed a various number of java version. So as a second question how would I downgrade for the current version(openjdk version "1.8.0_91") to a lower one, how would I detect any corrupt installations/ duplicates.

3) on a previous unsuccessful configuration I set the zeppelin port to 8082, how can I terminate the process as I deleted the previous files before killing the process.
I already tried with fuser 8082/tcp or with kill -9 <PID> but without any success yet

Any help would be much appreciated.

Installing R on Apache Zeppelin

I'm trying to install Apache Zeppelin on my old computer that runs Ubuntu. So far, I'm able to install Zeppelin very easily by cloning the latest 0.6.0 snapshot release using

git clone https://github.com/apache/incubator-zeppelin.git
cd incubator-zeppelin
mvn clean package -DskipTests

but I want to have R on Zeppelin. Supposedly, the 0.6.0 snapshot has two R interpreters, but when I run the R tutorial (the pre-made note that uses %r), I get this list of errors.

I followed several guides to try and install R as an interpreter, but each one resulted in some kind of error. I tried this instructional: http://www.r-bloggers.com/interactive-data-science-with-r-in-apache-zeppelin-notebook/, and got a build failure on "R Interpreter". The error message was

"dependency 'evaluate' is not available for package 'rzeppelin' 
* removing '/home/rebecca/Zeppelin-With-R/R/lib/rzeppelin'"

and then a bit lower down

Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2.1:exec (default) on project zeppelin-zrinterpreter: Command execution failed. Process exited with an error: 1

I also tried this Stack Overflow guide: Anyone tried to add R interpreter onto Apache Zeppelin?, and while I was able to run incubator-zeppelin, I received an error when I used either the %spark.r or %r interpreter tags, saying both "interpreter not found" and "prefix not found". Spark doesn't work either after following the first solution, getting the same error mentioned in the second solution (the jar file not being there), and then trying the second solution.

Does anyone have a guide for installing R onto the newest version of Zeppelin? I'm very flexible in the way I can install it. I can run other operating systems onto my computer, and I also have Virtual Box installed on my other computer, which is a mac.

zeppelin interpreter error even after giving correct details

getting the below error

and i have given mysql settings in the interpreter:

com.mysql.jdbc.Driver jdbc:mysql://:3306/ username and password

restarted interpreter and binded it, but still get the error

using commands: use and select commands

enter code herejava.lang.NullPointerException
at org.apache.zeppelin.postgresql.PostgreSqlInterpreter.executeSql(PostgreSqlInterpreter.java:201)
at org.apache.zeppelin.postgresql.PostgreSqlInterpreter.interpret(PostgreSqlInterpreter.java:288)
at org.apache.zeppelin.interpreter.ClassloaderInterpreter.interpret(ClassloaderInterpreter.java:57)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:300)
at org.apache.zeppelin.scheduler.Job.run(Job.java:169)
at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:134)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)

Apache Zeppelin – Highcharts

I am trying Apache zeppelin . I wanted to have highcharts. So I thought of using %html interpreter. I have done this

print("%html <h3> Hello World!! </h3>")

It perfectly works. Know I have the code for highcharts

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<title>Untitled Document</title>

<script type="text/javascript" src="http://ajax.googleapis.com/ajax/libs/jquery/1.3.2/jquery.min.js"></script>
<script type="text/javascript" src="http://www.highcharts.com/js/highcharts.js"></script>
<script type="text/javascript" src="http://code.highcharts.com/highcharts.js"></script>


<script type="text/javascript">

    $(function () {
        $('#container').highcharts({
            chart: {
                plotBackgroundColor: null,
                plotBorderWidth: null,
                plotShadow: false
            },
            title: {
                text: 'Browser market shares at a specific website, 2010'
            },
            tooltip: {
                pointFormat: '{series.name}: <b>{point.percentage}%</b>',
                percentageDecimals: 1
            },
            plotOptions: {
                pie: {
                    allowPointSelect: true,
                    cursor: 'pointer',
                    dataLabels: {
                        enabled: true,
                        color: '#000000',
                        connectorColor: '#000000',
                        formatter: function() {
                            return '<b>'+ this.point.name +'</b>: '+ this.percentage +' %';
                        }
                    }
                }
            },
            series: [{
                type: 'pie',
                name: 'Browser share',
                data: [
                    ['Firefox',   45.0],
                    ['IE',       26.8],
                    {
                        name: 'Chrome',
                        y: 12.8,
                        sliced: true,
                        selected: true
                    },
                    ['Safari',    8.5],
                    ['Opera',     6.2],
                    ['Others',   0.7]
                ]
            }]
        });
    });
</script>
</head>

<body>
    <div id="container" style="min-width: 400px; height: 400px; margin: 0 auto"></div>
</body>
</html>

But How could I put both together. I tried searching for samples but no help. Kindly someone help.

Apache Zeppelin behind a reverse proxy

I'm playing around with apache Zeppelin and want to put it behind a simple reverse apache 2 proxy. The problem is, I don't know if I proxy correctly all the routes. For instance, the /ws route represent the websocket server used by zeppelin and can't be reached in a GET request.

Here is my Apache2 conf:

    ProxyPass / http://localhost:8080
    ProxyPassReverse / http://localhost:8080
    ProxyPass /api http://localhost:8080/api
    ProxyPassReverse /api http://localhost:8080/api
    ProxyPass /styles http://localhost:8080/styles
    ProxyPassReverse /styles http://localhost:8080/styles
    ProxyPass /assets http://localhost:8080/assets
    ProxyPassReverse /assets http://localhost:8080/assets
    ProxyPass /scripts http://localhost:8080/scripts
    ProxyPassReverse /scrits http://localhost:8080/scripts
    ProxyPass /components http://localhost:8080/components
    ProxyPassReverse /components http://localhost:8080/components
    ProxyPass / http://localhost:8080
    ProxyPassReverse / http://localhost:8080
    ProxyPass /api http://localhost:8080/api
    ProxyPassReverse /api http://localhost:8080/api
    ProxyPass /styles http://localhost:8080/styles
    ProxyPassReverse /styles http://localhost:8080/styles
    ProxyPass /assets http://localhost:8080/assets
    ProxyPassReverse /assets http://localhost:8080/assets
    ProxyPass /scripts http://localhost:8080/scripts
    ProxyPassReverse /scrits http://localhost:8080/scripts
    ProxyPass /components http://localhost:8080/components
    ProxyPassReverse /components http://localhost:8080/components
    ProxyPass /fonts http://localhost:8080/fonts
    ProxyPassReverse /fonts http://localhost:8080/fonts

How can I proxy zeppelin correctly ? Or more precisely, how can I proxy the backend websocket?