livy-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harsch, Tim" <>
Subject Re: Spark scala examples
Date Sun, 27 May 2018 20:28:01 GMT
Hi Nirav,
There are a few ways to use Livy: Shared sessions and Batch sessions are covered in the REST
API docs ( and wrote
some cool articles.  I created a little bash framework for testing out some example code I
found at GetHue here:    Pointers
to the articles are in the README.  Livy also has a programmatic API you’ve probably seen
already ( )

With the shared session type “spark” the code that you execute with the Livy REST API
is pretty much exactly what you would execute in a spark-shell.  There are a lot of examples
via Google about running spark-shell and they translate well to running in Livy.


From: Nirav Patel <>
Reply-To: "" <>
Date: Friday, May 25, 2018 at 11:25 PM
To: "" <>
Subject: Spark scala examples


Can anyone point me to any spark-scala examples using livy as a spark jobserver? I am trying
to understand how much existing spark based work (rdd, dataframe based transformations) we
can leverage when using livy. seems like all but it'd be nice to see examples.


[Image removed by sender. What's New with Xactly]<>

[Image removed by sender.]<>  [Image removed by
sender.] <>   [Image removed by sender.]
<>   [Image removed by sender.] <>
  [Image removed by sender.] <>
View raw message