livy-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kant kodali <kanth...@gmail.com>
Subject Re: is there anyway to speed up launching a job?
Date Fri, 01 Jun 2018 20:48:59 GMT
The nice thing about livy is it offers REST interface so when integrated
with frontend users normally expect fast response times so they can spawn
more streaming / batch jobs.

thanks!

On Fri, Jun 1, 2018 at 1:17 PM, Adrian Petrescu <apetresc@gmail.com> wrote:

> Just out of personal curiosity, what is the use-case here? Given the
> massive amount of overhead involved in running Spark jobs of any kind (on
> the order of minutes), I've never heard of anyone angsting over ~500ms of
> latency before.
>
> On Fri, Jun 1, 2018 at 3:01 PM kant kodali <kanth909@gmail.com> wrote:
>
>> Hi All,
>>
>> is there anyway to speed up launching a job? Right now it takes about >=
>> 500ms to launch a job via livy. Trying to see if I can get it under <10ms?
>>
>> Thanks!
>>
>

Mime
View raw message