livy-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Saisai Shao <sai.sai.s...@gmail.com>
Subject Re: Globally Unique/ User defined session Ids
Date Fri, 04 May 2018 02:44:36 GMT
I think we already supported single node HA for Livy by using incremented
session id? Can you please elaborate your scenario and advantages of using
GUID?

Thanks
Jerry

Alex Bozarth <ajbozart@us.ibm.com> 于2018年5月4日周五 上午4:13写道:

> This sounds similar to a previous email chain from a few months ago. I
> think your answer may be in there.
> https://lists.apache.org/thread.html/36c67f57fd3b1fcc9f99c8f894b23618703c1141b32f1dd2a6f7f183@%3Cuser.livy.apache.org%3E
>
>
> *Alex Bozarth*
> Software Engineer
> Center for Open-Source Data & AI Technologies
> ------------------------------
> *E-mail:* *ajbozart@us.ibm.com* <ajbozart@us.ibm.com>
> *GitHub: **github.com/ajbozarth* <https://github.com/ajbozarth>
>
>
> 505 Howard Street
> San Francisco, CA 94105
> United States
>
>
>
> [image: Inactive hide details for Praveen Muthusamy ---05/03/2018 06:21:00
> AM---Hi, Is there support for sessionId to be GUID for batch]Praveen
> Muthusamy ---05/03/2018 06:21:00 AM---Hi, Is there support for sessionId to
> be GUID for batch usecase ? or can the
>
> From: Praveen Muthusamy <praveen.gct@gmail.com>
> To: user@livy.incubator.apache.org
> Date: 05/03/2018 06:21 AM
> Subject: Globally Unique/ User defined session Ids
> ------------------------------
>
>
>
> Hi,
>
> Is there support for sessionId to be GUID for batch usecase ? or can the
> sessionId be made to be user-defined.
>
> This will be useful for uniquely identifying sessions across restarts or
> crashes. We are maintaining client side mappings to session Id and restart
> / HA scenarios will make this session Id irrelevant.
>
> Found this Jira ticket *https://issues.cloudera.org/browse/LIVY-367*
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.cloudera.org_browse_LIVY-2D367&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=S1_S7Dymu4ZL6g7L21O78VQZ53vEnAyZ-cx37DPYDyo&m=Onn0e4C-5gH0jWfUH1XG46L-pvZJyMDBxSVS5WclJco&s=wuMUW6eBerWR8krUF4LSe8fnvBEeXOhbceSkcczasyk&e=>
> , but no further comments on it.
>
> It would be good if there is an option to assign GUID for a session,
> similar to Yarn AppId, which will be unique for certain extent.
>
> Please suggest what is the best way to maintain sessionIds across restarts
> or HA scenarios ?
>
> Regards,
> Praveen M
>
>
>
>

Mime
View raw message