livy-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Meisam Fathi <meisam.fa...@gmail.com>
Subject Re: job execution logs
Date Mon, 25 Jun 2018 20:29:03 GMT
If you are using YARN the driver logs are always available at YARN resource
manager.
You can also see the logs from /sessions/{sessionid}/logs

Thanks,
Meisam

On Sun, Jun 24, 2018 at 1:37 PM Abbass <amarouni@talend.com> wrote:

> Guys any idea about where Livy keeps job execution logs (Spark driver
> logs) ?
>
> I saw a couple of lines here :
>
> https://github.com/apache/incubator-livy/blob/master/server/src/main/scala/org/apache/livy/server/batch/BatchSession.scala#L90
> to redirect stdout & stderr somewhere.
>
> Is there anyway to persist these logs on the filesystem ?
>
> Thanks,
>
> As a recipient of an email from Talend, your contact personal data will be
> on our systems. Please see our contacts privacy notice at Talend, Inc. <
> https://www.talend.com/contacts-privacy-policy/>
>
>
>

Mime
View raw message