livy-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Meisam Fathi <meisam.fa...@gmail.com>
Subject Re: Some questions about RscDriver
Date Tue, 17 Jul 2018 00:49:16 GMT
>
>
> Within an interactive session, Livy communicate with Spark through RPC.
> According to some architecture diagrams, LivyServer has a RscClient, and
> Spark has a RscDriver. My understanding is that RscDriver is one of
> components belonging to Spark, and RscDriver has existed before the Livy
> project was created. Is that right?
>
> No. RscDriver and RscClient are both part of Livy. RscDriver starts the
Spark Driver. RscDriver stars a Spark context, gets the statements from
RscClient, runs them on SparkContext, and returns the results to RscClient.


Thanks,
Meisam

>

Mime
View raw message