livy-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Wandong Wu <>
Subject Re: Some questions about RscDriver
Date Tue, 17 Jul 2018 02:35:22 GMT

	Thank you for your response. I want to know how this component communicate with each other.
So, RscDriver communicate with Spark Driver through RPC? Right? 
	Is there a protocol between RscClient and RscDriver?


> On Jul 17, 2018, at 08:49, Meisam Fathi <> wrote:
> Within an interactive session, Livy communicate with Spark through RPC. According to
some architecture diagrams, LivyServer has a RscClient, and Spark has a RscDriver. My understanding
is that RscDriver is one of components belonging to Spark, and RscDriver has existed before
the Livy project was created. Is that right? 
> No. RscDriver and RscClient are both part of Livy. RscDriver starts the Spark Driver.
RscDriver stars a Spark context, gets the statements from RscClient, runs them on SparkContext,
and returns the results to RscClient.
> Thanks,
> Meisam

View raw message