flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kowshik Prakasam <kows...@gmail.com>
Subject Re: Accessing Flume Shell via RPC
Date Sun, 11 Mar 2012 04:09:02 GMT
Thanks for the info.

Flume's source code exposes a Java
interface: com.cloudera.flume.util.AdminRPC interface
and its Thrift implementation class: com.cloudera.flume.util.AdminRPCThrift
Using these two, I wrote my own Java REST server with Jersey that exposes
the Flume shell via
REST to my client.


On Sat, Mar 10, 2012 at 7:58 PM, Rajalakshmi Ramesh <rrajalakshmi@gatech.edu
> wrote:

> The programmatic way of doing something like what you have described needs
> some coding on your part. If you want to do it via scripting language,it
> may be possible to take the thrift ddl file mastercontrol.trift and
> implement your own client. This would mean reimplementing the
> FlumeShelll.java and FlumeMasterAdminServer.java file for reference.
> A link i bumped across when i wanted to do a mixed client/server with
> Thrift and Ruby.
> http://saladwithsteve.com/2008/04/my-first-thrift-app.html
> Thanks & Regards
> Rajalakshmi (Raji) Ramesh
> -------------------------------------------------------
> Georgia Institute of Technology
> Atlanta, GA
> -------------------------------------------------------
> On Fri, Mar 2, 2012 at 2:20 PM, Jay Stricks <jay@wapolabs.com> wrote:
>> Maybe this isn't helpful, but you can execute a script within a Flume
>> shell by using the -s flag when starting the Flume shell, in combination
>> with the -c flag (which you use to specify which master to connect to). So
>> you could append commands to a file and then execute the script all in one
>> shot.  Might not be what you were looking for though.
>> Jay S.
>> On Fri, Mar 2, 2012 at 1:04 PM, Kowshik Prakasam <kowshik@gmail.com>wrote:
>>> Hi all,
>>> From a flume master, I'm making a bulk of config changes to flume
>>> agents running in
>>> a cluster. Firing a flume shell command every time for each change is a
>>> very slow process.
>>>  Is there a way that I can programatically connect to the flume master
>>> to issue RPC
>>> calls that can mimic the flume shell?
>>> -Kowshik

View raw message