flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eran Kutner <e...@gigya.com>
Subject Re: Any experence using Flume-Thrift -C#
Date Thu, 15 Sep 2011 07:29:32 GMT
As fr as I know duplication is only a problem with you use certain file
sources. I don't think you would see this problem when sending events
directly to flume using thrift.

-eran



On Wed, Sep 14, 2011 at 23:58, Jonathan <jonny2112@gmail.com> wrote:

> It is all slowly starting to make sense, thanks for all your help. I am not
> sure if I commented this out somewhere in the code sample that you gave me
> but do you have any tips on reducing duplication being sent across Flume?
>
> Jonathan
>
>
>
> On Wed, Sep 14, 2011 at 2:59 AM, Eran Kutner <eran@gigya.com> wrote:
>
>> This class is a wrapper around a Flume event. You can see the declaration
>> of the actual flume event as a member: Thrift.ThriftFlumeEvent evt;
>> To get the actual flume event thrift classes in C# you need to compile the
>> thrift interface definition using the thrift compiler, the thrift compiler
>> will generate the C# code for you. In order to use it you wil also need to
>> include the Thrift assembly in your project.
>>
>> -eran
>>
>>
>>
>> On Tue, Sep 13, 2011 at 22:39, Jonathan <jonny2112@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Thank you so much for the code snippet it has been really helpful in
>>> trying to figure this all out. I am still trying to figure out where exactly
>>> you tell Thrift what data to move and where exactly you create the event.
>>>
>>> Thanks for your help,
>>> Jonathan
>>>
>>>
>>>
>>> On Tue, Sep 13, 2011 at 2:19 AM, Eran Kutner <eran@gigya.com> wrote:
>>>
>>>> Hi Jonathan,
>>>> You can see some code here. You will not be able to compile this class
>>>> as is, because it is has quite a few internal dependencies. It also does
>>>> quite a few things more than just send event to Flume, but it should be
>>>> enough to give you an idea of how to code something like that for yourself.
>>>> If you can't figure out how to compile the flume thrift definition to C#
>>>> code, let me know and I'll send you the compiled code.
>>>>
>>>> -eran
>>>>
>>>>
>>>>
>>>> On Mon, Sep 12, 2011 at 23:01, Jonathan <jonny2112@gmail.com> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> In my never end quest to find more information about flume, does anyone
>>>>> know of any code examples of Flume communicating with the .net framework
via
>>>>> thrift? Or even any good documentation on using thrift in .net? Either
would
>>>>> be invaluable for me to continue to evaluate Flume.
>>>>>
>>>>> As always thanks in advance for your help.
>>>>> Jonathan
>>>>>
>>>>
>>>>
>>>
>>
>

Mime
View raw message