flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Johny Rufus <jru...@cloudera.com>
Subject Re: Problema with JMS-Source and Kafka-Sink
Date Tue, 16 Jun 2015 23:49:13 GMT
Yes, each message in JMS is translated into one event. So you should be
able to see two messages when consuming from Kafka.
Can you use a logger sink instead of kafka sink and verify you are getting
two messages from the JMS source.


On Tue, Jun 16, 2015 at 6:16 AM, Guillermo Ortiz <konstt2000@gmail.com>

> So, If I consume many messages from JMS, each message is translated to one
> event?? how about when I write in Kafka with the Kafka Sink?
> 2015-06-16 13:25 GMT+02:00 Guillermo Ortiz <konstt2000@gmail.com>:
>> Hi,
>> I'm using a JMS-Source and Kafka-Sink
>> I read two message from a JMS-Source and the Kafka-Sink only puts one
>> message in Kafka, the join of these two messages. So, when I consume them,
>> I recieve these two message like one.
>> If I use a consumer of kafka I can see both messages with a newline
>> separator, but it's just one message not two.
>> I guess that it's not normal, right? What could it be happening? I have
>> been modifing the bachsizes and others properties although I don't think
>> that it should be important for this error.
>> Sorry for the subject but I wasn't sure about what to type to describe it.

View raw message