flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From beeshma r <beeshm...@gmail.com>
Subject Re: Flume got stopped with lifecycle.LifecycleSupervisor
Date Thu, 06 Aug 2015 16:46:48 GMT
HI

i Found this piece of clue

15/08/05 09:44:50 INFO hbase.AsyncHBaseSink: waiting on callback
15/08/05 09:44:50 INFO zookeeper.ClientCnxn: Opening socket connection to
server localhost/127.0.0.1:2181. Will not attempt to authenticate using
SASL (unknown error)
15/08/05 09:44:50 INFO zookeeper.ClientCnxn: Socket connection established
to localhost/127.0.0.1:2181, initiating session
15/08/05 09:44:50 INFO zookeeper.ClientCnxn: Session establishment complete
on server localhost/127.0.0.1:2181, sessionid = 0x14efebe2a9a0008,
negotiated timeout = 6000
15/08/05 09:44:50 INFO async.HBaseClient: Connecting to .META. region @
127.0.1.1:60020
15/08/05 09:44:51 INFO zookeeper.ZooKeeper: Session: 0x14efebe2a9a0008
closed




So may i whats the reason for  error zookeeper.ClientCnxn: Opening socket
connection to server localhost/127.0.0.1:2181. Will not attempt to
authenticate using SASL (unknown error)  happened?

is this real error ?  I am new to Flume Can yo please guide me

On Thu, Aug 6, 2015 at 9:27 AM, beeshma r <beeshma48@gmail.com> wrote:

>
> Hi
>  i am trying to sink data from twitter source .
>
> This is my flume.conf
>
> #source
> ###############################################################
> TwitterAgent.sources = Twitter
> TwitterAgent.channels = MemChannel
> TwitterAgent.sinks = HbaseOut
> TwitterAgent.sources.Twitter.type=MyTwitterSourceForFlume
> TwitterAgent.sources.Twitter.channels = MemChannel
> ###############################################################
> #chennal
> ###############################################################
> TwitterAgent.channels.MemChannel.type = memory
> TwitterAgent.channels.MemChannel.capacity = 10000
> TwitterAgent.channels.MemChannel.transactionCapacity = 100
> ###############################################################
> # HBase sink config
> ###############################################################
> TwitterAgent.sinks.HbaseOut.type =
> org.apache.flume.sink.hbase.AsyncHBaseSink
> TwitterAgent.sinks.HbaseOut.channel =MemChannel
> TwitterAgent.sinks.HbaseOut.table=Fallowers_table
> TwitterAgent.sinks.HbaseOut.columnFamily=Fallowers_det
> TwitterAgent.sinks.HbaseOut.batchSize = 5000
> TwitterAgent.sinks.HbaseOut.serializer = TwitterSplittingSerializer
>
>
> ConsumerKey,ConsumerSecret,AccessToken and AuthAccessTokenSecret
> hardcoded  in Source part
>
>  Here issue is flume process stopped with Info
>
> 15/08/04 10:11:59 INFO lifecycle.LifecycleSupervisor: Stopping lifecycle supervisor 10
>
> Here i attached log from flume run
>
> is there any configuration issue with flume.conf? or issue with hbase
> serializer?
>
> So how do i debug this ?
>
>
>
>
>
> --
>
>
>
>
>
>


--

Mime
View raw message