flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From lancexxx <fervent.li...@gmail.com>
Subject hdfs sink output mojibake
Date Fri, 02 Nov 2012 03:16:06 GMT
I got a error seems mojibake.



this is my flume.conf,is it any wrong?
---------
agent.sources = source1
agent.channels = channel1
agent.sinks = sink1

agent.channels.channel1.type = memory
agent.channels.channel1.capacity = 100000
agent.channels.channel1.transactionCapacity = 8000
agent.channels.channel1.keep-alive = 3

agent.sources.source1.type = avro
agent.sources.source1.bind = 0.0.0.0
agent.sources.source1.port = 4141
agent.sources.source1.channels = channel1



agent.sinks.sink1.type = hdfs
agent.sinks.sink1.hdfs.path = hdfs://flume:9000/g
agent.sinks.sink1.hdfs.fileType = DataStream
agent.sinks.sink1.hdfs.rollInterval = 300
agent.sinks.sink1.hdfs.rollSize = 0
agent.sinks.sink1.hdfs.rollCount = 0
agent.sinks.sink1.hdfs.batchSize = 1000
agent.sinks.sink1.serializer = AVRO_EVENT
agent.sinks.sink1.serializer.compressionCodec = snappy
agent.sinks.sink1.channel = channel1
-------------


--
lancexxx


Mime
View raw message