flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Z├╝lke <david.zue...@bitextender.com>
Subject Re: problem with fanout sink
Date Mon, 10 Oct 2011 23:38:30 GMT
> Hello:
> 
> So I'm having problems configuring a fanout sink.  Here's what I have for my collector
config:
> 
> config [ip-10-88-101-167.ec2.internal, collectorSource(35853), collectorSink("hdfs://flume-logs/%Y%m%d/","%H00-%{tailSrcFile}-%{host}-"),
collectorSink("file:///flume-logs/%Y%m%d/","%H00-%{tailSrcFile}-%{host}-")]
> 
> So the command succeeds, but never actually writes anything to the second sink listed.
 So if hdfs is listed as the first sink, all collected events sink there, and none get copied
to the second.
> 
> Am I doing something wrong?  CDH3 for everything...

Fanout sinks are listed in square brackets, so I think you ned to do:

collectorSource(35853), [ collectorSink(...), collectorSink(...) ]

- David



Mime
View raw message