flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mike Percy <mpe...@cloudera.com>
Subject Re: FlumeNG Error while going with Avro (Source) and HDFS (Sink)
Date Thu, 05 Jul 2012 19:00:57 GMT
On Wed, Jul 4, 2012 at 12:36 AM, Amit Handa <amithanda01@gmail.com> wrote:

>
>  1 c) hadoop version 0.20 is used
>

Because of the requirement for sync() in the HDFS sink, you must run an
appropriate version of Hadoop (HBase has the same requirement). Hadoop
0.20.2 will not work. Minimum compatible versions of Hadoop include:
branch-append, 0.20.205+, Hadoop 1.0.0+, and CDH3 / CDH4.

Regards,
Mike

Mime
View raw message