flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pritchard, Charles X. -ND" <Charles.X.Pritchard....@disney.com>
Subject flume and hadoop append
Date Wed, 09 Apr 2014 01:35:58 GMT
Exploring the idea of using “append” instead of creating new files with HDFS every few
minutes.
Are there particular design decisions / considerations?

There’s certainly a history of append with HDFS, mainly, earlier versions of Hadoop warn
strongly against using file append semantics.


-Charles
Mime
View raw message