flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jonathan <jonny2...@gmail.com>
Subject Issues with .tmp files in HDFS
Date Wed, 05 Oct 2011 17:00:43 GMT
Hey experts,

I have flume writing to a directory in hdfs. I then fire off a cron job to
move that data into hive every five minutes. The problem that I am having is
that the .tmp files are also moved and start causing errors on the collector
that is writing the files to hdfs. Is there any way to get rid of the .tmp
files or to have them in a different directory then the other files? Any
other suggestions on how I can work around this issue?

Jonathan

Mime
View raw message