flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arun Gujjar <arungujjart...@yahoo.com>
Subject How to convert *.bz2.tmp to *.bz2 file after restating the instance
Date Tue, 11 Nov 2014 23:35:19 GMT

Whenever we restart flume agent it creates a new HDFS file and start writing the data into
that file. The earlier file which was created will still be left as *bz2.tmp and from HIVE
queries we found that we were not able to read the data from this file.Here are the two questions
I have .
1. Could you please suggest how we can convert this bz2.tmp to bz2 file? because we loose
this data i.e. present in bz2.tmp file today. 
2. Is there as way to configure flume to start writing the data into the existing bz2.tmp
file instead of creating a new file?

Can someone please answer this?

View raw message