flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Indrek Mäestu <Indrek.Mae...@nortal.com>
Subject decompress snappy file if it was left open in hdfs
Date Thu, 22 Jun 2017 10:06:23 GMT
We using flume ingestig data into HDFS.
Flume sink is configured fileType=CompressedStream and codeC=snappy
If on any reason flume agent dies or namenode (HA) restarts, flume current sink file will
left open - .tmp extension.
testfile.snappy.tmp for example.

Is there any way to decompress such file and get data back human readable form?
Or is there any tool to fix such files?
We can use any other compression too, if there is a way to fix such files.


View raw message