flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sverre Bakke <sverre.ba...@gmail.com>
Subject HDFSSink, one file per exact hour
Date Thu, 23 Apr 2015 18:00:32 GMT

Is it possible to configure the HDFS Sink so that one file is created
per hour with rollover to a new file exactly on the hour every time?

e.g. 00:00:00 - 00:59:59 is stored in one file, 01:00:00 - 01:59:59 in
the next file, then 02:00:00 - 02:59:59, etc.

This to ensure that all files within the same hour can be quickly
located on the file system.


View raw message