flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tao Li <litao.bupt...@gmail.com>
Subject [KafkaSource] Write timestamp in the header
Date Tue, 14 Apr 2015 16:50:10 GMT
Hi all:

I found that KafkaSource will put "System.currentTimeMillis()" as
"timestamp" field in header. If we use HDFSEventSink, the HDFS log can be
rotate by the timestamp.

But the web server log usually contains "timestamp" string, and it indicate
the true timestamp, other than "System.currentTimeMillis()". So I think if
have a feature to allow to customarize the "timestamp" field, will be
better.

Mime
View raw message