flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jyotsna G <jyotsn...@gmail.com>
Subject Query regarding customizing baseNameHeader value
Date Wed, 27 Jun 2018 12:00:44 GMT

I have a spoolDir flume agent configured and the source path contains ":"
colon character in it which results in the below exception while writing in
to HDFS.

java.lang.IllegalArgumentException: Pathname
from hdfs://slc15zcc:8020/TPA_PAAS/*20180626.01:21:14*
/IDCS-CertificateAnalysis.csv.1530084044272.tmp* is not a valid DFS


What's the best way to work around this issue?

1) Is there a flume interceptor which I can configure to edit the
baseNameHeader value in the header?

2) Should I build a custom interceptor to remove/replace the colon
character in the basenameHeader?

Thanks & Regards,

View raw message