Normally you configure encryption in hdfs so it works automatically, rather than having each tool having to worry about it.
Otherwise, you will need to build your own custom sink 


On 7 December 2015 at 12:15, Ravi Kiran Aita <> wrote:




We are working on a prototype to aggregate logs and store them to HDFS on daily basis.

As per our requirements, we need to encrypt the data and store them to HDFS.


I don’t find any option in Flume HDFS sink for this.


Is there any way to encrypt the data at Flume HDFS sink before writing to HDFS?


Thanks in advance



Ravikiran Aita | Principal Software Engineer

EiQ Networks, Inc.

o: 91.402.311.6680 | p: 91.988.582.0680


"This email is intended only for the use of the individual or entity named above and may contain information that is confidential and privileged. If you are not the intended recipient, you are hereby notified that any dissemination, distribution or copying of the email is strictly prohibited. If you have received this email in error, please destroy the original message."