flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Huang, Zijian(Victor)" <zijian.hu...@etrade.com>
Subject RE: can flume get incremental data from database(such as DB2)?
Date Tue, 27 Sep 2011 18:16:18 GMT
I am not aware of any SQL source in Flume. it only has  "tailing files" as a source right now.
you probably have to write your own. I don't think it is difficult to implement a simple one,
which read in records from a DB table and then serialized as Avro event and send it over to
the collectorSource

Vic


________________________________
From: lulynn_2008 [mailto:lulynn_2008@163.com]
Sent: Tuesday, September 27, 2011 12:03 AM
To: flume-user@incubator.apache.org
Subject: can flume get incremental data from database(such as DB2)?

  Hello,
If I want to transfer incremental data from database to HDFS. Can flume be the middle layer?
I mean flume get incremental data from database(such as DB2), and then transfer the data to
HDFS. Please give your suggestion. Thank you.



Mime
View raw message