flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Zijad Purkovic <zijadpurko...@gmail.com>
Subject Re: Need help in writing to HDFS
Date Sat, 21 Jan 2012 23:46:45 GMT
instead of dfs sink try using:
collectorSink("hdfs://localhost:8020/home","some_filename")

On Sat, Jan 21, 2012 at 6:23 PM, DIPESH KUMAR SINGH
<dipesh.tech@gmail.com> wrote:
> Hi All,
>
> I am new to flume. I tried writing to HDFS through following command from
> command line and was able to successfully write in to HDFS:
>
>  flume node_nowatch -1 -s -n dump -c 'dump: text("/etc/services") |
> dfs("hdfs://localhost:8020/home/dservices.txt");'
>
> To try out the collector, I tried the following commands from multiconfig
> area of web interface :
>
> localhost: text("/etc/services") | agentSink("localhost",35853);
> localhost: collectorSource(35853) |
> dfs("hdfs://localhost:8020/home/dservices11.txt");
>
>
> I might be missing something basic in between.
> But, I am unable to write into HDFS, though the web interface displays the
> command has been "SUCCEEDED".
>
>
>
> Please guide, I wish to move data [ like plain text, PDF ] from a node to
> HDFS.
>
> Thanks!
>
> --
> Dipesh Kr. Singh
>
>
>
>



-- 
Zijad Purković
Dobrovoljnih davalaca krvi 3/19, Zavidovići
061/ 690 - 241

Mime
View raw message