flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mike Percy <mpe...@cloudera.com>
Subject Re: Call for documentation
Date Thu, 05 Jul 2012 06:55:48 GMT
Hi Ralph,
I saw your code review request but haven't had time to look at it yet. I'll
dig into it tomorrow.

Regards,
Mike

On Wednesday, July 4, 2012, Ralph Goers wrote:

> I am currently working on the web site. I believe that once that is in
> place both 1 and 2 will not be required.
>
> Ralph
>
> On Jul 4, 2012, at 7:40 AM, Mohammad Tariq wrote:
>
> > Hello Mike,
> >
> >      Before creating the JIRA, I need your green signal. Actually, I
> > just wanted to know if these things are worth mentioning in the
> > official documentation as they may seem very primitive to some of the
> > folks. For example, many newbies face following 4 problems quite often
> > :
> > 1 - Maven dependency problem.
> >     FIX : Use maven3 in place of maven2.
> >             We can also specify the maven version to be used in the
> > pom.xml file-
> >             <plugin>
> >
> <artifactId>maven-compiler-plugin</artifactId>
> >                               <configuration>
> >
> <executable>${JAVA_HOME}/bin/javac</executable>***
> >                               </configuration>
> >           </plugin>
> >
> > 2 - Out of resource issue while trying to build from trunk.
> >     FIX : Increase the memory before building the project -
> >     xport MAVEN_OPTS='-Xmx512m -XX:MaxPermSize=1024m'
> >
> > 3 - "hostname" directory is not getting created even after using the
> > %{host} sequence parameter.
> >     FIX : Using the  HDFS interceptor that adds a host header key to
> > each event, along with the corresponding hostname as the header value.
> >     Add the following lines in the configuration file to achieve this -
> >     agent.sources.tail.interceptors = hostint
> >     agent.sources.tail.interceptors.hostint.type =
> > org.apache.flume.interceptor.HostInterceptor$Builder
> >     agent.sources.tail.interceptors.hostint.preserveExisting = true
> >     agent.sources.tail.interceptors.hostint.useIP = false
> >
> > 4 - Unable to move data to the Hdfs and getting the following error -
> >     ERROR hdfs.HDFSEventSink: process failed
> > java.lang.NoSuchMethodError:
> > org.apache.hadoop.io.SequenceFile$Writer.syncFs()V
> >     FIX : Use a version of Hadoop that supports sync() operations,
> > which is required for sinks that flush periodically. Apache Hadoop
> > 0.20.205
> >     or higher or any CDH3 version for sync() support on 0.20.x/1.x
> > must be used.
> >
> > Regards,
> >    Mohammad Tariq
> >
> >
> > On Wed, Jul 4, 2012 at 1:14 AM, Mohammad Tariq <dontariq@gmail.com>
> wrote:
> >> Sure Mike..And thanks again for the support and valuable guidance.
> >>
> >> Regards,
> >>    Mohammad Tariq
> >>
> >>
> >> On Tue, Jul 3, 2012 at 10:05 PM, Mike Percy <mpercy@apache.org> wrote:
> >>> No problem. If you decide to work on this, please feel free to create
> a JIRA
> >>> and post tentative patches if you want early feedback.
> >>>
> >>> Also, don't hesitate to ping me or send a message the list if you have
> any
> >>> questions.
> >>>
> >>> Regards,
> >>> Mike
> >>>
> >>>
> >>> On Tue, Jul 3, 2012 at 12:49 AM, Mohammad Tariq <dontariq@gmail.com>
> wrote:
> >>>>
> >>>> Thanks a lot for the pointers Mike. Since it is the first time I am
> >>>> trying something like this, so I needed these.
> >>>>
> >>>> Regards,
> >>>>    Mohammad Tariq
> >>>>
> >>>>
> >>>> On Tue, Jul 3, 2012 at 4:19 AM, Mike Percy <mpercy@apache.org>
wrote:
> >>>>> By the way - if you want guidance on how to submit a patch, this
page
> >>>>> should
> >>>>> help:
> >>>>>
> >>>>>
> <https://cwiki.apache.org/confluence/display/FLUME/How+to+Contribute#HowtoContribute-ProvidingPatches>

Mime
View raw message