flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mike Percy <mpe...@cloudera.com>
Subject Re: Call for documentation
Date Thu, 05 Jul 2012 06:48:07 GMT
Mohammed,
That sounds fine, they sound like they would be in parts of a "getting
started" section. Please feel free create a Jira and submit a patch with
that stuff.

Regards,
Mike

On Wednesday, July 4, 2012, Mohammad Tariq wrote:

> Hello Mike,
>
>       Before creating the JIRA, I need your green signal. Actually, I
> just wanted to know if these things are worth mentioning in the
> official documentation as they may seem very primitive to some of the
> folks. For example, many newbies face following 4 problems quite often
> :
> 1 - Maven dependency problem.
>      FIX : Use maven3 in place of maven2.
>              We can also specify the maven version to be used in the
> pom.xml file-
>              <plugin>
>
> <artifactId>maven-compiler-plugin</artifactId>
>                                 <configuration>
>
> <executable>${JAVA_HOME}/bin/javac</executable>***
>                                 </configuration>
>             </plugin>
>
> 2 - Out of resource issue while trying to build from trunk.
>      FIX : Increase the memory before building the project -
>      xport MAVEN_OPTS='-Xmx512m -XX:MaxPermSize=1024m'
>
> 3 - "hostname" directory is not getting created even after using the
> %{host} sequence parameter.
>      FIX : Using the  HDFS interceptor that adds a host header key to
> each event, along with the corresponding hostname as the header value.
>      Add the following lines in the configuration file to achieve this -
>      agent.sources.tail.interceptors = hostint
>      agent.sources.tail.interceptors.hostint.type =
> org.apache.flume.interceptor.HostInterceptor$Builder
>      agent.sources.tail.interceptors.hostint.preserveExisting = true
>      agent.sources.tail.interceptors.hostint.useIP = false
>
> 4 - Unable to move data to the Hdfs and getting the following error -
>      ERROR hdfs.HDFSEventSink: process failed
> java.lang.NoSuchMethodError:
> org.apache.hadoop.io.SequenceFile$Writer.syncFs()V
>      FIX : Use a version of Hadoop that supports sync() operations,
> which is required for sinks that flush periodically. Apache Hadoop
> 0.20.205
>      or higher or any CDH3 version for sync() support on 0.20.x/1.x
> must be used.
>
> Regards,
>     Mohammad Tariq
>
>
> On Wed, Jul 4, 2012 at 1:14 AM, Mohammad Tariq <dontariq@gmail.com> wrote:
> > Sure Mike..And thanks again for the support and valuable guidance.
> >
> > Regards,
> >     Mohammad Tariq
> >
> >
> > On Tue, Jul 3, 2012 at 10:05 PM, Mike Percy <mpercy@apache.org> wrote:
> >> No problem. If you decide to work on this, please feel free to create a
> JIRA
> >> and post tentative patches if you want early feedback.
> >>
> >> Also, don't hesitate to ping me or send a message the list if you have
> any
> >> questions.
> >>
> >> Regards,
> >> Mike
> >>
> >>
> >> On Tue, Jul 3, 2012 at 12:49 AM, Mohammad Tariq <dontariq@gmail.com>
> wrote:
> >>>
> >>> Thanks a lot for the pointers Mike. Since it is the first time I am
> >>> trying something like this, so I needed these.
> >>>
> >>> Regards,
> >>>     Mohammad Tariq
> >>>
> >>>
> >>> On Tue, Jul 3, 2012 at 4:19 AM, Mike Percy <mpercy@apache.org> wrote:
> >>> > By the way - if you want guidance on how to submit a patch, this page
> >>> > should
> >>> > help:
> >>> >
> >>> >
> https://cwiki.apache.org/confluence/display/FLUME/How+to+Contribute#HowtoContribute-ProvidingPatches
> >>> >
> >>> > Regards,
> >>> > MIke
> >>> >
> >>> >
> >>> > On Mon, Jul 2, 2012 at 2:50 PM, Mike Percy <mpercy@apache.org>
> wrote:
> >>> >>
> >>> >> Hi Mohammad,
> >>> >> That's a great idea. Since you recently ran into such issues, please
> >>> >> feel
> >>> >> free to add that in to the User Guide and I would be happy to review
> >>> >> it.
> >>> >>
> >>> >> The RST source code for the User and Dev guides can be found here:
> >>> >>
> >>> >>
> >>> >>
> https://svn.apache.org/viewvc/incubator/flume/trunk/flume-ng-doc/sphinx/
> >>> >>
> >>> >> Regards,
> >>> >> Mike
> >>> >>
> >>> >>
> >>> >> On Mon, Jul 2, 2012 at 1:53 PM, Mohammad Tariq <dontariq@gmail.com>
> >>> >> wrote:
> >>> >>>
> >>> >>> Hello Mike,
> >>> >>>
> >>> >>>          How about adding a "common errors and possible solutions"
> >>> >>> section?? Many of the newbies like me faced a few hiccups while
> trying
> >>> >>> to build and use Flume-NG for the first time. It would be pretty
> >>> >>> useful for people like me. But it's just a suggestion from
my side.
> >>> >>> Pardon me if it sounds too childish. I am actually very new
to the
> >>> >>> open source world. Many thanks.
> >>> >>>
> >>> >>> Regards,
> >>> >>>     Mohammad Tariq
> >>> >>>
> >>> >>>
> >>> >>> On Mon, Jul 2, 2012 at 11:02 PM, Mike Percy <mpercy@apache.org>
> wrote:
> >>> >>> > Hi Flume users & devs,
> >>> >>> > Now that we have branched in preparation for a Flume 1.2.0
> release,
> >>> >>> > we
> >>> >>> > have
> >>> >>> > one week to improve the documentation coverage and find
any major
> >>> >>> > issues
> >>> >>> > before RC0.
> >>> >>> >
> >>> >>> > Looking at the docs, we are missing coverage on several
key
> >>> >>> > components,
>

Mime
View raw message