flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ralph Goers <ralph.go...@dslextreme.com>
Subject Re: Call for documentation
Date Wed, 04 Jul 2012 14:54:15 GMT
I am currently working on the web site. I believe that once that is in place both 1 and 2 will
not be required.

Ralph

On Jul 4, 2012, at 7:40 AM, Mohammad Tariq wrote:

> Hello Mike,
> 
>      Before creating the JIRA, I need your green signal. Actually, I
> just wanted to know if these things are worth mentioning in the
> official documentation as they may seem very primitive to some of the
> folks. For example, many newbies face following 4 problems quite often
> :
> 1 - Maven dependency problem.
>     FIX : Use maven3 in place of maven2.
>             We can also specify the maven version to be used in the
> pom.xml file-
>             <plugin>
> 			        <artifactId>maven-compiler-plugin</artifactId>
> 			        <configuration>
> 			          <executable>${JAVA_HOME}/bin/javac</executable>***
> 			        </configuration>
> 	    </plugin>	
> 
> 2 - Out of resource issue while trying to build from trunk.
>     FIX : Increase the memory before building the project -
>     xport MAVEN_OPTS='-Xmx512m -XX:MaxPermSize=1024m'
> 
> 3 - "hostname" directory is not getting created even after using the
> %{host} sequence parameter.
>     FIX : Using the  HDFS interceptor that adds a host header key to
> each event, along with the corresponding hostname as the header value.
>     Add the following lines in the configuration file to achieve this -
>     agent.sources.tail.interceptors = hostint
>     agent.sources.tail.interceptors.hostint.type =
> org.apache.flume.interceptor.HostInterceptor$Builder
>     agent.sources.tail.interceptors.hostint.preserveExisting = true
>     agent.sources.tail.interceptors.hostint.useIP = false
> 
> 4 - Unable to move data to the Hdfs and getting the following error -
>     ERROR hdfs.HDFSEventSink: process failed
> java.lang.NoSuchMethodError:
> org.apache.hadoop.io.SequenceFile$Writer.syncFs()V
>     FIX : Use a version of Hadoop that supports sync() operations,
> which is required for sinks that flush periodically. Apache Hadoop
> 0.20.205
>     or higher or any CDH3 version for sync() support on 0.20.x/1.x
> must be used.
> 
> Regards,
>    Mohammad Tariq
> 
> 
> On Wed, Jul 4, 2012 at 1:14 AM, Mohammad Tariq <dontariq@gmail.com> wrote:
>> Sure Mike..And thanks again for the support and valuable guidance.
>> 
>> Regards,
>>    Mohammad Tariq
>> 
>> 
>> On Tue, Jul 3, 2012 at 10:05 PM, Mike Percy <mpercy@apache.org> wrote:
>>> No problem. If you decide to work on this, please feel free to create a JIRA
>>> and post tentative patches if you want early feedback.
>>> 
>>> Also, don't hesitate to ping me or send a message the list if you have any
>>> questions.
>>> 
>>> Regards,
>>> Mike
>>> 
>>> 
>>> On Tue, Jul 3, 2012 at 12:49 AM, Mohammad Tariq <dontariq@gmail.com> wrote:
>>>> 
>>>> Thanks a lot for the pointers Mike. Since it is the first time I am
>>>> trying something like this, so I needed these.
>>>> 
>>>> Regards,
>>>>    Mohammad Tariq
>>>> 
>>>> 
>>>> On Tue, Jul 3, 2012 at 4:19 AM, Mike Percy <mpercy@apache.org> wrote:
>>>>> By the way - if you want guidance on how to submit a patch, this page
>>>>> should
>>>>> help:
>>>>> 
>>>>> https://cwiki.apache.org/confluence/display/FLUME/How+to+Contribute#HowtoContribute-ProvidingPatches
>>>>> 
>>>>> Regards,
>>>>> MIke
>>>>> 
>>>>> 
>>>>> On Mon, Jul 2, 2012 at 2:50 PM, Mike Percy <mpercy@apache.org>
wrote:
>>>>>> 
>>>>>> Hi Mohammad,
>>>>>> That's a great idea. Since you recently ran into such issues, please
>>>>>> feel
>>>>>> free to add that in to the User Guide and I would be happy to review
>>>>>> it.
>>>>>> 
>>>>>> The RST source code for the User and Dev guides can be found here:
>>>>>> 
>>>>>> 
>>>>>> https://svn.apache.org/viewvc/incubator/flume/trunk/flume-ng-doc/sphinx/
>>>>>> 
>>>>>> Regards,
>>>>>> Mike
>>>>>> 
>>>>>> 
>>>>>> On Mon, Jul 2, 2012 at 1:53 PM, Mohammad Tariq <dontariq@gmail.com>
>>>>>> wrote:
>>>>>>> 
>>>>>>> Hello Mike,
>>>>>>> 
>>>>>>>         How about adding a "common errors and possible solutions"
>>>>>>> section?? Many of the newbies like me faced a few hiccups while
trying
>>>>>>> to build and use Flume-NG for the first time. It would be pretty
>>>>>>> useful for people like me. But it's just a suggestion from my
side.
>>>>>>> Pardon me if it sounds too childish. I am actually very new to
the
>>>>>>> open source world. Many thanks.
>>>>>>> 
>>>>>>> Regards,
>>>>>>>    Mohammad Tariq
>>>>>>> 
>>>>>>> 
>>>>>>> On Mon, Jul 2, 2012 at 11:02 PM, Mike Percy <mpercy@apache.org>
wrote:
>>>>>>>> Hi Flume users & devs,
>>>>>>>> Now that we have branched in preparation for a Flume 1.2.0
release,
>>>>>>>> we
>>>>>>>> have
>>>>>>>> one week to improve the documentation coverage and find any
major
>>>>>>>> issues
>>>>>>>> before RC0.
>>>>>>>> 
>>>>>>>> Looking at the docs, we are missing coverage on several key
>>>>>>>> components,
>>>>>>>> so
>>>>>>>> this is a ripe opportunity for new contributors come in and
submit a
>>>>>>>> patch
>>>>>>>> or two. The plan is still to begin the release vote on Monday,
July
>>>>>>>> 9,
>>>>>>>> and I
>>>>>>>> know some folks in the U.S. plan on taking a few days off
this week
>>>>>>>> for
>>>>>>>> Independence Day, so if you want to contribute, please get
them in
>>>>>>>> early so
>>>>>>>> the available committers can review the patches and commit
them.
>>>>>>>> 
>>>>>>>> Committers - please commit any changes to the trunk as usual,
and
>>>>>>>> I'll
>>>>>>>> be
>>>>>>>> happy to backport applicable doc updates, build fixes, or
any
>>>>>>>> critical
>>>>>>>> bug
>>>>>>>> fixes to the release branch. Just send a note to the list.
>>>>>>>> 
>>>>>>>> Looking forward to a great 1.2.0 release!
>>>>>>>> 
>>>>>>>> Regards,
>>>>>>>> Mike
>>>>>>>> 
>>>>>> 
>>>>>> 
>>>>> 
>>> 
>>> 


Mime
View raw message