flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Denes Arvay <de...@cloudera.com>
Subject Re: morphline interceptor
Date Thu, 23 Feb 2017 20:56:58 GMT
Hi,

I'm not too familiar with morphlines but my first guess is that the value
of the outputFields should be an array. See:
http://kitesdk.org/docs/1.0.0/morphlines/morphlines-reference-guide.html#split
Or you might use "outputField" instead of "outputFields"

Regards,
Denes

On Mon, Feb 6, 2017 at 8:26 AM Alireza <alireza.shahriari@gmail.com> wrote:

> Hi I'm trying to use morphline inteceptor and convert my syslog to JSON
> for start i tried to use split command for splitting my string ,but im
> getting error as below:
>
>
>  Source r1 has been removed due to an error during configuration
> com.typesafe.config.ConfigException$WrongType:
> /root/flume.17/conf/morph.conf: 21: Cannot concatenate object or list with
> a non-object-or-list, ConfigString("split") and
> SimpleConfigObject({"outputFields":"substrings","inputField":"message","addEmptyStrings":false,"isRegex":false,"trim":true,"separator":"
> "}) are not compatible
>
> my morphline configuration file:
>
> morphlines : [
>   {
>     # Name used to identify a morphline. E.g. used if there are multiple
>     # morphlines in a morphline config file
>     id : morphline1
>
>     # Import all morphline commands in these java packages and their
>     # subpackages. Other commands that may be present on the classpath are
>     # not visible to this morphline.
>     importCommands : ["org.kitesdk.**"]
>
>     commands : [
>       {
>         # Parse input attachment and emit a record for each input
> line
>
>     readLine {
>           charset : UTF-8
>         }
>       }
>
>       ,split {
>       inputField : message
>       outputFields : "substrings"
>       separator : " "
>       isRegex : false
>
>       addEmptyStrings : false
>       trim : true          }
>         }
>       }
>
>
>     ]
>   }
> ]
>
>
>

Mime
View raw message