phoenix-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mallieswari Dineshbabu <dmalliesw...@gmail.com>
Subject Re: Enabling Tracing makes HMaster service fail to start
Date Thu, 09 Nov 2017 09:57:57 GMT
Hi Elser,

Thanks for the update. I have tried with log4j.PROPERTIES as additional
option only. Let me remove the changes from log4j.PROPERTIES;

Regarding version compatibility, I hope I am using compatible version of
Phoenix and HBase. Please find the details below,
Hadoop - 2.7.2
HBase - 1.2.5
Phoenix - apache-phoenix-4.12.0-HBase-1.2/

Query:
Could you please suggest the compatible version of Phoenix for Hadoop 2.7.2
and HBase 1.2.5?

Regarding classpath, I have ensured that required classpath are updated
properly by running phoenix_utils.py; Except phoenix_classpath all other
variables has proper values.

Query:
Could you please tell what else I miss here regarding classpath?

Regards,
Mallieswari D

On Thu, Nov 9, 2017 at 12:00 AM, Josh Elser <elserj@apache.org> wrote:

> Please note that there is a difference between Phoenix Tracing and the
> TRACE log4j level.
>
> It appears that you're using a version of Phoenix which is incompatible
> with the version of HBase/Hadoop that you're running. The implementation of
> PhoenixMetricsSink is incompatible with the interface/abstract-class that
> HBase/Hadoop is expecting.
>
> This may be a classpath or Phoenix version issue, or you may have stumbled
> onto a bug.
>
> On 11/8/17 6:33 AM, Mallieswari Dineshbabu wrote:
>
>> Hi All,
>>
>> I am working with HBase-Phoenix, /everything works fine/. In addition
>> trying to enable Tracing <https://phoenix.apache.org/tracing.html> in
>> Phoenix with the following steps,
>>
>>  1. Copy ‘hadoop-metrics2-hbase.PROPERTIES’ from Phoenix package to
>>     HBase conf folder.
>>  2. ‘hadoop-metrics2-phoenix.PROPERTIES’ file will be in ‘Phoenix/bin’
>>     location by default. So I left it as it is.
>>  3. Add the following property to phoenix configuration,
>>
>> <property>
>>
>>     <name>phoenix.trace.frequency</name>
>>
>>    <value>always</value>
>>
>> </property>
>>
>> After doing the above, HBase’s HMaster fails to start with the following
>> exception; Please tell if you have any suggestion on this,
>>
>> 2017-11-08 16:46:56,118 INFO  [main] regionserver.RSRpcServices:
>> master/Selfuser-VirtualBox/172.16.203.117:60000 <
>> http://172.16.203.117:60000> server-side HConnection retries=140
>>
>> 2017-11-08 16:46:56,520 INFO  [main] ipc.SimpleRpcScheduler: Using
>> deadline as user call queue, count=3
>>
>> 2017-11-08 16:46:56,554 INFO  [main] ipc.RpcServer:
>> master/Selfuser-VirtualBox/192.16.203.117:60000 <
>> http://192.16.203.117:60000>: started 10 reader(s) listening on
>> port=60000
>>
>> *2017-11-08 16:46:56,839 INFO  [main] impl.MetricsConfig: loaded
>> properties from hadoop-metrics2-hbase.properties*
>>
>> *2017-11-08 16:46:56,926 INFO  [main] trace.PhoenixMetricsSink: Writing
>> tracing metrics to phoenix table*
>>
>> *2017-11-08 16:46:56,933 ERROR [main] master.HMasterCommandLine: Master
>> exiting*
>>
>> *java.lang.RuntimeException: Failed construction of Master: class
>> org.apache.hadoop.hbase.master.HMaster. *
>>
>> *at org.apache.hadoop.hbase.master.HMaster.constructMaster(
>> HMaster.java:2512)*
>>
>>
>> at org.apache.hadoop.hbase.master.HMasterCommandLine.startMaste
>> r(HMasterCommandLine.java:231)
>>
>> at org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMaste
>> rCommandLine.java:137)
>>
>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>>
>> at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(Server
>> CommandLine.java:126)
>>
>> at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2522)
>>
>> Caused by: java.lang.AbstractMethodError: org.apache.phoenix.trace.Phoen
>> ixMetricsSink.init(Lorg/apache/commons/configuration/SubsetC
>> onfiguration;)V
>>
>> at org.apache.hadoop.metrics2.impl.MetricsConfig.getPlugin(Metr
>> icsConfig.java:199)
>>
>> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.newSink(
>> MetricsSystemImpl.java:530)
>>
>> at org.apache.hadoop.metrics2.impl.MetricsSdrddystemImpl.config
>> ureSinks(MetricsSystemImpl.java:502)
>>
>> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.configure(
>> MetricsSystemImpl.java:481)
>>
>> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.start(Metr
>> icsSystemImpl.java:189)
>>
>> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(Metri
>> csSystemImpl.java:164)
>>
>> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(Def
>> aultMetricsSystem.java:54)
>>
>> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initiali
>> ze(DefaultMetricsSystem.java:50)
>>
>> at org.apache.hadoop.hbase.metrics.BaseSourceImpl$DefaultMetric
>> sSystemInitializer.init(BaseSourceImpl.java:49)
>>
>> at org.apache.hadoop.hbase.metrics.BaseSourceImpl.<init>(BaseSo
>> urceImpl.java:72)
>>
>> at org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceImpl.<in
>> it>(MetricsHBaseServerSourceImpl.java:66)
>>
>> at org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryI
>> mpl.getSource(MetricsHBaseServerSourceFactoryImpl.java:48)
>>
>> at org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryI
>> mpl.create(MetricsHBaseServerSourceFactoryImpl.java:38)
>>
>> at org.apache.hadoop.hbase.ipc.MetricsHBaseServer.<init>(Metric
>> sHBaseServer.java:40)
>>
>> at org.apache.hadoop.hbase.ipc.RpcServer.<init>(RpcServer.java:2040)
>>
>> at org.apache.hadoop.hbase.regionserver.RSRpcServices.<init>(
>> RSRpcServices.java:930)
>>
>> at org.apache.hadoop.hbase.master.MasterRpcServices.<init>(
>> MasterRpcServices.java:231)
>>
>> at org.apache.hadoop.hbase.master.HMaster.createRpcServices(
>> HMaster.java:572)
>>
>> at org.apache.hadoop.hbase.regionserver.HRegionServer.<init>(
>> HRegionServer.java:531)
>>
>> at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:412)
>>
>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>>
>> at sun.reflect.NativeConstructorAccessorImpl.newInstance(Native
>> ConstructorAccessorImpl.java:57)
>>
>> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(De
>> legatingConstructorAccessorImpl.java:45)
>>
>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>>
>> at org.apache.hadoop.hbase.master.HMaster.constructMaster(
>> HMaster.java:2505)
>>
>> ... 5 more
>>
>> Note: Additionally based on this Hortonworks reference <
>> https://community.hortonworks.com/articles/92371/trace-
>> logging-for-phoenix.html>, did the following changes in log4j.PROPERTIES
>> of Phoenix. Still facing same issue;
>>
>> log4j.threshold=TRACE
>>
>> log4j.logger.org.apache.phoenix=TRACE log4j.logger.org.apache.hadoop
>> .hbase.ipc=TRACE
>>
>> log4j.logger.org.apache.hadoop.hbase.ipc.RegionCoprocessorRp
>> cChannel=DEBUG
>>
>> --
>> Thanks and regards
>> D.Mallieswari
>>
>


-- 
Thanks and regards
D.Mallieswari

Mime
View raw message