phoenix-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mujtaba Chohan <mujt...@apache.org>
Subject Re:
Date Thu, 28 Jul 2016 23:16:38 GMT
To use pherf-cluster.py script make sure $HBASE_DIR/bin/hbase file is
available which is used to construct classpath. Also add the following line
to script before java_cmd is executed to make sure *hbasecp* variable
contains phoenix jar: print "Classpath used to launch pherf: " + hbasecp

Also try running pherf-standalone.py which does not need any variable to be
set and uses fat phoenix-client.jar with all dependencies bundled.

- mujtaba

On Thu, Jul 28, 2016 at 10:14 AM, Nathan Davis <nathan.davis@salesforce.com>
wrote:

> Hi All,
> I'm trying to run pherf-cluster.py against an EMR cluster (on the master
> server). The command I'm using is `HBASE_DIR=/usr/lib/hbase
> ./pherf-cluster.py -drop all -l -q -z localhost -schemaFile
> ./config/datamodel/user_defined_schema.sql -scenarioFile
> ./config/scenario/user_defined_scenario.xml`. I get error "java.lang.NoClassDefFoundError:
> org/apache/phoenix/schema/TableNotFoundException". Below is part of my
> terminal session that shows the applicable directories and the failed pherf
> command.
>
> [ec2-user@ip-10-2-* bin]$ pwd
>> /usr/lib/phoenix/bin
>>
>
>
>> [ec2-user@ip-10-2-* bin]$ ls -l /usr/lib/phoenix/
>> total 221104
>> drwxr-xr-x 3 root root     4096 Jul 28 16:54 bin
>> -rw-r--r-- 1 root root 98170649 Jul  8 03:18
>> phoenix-4.7.0-HBase-1.2-client.jar
>> -rw-r--r-- 1 root root  4898513 Jul  8 03:18
>> phoenix-4.7.0-HBase-1.2-client-minimal.jar
>> -rw-r--r-- 1 root root 46138953 Jul  8 03:18
>> phoenix-4.7.0-HBase-1.2-client-spark.jar
>> -rw-r--r-- 1 root root 31312803 Jul  8 03:18
>> phoenix-4.7.0-HBase-1.2-client-without-hbase.jar
>> -rw-r--r-- 1 root root 25644258 Jul  8 03:18
>> phoenix-4.7.0-HBase-1.2-server.jar
>> -rw-r--r-- 1 root root     6044 Jul  8 03:18
>> phoenix-4.7.0-HBase-1.2-tests.jar
>> -rw-r--r-- 1 root root  4152940 Jul  8 03:18
>> phoenix-4.7.0-HBase-1.2-thin-client.jar
>> -rw-r--r-- 1 root root     2884 Jul  8 03:18
>> phoenix-assembly-4.7.0-HBase-1.2-tests.jar
>> lrwxrwxrwx 1 root root       34 Jul 22 17:32 phoenix-client.jar ->
>> phoenix-4.7.0-HBase-1.2-client.jar
>> -rw-r--r-- 1 root root  3631295 Jul  8 03:18
>> phoenix-core-4.7.0-HBase-1.2.jar
>> -rw-r--r-- 1 root root  1674792 Jul  8 03:18
>> phoenix-core-4.7.0-HBase-1.2-tests.jar
>> -rw-r--r-- 1 root root    35501 Jul  8 03:18
>> phoenix-flume-4.7.0-HBase-1.2.jar
>> -rw-r--r-- 1 root root    23736 Jul  8 03:18
>> phoenix-flume-4.7.0-HBase-1.2-tests.jar
>> -rw-r--r-- 1 root root   159771 Jul  8 03:18
>> phoenix-pherf-4.7.0-HBase-1.2.jar
>> -rw-r--r-- 1 root root  4479303 Jul  8 03:18
>> phoenix-pherf-4.7.0-HBase-1.2-minimal.jar
>> -rw-r--r-- 1 root root    58160 Jul  8 03:18
>> phoenix-pherf-4.7.0-HBase-1.2-tests.jar
>> -rw-r--r-- 1 root root    42216 Jul  8 03:18
>> phoenix-pig-4.7.0-HBase-1.2.jar
>> -rw-r--r-- 1 root root    43578 Jul  8 03:18
>> phoenix-pig-4.7.0-HBase-1.2-tests.jar
>> -rw-r--r-- 1 root root    18810 Jul  8 03:18
>> phoenix-server-4.7.0-HBase-1.2.jar
>> -rw-r--r-- 1 root root  3357692 Jul  8 03:18
>> phoenix-server-4.7.0-HBase-1.2-runnable.jar
>> -rw-r--r-- 1 root root    20170 Jul  8 03:18
>> phoenix-server-4.7.0-HBase-1.2-tests.jar
>> -rw-r--r-- 1 root root    10451 Jul  8 03:18
>> phoenix-server-client-4.7.0-HBase-1.2.jar
>> -rw-r--r-- 1 root root     7139 Jul  8 03:18
>> phoenix-server-client-4.7.0-HBase-1.2-tests.jar
>> lrwxrwxrwx 1 root root       34 Jul 22 17:32 phoenix-server.jar ->
>> phoenix-4.7.0-HBase-1.2-server.jar
>> -rw-r--r-- 1 root root    77327 Jul  8 03:18
>> phoenix-spark-4.7.0-HBase-1.2.jar
>> -rw-r--r-- 1 root root    91730 Jul  8 03:18
>> phoenix-spark-4.7.0-HBase-1.2-tests.jar
>> lrwxrwxrwx 1 root root       39 Jul 22 17:32 phoenix-thin-client.jar ->
>> phoenix-4.7.0-HBase-1.2-thin-client.jar
>> -rw-r--r-- 1 root root    16329 Jul  8 03:18
>> phoenix-tracing-webapp-4.7.0-HBase-1.2.jar
>> -rw-r--r-- 1 root root  2284964 Jul  8 03:18
>> phoenix-tracing-webapp-4.7.0-HBase-1.2-runnable.jar
>> -rw-r--r-- 1 root root     8065 Jul  8 03:18
>> phoenix-tracing-webapp-4.7.0-HBase-1.2-tests.jar
>>
>
>
>> [ec2-user@ip-10-2-1-118 bin]$ ls -l /usr/lib/hbase/
>> total 152732
>> drwxr-xr-x 4 root root     4096 Jul 22 17:32 bin
>> lrwxrwxrwx 1 root root       15 Jul 22 17:32 conf -> /etc/hbase/conf
>> -rw-r--r-- 1 root root    20861 Jul  8 02:17 hbase-annotations-1.2.1.jar
>> -rw-r--r-- 1 root root    14224 Jul  8 02:17
>> hbase-annotations-1.2.1-tests.jar
>> lrwxrwxrwx 1 root root       27 Jul 22 17:32 hbase-annotations.jar ->
>> hbase-annotations-1.2.1.jar
>> -rw-r--r-- 1 root root  1297581 Jul  8 02:17 hbase-client-1.2.1.jar
>> lrwxrwxrwx 1 root root       22 Jul 22 17:32 hbase-client.jar ->
>> hbase-client-1.2.1.jar
>> -rw-r--r-- 1 root root   576307 Jul  8 02:17 hbase-common-1.2.1.jar
>> -rw-r--r-- 1 root root   228279 Jul  8 02:17 hbase-common-1.2.1-tests.jar
>> lrwxrwxrwx 1 root root       22 Jul 22 17:32 hbase-common.jar ->
>> hbase-common-1.2.1.jar
>> -rw-r--r-- 1 root root   131596 Jul  8 02:17 hbase-examples-1.2.1.jar
>> lrwxrwxrwx 1 root root       24 Jul 22 17:32 hbase-examples.jar ->
>> hbase-examples-1.2.1.jar
>> -rw-r--r-- 1 root root    19531 Jul  8 02:17
>> hbase-external-blockcache-1.2.1.jar
>> lrwxrwxrwx 1 root root       35 Jul 22 17:32
>> hbase-external-blockcache.jar -> hbase-external-blockcache-1.2.1.jar
>> -rw-r--r-- 1 root root    95415 Jul  8 02:17
>> hbase-hadoop2-compat-1.2.1.jar
>> lrwxrwxrwx 1 root root       30 Jul 22 17:32 hbase-hadoop2-compat.jar ->
>> hbase-hadoop2-compat-1.2.1.jar
>> -rw-r--r-- 1 root root    36616 Jul  8 02:17 hbase-hadoop-compat-1.2.1.jar
>> lrwxrwxrwx 1 root root       29 Jul 22 17:32 hbase-hadoop-compat.jar ->
>> hbase-hadoop-compat-1.2.1.jar
>> -rw-r--r-- 1 root root    13194 Jul  8 02:17 hbase-it-1.2.1.jar
>> -rw-r--r-- 1 root root  2837755 Jul  8 02:17 hbase-it-1.2.1-tests.jar
>> lrwxrwxrwx 1 root root       18 Jul 22 17:32 hbase-it.jar ->
>> hbase-it-1.2.1.jar
>> -rw-r--r-- 1 root root   102090 Jul  8 02:17 hbase-prefix-tree-1.2.1.jar
>> lrwxrwxrwx 1 root root       27 Jul 22 17:32 hbase-prefix-tree.jar ->
>> hbase-prefix-tree-1.2.1.jar
>> -rw-r--r-- 1 root root   116740 Jul  8 02:17 hbase-procedure-1.2.1.jar
>> lrwxrwxrwx 1 root root       25 Jul 22 17:32 hbase-procedure.jar ->
>> hbase-procedure-1.2.1.jar
>> -rw-r--r-- 1 root root  4365816 Jul  8 02:17 hbase-protocol-1.2.1.jar
>> lrwxrwxrwx 1 root root       24 Jul 22 17:32 hbase-protocol.jar ->
>> hbase-protocol-1.2.1.jar
>> -rw-r--r-- 1 root root    67347 Jul  8 02:17
>> hbase-resource-bundle-1.2.1.jar
>> lrwxrwxrwx 1 root root       31 Jul 22 17:32 hbase-resource-bundle.jar ->
>> hbase-resource-bundle-1.2.1.jar
>> -rw-r--r-- 1 root root   431393 Jul  8 02:17 hbase-rest-1.2.1.jar
>> lrwxrwxrwx 1 root root       20 Jul 22 17:32 hbase-rest.jar ->
>> hbase-rest-1.2.1.jar
>> -rw-r--r-- 1 root root  4139927 Jul  8 02:17 hbase-server-1.2.1.jar
>> -rw-r--r-- 1 root root  7459050 Jul  8 02:17 hbase-server-1.2.1-tests.jar
>> lrwxrwxrwx 1 root root       22 Jul 22 17:32 hbase-server.jar ->
>> hbase-server-1.2.1.jar
>> -rw-r--r-- 1 root root    13051 Jul  8 02:17 hbase-shell-1.2.1.jar
>> lrwxrwxrwx 1 root root       21 Jul 22 17:32 hbase-shell.jar ->
>> hbase-shell-1.2.1.jar
>> -rw-r--r-- 1 root root  2760746 Jul  8 02:17 hbase-thrift-1.2.1.jar
>> lrwxrwxrwx 1 root root       22 Jul 22 17:32 hbase-thrift.jar ->
>> hbase-thrift-1.2.1.jar
>> drwxr-xr-x 7 root root     4096 Jul 22 17:32 hbase-webapps
>> drwxr-xr-x 3 root root     4096 Jul 22 17:32 include
>> drwxr-xr-x 3 root root    12288 Jul 22 17:32 lib
>> lrwxrwxrwx 1 root root       14 Jul 22 17:32 logs -> /var/log/hbase
>> -rw-r--r-- 1 root root 98170649 Jul 28 16:04 phoenix-client.jar
>> -rw-r--r-- 1 root root  3631295 Jul 28 16:07
>> phoenix-core-4.7.0-HBase-1.2.jar
>> -rw-r--r-- 1 root root 25644258 Jul 28 16:04 phoenix-server.jar
>> -rw-r--r-- 1 root root  4152940 Jul 28 16:04 phoenix-thin-client.jar
>> lrwxrwxrwx 1 root root       14 Jul 22 17:32 pids -> /var/run/hbase
>>
>
>
>> [ec2-user@ip-10-2-* bin]$ HBASE_DIR=/usr/lib/hbase ./pherf-cluster.py
>> -drop all -l -q -z localhost -schemaFile
>> ./config/datamodel/user_defined_schema.sql -scenarioFile
>> ./config/scenario/user_defined_scenario.xml
>> HBASE_DIR environment variable is currently set to: /usr/lib/hbase
>> Exception in thread "main" java.lang.NoClassDefFoundError:
>> org/apache/phoenix/schema/TableNotFoundException
>> at org.apache.phoenix.pherf.Pherf.<init>(Pherf.java:52)
>> at org.apache.phoenix.pherf.Pherf.main(Pherf.java:188)
>> Caused by: java.lang.ClassNotFoundException:
>> org.apache.phoenix.schema.TableNotFoundException
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>> ... 2 more
>
>
> It seems like some jar is missing or another path is needed in the -cp
> list.
>
> Thanks ahead of time for your help!
>
> -nathan
>

Mime
View raw message