phoenix-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kevin <kiss.kevin...@gmail.com>
Subject Re: how dose count(1) works?
Date Mon, 04 Jul 2016 01:56:44 GMT
hi,all:
    I was created tables through phoenix and I load data through pig by
using org.apache.phoenix.pig.PhoenixHBaseStorage . if hbase was worked on
hdfs all is fine( a count from hbase or phoenix) ,but if hbase was worked
on alluxio only hbase works well ,on phoenix I have a test of count(1)
about table a and table b , a have 2880404 rows and test failed by
regionserver crashed ,b have 1920800 rows test sucessed. I have try to
increase ram config : export HBASE_HEAPSIZE=4096   export
HBASE_OPTS="-XX:NewSize=1024m ...   but still failed , I can't found error
msg from RegionServer's log. the only unusual  msg is :
2016-07-01 17:43:53,705 WARN  [RS_LOG_REPLAY_OPS-slave1:60020-1]
wal.HLogSplitter: Could not open
alluxio://master:19998/hbase/WALs/slave1,60020,1467365859688-splitting/slave1%2C60020%2C1467365859688.1467365864899
for reading. File is empty
java.io.EOFException
at java.io.DataInputStream.readFully(DataInputStream.java:197)
at java.io.DataInputStream.readFully(DataInputStream.java:169)
at org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:1848)
at
org.apache.hadoop.io.SequenceFile$Reader.initialize(SequenceFile.java:1813)
at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1762)
at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1776)
at
org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader.<init>(SequenceFileLogReader.java:70)
at
org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader.reset(SequenceFileLogReader.java:176)
at
org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader.initReader(SequenceFileLogReader.java:185)
at
org.apache.hadoop.hbase.regionserver.wal.ReaderBase.init(ReaderBase.java:70)
at
org.apache.hadoop.hbase.regionserver.wal.HLogFactory.createReader(HLogFactory.java:129)
at
org.apache.hadoop.hbase.regionserver.wal.HLogFactory.createReader(HLogFactory.java:91)
at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.getReader(HLogSplitter.java:668)
at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.getReader(HLogSplitter.java:577)
at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLogFile(HLogSplitter.java:282)
at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLogFile(HLogSplitter.java:225)
at
org.apache.hadoop.hbase.regionserver.SplitLogWorker$1.exec(SplitLogWorker.java:143)
at
org.apache.hadoop.hbase.regionserver.handler.HLogSplitterHandler.process(HLogSplitterHandler.java:82)
at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:128)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)

but the server didn't stop when this happen.

and I can find hs_err_pid35722.log from hbase_home


2016-07-02 2:58 GMT+08:00 Alicia Shu <ashu@hortonworks.com>:

> Kevin,
>
> Did you upload data into the table through HBase or Phoenix? If through
> HBase, there could be some meta information not probably updated in
> Phoenix and you would get exceptions. Nevertheless, log files will be
> helpful to see what exactly happened.
>
> Alicia
>
> On 7/1/16, 10:00 AM, "Josh Elser" <josh.elser@gmail.com> wrote:
>
> >Can you share the error that your RegionServers report in the log before
> >they crash? It's hard to give an explanation without knowing the error
> >you're facing.
> >
> >Thanks.
> >
> >kevin wrote:
> >> hi,all
> >>      I have a test about hbase run top of alluxio . In my hbase there is
> >> a table a create by phoenix an have 2880404 rows. I can run : count "A"
> >>   on hbase ,but not on phoenix(select count(1) from A),if I do so,hbase
> >> region server will crash.
> >> so I want to know how dose count(1) works?what is the different between
> >> the tow way when I do the same thing?
> >
>
>

Mime
View raw message