phoenix-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "" <>
Subject Re: count on large table
Date Wed, 08 Oct 2014 01:09:08 GMT
Hi, Abe
Maybe setting the following property would help...


From: Abe Weinograd
Date: 2014-10-08 04:34
To: user
Subject: count on large table
I have a table with 1B  rows.  I know this can is very specific to my environment, but just
doing a SELECT COUNT(1) on the table   It never finished.  

We have a 10 node cluster with the RS's Heap size at 26GiB and skewed towards the block cache.
 In the RS logs, i see a lot of these:

2014-10-07 16:27:04,942 WARN org.apache.hadoop.ipc.RpcServer: (responseTooSlow): {"processingtimems":22770,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"","starttimems":1412713602172,"queuetimems":0,"class":"HRegionServer","responsesize":8,"method":"Scan"}

They stop eventually, but i the query times out and the query tool reports: org.apache.phoenix.exception.PhoenixIOException:
187541ms passed since the last invocation, timeout is currently set to 60000

Any ideas of where I can start in order to figure this out?

using Phoenix 4.1 on CDH 5.1 (Hbase 0.98.1)

View raw message