phoenix-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "sunfl@certusnet.com.cn" <su...@certusnet.com.cn>
Subject Re: count on large table
Date Wed, 08 Oct 2014 01:09:08 GMT
Hi, Abe
Maybe setting the following property would help...
<property> 
    <name>phoenix.query.timeoutMs</name> 
    <value>3600000</value> 
</property>

Thanks,
Sun






From: Abe Weinograd
Date: 2014-10-08 04:34
To: user
Subject: count on large table
I have a table with 1B  rows.  I know this can is very specific to my environment, but just
doing a SELECT COUNT(1) on the table   It never finished.  

We have a 10 node cluster with the RS's Heap size at 26GiB and skewed towards the block cache.
 In the RS logs, i see a lot of these:

2014-10-07 16:27:04,942 WARN org.apache.hadoop.ipc.RpcServer: (responseTooSlow): {"processingtimems":22770,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"10.10.0.10:44791","starttimems":1412713602172,"queuetimems":0,"class":"HRegionServer","responsesize":8,"method":"Scan"}

They stop eventually, but i the query times out and the query tool reports: org.apache.phoenix.exception.PhoenixIOException:
187541ms passed since the last invocation, timeout is currently set to 60000

Any ideas of where I can start in order to figure this out?

using Phoenix 4.1 on CDH 5.1 (Hbase 0.98.1)

Thanks,
Abe
Mime
View raw message