phoenix-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jonathan Leech <jonat...@gmail.com>
Subject Re: phoenix table with 50 salt buckets ( regions ) - now shows as 68 regions and18 of them stale
Date Thu, 22 Mar 2018 21:21:29 GMT
Did you set the split policy to CostantSizeRegionSplitPolicy?

> On Mar 22, 2018, at 2:56 PM, Adi Kadimetla <kadimetla@gmail.com> wrote:
> 
> Group,
> TABLE - with 50 salt buckets and configured as time series table.
> 
> Having pre split into 50 SALT buckets we disabled the region splits using max file size
as 100 GB for the split.
> 
> I see some of the keys got split and created stale regions.
> 
> no writes are happening into the region f3f0a711370c8acb88f5294ec9dfa648
> 
> region - f3f0a711370c8acb88f5294ec9dfa648  
> start key - .\x00x\00 ... ( all x\00 )
> end key - .\x80\x00\x01`\x02<8\x07\x00\x00\x00\x00\x81\x80\x00\x01`\x02<\x14`\x00\x00\x00\x005VPK06CewQV2nI_1qS6baA\x00oAPASXODoBkIBIYJT3BPrQ
> 
> 
> All the writes are going to this region 7feabc1eea26727c03366efba27f2016.
> 
> region - 7feabc1eea26727c03366efba27f2016
> start key - .\x80\x00\x01`\x02<8\x07\x00\x00\x00\x00\x81\x80\x00\x01`\x02<\x14`\x00\x00\x00\x005VPK06CewQV2nI_1qS6baA\x00oAPASXODoBkIBIYJT3BPrQ
> 
> end key - /\x00\x00 ... ( all x\00 )
> 
> 
> salt bucket byte - hash(row key) % N salt buckets
> 
> 
> I was expecting only salt bucket bytes for the start and end keys. Instead I see row
keys have been appended to the salt bucket byte and those regions are not used. 
> 
> Any pointer what caused the split and how to prevent.
> 
> Command to remove stale region and restore as contiguous start and end keys. 
> 
> region - 7feabc1eea26727c03366efba27f2016
> 
> start key - .\x00\x00 .. ( all x\00 )
> 
> end key - /\x00\x00 ... ( all x\00 )
> 
> 
> HDP  - 2.6.3
> HBase 1.1.2
> Phoenix 4.7.0
> 
> 
> Thanks
> 
> 
> 
> 
> 
> 
> 
> 
>      
> 

Mime
View raw message