phoenix-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Adi Kadimetla <kadime...@gmail.com>
Subject phoenix table with 50 salt buckets ( regions ) - now shows as 68 regions and18 of them stale
Date Thu, 22 Mar 2018 20:56:18 GMT
Group,
TABLE - with 50 salt buckets and configured as time series table.

Having pre split into 50 SALT buckets we disabled the region splits using
max file size as 100 GB for the split.

I see some of the keys got split and created stale regions.

no writes are happening into the region f3f0a711370c8acb88f5294ec9dfa648

region - f3f0a711370c8acb88f5294ec9dfa648
start key - .\x00x\00 ... ( all x\00 )
end key -
.\x80\x00\x01`\x02<8\x07\x00\x00\x00\x00\x81\x80\x00\x01`\x02<\x14`\x00\x00\x00\x005VPK06CewQV2nI_1qS6baA\x00oAPASXODoBkIBIYJT3BPrQ


All the writes are going to this region 7feabc1eea26727c03366efba27f2016.

region - 7feabc1eea26727c03366efba27f2016
start key -
.\x80\x00\x01`\x02<8\x07\x00\x00\x00\x00\x81\x80\x00\x01`\x02<\x14`\x00\x00\x00\x005VPK06CewQV2nI_1qS6baA\x00oAPASXODoBkIBIYJT3BPrQ

end key - /\x00\x00 ... ( all x\00 )


salt bucket byte - hash(row key) % N salt buckets


I was expecting only salt bucket bytes for the start and end keys. Instead
I see row keys have been appended to the salt bucket byte and those regions
are not used.

Any pointer what caused the split and how to prevent.

Command to remove stale region and restore as contiguous start and end
keys.

region - 7feabc1eea26727c03366efba27f2016

start key - .\x00\x00 .. ( all x\00 )

end key - /\x00\x00 ... ( all x\00 )


HDP  - 2.6.3
HBase 1.1.2
Phoenix 4.7.0


Thanks

Mime
View raw message