phoenix-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Salou Guillaume <g.sa...@gmail.com>
Subject Re: huge query result miss some fields
Date Thu, 24 Nov 2016 13:53:53 GMT
My rows are bigger than 1KB.

I've tried to put limit in pig query, but it's not possible, trying to do
with MR job.

jinzhuan what is your framework to do the dump ?

The problem doesn't exist with dump throw flink.

*Regards,*


2016-11-24 14:19 GMT+01:00 金砖 <jinzhuan@wacai.com>:

> thanks Ankit.
>
> PHOEINX-3112 is not my case.
>
> Each row is less than 1KB.
>
> ----------------------------------------------------------------
> *金砖*
> 挖财网络技术有限公司
> 地址:杭州市西湖区古翠路80号浙江科技产业大厦12楼
> 手机:15558015995
>
>  原始邮件
> *发件人:* Ankit Singhal<ankitsinghal59@gmail.com>
> *收件人:* user<user@phoenix.apache.org>
> *发送时间:* 2016年11月24日(周四) 20:52
> *主题:* Re: huge query result miss some fields
>
> Do you have bigger rows? if yes , it may be similar to
> https://issues.apache.org/jira/browse/PHOENIX-3112 and
> increasing hbase.client.scanner.max.result.size can help.
>
>
>
> On Thu, Nov 24, 2016 at 6:00 PM, 金砖 <jinzhuan@wacai.com> wrote:
>
>> thanks Abel.
>>
>>
>> I tried update statistics, it did not work.
>>
>>
>> But after some retries, I found something interesting:
>>
>> I add  'limit 100000000'  after my sql.
>>
>> Even actual size of result is the same(since there’s only 100000 rows in
>> table),  but the missing problem is solved.
>>
>> ----------------------------------------------------------------
>> *金砖*
>> 挖财网络技术有限公司
>> 地址:杭州市西湖区古翠路80号浙江科技产业大厦12楼
>> 手机:15558015995
>>
>>  原始邮件
>> *发件人:* Abel Fernández<mevsmyself@gmail.com>
>> *收件人:* user<user@phoenix.apache.org>
>> *发送时间:* 2016年11月24日(周四) 20:14
>> *主题:* Re: huge query result miss some fields
>>
>> Hi Jinzhuan,
>>
>> Have you tried to update the statistics of your table?
>>
>> https://phoenix.apache.org/update_statistics.html
>>
>>
>> On Thu, 24 Nov 2016 at 11:46 金砖 <jinzhuan@wacai.com> wrote:
>>
>>> hi, all:
>>>
>>> I’m using phoenix-4.8.0-hbase-1.1 with hbase 1.1.3.
>>>
>>> When query a lot of rows(ex: 100,000),  some fileds of rows does not
>>> exists  in result set.
>>>
>>>
>>> steps
>>>
>>> 1. I created a table test(pk varchar primary key, id bigint, name
>>> varchar, age bigint).
>>>
>>> 2. then populated with 100000 rows, with key prefix 'prefix', and rows
>>> will be 'prefix1' - 'prefix100000'.
>>>
>>> 3. then query with select * from test;
>>>
>>>
>>> occasionally some fields with be lost in rows,
>>>
>>> sometimes 2 rows missing id and age,
>>>
>>> some times 3 rows missing name.
>>>
>>>
>>> Can anyone be helpful?  Is there some settings should be done ?
>>>
>>> ----------------------------------------------------------------
>>> *jinzhuan*
>>>
>> --
>> Un saludo - Best Regards.
>> Abel
>>
>
>

Mime
View raw message