phoenix-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kunal Gupta <kunal1...@iiitd.ac.in>
Subject Re: Re: Query returning different results in Apache Phoenix and MySQL
Date Tue, 13 Jan 2015 02:41:13 GMT
Thanks Sunfl for replying

can you tell me which HDFS api?
And command that you provided me will it calculate the whole size of table
if table is splitted in multiple region.

Thanks , Kunal


On Tue, Jan 13, 2015 at 6:40 AM, sunfl@certusnet.com.cn <
sunfl@certusnet.com.cn> wrote:

> Hi, Kunal
> If you want to know the disk usage of table in Phoenix, you can definitely
> search for the hbase table size
> that stored on HDFS. So you can issue command like "hadoop fs -du -h
> /hbase/data/default/YOUR PHONEIX TABLES".
>
> I don't know how to calculate that through java code, but I think you can
> use sort of hdfs api to do that if you want to.
>
> Thanks,
> Sun.
>
> ------------------------------
> ------------------------------
>
> CertusNet
>
>
> *From:* Kunal Gupta <kunal1340@iiitd.ac.in>
> *Date:* 2015-01-12 22:35
> *To:* user <user@phoenix.apache.org>
> *Subject:* Re: Query returning different results in Apache Phoenix and
> MySQL
> I think i have overcome with my problem but i stuck in another problem
>
> I overcome by changing in MySQL Table Eventlog by considering DATEPLUSTIME
> attribute as TIMESTAMP datatype instead of DATE datatype because in Apache
> Phoenix there was TIMESTAMP datatype.
>
> Thank you for your response
>
> *My another Problem is Can you tell me how to calculate DISK USAGE of all
> table in Apache Phoenix either by query or by some JAVA code*
>
> Thanks , Kunal
>
>
> On Mon, Jan 12, 2015 at 7:24 PM, Dhaval Modi <dhavalmodi24@gmail.com>
> wrote:
>
>> Hi Kunal,
>>
>>
>> Try running below query in both MySQL and Phoenix and find the missing
>> entries.
>>
>> SELECT E1.CASEID, E1.DATEPLUSTIME, E1.SUBSTATUS
>>       FROM EVENTLOG AS E1
>>         WHERE E1.DATEPLUSTIME IN
>>              (SELECT MIN(E2.DATEPLUSTIME)
>>                          FROM EVENTLOG AS E2
>>                               GROUP BY E2.CASEID);
>>
>> Send us the copy of missing entries to understand this issue.
>>
>>
>>
>>
>> Regards,
>> Dhaval Modi
>> dhavalmodi24@gmail.com
>>
>> On 12 January 2015 at 18:06, Kunal Gupta <kunal1340@iiitd.ac.in> wrote:
>>
>>> For 65,000 records i get exact value as MySQL gives, i don't know why it
>>> giving me wrong answer on 466738 records
>>>
>>> Thanks , Kunal
>>>
>>>
>>> On Mon, Jan 12, 2015 at 4:14 PM, Gabriel Reid <gabriel.reid@gmail.com>
>>> wrote:
>>>
>>>> Kunal,
>>>>
>>>> Just to clarify: I didn't mean that you should post (or send) the full
>>>> contents of your table. Instead, I mean you should make a minimal test case
>>>> (with a minimal number of records) that demonstrates the issue. For
>>>> example, do you get unexpected results if you only have 10 records in your
>>>> table?
>>>>
>>>> - Gabriel
>>>>
>>>>
>>>> On Mon, Jan 12, 2015 at 10:58 AM, Kunal Gupta <kunal1340@iiitd.ac.in>
>>>> wrote:
>>>>
>>>>> Thank You Gabriel for your response and will reply you soon with
>>>>> snapshot of all becasue Table contain 466738 records so i will send you
>>>>> snapshot of those who are missing in Phoenix.
>>>>>
>>>>> Can you tell me if i can perform same operation in different way as i
>>>>> defined in my earlier mail.I hope you got me question
>>>>>
>>>>> Thanks , Kunal
>>>>>
>>>>>
>>>>> On Mon, Jan 12, 2015 at 1:20 PM, Gabriel Reid <gabriel.reid@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Hi Kunal,
>>>>>>
>>>>>> I think you'll need to post some additional information to get an
>>>>>> answer to your question. You said that MySQL returns 35 rows and
>>>>>> Phoenix returns 32 rows, but it's not clear from your description
what
>>>>>> the rows are that are missing from the Phoenix result, or what it
is
>>>>>> that makes the Phoenix result incorrect and the MySQL result correct.
>>>>>>
>>>>>> The best approach to resolving this would be to create a minimal
case,
>>>>>> with a smaller number of rows, that demonstrates the issue that you're
>>>>>> encountering.
>>>>>>
>>>>>> - Gabriel
>>>>>>
>>>>>>
>>>>>> On Mon, Jan 12, 2015 at 8:43 AM, Kunal Gupta <kunal1340@iiitd.ac.in>
>>>>>> wrote:
>>>>>> > I have a table named as EVENTLOG which has 3 columns:
>>>>>> >
>>>>>> >     (CASEID VARCHAR(200), DATEPLUSTIME TIMESTAMP, SUBSTATUS
>>>>>> VARCHAR(200))
>>>>>> >
>>>>>> > DATEPLUSTIME is in format of YYYY-MM-DD hh:mm:ss. Below is the
>>>>>> query that
>>>>>> > will work on Apache phoenix as well as for MySQL.
>>>>>> >
>>>>>> >     SELECT DISTINCT E1.SUBSTATUS
>>>>>> >       FROM EVENTLOG AS E1
>>>>>> >         WHERE E1.DATEPLUSTIME IN
>>>>>> >              (SELECT MIN(E2.DATEPLUSTIME)
>>>>>> >                          FROM EVENTLOG AS E2
>>>>>> >                               GROUP BY E2.CASEID);
>>>>>> >
>>>>>> > Table contains 466738 records. When i perform the above query
in
>>>>>> MySQL , i
>>>>>> > get 35 rows of it but on Apache Phoenix i get 32 rows so it
is
>>>>>> missing 3
>>>>>> > rows why is there difference in their result.
>>>>>> > Table looks like the following(Records Striped).
>>>>>> >
>>>>>> >      +----+---+---+---+--+----------+----+-----------+
>>>>>> >      | CASEID |      DATEPLUSTIME  | SUBSTATUS |
>>>>>> >      +----+---+---+---+--------+-----+---+-----------+
>>>>>> >      |  1     | 2010-04-10 18:20:38      | Assignment|
>>>>>> >      |  1     | 2010-04-10 20:12:56      | Update    |
>>>>>> >      |  1     | 2010-11-23 23:12:34      | Assigned  |
>>>>>> >      |  1     | 2010-11-25 23:45:34      | Assigned  |
>>>>>> >      |  2     | 2010-12-30 12:32:23      | Reassigned|
>>>>>> >      |  2     | 2014-12-30 12:34:21      | Operator  |
>>>>>> >      |  2     | 2014-12-25 20:32:45      | Operator  |
>>>>>> >      |  3     | 2014-12-26 08:45:54      | Progress  |
>>>>>> >      |  3     | 2014-12-30 08:49:32      | Call      |
>>>>>> >      +----+---+---+---+---+----+------+--+-----------+
>>>>>> > [Expected Output]
>>>>>> >
>>>>>> >     Assignment
>>>>>> >     Reassigned
>>>>>> >     Progress
>>>>>> >
>>>>>> > MySQL does the task correctly butr Phoenix return incomplete
result.
>>>>>> > Please help me.
>>>>>> >
>>>>>> >
>>>>>> > Thanks , Kunal
>>>>>> >
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>

Mime
View raw message