phoenix-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Li Gao <g...@marinsoftware.com>
Subject Re: When will be the stats based join selector be implemented?
Date Thu, 08 Oct 2015 18:37:38 GMT
Hi Maryann,

I am wondering if you could help me understand how the Phoenix calcite
branch is using Calcite to do query optimizations

i.e.

   - some pointers to the code where the joins can detect whether a hash
   join or a sort merge join should be used for a given case
   - pointers to how the cost is calculated in the code
   - pointers to how the filter predicate push down is implemented in the
   code

Examples  would be greatly appreciated.

Thanks,
Li


On Mon, Oct 5, 2015 at 5:49 PM, Maryann Xue <maryann.xue@gmail.com> wrote:

> Hi Li,
>
> Sorry, I forgot to mention that this calcite branch is now depending on
> Apache Calcite's master branch instead of any of its releases. So you need
> to checkout Calcite (git://github.com/apache/incubator-calcite.git) first
> and run `mvn install` for that project before going back to the Phoenix
> project and run mvn commands.
>
> On Mon, Oct 5, 2015 at 6:43 PM, Li Gao <gaol@marinsoftware.com> wrote:
>
>> Hi Maryann,
>>
>> This looks great. Thanks for pointing me to the right branch!  For some
>> reason I am getting the following errors when I do mvn package
>>
>> [WARNING] The POM for
>> org.apache.calcite:calcite-avatica:jar:1.5.0-incubating-SNAPSHOT is
>> missing, no dependency information available
>>
>> [WARNING] The POM for
>> org.apache.calcite:calcite-core:jar:1.5.0-incubating-SNAPSHOT is missing,
>> no dependency information available
>>
>> [WARNING] The POM for
>> org.apache.calcite:calcite-core:jar:tests:1.5.0-incubating-SNAPSHOT is
>> missing, no dependency information available
>>
>> [WARNING] The POM for
>> org.apache.calcite:calcite-linq4j:jar:1.5.0-incubating-SNAPSHOT is missing,
>> no dependency information available
>>
>> Where can I find these dependencies?
>>
>> Thanks,
>>
>> Li
>>
>>
>>
>> On Mon, Oct 5, 2015 at 12:19 PM, Maryann Xue <maryann.xue@gmail.com>
>> wrote:
>>
>>> Hi Li,
>>>
>>> We are moving towards integrating with Calcite as our stats based
>>> optimization now. You can checkout our calcite
>>> <https://git1-us-west.apache.org/repos/asf?p=phoenix.git;a=shortlog;h=refs/heads/calcite>
>>> branch and play with it if you are interested. It's still under
>>> development, but you can already see some amazing optimization examples in
>>> our test file CalciteIT.java. You can also go
>>> http://www.slideshare.net/HBaseCon/ecosystem-session-2-49044349 for
>>> more information.
>>>
>>>
>>> Thanks,
>>> Maryann
>>>
>>>
>>>
>>>
>>> On Mon, Oct 5, 2015 at 2:08 PM, Li Gao <gaol@marinsoftware.com> wrote:
>>>
>>>> Hi all,
>>>>
>>>> I am currently looking into getting optimized joins based on table
>>>> stats. I noticed in the QueryCompile at line 232-234 is still saying "TODO".
>>>>
>>>>
>>>> https://github.com/apache/phoenix/blob/4.x-HBase-1.0/phoenix-core/src/main/java/org/apache/phoenix/compile/QueryCompiler.java
>>>>
>>>> We have a need to get the selector enabled based on the size of the the
>>>> LHS and RHS table.
>>>>
>>>> Thanks,
>>>> Li
>>>>
>>>
>>>
>>
>

Mime
View raw message