phoenix-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From James Taylor <jamestay...@apache.org>
Subject Re: When would/should I use spark with phoenix?
Date Sun, 11 Sep 2016 15:12:47 GMT
It's not an either/or with Phoenix and Spark - often companies use both as
they're very complementary. See this [1] blog for an example. Spark is a
processing engine while Phoenix+HBase is a database/store. You'll need to
store your data somewhere.
Thanks,
James

[1]
http://tech.marinsoftware.com/nosql/digital-advertising-storage-on-apache-hbase-and-apache-phoenix/?platform=hootsuite

On Sunday, September 11, 2016, Cheyenne Forbes <
cheyenne.osanu.forbes@gmail.com> wrote:

> Thank you. For a project as big as Facebook or Snapschat, would you
> recommend using Spark or Phoenix for things such as message
> retrieval/insert, user search, user feeds retrieval/insert, etc. and what
> are the pros and cons?
>
> Regard,
> Cheyenne
>
>
> On Sun, Sep 11, 2016 at 8:31 AM, John Leach <jleach4@gmail.com
> <javascript:_e(%7B%7D,'cvml','jleach4@gmail.com');>> wrote:
>
>> Spark has a robust execution model with the following features that are
>> not part of phoenix
>>         * Scalable
>>         * fault tolerance with lineage (Handles large intermediate
>> results)
>>         * memory management for tasks
>>         * Resource Management (Fair Scheduling)
>>         * Additional SQL Features (Windowing ,etc.)
>>         * Machine Learning Libraries
>>
>>
>> Regards,
>> John
>>
>> > On Sep 11, 2016, at 2:45 AM, Cheyenne Forbes <
>> cheyenne.osanu.forbes@gmail.com
>> <javascript:_e(%7B%7D,'cvml','cheyenne.osanu.forbes@gmail.com');>> wrote:
>> >
>> > I realized there is a spark plugin for phoenix, any use cases? why
>> would I use spark with phoenix instead of phoenix by itself?
>>
>>
>

Mime
View raw message