phoenix-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Krishna <research...@gmail.com>
Subject Re: Phoenix on Amazon EMR
Date Tue, 09 Sep 2014 14:15:04 GMT
Please share the script as it will help in faster adoption of 3.x on EMR.

Thanks.

On Monday, September 8, 2014, Abhilash L L <abhilash@capillarytech.com>
wrote:

> Hello,
>
>    We are using Phoenix 3 on hadoop 2.4x on EMR. We have a boot strap
> action which pulls phoenix 3 from s3 (our own bucket) and copies into hives
> aux lib.
>
>    Would be glad to share the script.
>
>
> Regards,
> Abhilash L L
> Capillary Technologies
> M:919886208262
> abhilash@capillarytech.com
> <javascript:_e(%7B%7D,'cvml','abhilash@capillarytech.com');> |
> www.capillarytech.com
>
> Email from people at capillarytech.com may not represent official policy
> of  Capillary Technologies unless explicitly stated. Please see our
> Corporate-Email-Policy
> <http://support.capillary.co.in/policy-public/Corporate-Email-Policy.pdf>
> for details. Contents of this email are confidential. Please contact the
> Sender if you have received this email in error.
>
>
> On Tue, Sep 9, 2014 at 10:33 AM, Tulasi Paradarami <research800@gmail.com
> <javascript:_e(%7B%7D,'cvml','research800@gmail.com');>> wrote:
>
>> Yes, a blog post will be of great help especially considering its not
>> clear when Amazon will upgrade their default version to 3.x or 4.x
>>
>>
>> On Sep 8, 2014, at 9:07 PM, James Taylor <jamestaylor@apache.org
>> <javascript:_e(%7B%7D,'cvml','jamestaylor@apache.org');>> wrote:
>>
>> Thanks, Puneet. That's super helpful. Was (2) difficult to do? That might
>> make an interesting blog if you're up for it. I'd be happy to post on your
>> behalf  if that's helpful.
>>
>> Thanks,
>> James
>>
>> On Monday, September 8, 2014, Puneet Kumar Ojha <
>> puneet.kumar@pubmatic.com
>> <javascript:_e(%7B%7D,'cvml','puneet.kumar@pubmatic.com');>> wrote:
>>
>>>  See Comments Inline
>>>
>>>
>>>
>>> Thanks
>>>
>>>
>>>
>>>
>>>
>>> ------ Original message------
>>>
>>> *From: *Krishna
>>>
>>> *Date: *Tue, Sep 9, 2014 5:24 AM
>>>
>>> *To: *user@phoenix.apache.org;
>>>
>>> *Subject:*Phoenix on Amazon EMR
>>>
>>>
>>>   Hi,
>>>
>>>  Does anyone have experience using Amazon EMR with Phoenix? I'm
>>> currently evaluating Phoenix for a HBase store on Amazon EMR. EMR provides
>>> Phoenix 2.1.2 as the default installation but I prefer to use 3x.---Use 3.x
>>>
>>>  Could someone clarify the following with regards to 2.1.2?
>>>
>>>    1. Does this version support bulk-loading capabilities? We expect to
>>>    load more than trillion rows, so, bulk-loader is a necessity.  Use-Can
>>>    Phoenix 2.1.2 run on either Hadoop1 or Hadoop2? -No. Use 3.x for mapreduce
>>>    uploaded.
>>>    2. Did anyone try installing Phoenix 3x using EMR's bootstrap action
>>>    capabilities?-Yes....it works.You will need to build client jar as per
>>>    hadoop 2 version supported by AWS.
>>>    3. In the following arguments to the bulk loader, is port # required
>>>    or optional? If I'm using Hadoop2, should Resource Manager node be
>>>    substituted for Job Tracker? -Yes.  You will see the port details
>>>    when u login to emr cluster.
>>>       1.  -hd <arg>      HDFS NameNode IP:<port>
>>>       2.  -mr <arg>      MapReduce Job Tracker IP:<port>
>>>       3.  -zk <arg>      Zookeeper IP:<port>
>>>
>>>  Thanks for your inputs.
>>>
>>>  Krishna
>>>
>>>
>
> Email from people at capillarytech.com may not represent official policy
> of Capillary Technologies unless explicitly stated. Please see our
> Corporate-Email-Policy for details.Contents of this email are confidential.
> Please contact the Sender if you have received this email in error.
>

Mime
View raw message