phoenix-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Steve Terrell <sterr...@oculus360.us>
Subject Re: Dynamic column using Pig STORE function
Date Wed, 17 Feb 2016 20:25:44 GMT
And meanwhile, try the streaming function.  Seems inefficient, but I
routinely load tens of thousands of records with dynamic fields this way.
Hasn't ever crashed on a single upsert, and it's actually pretty fast, at
least if your Pig job is running on the same cluster as Phoenix.

On Wed, Feb 17, 2016 at 1:38 PM, Ravi Kiran <maghamravikiran@gmail.com>
wrote:

> Hi ,
>    Unfortunately, we don't support dynamic columns within the phoenix-pig
> module.  Currently, the only two options to PhoenixHBaseStorage are
> specifying the table or a set of table columns .  We can definitely support
> dynamic columns.  Please feel free to create a ticket.
>
> Regards
> Ravi
>
> On Wed, Feb 17, 2016 at 10:56 AM, Steve Terrell <sterrell@oculus360.us>
> wrote:
>
>> I would be interested in knowing, too.  My solution was to write a Pig
>> streaming function that executed the Phoenix upsert command for every row.
>>
>> On Wed, Feb 17, 2016 at 7:21 AM, Sumanta Gh <sumanta.gh@tcs.com> wrote:
>>
>>> Hi,
>>> I was going through the Phoenix Pig integration [1].
>>> I need to store value in a dynamic column using
>>> org.apache.phoenix.pig.PhoenixHBaseStorage.
>>> Is dynamic column allowed in STORE function? Please send me some example.
>>>
>>> [1] - https://phoenix.apache.org/pig_integration.html
>>>
>>> Regards
>>> Sumanta Ghosh
>>>
>>> =====-----=====-----=====
>>> Notice: The information contained in this e-mail
>>> message and/or attachments to it may contain
>>> confidential or privileged information. If you are
>>> not the intended recipient, any dissemination, use,
>>> review, distribution, printing or copying of the
>>> information contained in this e-mail message
>>> and/or attachments to it are strictly prohibited. If
>>> you have received this communication in error,
>>> please notify us by reply e-mail or telephone and
>>> immediately and permanently delete the message
>>> and any attachments. Thank you
>>>
>>>
>>
>

Mime
View raw message