phoenix-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pedro Gandola <pedro.gand...@gmail.com>
Subject Re: Phoenix error : Task rejected from org.apache.phoenix.job.JobManager
Date Thu, 30 Jun 2016 10:31:30 GMT
Hi Vishnu,

Increasing the threadPool size on your cli client and it should work, at
least it worked well for me.

Cheers
Pedro

On Thu, Jun 30, 2016 at 11:16 AM, vishnu rao <jaihind213@gmail.com> wrote:

> hi
>
> i was using the "sqlline.py" client .. exiting the client should have
> cleared this queue  but on reconnecting it kept giving this error
>
> so i was puzzled as to y on restart the client - the client kept giving
> this error - as the new connection was sending the query for the first time.
>
> On Thu, Jun 30, 2016 at 6:11 PM, Pedro Gandola <pedro.gandola@gmail.com>
> wrote:
>
>> Hi Vishnu,
>>
>> Phoenix client has an internal queue to process your queries and in this
>> case the queue is full and all threads are busy, so it can't accept more
>> work. if the number of cores in your cluster increase you should increase
>> the number of threads in the client thread pool as well.
>>
>> You can find more details about those properties here
>> <https://phoenix.apache.org/tuning.html>, more specifically
>> *phoenix.query.threadPoolSize*, *phoenix.query.queueSize.*
>>
>> I would say for you to increase the *phoenix.query.threadPoolSize* in
>> your client.
>>
>> Another thing, doing something like this in your code you can track your
>> client queues:
>>
>> ThreadPoolExecutor executor =
>>> PhoenixDriver.INSTANCE.getQueryServices().getExecutor();
>>> recordMetric("Phoenix/ThreadPool/CoreSize", executor.getCorePoolSize());
>>> recordMetric("Phoenix/ThreadPool/ActiveCount",
>>> executor.getActiveCount());
>>> recordMetric("Phoenix/ThreadPool/QueueSize", executor.getQueue().size());
>>
>>
>> Cheers
>> Pedro
>>
>> On Thu, Jun 30, 2016 at 10:24 AM, vishnu rao <jaihind213@gmail.com>
>> wrote:
>>
>>> hi i get this error sometimes "task rejected from JobManager..."
>>>
>>> java.lang.RuntimeException:
>>> org.apache.phoenix.exception.PhoenixIOException: Task
>>> org.apache.phoenix.job.JobManager$InstrumentedJobFutureTask@1b0a7baf
>>> rejected from org.apache.phoenix.job.JobManager$1@62417a16[Running,
>>> pool size = 128, active threads = 128, queued tasks = 5000, completed tasks
>>> = 2]
>>>
>>> can some explain how do i figure out who to work around this ?
>>>
>>> what is this queue and where is this located ?
>>>
>>>
>>> --
>>> with regards,
>>> ch Vishnu
>>> mash213.wordpress.com
>>> doodle-vishnu.blogspot.in
>>>
>>
>>
>
>
> --
> with regards,
> ch Vishnu
> mash213.wordpress.com
> doodle-vishnu.blogspot.in
>

Mime
View raw message