phoenix-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Josh Elser <josh.el...@gmail.com>
Subject Re: Phoenix error : Task rejected from org.apache.phoenix.job.JobManager
Date Wed, 06 Jul 2016 16:36:29 GMT
It sounds like whatever query you were running was just causing the 
error to happen again locally. Like you said, if you launched a new 
instance of sqlline.py, you would have a new JVM and thus a new 
ThreadPool (and backing queue).

vishnu rao wrote:
> hi
>
> i was using the "sqlline.py" client .. exiting the client should have
> cleared this queue  but on reconnecting it kept giving this error
>
> so i was puzzled as to y on restart the client - the client kept giving
> this error - as the new connection was sending the query for the first time.
>
> On Thu, Jun 30, 2016 at 6:11 PM, Pedro Gandola <pedro.gandola@gmail.com
> <mailto:pedro.gandola@gmail.com>> wrote:
>
>     Hi Vishnu,
>
>     Phoenix client has an internal queue to process your queries and in
>     this case the queue is full and all threads are busy, so it can't
>     accept more work. if the number of cores in your cluster increase
>     you should increase the number of threads in the client thread pool
>     as well.
>
>     You can find more details about those properties here
>     <https://phoenix.apache.org/tuning.html>, more specifically
>     *phoenix.query.threadPoolSize*, *phoenix.query.queueSize.*
>
>     I would say for you to increase the *phoenix.query.threadPoolSize*
>     in your client.
>
>     Another thing, doing something like this in your code you can track
>     your client queues:
>
>         ThreadPoolExecutor executor =
>         PhoenixDriver.INSTANCE.getQueryServices().getExecutor();
>         recordMetric("Phoenix/ThreadPool/CoreSize",
>         executor.getCorePoolSize());
>         recordMetric("Phoenix/ThreadPool/ActiveCount",
>         executor.getActiveCount());
>         recordMetric("Phoenix/ThreadPool/QueueSize",
>         executor.getQueue().size());
>
>
>     Cheers
>     Pedro
>
>     On Thu, Jun 30, 2016 at 10:24 AM, vishnu rao <jaihind213@gmail.com
>     <mailto:jaihind213@gmail.com>> wrote:
>
>         hi i get this error sometimes "task rejected from JobManager..."
>
>         java.lang.RuntimeException:
>         org.apache.phoenix.exception.PhoenixIOException: Task
>         org.apache.phoenix.job.JobManager$InstrumentedJobFutureTask@1b0a7baf
>         rejected from
>         org.apache.phoenix.job.JobManager$1@62417a16[Running, pool size
>         = 128, active threads = 128, queued tasks = 5000, completed
>         tasks = 2]
>
>
>         can some explain how do i figure out who to work around this ?
>
>         what is this queue and where is this located ?
>
>
>         --
>         with regards,
>         ch Vishnu
>         mash213.wordpress.com <http://mash213.wordpress.com>
>         doodle-vishnu.blogspot.in <http://doodle-vishnu.blogspot.in>
>
>
>
>
>
> --
> with regards,
> ch Vishnu
> mash213.wordpress.com <http://mash213.wordpress.com>
> doodle-vishnu.blogspot.in <http://doodle-vishnu.blogspot.in>

Mime
View raw message