phoenix-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nick Dimiduk <ndimi...@gmail.com>
Subject Re: hbase / phoenix errors
Date Tue, 07 Apr 2015 16:05:21 GMT
Also, beside each region server log file (.log) there's also the output
file (.out). Check the output files as well, as some serious crashes
scenarios bypass the logs and go directly to the out files.

-n

On Tuesday, April 7, 2015, Devaraj Das <ddas@hortonworks.com> wrote:

>  Hi Ralph, were you using the Phoenix bundled with HDP-2.2 or was that a
> separate installation? Could you please copy/paste some log lines around
> the time of a regionserver's crash (look for exceptions etc around that
> time in the regionserver logs).
>
> Thanks
>  Devaraj
>
> On Apr 6, 2015, at 3:00 PM, Perko, Ralph J <Ralph.Perko@pnnl.gov
> <javascript:_e(%7B%7D,'cvml','Ralph.Perko@pnnl.gov');>> wrote:
>
>   Hi, we recently upgraded to Phoenix 4.3 and Hortonworks 2.2 (HBase
> .98.4) and we are running into some issues.  I am wondering if I am missing
> something easy and hoping you can help.  I have 34 regions servers and many
> keep crashing but without much in the way of error messages.
>
>
>
> Here are the things that stand out:
>
>
>
> ClientAsync.Process – waiting for some tasks to finish
>
> smallCompaction RPCRetryingCaller: Call exception …. ‘msg row
> ‘SOME_PHOENIX_TABLE_NAME_IDX:<some long key>’ on table: SYSTEM.STATS
> attempt 225/350
>
>
>
> Similar ones for largeCompaction as well.
>
>
>
> The other issue is the Pig loader hangs with these messages in the mapper
> logs:
>
> [phoenix-1-thread-0] RPCRetryingCaller: Call exception msg row ‘’ on table
> ‘SYSTEM.CATALOG’
>
>
>
> Eventually the mappers time out – no errors
>
>
>
> Regions servers come up and down.  There are lots of connection refused
> errors as well.
>
>
>
> Restarting hbase does not help.  The region servers will come up then go
> down again.
>
>
>
> Zookeeper is up.  I’ve restarted just in case but it did not help
>
>
>
> I cannot connect to Phoenix from the command line
>
>
>
> Any help is appreciated.
>
>
>
> Thanks!
>
> Ralph
>
>
>
>

Mime
View raw message