From user-return-6025-apmail-phoenix-user-archive=phoenix.apache.org@phoenix.apache.org Wed Sep 7 02:49:47 2016 Return-Path: X-Original-To: apmail-phoenix-user-archive@minotaur.apache.org Delivered-To: apmail-phoenix-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A20DB19722 for ; Wed, 7 Sep 2016 02:49:47 +0000 (UTC) Received: (qmail 2280 invoked by uid 500); 7 Sep 2016 02:49:47 -0000 Delivered-To: apmail-phoenix-user-archive@phoenix.apache.org Received: (qmail 2223 invoked by uid 500); 7 Sep 2016 02:49:47 -0000 Mailing-List: contact user-help@phoenix.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@phoenix.apache.org Delivered-To: mailing list user@phoenix.apache.org Received: (qmail 2210 invoked by uid 99); 7 Sep 2016 02:49:47 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 07 Sep 2016 02:49:47 +0000 Received: from mail-qt0-f178.google.com (mail-qt0-f178.google.com [209.85.216.178]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id A701C1A003E for ; Wed, 7 Sep 2016 02:49:46 +0000 (UTC) Received: by mail-qt0-f178.google.com with SMTP id 11so1295112qtc.0 for ; Tue, 06 Sep 2016 19:49:46 -0700 (PDT) X-Gm-Message-State: AE9vXwPnjh239YKJkQCUd6oGG8Rayyza0iz0mnxd31VgI+bHiEZcCUD0TyXDTXmQHCqM7y81OTd7vdpCWsWFCg== X-Received: by 10.237.60.44 with SMTP id t41mr48330168qte.102.1473216585890; Tue, 06 Sep 2016 19:49:45 -0700 (PDT) MIME-Version: 1.0 Received: by 10.200.40.246 with HTTP; Tue, 6 Sep 2016 19:49:45 -0700 (PDT) In-Reply-To: References: From: James Taylor Date: Tue, 6 Sep 2016 19:49:45 -0700 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: org.apache.hadoop.hbase.DoNotRetryIOException To: user Content-Type: multipart/alternative; boundary=94eb2c0e7ed047845f053be1f76f --94eb2c0e7ed047845f053be1f76f Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Thanks for following up with the root cause. This bug has been fixed in PHOENIX-930 and will appear in the next release (4.8.1). On Tue, Sep 6, 2016 at 7:42 PM, Yang Zhang wrote: > Thanks > > I have already handled this problem with your help. > and I also learned what make this mistake > when i create table with duplicate column name (i.e. create table test(id > integer primary key,name char(32),name char(64)) ) > phoenix will throw an exception but i can still find the wrong table. Thi= s > cause my table doesn't match my metadata. > afther that, i can't drop my table and get the DoNotRetryIOException > > I am not sure whether this is an issue or the version latter had handled > this(my version is 4.4.0 ). > But in my opinion ,phoenix shoule not create a helf table when customer'= s > grammer has error. > > > > 2016-09-07 9:21 GMT+08:00 James Taylor : > >> Sorry for the issue you've hit, Yang Zhang. You may need to do the >> following to recover: >> - drop the table from the hbase shell >> - create a snapshot of the SYSTEM.CATALOG table just in case >> - delete the rows for the table from the SYSTEM.CATALOG table (i.e. issu= e >> a DELETE FROM SYSTEM.CATALOG WHERE TABLE_SCHEM =3D AN= D >> TABLE_NAME =3D ) >> - bounce your cluster (since the SYSTEM.CATALOG table is cached) >> >> On Tue, Sep 6, 2016 at 5:56 PM, Yang Zhang >> wrote: >> >>> it got the DoNotRetryIOException again, >>> >>> This time i just try to creat a table, When i Try to drop the table ,I >>> got this Exception, >>> Here are the Exception stack below >>> >>> Error: org.apache.hadoop.hbase.DoNotRetryIOException: MAGNETISM_MODEL: = 6 >>> at org.apache.phoenix.util.ServerUtil.createIOException(ServerU >>> til.java:84) >>> at org.apache.phoenix.coprocessor.MetaDataEndpointImpl.dropTabl >>> e(MetaDataEndpointImpl.java:1298) >>> at org.apache.phoenix.coprocessor.generated.MetaDataProtos$Meta >>> DataService.callMethod(MetaDataProtos.java:10525) >>> at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRe >>> gion.java:6864) >>> at org.apache.hadoop.hbase.regionserver.HRegionServer.execServi >>> ceOnRegion(HRegionServer.java:3415) >>> at org.apache.hadoop.hbase.regionserver.HRegionServer.execServi >>> ce(HRegionServer.java:3397) >>> at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$Clie >>> ntService$2.callBlockingMethod(ClientProtos.java:29998) >>> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2078) >>> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108) >>> at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExec >>> utor.java:114) >>> at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:94) >>> at java.lang.Thread.run(Thread.java:745) >>> Caused by: java.lang.ArrayIndexOutOfBoundsException: 6 >>> at org.apache.phoenix.schema.PTableImpl.init(PTableImpl.java:354) >>> at org.apache.phoenix.schema.PTableImpl.(PTableImpl.java:276) >>> at org.apache.phoenix.schema.PTableImpl.makePTable(PTableImpl.java:265) >>> at org.apache.phoenix.coprocessor.MetaDataEndpointImpl.getTable >>> (MetaDataEndpointImpl.java:811) >>> at org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildTab >>> le(MetaDataEndpointImpl.java:448) >>> at org.apache.phoenix.coprocessor.MetaDataEndpointImpl.doDropTa >>> ble(MetaDataEndpointImpl.java:1318) >>> at org.apache.phoenix.coprocessor.MetaDataEndpointImpl.dropTabl >>> e(MetaDataEndpointImpl.java:1272) >>> ... 10 more >>> >>> SQLState: 08000 >>> ErrorCode: 101 >>> >>> >>> I still can't handle this problem, Any one can help me ? >>> >>> Thank you very much >>> >>> 2016-07-23 10:34 GMT+08:00 Yang Zhang : >>> >>>> Hello everyone >>>> >>>> I got an =EF=BC=88org.apache.hadoop.hbase.DoNotRetryIOException= =EF=BC=89 when >>>> using phoenix. my version is phoenix-4.4.0-HBase-0.98-bin. >>>> I create a table and upsert data into it. But someday i want to modify >>>> it, so i execute =EF=BC=88alter table drop column c1=EF=BC=89and ( alt= er table add c2 >>>> bigint). after that i upsert new data into my table for each row. I >>>> try select * from my table,it got success=E3=80=82 >>>> >>>> But afther a time, I try to select * from it, I got DoNotRetryIO= Exception >>>> at org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.jav= a:84) >>>> and java .lang.ArrayIndexOutOfBoundsException:10 at >>>> org.apache.phoenix.schema.PtableImpl.init(PtableImpl.java:354)=E3=80= =82 >>>> >>>> >>>> When I try to drop the table I still got DoNotRetryException >>>> Exception, Btw anyone have try drop phoenix table in hbase shell ? I >>>> should find some way to drop the table. >>>> >>>> >>>> >>>> Thanks very much=EF=BC=81 >>>> >>>> >>>> >>> >> > --94eb2c0e7ed047845f053be1f76f Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Thanks for following up with the root cause. This bug has = been fixed in=C2=A0PHOENIX-930 and will appear in the next release (4.8.1).=

On Tue, Sep= 6, 2016 at 7:42 PM, Yang Zhang <zhang.yang.dm@gmail.com> wrote:
Thanks
I have already handled this problem with your help.
= and I also =C2=A0learned what make this mistake
when i create tab= le with duplicate column name (i.e. create table test(id integer primary ke= y,name char(32),name char(64)) =C2=A0)
phoenix will throw an exce= ption but i can still find the wrong table. This cause my table doesn't= match my metadata.
afther that, i can't drop my table and ge= t the DoNotRetryIOException

I am not sure whether = this is an issue or the version latter had handled this(my version is 4.4.0= ).
But =C2=A0in my opinion ,phoenix shoule not create a helf tab= le when customer's grammer has error.


=
2016-09-07 9:21 GMT+08:00 James Taylor <jamestaylor@apache.org>:
=
Sorry for the issue you've hit, Yang Zhang. You may ne= ed to do the following to recover:
- drop the table from the hbase shel= l
- create a snapshot of the SYSTEM.CATALOG table just in case
- delete the rows for the table from the SYSTEM.CATALOG table (i.e.= issue a DELETE FROM SYSTEM.CATALOG WHERE TABLE_SCHEM =3D <your schema n= ame> AND TABLE_NAME =3D <your table name>)
- bounce your= cluster (since the SYSTEM.CATALOG table is cached)

On Tue, Sep 6, 2016= at 5:56 PM, Yang Zhang <zhang.yang.dm@gmail.com> wrot= e:
it got the DoNotRetry= IOException again,

This time i just try to creat a table= , When i Try to drop the table ,I got this Exception,
Here are th= e Exception stack below

Error: org.apache.had= oop.hbase.DoNotRetryIOException: MAGNETISM_MODEL: 6
at org.apache.phoenix.util.Server= Util.createIOException(ServerUtil.java:84)
at org.apache.phoenix.coprocessor.MetaData= EndpointImpl.dropTable(MetaDataEndpointImpl.java:1298)
= at org.apache.phoenix.coproces= sor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:10525)
at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:6864)
at = org.apache.hadoop.hbase.regionserver.HRegionServer.execServiceOnR= egion(HRegionServer.java:3415)
at org.apache.hadoop.hbase.regionserver.HRegionServer.= execService(HRegionServer.java:3397)
at org.apache.hadoop.hbase.protobuf.generated.Cl= ientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:2= 9998)
at org.apache.= hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2078)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108)
at org.apache.hadoop.hbase.ipc.RpcExecutor.consu= merLoop(RpcExecutor.java:114)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExe= cutor.java:94)
= at java.lang.Thread.run(Thread.java:745)
Caused by: java.lan= g.ArrayIndexOutOfBoundsException: 6
at org.apache.phoenix.schema.PTableImpl.init(PTab= leImpl.java:354)
at org.apache.phoenix.schema.PTableImpl.<init>(PTableImpl.java= :276)
at org.ap= ache.phoenix.schema.PTableImpl.makePTable(PTableImpl.java:265)
at org.apache.phoenix.= coprocessor.MetaDataEndpointImpl.getTable(MetaDataEndpointImpl.ja= va:811)
at org.= apache.phoenix.coprocessor.MetaDataEndpointImpl.buildTable(MetaDa= taEndpointImpl.java:448)
at org.apache.phoenix.coprocessor.MetaDataEndpointImpl.doDro= pTable(MetaDataEndpointImpl.java:1318)
at org.apache.phoenix.coprocessor.MetaDat= aEndpointImpl.dropTable(MetaDataEndpointImpl.java:1272)
... 10 more

SQLState: =C2=A008000
ErrorCode: 101

=

I still can't handle this problem, Any one ca= n help me ?

Thank you very much

2016-07-23 10:= 34 GMT+08:00 Yang Zhang <zhang.yang.dm@gmail.com>:
=
Hello everyone

=C2=A0 =C2=A0 =C2=A0 I g= ot an =EF=BC=88org.apache.hadoop.hbase.DoNotRetryIOException=EF=BC=89 = when using phoenix. =C2=A0my version is=C2=A0phoenix-4.4.0-HBase-0.98-bin.
I create a table and upsert data int= o it. But someday i want to modify it, so i execute =EF=BC=88alter table dr= op column c1=EF=BC=89and ( alter table add c2 bigint). after that i upsert = new data into my table=C2=A0for each= row. I try select * from my table,i= t got success=E3=80=82
=C2=A0 =C2=A0 =C2=A0 But= afther a time, I try to select * from it, I got=C2=A0DoNotRetryIOException at org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:84) =C2=A0and =C2=A0java .la= ng.ArrayIndexOutOfBoundsException:10 at org.apache.phoenix.schema.Ptab= leImpl.init(PtableImpl.java:354)=E3=80=82

=C2=A0 = =C2=A0 =C2=A0 When I try to drop the table I still got DoNotRetryException = Exception, Btw anyone have try drop phoenix table in hbase shell ?=C2=A0 I = should find some way to drop the table.
<= br>


=
Thanks very much=EF=BC=81
=





--94eb2c0e7ed047845f053be1f76f--