incubator-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Willem Jiang <willem.ji...@gmail.com>
Subject Re: [DISCUSS] Incubating Proposal of Kyuubi
Date Thu, 03 Jun 2021 04:45:53 GMT
Hi Atri,

I shared the same concern with you when Kent Yao came to me two month ago.
I think he already realized it and made some improvements recently.
He told me he want to build up the community around Sparks ecosystem
by donating this project into ASF last week.
He did a presentation about it  in China Open Source Hackathon
2012[1], and hold a meetup about Sparks.
>From my mentoring experience, I saw the similar situation, if the
project main developer realize the community over code and will to do
some change, the community will be built soon.  So I'd like to give
this project a try.

[1]https://www.163.com/dy/article/GAPRPV840518DLIO.html

Willem Jiang

Twitter: willemjiang
Weibo: 姜宁willem

On Wed, Jun 2, 2021 at 4:48 PM Atri Sharma <atri@apache.org> wrote:
>
> Thanks.
>
> I looked at the link you advised on and if I am reading it correctly, top
> committer has 630ish commits and the next committer has 73 commits?
>
> IMO this is an indication of the community not being active enough and
> hence the risk of project getting orphaned is measurable.
>
> Atri
>
> On Wed, 2 Jun 2021, 06:57 Willem Jiang, <willem.jiang@gmail.com> wrote:
>
> > Hi Atri Sharma,
> >
> > It's easier to check out the recent contribution of kyuubi from this
> > link[1].
> > We already identified the one person contribution issue of kyuubi when
> > Kent came to us and we kept reminding him to put more effort into
> > building the community.
> > Last week I had a long F2F conversation with Kent, I think he already
> > knows about it and there have been some improvements in recent months
> > but there is still a long way to go if Kyuubi is accepted as a podling
> > in the Apache Incubator.
> >
> > [1]https://github.com/NetEase/kyuubi/graphs/contributors
> >
> > Willem Jiang
> >
> > Twitter: willemjiang
> > Weibo: 姜宁willem
> >
> > On Tue, Jun 1, 2021 at 10:52 PM Atri Sharma <atri@apache.org> wrote:
> > >
> > > Hi,
> > >
> > > I took a look at commit log and seems like all the commits for last 3
> > > months have been done by a single person.
> > >
> > > How active are the remaining committers?
> > >
> > > On Mon, 31 May 2021, 12:59 Kent Yao, <yao@apache.org> wrote:
> > >
> > > > Hi Alexander Alten,
> > > >
> > > > Thanks for your interest and +1 for Kyuubi.
> > > >
> > > > Not being very familiar with Dremel, I just took a quick look at the
> > > > profile of a very similar and exciting project, Apache Drill. If I
> > > > understand correctly, Kyuubi is built on top of the compute layer
> > > > (Apache Spark), while Apache Drill is built on top of the storage
> > > > layer.
> > > >
> > > > Apache Spark has a large user base and usage scenarios all over the
> > > > world. When users have some basic Spark programming and tuning skills,
> > > > things are easy for them. But many times, most users do not have all
> > > > of these abilities when they use Spark directly or indirectly. We want
> > > > to build a more easy-to-use platform on top of it to help these users.
> > > > On the one hand, we will work on the interface layer to make it easy
> > > > to access (of course, this effort will make our project look very
> > > > similar to other projects, such as HiveServer2). On the other hand, we
> > > > will work under Kyuubi's multi-tenant architecture to extend our
> > > > on-prem Spark SQL engine(a.k.a Kyuubi engine) to make it more stable
> > > > and efficient in our scenario.
> > > >
> > > > What's more, we are going to add more on-prem Kyuubi engine types, e.g.
> > > > Flink.
> > > >
> > > > Alexander Alten <alo@scalytics.io> 于2021年5月31日周一 下午2:35写道:
> > > >
> > > > >
> > > > > Hey,
> > > > >
> > > > > Looks like an interesting project, competition to Starburst. How
> > does it
> > > > > compare to Apache Dremel?
> > > > >
> > > > >  +1 (non-binding) for incubation.
> > > > >
> > > > > Thanks and stay safe,
> > > > > --alex
> > > > >
> > > > > On Mon, May 31, 2021, 08:21 Kent Yao <yao@apache.org> wrote:
> > > > >
> > > > > > Dear all,
> > > > > >
> > > > > > We want to propose Kyuubi as a new Apache Incubator project.
> > > > > >
> > > > > > Kyuubi is a distributed multi-tenant Thrift JDBC/ODBC server
for
> > > > > > large-scale data management, processing, and analytics, built
on
> > top
> > > > > > of Apache Spark and designed to support more engines (i.e.,
Apache
> > > > > > Flink). We are aiming to make Kyuubi an "out-of-the-box" tool
for
> > data
> > > > > > warehouses and data lakes. Kyuubi concentrates on improving
the
> > > > > > experience for non-Spark users, making it easy for them to use
> > Spark
> > > > > > as a service and focus on business data of their own, not where
it
> > > > > > stores, how it computes. NetEase has open-sourced Kyuubi since
> > 2018,
> > > > > > https://github.com/NetEase/kyuubi.
> > > > > >
> > > > > > Many thanks to Willem Jiang (Champion), Jeff Zhang, Duo Zhang,
> > Akira
> > > > > > Ajisaka for being the mentors of the Kyuubi project and helping
us
> > set
> > > > > > up this proposal. The proposal can be found at
> > > > > >
> > https://cwiki.apache.org/confluence/display/INCUBATOR/KyuubiProposal.
> > > > > >
> > > > > > Looking forward to your feedback and thank you very much.
> > > > > >
> > > > > > Best regards,
> > > > > > Kent Yao
> > > > > >
> > > > > >
> > ---------------------------------------------------------------------
> > > > > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > > > > For additional commands, e-mail: general-help@incubator.apache.org
> > > > > >
> > > > > >
> > > >
> > > >
> > > >
> > > > --
> > > >
> > > >  Kent Yao
> > > > @ Data Science Center, Hangzhou Research Institute, NetEase Corp.
> > > > a spark enthusiast
> > > > kyuubiis a unified multi-tenant JDBC interface for large-scale data
> > > > processing and analytics, built on top of Apache Spark.
> > > >
> > > > spark-authorizerA Spark SQL extension which provides SQL Standard
> > > > Authorization for Apache Spark.
> > > > spark-postgres A library for reading data from and transferring data
> > > > to Postgres / Greenplum with Spark SQL and DataFrames, 10~100x faster.
> > > > itatchiA library that brings useful functions from various modern
> > > > database management systems to Apache Spark.
> > > >
> > > > ---------------------------------------------------------------------
> > > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > > For additional commands, e-mail: general-help@incubator.apache.org
> > > >
> > > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: general-help@incubator.apache.org
> >
> >

---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org


Mime
View raw message