incubator-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kent Yao <...@apache.org>
Subject Re: [DISCUSS] Incubating Proposal of Kyuubi
Date Wed, 02 Jun 2021 09:43:13 GMT
Hi Atri Sharma,

I just notice that you might mean '3 years' not '3 months' in your
first mail, LOL. Sorry for the confusion.

After borrowed the PR merge tool[1] from one Apache project to learn how
they manage PR and commits, we start to use it to merge PRs, which squashes
all commits in one single PR before gets merged to the main codebase. So
the gap here is not that big as it looks on the Github contributors page if
we don't switch to use that tool and merge all the PR commits to the main
codebase.

Sorry for the confusion about this too.

Bests,

Kent Yao

[1]
https://github.com/NetEase/kyuubi/commit/aa4c8bb6e5286fd1d226fd8e03841f33948ebeb4

Atri Sharma <atri@apache.org> 于2021年6月2日周三 下午4:48写道:

> Thanks.
>
> I looked at the link you advised on and if I am reading it correctly, top
> committer has 630ish commits and the next committer has 73 commits?
>
> IMO this is an indication of the community not being active enough and
> hence the risk of project getting orphaned is measurable.
>
> Atri
>
> On Wed, 2 Jun 2021, 06:57 Willem Jiang, <willem.jiang@gmail.com> wrote:
>
> > Hi Atri Sharma,
> >
> > It's easier to check out the recent contribution of kyuubi from this
> > link[1].
> > We already identified the one person contribution issue of kyuubi when
> > Kent came to us and we kept reminding him to put more effort into
> > building the community.
> > Last week I had a long F2F conversation with Kent, I think he already
> > knows about it and there have been some improvements in recent months
> > but there is still a long way to go if Kyuubi is accepted as a podling
> > in the Apache Incubator.
> >
> > [1]https://github.com/NetEase/kyuubi/graphs/contributors
> >
> > Willem Jiang
> >
> > Twitter: willemjiang
> > Weibo: 姜宁willem
> >
> > On Tue, Jun 1, 2021 at 10:52 PM Atri Sharma <atri@apache.org> wrote:
> > >
> > > Hi,
> > >
> > > I took a look at commit log and seems like all the commits for last 3
> > > months have been done by a single person.
> > >
> > > How active are the remaining committers?
> > >
> > > On Mon, 31 May 2021, 12:59 Kent Yao, <yao@apache.org> wrote:
> > >
> > > > Hi Alexander Alten,
> > > >
> > > > Thanks for your interest and +1 for Kyuubi.
> > > >
> > > > Not being very familiar with Dremel, I just took a quick look at the
> > > > profile of a very similar and exciting project, Apache Drill. If I
> > > > understand correctly, Kyuubi is built on top of the compute layer
> > > > (Apache Spark), while Apache Drill is built on top of the storage
> > > > layer.
> > > >
> > > > Apache Spark has a large user base and usage scenarios all over the
> > > > world. When users have some basic Spark programming and tuning
> skills,
> > > > things are easy for them. But many times, most users do not have all
> > > > of these abilities when they use Spark directly or indirectly. We
> want
> > > > to build a more easy-to-use platform on top of it to help these
> users.
> > > > On the one hand, we will work on the interface layer to make it easy
> > > > to access (of course, this effort will make our project look very
> > > > similar to other projects, such as HiveServer2). On the other hand,
> we
> > > > will work under Kyuubi's multi-tenant architecture to extend our
> > > > on-prem Spark SQL engine(a.k.a Kyuubi engine) to make it more stable
> > > > and efficient in our scenario.
> > > >
> > > > What's more, we are going to add more on-prem Kyuubi engine types,
> e.g.
> > > > Flink.
> > > >
> > > > Alexander Alten <alo@scalytics.io> 于2021年5月31日周一 下午2:35写道:
> > > >
> > > > >
> > > > > Hey,
> > > > >
> > > > > Looks like an interesting project, competition to Starburst. How
> > does it
> > > > > compare to Apache Dremel?
> > > > >
> > > > >  +1 (non-binding) for incubation.
> > > > >
> > > > > Thanks and stay safe,
> > > > > --alex
> > > > >
> > > > > On Mon, May 31, 2021, 08:21 Kent Yao <yao@apache.org> wrote:
> > > > >
> > > > > > Dear all,
> > > > > >
> > > > > > We want to propose Kyuubi as a new Apache Incubator project.
> > > > > >
> > > > > > Kyuubi is a distributed multi-tenant Thrift JDBC/ODBC server
for
> > > > > > large-scale data management, processing, and analytics, built
on
> > top
> > > > > > of Apache Spark and designed to support more engines (i.e.,
> Apache
> > > > > > Flink). We are aiming to make Kyuubi an "out-of-the-box" tool
for
> > data
> > > > > > warehouses and data lakes. Kyuubi concentrates on improving
the
> > > > > > experience for non-Spark users, making it easy for them to use
> > Spark
> > > > > > as a service and focus on business data of their own, not where
> it
> > > > > > stores, how it computes. NetEase has open-sourced Kyuubi since
> > 2018,
> > > > > > https://github.com/NetEase/kyuubi.
> > > > > >
> > > > > > Many thanks to Willem Jiang (Champion), Jeff Zhang, Duo Zhang,
> > Akira
> > > > > > Ajisaka for being the mentors of the Kyuubi project and helping
> us
> > set
> > > > > > up this proposal. The proposal can be found at
> > > > > >
> > https://cwiki.apache.org/confluence/display/INCUBATOR/KyuubiProposal.
> > > > > >
> > > > > > Looking forward to your feedback and thank you very much.
> > > > > >
> > > > > > Best regards,
> > > > > > Kent Yao
> > > > > >
> > > > > >
> > ---------------------------------------------------------------------
> > > > > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > > > > For additional commands, e-mail:
> general-help@incubator.apache.org
> > > > > >
> > > > > >
> > > >
> > > >
> > > >
> > > > --
> > > >
> > > >  Kent Yao
> > > > @ Data Science Center, Hangzhou Research Institute, NetEase Corp.
> > > > a spark enthusiast
> > > > kyuubiis a unified multi-tenant JDBC interface for large-scale data
> > > > processing and analytics, built on top of Apache Spark.
> > > >
> > > > spark-authorizerA Spark SQL extension which provides SQL Standard
> > > > Authorization for Apache Spark.
> > > > spark-postgres A library for reading data from and transferring data
> > > > to Postgres / Greenplum with Spark SQL and DataFrames, 10~100x
> faster.
> > > > itatchiA library that brings useful functions from various modern
> > > > database management systems to Apache Spark.
> > > >
> > > > ---------------------------------------------------------------------
> > > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > > For additional commands, e-mail: general-help@incubator.apache.org
> > > >
> > > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: general-help@incubator.apache.org
> >
> >
>


-- 

 *Kent Yao *
@ Data Science Center, Hangzhou Research Institute, NetEase Corp.
a spark enthusiast
kyuubi <https://github.com/yaooqinn/kyuubi>is a unified multi-tenant JDBC
interface for large-scale data processing and analytics, built on top of Apache
Spark <http://spark.apache.org/>.
spark-authorizer <https://github.com/yaooqinn/spark-authorizer>A Spark SQL
extension which provides SQL Standard Authorization for Apache Spark
<http://spark.apache.org/>.
spark-postgres <https://github.com/yaooqinn/spark-postgres> A library for
reading data from and transferring data to Postgres / Greenplum with Spark
SQL and DataFrames, 10~100x faster.
itatchi <https://github.com/yaooqinn/spark-func-extras>A library that
brings useful functions from various modern database management
systems to​ Apache
Spark <http://spark.apache.org/>.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message