incubator-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Cheng Pan" <379377...@qq.com>
Subject RE: [DISCUSS] Incubating Proposal of Kyuubi
Date Wed, 02 Jun 2021 16:32:30 GMT
Hi all,


Thanks for the review and questions.


I'm one of the Kyuubi committers, and have participated in the recent 6 months, include code
changes[1], PR reviews,
documents improvements, discussions, etc.


I'd like to say, both Kent and other committers are nice and patient persons, and most of
the discussions and&nbsp;
code reviews happen in GitHub, I got many benefits from the contribution of Kyuubi.


Kyuubi community is still young, but growing.


From GitHub statistics[2], in the last 6 months, there are over 20 people participated in
Kyuubi code development, include
6 people over hundred lines change, 4 people over thousand lines change.


As a new committer, besides on code contribution, I'm also trying my best to extend the community.
I recommend those engineers&nbsp;
who are finding the way to migrate ETL infrastructure from Hive to Spark SQL to have a try
on Kyuubi, and collect the bug&nbsp;
reports[3][4] and some feature requests from them. I'm also looking for some potential contributors
from the open-source&nbsp;
community. For example, there is a project[5] build on top of Kyuubi to simplify to the deployment
of Spark SQL on Kubernetes.&nbsp;
And there is a blog[6](in Chinese) written in recent days that analyzed the architecture design
and code implementation of Kyuubi.
And from the mail lists in Apache Incubator discussions, I also see some people are interested
in this project.


I know there is still a long way to go to building the community, and hope to get helped by
Apache Incubator.


[1] https://github.com/NetEase/kyuubi/commits?author=pan3793
[2] https://github.com/NetEase/kyuubi/graphs/contributors?from=2020-12-01&amp;to=2021-06-02&amp;type=c
[3] https://github.com/NetEase/kyuubi/issues/280
[4] https://github.com/NetEase/kyuubi/issues/647
[5] https://github.com/yilong2001/spark-sql-on-k8s
[6] https://blog.51cto.com/xpleaf/2780248


Best,
Cheng Pan



------------------&nbsp;原始邮件&nbsp;------------------
发件人:                                                                               
                                        "general"                                        
                                           <atri@apache.org&gt;;
发送时间:&nbsp;2021年6月2日(星期三) 晚上11:26
收件人:&nbsp;"general"<general@incubator.apache.org&gt;;

主题:&nbsp;Re: [DISCUSS] Incubating Proposal of Kyuubi



I am genuinely worried about one contributor being the dominant of all.

This puts the stability of the project in jeopardy and unless this is
remedied, I feel the project should focus on developing a more diverse
community first.

On Wed, 2 Jun 2021, 20:23 Sheng Wu, <wu.sheng.841108@gmail.com&gt; wrote:

&gt; Hi Kent
&gt;
&gt; Thanks for replying, but to be honest, your mail format is chaos.
&gt; Take a look at bellowing, which is what I saw in the gmail.
&gt;
&gt; This may be an issue of your mail client or some else.
&gt;
&gt; &gt; The current #.2 - 5 top
&gt; &gt; contributors will stay as committers, and they will join the PPMC during
&gt; &gt; incubation.
&gt;
&gt; PPMC usually is the default for all initial committers, considering your
&gt; community is still small and not very active.
&gt; You should invite all people you trusted to join, rather than pushing them
&gt; away.
&gt; This is not just a too-high bar issue. Excluding 4 out of 5 is strange.
&gt; I can't guess what is the root cause, why the other 4 PPMC members don't
&gt; touch codes but are trusted completely. Meanwhile, people with easily
&gt; measurable code contributions are just as committers?
&gt; We(ASF) always remind the community to recognize no-code contribution, but
&gt; in this case, it seems the opposite? Don't recognize code contributors
&gt; enough?
&gt; Please reach your mentors, this seems not a typical ASF style. If you have
&gt; other people already involved in the ASF, asking them too.
&gt;
&gt; And from your description of the release process, I think you should talk
&gt; more with your mentors.
&gt; Such as what is a qualified ASF release, what should be checked.
&gt; This is not a block, the point I mentioned this is, you will need more
&gt; people.
&gt;
&gt;
&gt; Sheng Wu 吴晟
&gt; Twitter, wusheng1108
&gt;
&gt;
&gt; Kent Yao <yao@apache.org&gt; 于2021年6月2日周三 下午10:37写道:
&gt;
&gt; &gt; Hi Sheng,
&gt; &gt;
&gt; &gt; Thanks for your detailed check and valuable comments. They are
&gt; &gt; accommodating. I have addressed some of them directly in the proposal.
&gt; &gt; Please also check the table below for some Q&amp;As.
&gt; &gt; QA
&gt; &gt; You listed only 5 core maintainers, but clearly only one has dominated
&gt; &gt; contributions. The distortion and skewness of the contributions are
&gt; mainly
&gt; &gt; caused by the way how we merge PRs changed(mentioned in another email on
&gt; &gt; the list).
&gt; &gt; I agree with Atri, orphaned is measurable. It is better to adjust this
&gt; &gt; statement a little. Address the comment to notify the risk in the Kyuubi
&gt; &gt; proposal.
&gt; &gt; Also, with this fact, the core maintainers should notice whether this
&gt; small
&gt; &gt; group of people to make sure your features iteration, bug fix, and
&gt; release
&gt; &gt; process working by following ASF's requirements.This would not be an easy
&gt; &gt; job. Currently, we learn the release process from some Apache projects,
&gt; &gt; using major.minor.patch for versioning. As we can see, since Kyuubi 1.0,
&gt; it
&gt; &gt; takes us 2 ~ 3 weeks for a patch release that contains 5-10 bug fixes
&gt; until
&gt; &gt; EOL. And it takes us about two months to finish a minor release with 3 ~
&gt; 5
&gt; &gt; big improvements and various small features/bug fixes. We also will start
&gt; &gt; with some release candidates for preview and test before the final. This
&gt; is
&gt; &gt; how we develop and release Kyuubi for now, but we do have a long way to
&gt; go
&gt; &gt; and learn to match the ASF requirement.
&gt; &gt; And your committer list is very strange... 1. Why some of them are PPMC
&gt; and
&gt; &gt; others are committers? Where this hierarchy comes from? The current PPMC
&gt; &gt; candidates help us a lot build the Kyuubi project and community, not
&gt; &gt; directly to the codebase but as mentors(before Apache). Most of them are
&gt; &gt; from Apache mature TLPs, which have close relationships with Kyuubi. They
&gt; &gt; have sufficient Apache Way experience to guide us to become a more
&gt; &gt; Apache-like project before submitting this proposal in many ways. We will
&gt; &gt; continue to promote more contributors to the PPMC/committer based on
&gt; their
&gt; &gt; code or non-code contributions during incubation.
&gt; &gt; 2. Your core maintainers have 5, which only 4 PPMC? The current #.2 - 5
&gt; top
&gt; &gt; contributors will stay as committers, and they will join the PPMC during
&gt; &gt; incubation.
&gt; &gt; 3. I think only the top 4 have over 400 LOC, why you declared you have 5
&gt; &gt; core developers? I didn't notice that 400 LOC is a bar for core
&gt; developer,
&gt; &gt; will change 5 to 4 core developers accordingly
&gt; &gt; I think you don't have enough no-salaried developers, am I missing
&gt; &gt; anything? Yes.
&gt; &gt; Changed in the proposal, most of the contributors are salaried, and some
&gt; of
&gt; &gt; them are willing to help in the spare time. Thanks
&gt; &gt; This project belongs to NetEase Inc. clearly, why NO SGA? Added SGA in
&gt; &gt; Proposal. All work here is approved by NetEase and can be forward.
&gt; &gt; At last, you are asking about github.com/apache/incubator-kyuubi-shaded
&gt; &gt; repo,
&gt; &gt; what does this represent? I can only see you have only one source repo
&gt; and
&gt; &gt; a doc repo. Removed this requirement in the proposal, and we will apply
&gt; it
&gt; &gt; from IPMC if we do need this in the future.
&gt; &gt; ------------------------------
&gt; &gt;
&gt; &gt; Bests
&gt; &gt;
&gt; &gt; Kent Yao
&gt; &gt;
&gt; &gt; Sheng Wu <wu.sheng.841108@gmail.com&gt; 于2021年6月2日周三
下午5:45写道:
&gt; &gt;
&gt; &gt; &gt; Hi
&gt; &gt; &gt;
&gt; &gt; &gt; I read the contributor list and the proposal
&gt; &gt; &gt; &gt; The risk of the Kyuubi project being abandoned is minimal.
Many
&gt; &gt; &gt; organizations are using Kyuubi to build critical big data pipelines
and
&gt; &gt; &gt; willing to help develop Kyuubi's community if it becomes an ASF
&gt; project.
&gt; &gt; &gt;
&gt; &gt; &gt; I think the team should evaluate the status again. You listed only
5
&gt; core
&gt; &gt; &gt; maintainers, but clearly only one has dominated contributions.
I agree
&gt; &gt; with
&gt; &gt; &gt; Atri, orphaned is measurable.
&gt; &gt; &gt; It is better to adjust this statement a little. Also, with this
fact,
&gt; the
&gt; &gt; &gt; core maintainers should notice whether this small group of people
to
&gt; make
&gt; &gt; &gt; sure your features iteration, bug fix, and release process working
by
&gt; &gt; &gt; following ASF's requirements.
&gt; &gt; &gt; This would not be an easy job.
&gt; &gt; &gt;
&gt; &gt; &gt; And your committer list is very strange
&gt; &gt; &gt; ```
&gt; &gt; &gt; Kent Yao (yao@apache.org) (PPMC)
&gt; &gt; &gt; Wenchen Fan (wenchen@apache.org) (PPMC)
&gt; &gt; &gt; Wanqiang Ji (jiwq@apache.org) (PPMC)
&gt; &gt; &gt; Xun Liu (liuxun@apache.org) (PPMC)
&gt; &gt; &gt; Fei Wang (cn.feiwang@gmail.com)
&gt; &gt; &gt; Ulysses You (ulyssesyou18@gmail.com)
&gt; &gt; &gt; Cheng Pan (pan3793@gmail.com)
&gt; &gt; &gt; Hongxiang Jiang (jhx1008@gmail.com)
&gt; &gt; &gt; Zen Jin(xinjingziranchan@gmail.com)
&gt; &gt; &gt; ```
&gt; &gt; &gt; 1. Why some of them are PPMC and others are committers? Where this
&gt; &gt; &gt; hierarchy comes from?
&gt; &gt; &gt; 2. Your core maintainers have 5, which only 4 PPMC? (Even hierarchy
&gt; makes
&gt; &gt; &gt; sense, most likely not)
&gt; &gt; &gt; 3. I think only the top 4 have over 400 LOC, why you declared you
have
&gt; 5
&gt; &gt; &gt; core developers?
&gt; &gt; &gt;
&gt; &gt; &gt; Another re-evaluation request is about `Reliance on Salaried
&gt; Developers:`
&gt; &gt; &gt; &gt; They are all passionate about the project, and we are
confident that
&gt; &gt; the
&gt; &gt; &gt; project will continue even if no salaried developers contribute
to the
&gt; &gt; &gt; project.
&gt; &gt; &gt;
&gt; &gt; &gt; I think you don't have enough no-salaried developers, am I missing
&gt; &gt; &gt; anything?
&gt; &gt; &gt;
&gt; &gt; &gt; About IP clearance, `Initial Source and Intellectual Property
&gt; Submission
&gt; &gt; &gt; Plan`
&gt; &gt; &gt; &gt; As soon as Kyuubi is approved to join Apache Incubator,
our initial
&gt; &gt; &gt; committers will submit iCLA(s) and CCLA(s). The codebase is already
&gt; &gt; &gt; licensed under the Apache License 2.0.
&gt; &gt; &gt;
&gt; &gt; &gt; This project belongs to NetEase Inc. clearly, why NO SGA?
&gt; &gt; &gt;
&gt; &gt; &gt; At last, you are asking about `
&gt; &gt; github.com/apache/incubator-kyuubi-shaded`
&gt; <http://github.com/apache/incubator-kyuubi-shaded&gt;
&gt; &gt; <http://github.com/apache/incubator-kyuubi-shaded&gt;
&gt; &gt; &gt; <http://github.com/apache/incubator-kyuubi-shaded&gt;
&gt; &gt; &gt; repo, what does this represent? I can only see you have only one
source
&gt; &gt; &gt; repo and a doc repo.
&gt; &gt; &gt;
&gt; &gt; &gt; Sheng Wu 吴晟
&gt; &gt; &gt; Twitter, wusheng1108
&gt; &gt; &gt;
&gt; &gt; &gt;
&gt; &gt; &gt; Atri Sharma <atri@apache.org&gt; 于2021年6月2日周三
下午4:49写道:
&gt; &gt; &gt;
&gt; &gt; &gt; &gt; Thanks.
&gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; I looked at the link you advised on and if I am reading
it correctly,
&gt; &gt; top
&gt; &gt; &gt; &gt; committer has 630ish commits and the next committer has
73 commits?
&gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; IMO this is an indication of the community not being active
enough
&gt; and
&gt; &gt; &gt; &gt; hence the risk of project getting orphaned is measurable.
&gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; Atri
&gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; On Wed, 2 Jun 2021, 06:57 Willem Jiang, <willem.jiang@gmail.com&gt;
&gt; &gt; wrote:
&gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; Hi Atri Sharma,
&gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; It's easier to check out the recent contribution
of kyuubi from
&gt; this
&gt; &gt; &gt; &gt; &gt; link[1].
&gt; &gt; &gt; &gt; &gt; We already identified the one person contribution
issue of kyuubi
&gt; &gt; when
&gt; &gt; &gt; &gt; &gt; Kent came to us and we kept reminding him to
put more effort into
&gt; &gt; &gt; &gt; &gt; building the community.
&gt; &gt; &gt; &gt; &gt; Last week I had a long F2F conversation with
Kent, I think he
&gt; already
&gt; &gt; &gt; &gt; &gt; knows about it and there have been some improvements
in recent
&gt; months
&gt; &gt; &gt; &gt; &gt; but there is still a long way to go if Kyuubi
is accepted as a
&gt; &gt; podling
&gt; &gt; &gt; &gt; &gt; in the Apache Incubator.
&gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; [1]https://github.com/NetEase/kyuubi/graphs/contributors
&gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; Willem Jiang
&gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; Twitter: willemjiang
&gt; &gt; &gt; &gt; &gt; Weibo: 姜宁willem
&gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; On Tue, Jun 1, 2021 at 10:52 PM Atri Sharma <atri@apache.org&gt;
&gt; wrote:
&gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; Hi,
&gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; I took a look at commit log and seems
like all the commits for
&gt; &gt; last 3
&gt; &gt; &gt; &gt; &gt; &gt; months have been done by a single person.
&gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; How active are the remaining committers?
&gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; On Mon, 31 May 2021, 12:59 Kent Yao,
<yao@apache.org&gt; wrote:
&gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; Hi Alexander Alten,
&gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; Thanks for your interest and
+1 for Kyuubi.
&gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; Not being very familiar with
Dremel, I just took a quick look
&gt; at
&gt; &gt; &gt; the
&gt; &gt; &gt; &gt; &gt; &gt; &gt; profile of a very similar and
exciting project, Apache Drill.
&gt; If
&gt; &gt; I
&gt; &gt; &gt; &gt; &gt; &gt; &gt; understand correctly, Kyuubi
is built on top of the compute
&gt; layer
&gt; &gt; &gt; &gt; &gt; &gt; &gt; (Apache Spark), while Apache
Drill is built on top of the
&gt; storage
&gt; &gt; &gt; &gt; &gt; &gt; &gt; layer.
&gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; Apache Spark has a large user
base and usage scenarios all over
&gt; &gt; the
&gt; &gt; &gt; &gt; &gt; &gt; &gt; world. When users have some
basic Spark programming and tuning
&gt; &gt; &gt; &gt; skills,
&gt; &gt; &gt; &gt; &gt; &gt; &gt; things are easy for them. But
many times, most users do not
&gt; have
&gt; &gt; &gt; all
&gt; &gt; &gt; &gt; &gt; &gt; &gt; of these abilities when they
use Spark directly or indirectly.
&gt; We
&gt; &gt; &gt; &gt; want
&gt; &gt; &gt; &gt; &gt; &gt; &gt; to build a more easy-to-use
platform on top of it to help these
&gt; &gt; &gt; &gt; users.
&gt; &gt; &gt; &gt; &gt; &gt; &gt; On the one hand, we will work
on the interface layer to make it
&gt; &gt; &gt; easy
&gt; &gt; &gt; &gt; &gt; &gt; &gt; to access (of course, this
effort will make our project look
&gt; very
&gt; &gt; &gt; &gt; &gt; &gt; &gt; similar to other projects,
such as HiveServer2). On the other
&gt; &gt; hand,
&gt; &gt; &gt; &gt; we
&gt; &gt; &gt; &gt; &gt; &gt; &gt; will work under Kyuubi's multi-tenant
architecture to extend
&gt; our
&gt; &gt; &gt; &gt; &gt; &gt; &gt; on-prem Spark SQL engine(a.k.a
Kyuubi engine) to make it more
&gt; &gt; &gt; stable
&gt; &gt; &gt; &gt; &gt; &gt; &gt; and efficient in our scenario.
&gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; What's more, we are going to
add more on-prem Kyuubi engine
&gt; &gt; types,
&gt; &gt; &gt; &gt; e.g.
&gt; &gt; &gt; &gt; &gt; &gt; &gt; Flink.
&gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; Alexander Alten <alo@scalytics.io&gt;
于2021年5月31日周一 下午2:35写道:
&gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; Hey,
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; Looks like an interesting
project, competition to Starburst.
&gt; &gt; How
&gt; &gt; &gt; &gt; &gt; does it
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; compare to Apache
Dremel?
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt;&nbsp; +1 (non-binding)
for incubation.
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; Thanks and stay safe,
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; --alex
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; On Mon, May 31, 2021,
08:21 Kent Yao <yao@apache.org&gt; wrote:
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; Dear all,
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; We want to
propose Kyuubi as a new Apache Incubator
&gt; project.
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; Kyuubi is
a distributed multi-tenant Thrift JDBC/ODBC
&gt; server
&gt; &gt; &gt; for
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; large-scale
data management, processing, and analytics,
&gt; built
&gt; &gt; &gt; on
&gt; &gt; &gt; &gt; &gt; top
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; of Apache
Spark and designed to support more engines (i.e.,
&gt; &gt; &gt; &gt; Apache
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; Flink). We
are aiming to make Kyuubi an "out-of-the-box"
&gt; tool
&gt; &gt; &gt; for
&gt; &gt; &gt; &gt; &gt; data
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; warehouses
and data lakes. Kyuubi concentrates on improving
&gt; &gt; the
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; experience
for non-Spark users, making it easy for them to
&gt; &gt; use
&gt; &gt; &gt; &gt; &gt; Spark
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; as a service
and focus on business data of their own, not
&gt; &gt; where
&gt; &gt; &gt; &gt; it
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; stores, how
it computes. NetEase has open-sourced Kyuubi
&gt; &gt; since
&gt; &gt; &gt; &gt; &gt; 2018,
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; https://github.com/NetEase/kyuubi.
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; Many thanks
to Willem Jiang (Champion), Jeff Zhang, Duo
&gt; &gt; Zhang,
&gt; &gt; &gt; &gt; &gt; Akira
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; Ajisaka for
being the mentors of the Kyuubi project and
&gt; &gt; helping
&gt; &gt; &gt; &gt; us
&gt; &gt; &gt; &gt; &gt; set
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; up this proposal.
The proposal can be found at
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt;
&gt; https://cwiki.apache.org/confluence/display/INCUBATOR/KyuubiProposal
&gt; &gt; .
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; Looking forward
to your feedback and thank you very much.
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; Best regards,
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; Kent Yao
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt;
&gt; ---------------------------------------------------------------------
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; To unsubscribe,
e-mail:
&gt; &gt; &gt; general-unsubscribe@incubator.apache.org
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; For additional
commands, e-mail:
&gt; &gt; &gt; &gt; general-help@incubator.apache.org
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; --
&gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt;&nbsp; Kent Yao
&gt; &gt; &gt; &gt; &gt; &gt; &gt; @ Data Science Center, Hangzhou
Research Institute, NetEase
&gt; Corp.
&gt; &gt; &gt; &gt; &gt; &gt; &gt; a spark enthusiast
&gt; &gt; &gt; &gt; &gt; &gt; &gt; kyuubiis a unified multi-tenant
JDBC interface for large-scale
&gt; &gt; data
&gt; &gt; &gt; &gt; &gt; &gt; &gt; processing and analytics, built
on top of Apache Spark.
&gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt; spark-authorizerA Spark SQL
extension which provides SQL
&gt; Standard
&gt; &gt; &gt; &gt; &gt; &gt; &gt; Authorization for Apache Spark.
&gt; &gt; &gt; &gt; &gt; &gt; &gt; spark-postgres A library for
reading data from and transferring
&gt; &gt; &gt; data
&gt; &gt; &gt; &gt; &gt; &gt; &gt; to Postgres / Greenplum with
Spark SQL and DataFrames, 10~100x
&gt; &gt; &gt; &gt; faster.
&gt; &gt; &gt; &gt; &gt; &gt; &gt; itatchiA library that brings
useful functions from various
&gt; modern
&gt; &gt; &gt; &gt; &gt; &gt; &gt; database management systems
to Apache Spark.
&gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; ---------------------------------------------------------------------
&gt; &gt; &gt; &gt; &gt; &gt; &gt; To unsubscribe, e-mail:
&gt; general-unsubscribe@incubator.apache.org
&gt; &gt; &gt; &gt; &gt; &gt; &gt; For additional commands, e-mail:
&gt; &gt; general-help@incubator.apache.org
&gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt;
&gt; ---------------------------------------------------------------------
&gt; &gt; &gt; &gt; &gt; To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
&gt; &gt; &gt; &gt; &gt; For additional commands, e-mail: general-help@incubator.apache.org
&gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt; &gt;
&gt; &gt; &gt; &gt;
&gt; &gt; &gt;
&gt; &gt;
&gt; &gt;
&gt; &gt; --
&gt; &gt;
&gt; &gt;&nbsp; *Kent Yao *
&gt; &gt; @ Data Science Center, Hangzhou Research Institute, NetEase Corp.
&gt; &gt; a spark enthusiast
&gt; &gt; kyuubi <https://github.com/yaooqinn/kyuubi&gt;is a unified multi-tenant
&gt; JDBC
&gt; &gt; interface for large-scale data processing and analytics, built on top of
&gt; &gt; Apache
&gt; &gt; Spark <http://spark.apache.org/&gt;.
&gt; &gt; spark-authorizer <https://github.com/yaooqinn/spark-authorizer&gt;A
Spark
&gt; SQL
&gt; &gt; extension which provides SQL Standard Authorization for Apache Spark
&gt; &gt; <http://spark.apache.org/&gt;.
&gt; &gt; spark-postgres <https://github.com/yaooqinn/spark-postgres&gt; A
library
&gt; for
&gt; &gt; reading data from and transferring data to Postgres / Greenplum with
&gt; Spark
&gt; &gt; SQL and DataFrames, 10~100x faster.
&gt; &gt; itatchi <https://github.com/yaooqinn/spark-func-extras&gt;A library
that
&gt; &gt; brings useful functions from various modern database management
&gt; &gt; systems to Apache
&gt; &gt; Spark <http://spark.apache.org/&gt;.
&gt; &gt;
&gt;
Mime
  • Unnamed multipart/alternative (inline, 8-Bit, 0 bytes)
View raw message