From general-return-57430-apmail-incubator-general-archive=incubator.apache.org@incubator.apache.org Thu Sep 29 14:04:46 2016 Return-Path: X-Original-To: apmail-incubator-general-archive@www.apache.org Delivered-To: apmail-incubator-general-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 018AB1982D for ; Thu, 29 Sep 2016 14:04:46 +0000 (UTC) Received: (qmail 29605 invoked by uid 500); 29 Sep 2016 14:04:45 -0000 Delivered-To: apmail-incubator-general-archive@incubator.apache.org Received: (qmail 29371 invoked by uid 500); 29 Sep 2016 14:04:45 -0000 Mailing-List: contact general-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@incubator.apache.org Delivered-To: mailing list general@incubator.apache.org Received: (qmail 29321 invoked by uid 99); 29 Sep 2016 14:04:44 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Sep 2016 14:04:44 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 69AE1C0C0D for ; Thu, 29 Sep 2016 14:04:44 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.379 X-Spam-Level: ** X-Spam-Status: No, score=2.379 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx2-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id QrhXe-ImKPbs for ; Thu, 29 Sep 2016 14:04:35 +0000 (UTC) Received: from mail-yb0-f182.google.com (mail-yb0-f182.google.com [209.85.213.182]) by mx2-lw-us.apache.org (ASF Mail Server at mx2-lw-us.apache.org) with ESMTPS id 3B7D15FC17 for ; Thu, 29 Sep 2016 14:04:35 +0000 (UTC) Received: by mail-yb0-f182.google.com with SMTP id z8so17499438ybh.3 for ; Thu, 29 Sep 2016 07:04:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=iyWQ0qLHV0Fk4ClXPv1J1b+NREzePTxiRQwDH0lQwjg=; b=BQLzrxFJFYtWHuy54+nA6JJi7f8gJl/gELW58wioRwgdLlRsXKjNSdhHI0mos9skPw BP6dt2c60e8k58g47a7UAzbfSd57JakvrcEJ3mQrmmmuGUQ0EQ7MM+1rK5jkvS5Adky9 EAtxnmNTGZxREoO1jQKebP0ycBG8gmYZPe++u3/C/t4a42RXAFx4p71GuuQjwslrxedv 2ExEKw0nFSf8SHFcWa975pZcIXJdnoIyNKVYXTM2CNK3F6QGmkYt/T/9Ix0o3scpOuf0 KAbpRQ/QC0JF13rH3gqUY5sZsZmQvosTBLiuWwunkdxfdjWEQecpkxFXd3QGXxQ2zEJu cs2A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=iyWQ0qLHV0Fk4ClXPv1J1b+NREzePTxiRQwDH0lQwjg=; b=BaxRNikkd7KvOQy8pdYleULv0j6vbjnQKzExVTYhZJ2EK/W78tW8J3xDc8ZoF7usWH ElehyEaLZTlcTAzkJePUF0o1ZiQNjgKMPwxkKy2a7PYu//zIBsz3em+48cRw6cJ+M67K A8xzs253dYL5AnjKQ+1Rg9d0npGZ6pUOwRdGmOf4VHv9iTt3S6oXLlL8Y7Sy0GZhp2R2 JW3mPyfpd06OZPt/OuZ3uoweaKsmkrt6qdoEkv3/Pl8wOnmGtyhDRJI9qfSvtyhTizy7 mrCsNEtEbQJRCyE2vXL0yS4VyPJ6Vo3AvhLdLvXG88cjB7xp9NrnuakhmZ0rBz3zoRL3 aFXA== X-Gm-Message-State: AA6/9RkwYbODihSlindV0IbEK0TdJinf+yzC6SB3lsT5yrvgFvxn/61JCNVNSmgmDZJMW91PQZalo5OS1yWefw== X-Received: by 10.37.170.236 with SMTP id t99mr940006ybi.154.1475157868119; Thu, 29 Sep 2016 07:04:28 -0700 (PDT) MIME-Version: 1.0 Received: by 10.13.209.68 with HTTP; Thu, 29 Sep 2016 07:04:27 -0700 (PDT) In-Reply-To: References: From: Jason Plurad Date: Thu, 29 Sep 2016 10:04:27 -0400 Message-ID: Subject: Re: [DISCUSS] Olympian Incubation Proposal To: general@incubator.apache.org Content-Type: multipart/alternative; boundary=94eb2c19e60cb78d57053da5f451 --94eb2c19e60cb78d57053da5f451 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable The Titan community is serviced by the aureliusgraphs Google group, which is actually moderated by Datastax employees. I started a thread last week about continuing progress with Titan at Apache [1]. The intent with this proposal is not to fracture the Titan community, rather to preserve it. The community has been concerned about this for a long time with little response from Datastax [2][3][4]. Development on Titan by Datastax appears to be abandoned. The latest release of Titan was over a year ago. There is a titan11 branch with more recent development, but the last commit on that branch was 4 months ago. There are many pull requests ready for review/merge, including one to update Apache TinkerPop support, but those appear to be waiting on efforts from the lead Titan developers when they are free to do so [5]. The two lead developers of Titan have not appeared on the Google group in over 6 months. The last message from Matthias: September 2015, Dan: March 2016. We are aware of potential issues with the name Olympian. If accepted into the incubator, further research and consideration on selecting a new name will be done, as described in the proposal. -- Jason [1] Sep 19 https://groups.google.com/d/msg/aureliusgraphs/jEN_7QwVXZ4/mz3gik-FAgAJ [2] Apr 11 https://groups.google.com/d/msg/aureliusgraphs/R0RJnvVbgCs/vkYEsXD3HgAJ [3] Jun 30 https://groups.google.com/d/msg/aureliusgraphs/8chVUNHqHTA/i-N5b0Q3BQAJ [4] Jan 7 https://groups.google.com/d/msg/aureliusgraphs/e5L5M6MQozY/QHXtx5hFAwAJ [5] May 4 https://github.com/thinkaurelius/titan/pull/1312 On Thu, Sep 29, 2016 at 9:03 AM, Susan Malaika wrote: > Hi JB > Datastax know about the incubator effort. As far as I know they will not > sign the grant agreement. I was under the impression that the incubator > proposal can proceed after discussion if there is sufficient community > interest. > Susan Malaika > > -----Jean-Baptiste Onofr=C3=A9 wrote: ----- > To: general@incubator.apache.org > From: Jean-Baptiste Onofr=C3=A9 > Date: 09/29/2016 08:43AM > Subject: Re: [DISCUSS] Olympian Incubation Proposal > > Hi Henry, > > Is DataStax know and agree with the fork ? > > Else, the Software Grant Agreement won't be possible and it won't be > able to easy to head to graduation. > > Regards > JB > > On 09/29/2016 06:01 AM, Henry Saputra wrote: > > Hi All, > > > > Please find below a proposal for a new incubator podling, Apache > Olympian, > > formerly Titan. > > Apache Olympian is software designed to support the processing of graph= s > so > > large that they require storage and computational capacities beyond wha= t > a > > single machine can provide. > > > > This project will be a fork of Titan graph database project ( > > https://github.com/thinkaurelius/titan/) that already come with Apache > > License v2.0. > > The project was created by company called Aurelius and was acquired by > > Datstax. > > Coming to 2016 there has been less activity in the project as the > original > > authors are busy with other software development, but there is > significant > > interest from the community (see https://groups.google.com/forum/#!msg/ > > aureliusgraphs/jEN_7QwVXZ4/mz3gik-FAgAJ) > > > > The community have tried to reaching out to Datastax to donate the > > copyright and trademark of project to ASF but it was not approved. > > Because of that, the community has decided to go to ASF with different > > name: Apache Olympian. > > > > The wiki proposal page is located at this URL: > > > > https://wiki.apache.org/incubator/OlympianProposal > > > > I have also included the current text of that page below. > > > > Looking forward of comments or questions about this proposal. > > > > > > Thanks, > > Henry Saputra > > On behalf of Apache Olympian community > > > > > > =3D Apache Olympian Proposal =3D=3D > > > > =3D=3D Abstract =3D=3D > > > > Olympian (formerly Titan) is software designed to support the processin= g > of > > graphs so large that they require storage and computational capacities > > beyond what a single machine can provide. Scaling graph data processing > for > > real time traversals and analytical queries is Olympian=E2=80=99s main = benefit. > > > > =3D=3D Proposal =3D=3D > > > > Olympian consists of about 75K of Java code under the Apache 2 license > > . It supports very large > > graphs, with many concurrent transactions and operational graph > processing. > > Olympian graphs scale with the number of machines in the cluster. > Olympian > > already integrates with a number of Apache projects: > > > > - > > > > Provides native support for the popular property graph data model > > exposed by Apache TinkerPop . > > - > > > > Provides native support for the Gremlin graph traversal language > defined > > by Apache TinkerPop for programming language agnostic connectivity. > > - > > > > Provides graph persistence solutions with: > > - > > > > Apache Cassandra > > - > > > > Apache HBase > > - > > > > Provides advanced indexing with: > > - > > > > Apache Lucene > > - > > > > Apache Solr > > - > > > > Supports global graph analytics and batch graph processing through > > the Apache > > Hadoop framework with processors > implemented > > with: > > - > > > > Apache Spark > > - > > > > Apache Giraph > > > > > > Other software Olympian interfaces with includes: > > > > - > > > > BerkeleyDB > > - > > > > Elasticsearch > > > > > > =3D=3D Background =3D=3D > > > > Marko Rodriguez and Matthias Broecheler, cofounders of the Aurelius gra= ph > > consulting =EF=AC=81rm, developed the Titan distributed graph database = system and > > made it available under the Apache 2 license in 2012. Marko is also a > > cofounder of the Apache TinkerPop project and the primary developer of > the > > Gremlin graph traversal language. Other developers of Titan include Dan > > LaRocque, Stephen Mallette, Daniel Kuppitz, and Pavel Yaskevich. Datast= ax > > acquired Aurelius in February 2015, prior to the Titan 1.0 release in > > September 2015. > > > > Since Titan became available on GitHub, there have been 4434 commits, 3= 8 > > branches, 23 releases, and 35 contributors. In 2016 there has been les= s > > activity as the original authors are busy with other software > development, > > but there is significant interest from the community. > > > > =3D=3D Rationale =3D=3D > > > > (1) There are a number of Apache projects that integrate with Titan. > > > > (2) Apache Atlas (incubating) > packages > > and ships Titan as an essential component, yet Titan is not part of > Apache. > > > > (3) There are a number of existing users of Titan who are keen to > continue > > to develop the code. These users provide the basis of the community for > the > > proposed project. > > > > =3D=3D Initial Goals =3D=3D > > > > The initial goals are as follows: > > > > - > > > > Establish the project governance in The Apache Way and broaden the > > community. > > - > > > > Distribute an incubating release aligned with the latest Apache > > TinkerPop version and prepared in accordance with the Apache release > > process. > > - > > > > Improve the documentation. > > - > > > > Add more unit/scenario tests. > > - > > > > Contribute functional and performance-related enhancements to the > code. > > > > > > =3D=3D Current Status =3D=3D > > > > The project will be forked off the existing Titan code base. This code > has > > been available under the Apache 2 License but has not been subject to t= he > > Apache governance. The proposed project will adhere to Apache=E2=80=99s > governance > > and processes. This is one of the key benefits and reasons for bringing > the > > project forward as an incubator candidate. > > > > There are 37 pull requests currently open against Titan, and the last > pull > > request was merged in June 2016. During incubation, the community will > > adopt a voting-based approach to review and commit those changes into t= he > > code base in preparation for the first incubating release. > > > > =3D=3D=3D Meritocracy =3D=3D=3D > > > > The proposed project will adopt the familiar process of progression fro= m > > submitter to contributor to PMC. The community includes active committe= rs > > and PMC members on other Apache projects (e.g. Apache TinkerPop, Apache > > Atlas (incubating), Apache HBase). > > > > =3D=3D=3D Community =3D=3D=3D > > > > There is an active and passionate community of existing Titan users. It > is > > believed that this community will continue to grow and to progress. Tit= an > > is well-designed to support different backends, and the community will > > naturally grow as more backends are written to fit into the Titan > > architecture. Since the Titan 1.0 release, 3 different storage provider= s > > have become available. Also once an incubation release is made availabl= e, > > the community will likely see quick adoption from the Apache TinkerPop > user > > base. > > > > =3D=3D=3D Core Developers =3D=3D=3D > > > > The community includes developers from a number of vendors (e.g. Google= , > > HortonWorks, IBM, Mindmaps, Classmethod) and users (both academic and > > commercial). It contains two active committers and PMC members from the > > Apache TinkerPop project, one active committer and PPMC member from > Apache > > Atlas (incubating), and one committer from Apache HBase. The developers > > represent a good mixture of skills, including expertise with each of th= e > > supported providers. > > > > =3D=3D=3D Alignment =3D=3D=3D > > > > The proposed project will be used by or integrated with a number of oth= er > > Apache components, including (probably) TinkerPop, Atlas, Hadoop, Spark= , > > Cassandra, and HBase. It is logical that the project should also be hom= ed > > within Apache and subject to the governance principles of Apache. > > > > =3D=3D Known Risks =3D=3D > > > > =3D=3D=3D Orphaned products =3D=3D=3D > > > > All the companies and developers associated with academic institutions > who > > are engaged or want to be engaged with Titan are well aware of the open > > source philosophy and the importance of open governance of open source > > products. Hence, we think the risks of Titan being orphaned are minimal= . > > > > =3D=3D=3D Inexperience with Open Source =3D=3D=3D > > > > The project is based on an existing open source code base (Titan 1.0) a= nd > > the community consists of developers and vendors who have a history and > > strategy of open development and governance. The initial committers > include > > committers and PMC members from other Apache projects. > > > > =3D=3D=3D Homogenous Developers =3D=3D=3D > > > > The community consists of geographically-dispersed volunteers from > academic > > and a range of commercial organisations. The geographic diversity > includes > > North America, Europe, Asia, and Australia. > > > > =3D=3D=3D Reliance on Salaried Developers =3D=3D=3D > > > > Many of the developers are salaried by the vendors in the community, bu= t > > the vendors have publicly stated their support for open systems and > whilst > > we might expect to see some gradual replacement of members of the > > community, we believe that it will remain stable and viable into the > > future. All members of the community are passionate about the project a= nd > > are likely to contribute outside of =E2=80=98normal working hours=E2=80= =99. > > > > =3D=3D=3D Relationships with Other Apache Products =3D=3D=3D > > > > The proposed project has dependencies on other Apache projects, includi= ng > > Cassandra and HBase, for example. There are Apache projects that depend > > upon the availability of an open, scalable graph database. Apache Atlas > is > > an example of such a project. Apache S2Graph (incubating) > > is currently an incubator > project > > at Apache, however it does not currently implement the Apache TinkerPop > > interfaces, although it has an open JIRA for that effort. > > > > =3D=3D=3D An Excessive Fascination with the Apache Brand =3D=3D=3D > > > > Whilst the Apache brand will help to attract developers and consumers t= o > > the project, it is not for this reason that the proposal is being made. > It > > is to align the governance of the project with that of the other > components > > with which it is commonly used and to benefit from the development > > principles adopted by Apache. In particular, TinkerPop is Titan=E2=80= =99s most > > critical component/dependency, one so tight that Titan releases are > > contemporaneous or follow TinkerPop releases. > > > > =3D=3D Documentation =3D=3D > > > > Information on the existing Titan code base can be found at: > > http://titan.thinkaurelius.com/ > > > > =3D=3D Initial Source =3D=3D > > > > The initial source will be based off a fork of the Titan code base. The > > latter can be found at: https://github.com/thinkaurelius/titan. The > fork to > > be used as the base is from: https://github.com/pluradj/titan > > > > =3D=3D Source and Intellectual Property Submission Plan =3D=3D > > > > Since Datastax owns the copyright and trademark for Titan, when the > > proposal is accepted to the ASF Incubator, the community will choose a > > different name. It is proposed that Titan will enter incubation with th= e > > name Olympian. The community will finalize and document the name resear= ch > > during incubation. Individuals in the community have discussed the > > possibility of a software grant from Datastax, but Datastax was not > > interested in donating code or brand to the ASF. When asked if they wou= ld > > block others taking it to Apache they did not respond. > > > > =3D=3D External Dependencies =3D=3D > > > > Titan has the following external dependencies: > > > > * Java 1.8 > > > > * Apache Maven 3.0.5 (Apache 2.0 License) > > > > * JUnit 4.12 (EPL) > > > > * MRUnit 1.1.0 (Apache 2.0 License) > > > > * Apache Cassandra (Apache 2.0 License) > > > > * Jamm (Apache 2.0 License) > > > > * Metrics 2.1.1 and 3.0.1 (Apache 2.0 License) > > > > * Sesame 2.7.10 (Eclipse Public License Version 1.0) > > > > * slf4j 1.7.5 (MIT) > > > > * Apache HTTPComponents 4.4.1 (Apache 2.0 License) > > > > * Apache Hadoop 1.2.1 & 2.7.1 (Apache 2.0 License) > > > > * Apache HBase (Apache 2.0 License) > > > > * Jackson 1.9.2 & 2.4.4 (Apache 2.0 License) > > > > * Apache Lucene 4.10.4 (Apache 2.0 License) > > > > * Elasticsearch 1.5.1 (Apache 2.0 License) > > > > * Apache Commons Beanutils 1.7.0 (Apache 2.0 License) > > > > * Joda Time 1.6.2 (Apache 2.0 License) > > > > * Google ConcurrentLinkedHashMap (Apache 2.0 License) > > > > * Antlr 2.7.7 And 3.2 (BSD License) > > > > * ASM 3 & 4 (http://asm.ow2.org/license.html) > > > > * Apache Zookeeper 3.4.6 (Apache 2.0 License) > > > > * Jersey 1.9 (CDDL 1.1 and GPL v2) > > > > * JNA 4.0.0 (LGPL 2.1 and Apache 2.0 License) > > > > * Kuali Maven s3 Wagon 1.1.20 (Educational Community License, Version > 2.0) > > > > * Apache Tomcat Jasper 5.5.23 (Apache 2.0 License) > > > > * Berkeley DB 5.0.73 (Sleepycat License) > > > > Upon acceptance to the incubator, we would begin a thorough analysis of > all > > transitive dependencies to verify this information and introduce licens= e > > checking into the build and release process by integrating with Apache > > Rat. In the case where a dependency has an Apache incompatible license= , > > such as Berkeley DB, we will remove or replace it with an appropriate > > alternative. > > > > =3D=3D Cryptography =3D=3D > > > > Titan will support encryption of client-server communication through it= s > > use of the Apache TinkerPop Gremlin Server. We do not expect Titan to > be a > > controlled export due to its use of encryption. > > > > =3D=3D Required resources =3D=3D > > > > =3D=3D=3D Mailing lists =3D=3D=3D > > > > * private@olympian.incubator.apache.org (with moderated subscriptions) > > > > * commits@olympian.incubator.apache.org > > > > * dev@olympian.incubator.apache.org > > > > * user@olympian.incubator.apache.org > > > > =3D=3D=3D Git Repository =3D=3D=3D > > > > The team would like to use git for source control. We request a writabl= e > > git repo https://git-wip-us.apache.org/repos/asf/incubator-olympian.git= , > > and mirroring to be set up to GitHub through INFRA. We also request > > configuration for continuous integration with Travis CI. > > > > =3D=3D=3D Issue Tracking =3D=3D=3D > > > > Titan currently uses the GitHub issue tracker and the team would like t= o > > migrate all of these issues to the Apache JIRA. > > > > =3D=3D Initial Committers =3D=3D > > > > Dylan Bethune-Waddell - dylan.bethune.waddell@mail.utoronto.ca > > > > Mathias Bogaert - mathias.bogaert@gmail.com > > > > Misha Brukman - mbrukman@google.com > > > > Felix Chapman - felix@mindmaps.io > > > > Sheldon Hall - sheldon@mindmaps.io > > > > Jing Chen (Jerry) He - jerryjch@apache.org > > > > Madhan Neethiraj - mneethiraj@hortonworks.com > > > > Alexander Patrikalakis - amcp@me.com > > > > Jason Plurad - pluradj@apache.org > > > > Suma Shivaprasad - sumasai@apache.org > > > > Lindsay Smith - lindsaysmith@google.com > > > > Filipe Teixeira - fppintoteixeira@gmail.com > > > > Ted Wilmes - twilmes@apache.org > > > > =3D=3D Affiliations =3D=3D > > > > Dylan Bethune-Waddell - Jurisica Lab, Princess Margaret Cancer Centre, > UHN > > > > Mathias Bogaert - Independent Contractor > > > > Misha Brukman - Google > > > > Felix Chapman - Mindmaps > > > > Sheldon Hall - Mindmaps > > > > Jing Chen (Jerry) He - IBM > > > > Madhan Neethiraj - HortonWorks > > > > Alexander Patrikalakis - Classmethod, Inc. > > > > Jason Plurad - IBM > > > > Suma Shivaprasad - HortonWorks > > > > Lindsay Smith - Google > > > > Filipe Teixeira - Mindmaps > > > > Ted Wilmes - Expero Inc. > > > > =3D=3D Sponsors =3D=3D > > > > =3D=3D=3D Champion =3D=3D=3D > > > > Henry Saputra - hsaputra@apache.org > > > > =3D=3D=3D Nominated Mentors =3D=3D=3D > > > > Alan Gates - gates@apache.org > > > > P. Taylor Goetz - ptgoetz@apache.org > > > > Henry Saputra - hsaputra@apache.org > > > > Michael Stack - stack@apache.org > > > > =3D=3D=3D Sponsoring Entity =3D=3D=3D > > > > The Apache Incubator > > > > -- > Jean-Baptiste Onofr=C3=A9 > jbonofre@apache.org > http://blog.nanthrax.net > Talend - http://www.talend.com > > --------------------------------------------------------------------- > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org > For additional commands, e-mail: general-help@incubator.apache.org > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org > For additional commands, e-mail: general-help@incubator.apache.org > > --94eb2c19e60cb78d57053da5f451--