incubator-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Purtell <>
Subject Re: Slider Proposal
Date Thu, 10 Apr 2014 15:28:35 GMT
Hi Steve,

Does Slider target the deployment and management of components/projects in
the Hadoop project itself? Not just the ecosystem examples mentioned in the
proposal? I don't see this mentioned in the proposal.

The reason I ask is I'm wondering how Slider differentiates from projects
like Apache Twill or Apache Bigtop that are already existing vehicles for
achieving the aims discussed in the Slider proposal. Tackling
cross-component resource management issues could certainly be that, but
only if core Hadoop services are also brought into the deployment and
management model, because IO pathways extend over multiple layers and
components. You mention HBase and Accumulo as examples. Both are HDFS
clients. Would it be insufficient to reserve or restrict resources for e.g.
the HBase RegionServer without also considering the HDFS DataNode? Do the
HDFS DataNode and HBase RegionServer have exactly the same kind of
deployment, recovery/restart, and dynamic scaling concerns? Or are these
sort of considerations outside the Slider proposal scope?

On Mon, Mar 31, 2014 at 11:49 AM, Steve Loughran <>wrote:

> Hi
> For people wondering what's been happening with that Hoya proposal, I've
> got a successor proposal up for discussion.
> This proposal -as well as having a different name- is a superset of the
> original draft. It emphasises that making the tool usable by other
> applications via a client API is a key need -it's how some people have been
> using Hoya- and that packaging and service registration and discovery are
> key areas for improvement.
> The code is up on github at for
> people to download and play with
> If you look closely you'll see that the packaging is still .hoya, as are a
> lot of the classnames. That's something we'll fix during incubation, along
> with some of the code packaging.
> Comments?
> -Stevve
> --
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.

Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message