Re: Hoya Proposal

2014-03-10 Thread Steve Loughran
We're doing some redesign and need to get some more progress on that before putting the proposal out -otherwise people wouldn't get a current view of what's being built. -steve On 5 March 2014 01:07, Roman Shaposhnik wrote: > Steve, > > I am just wondering: are you in a position to move forwar

Re: Hoya Proposal

2014-03-04 Thread Roman Shaposhnik
Steve, I am just wondering: are you in a position to move forward with the proposal at this point or are you still mulling over the feedback? Thanks, Roman. On Wed, Jan 8, 2014 at 7:08 AM, Steve Loughran wrote: > I'm starting to put together the incubation proposal for Hoya: a tool to > dynamic

Re: Hoya Proposal

2014-02-05 Thread Steve Loughran
not yet, but that should be the goal. It's already a hadoop-cliuster-ready app, so all that is needed is patching the configs for the target cluster (filesystem, ZK, security) and building up the commands to exec On 2 February 2014 17:55, Edward J. Yoon wrote: > Hi, Hoya looks nice. > > > 5. He

Re: Hoya Proposal

2014-02-02 Thread Edward J. Yoon
Hi, Hoya looks nice. > 5. Help migrate more distributed applications into YARN clusters - such as > Apache HAMA. BTW, this means that HAMA can be deployed on YARN cluster using HOYA without implement separate YARN application? On Wed, Jan 22, 2014 at 6:42 PM, Steve Loughran wrote: > thanks Jak

Re: Hoya Proposal

2014-01-22 Thread Steve Loughran
thanks Jakob - we haven't had a vote yet though, still discussing the proposal On 22 January 2014 06:57, Jakob Homan wrote: > HOYA looks like a useful bit of code,which if squinted at appropriately, > might, sorta be able to be implemented with another useful bit of code > already in the incuba

Re: Hoya Proposal

2014-01-21 Thread Jakob Homan
HOYA looks like a useful bit of code,which if squinted at appropriately, might, sorta be able to be implemented with another useful bit of code already in the incubator. But could just as well be independent. Let's let HOYA in and see where the communities that develop around it and Twill want to

Re: Hoya Proposal

2014-01-21 Thread Chris Riccomini
Hey Guys, I'd like to +1 non-binding Hoya (or whatever you want to call it). It's going to be really useful for the YARN ecosystem to have a project like this out there, and it makes a lot of sense to put it in Apache. Hopefully we can move past the naming stuff, and get the project in. Cheers,

Re: Hoya Proposal

2014-01-20 Thread Tommaso Teofili
I just can speak for the Hama-to-Yarn use case (with my newbie hat on) and it seems Hoya may be really helpful as the entry point to address it as it provides a set of simple and useful tools. For the sake of the names I think Hoya would be good (while Hyena would not). Just my 0.02 cents, Tommaso

Re: Hoya Proposal

2014-01-17 Thread Andreas Neumann
Deveraj, all these features that you list are not only useful for existing applications but also for applications developed with Twill. But I agree that the initial focus of the projects is different, and we should keep talking in the future abut possible convergence. -Andreas. On Fri, Jan 17,

Re: Hoya Proposal

2014-01-17 Thread Bertrand Delacretaz
On Wed, Jan 15, 2014 at 1:57 AM, lars hofhansl wrote: > ...I should we shouldn't rule out a name just because the English > pronunciation is similar to another project. > Will people really confuse Apache Hyena and Apache Jena?... At this early stage it's very easy to switch names, so let's avoi

Re: Hoya Proposal

2014-01-17 Thread Bernd Fondermann
On Fri, Jan 17, 2014 at 1:13 PM, Steve Loughran wrote: > On 17 January 2014 10:10, Bernd Fondermann wrote: > >> (side note: When a project graduates, a PMC is established and tasked with >> a specific task. Two PMCs cannot have the same task. Therefore, it is >> better in my opinion to either clea

Re: Hoya Proposal

2014-01-17 Thread Steve Loughran
On 17 January 2014 10:10, Bernd Fondermann wrote: > Very informative explanation. I've got a better understanding of the > proposal now. > > I suggest that a remark like this is added to the Hoya proposal, so this > part of the discussion becomes part of the vote on the propo

Re: Hoya Proposal

2014-01-17 Thread Bernd Fondermann
Very informative explanation. I've got a better understanding of the proposal now. I suggest that a remark like this is added to the Hoya proposal, so this part of the discussion becomes part of the vote on the proposal.The proposal's "Known Risk" section lacks a "Relati

Re: Hoya Proposal

2014-01-17 Thread Steve Loughran
> Andreas, to me, Twill is a library, a convenience library, that one > can use to write Yarn apps. Hoya aims to provide a general framework > using which one can take existing apps (HBase/Accumulo to start with), > and make them run well in a Yarn cluster, without intruding at all > into the App i

Re: Hoya Proposal

2014-01-17 Thread Steve Loughran
On 16 January 2014 12:41, Tommaso Teofili wrote: > Hi all, > > @Steve I'm curious to know if also Apache Hama may leverage Hoya to be > deployed on YARN. > > If you are going to make a 100% commit to running in YARN -which, if you aren't ready yet, Hama should be able to do in some point in the f

Re: Hoya Proposal

2014-01-16 Thread Devaraj Das
Andreas, to me, Twill is a library, a convenience library, that one can use to write Yarn apps. Hoya aims to provide a general framework using which one can take existing apps (HBase/Accumulo to start with), and make them run well in a Yarn cluster, without intruding at all into the App internals.

Re: Hoya Proposal

2014-01-16 Thread Andreas Neumann
I do see a lot of value in all the features of Hoya, and I am not trying to discredit it. Yet I do think that most of these features are actually already in Twill or would be great additions to Twill, and sooner or later will be implemented in Twill, implying even greater overlap. I am not sure wh

Re: Hoya Proposal

2014-01-16 Thread Tommaso Teofili
Hi all, @Steve I'm curious to know if also Apache Hama may leverage Hoya to be deployed on YARN. If yes, that'd hopefully bring some more people involved from Hama as well. My 0.02 cents, Tommaso 2014/1/14 Enis Söztutar > > +1 -I'd really like input from the HBase and Accumulo teams as they

Re: Hoya Proposal

2014-01-16 Thread Enis Söztutar
> +1 -I'd really like input from the HBase and Accumulo teams as they are the first apps we're trying to work with. Great, please add me as a mentor than. There is another animal named "Nyala" ( http://thewebsiteofeverything.com/animals/mammals/Artiodactyla/Bovidae/Tragelaphus/Tragelaphus-angasii

Re: Hoya Proposal

2014-01-15 Thread Josh Elser
I wanted to weigh in on some of Steve's thoughts, I'm actually really excited about being able to leverage Hoya inside of Accumulo itself. We presently have a few system tests that rely on manual set up, which can be frustrating to deal with on a beefy boxes (running multiple Accumulo procs on a s

Re: Hoya Proposal

2014-01-15 Thread Bernd Fondermann
I think that Andreas has a valid point. With the description you are giving here, there seems to be much more overlap with the Twill podling than I initially anticipated. In the Hoya proposal, I'd like to learn about how it compares to Twill and why it makes sense to start another such po

Re: Hoya Proposal

2014-01-15 Thread Steve Loughran
On 15 January 2014 02:13, Andreas Neumann wrote: > I see. So is Hoya limited to HBase and Accumulo? Or is it open for any > other type of existing application? If so, won't it have some common > abstraction that is shared by all of them? That is where I see the > similarity with Twill. > > it sta

Re: Hoya Proposal

2014-01-14 Thread Andreas Neumann
I see. So is Hoya limited to HBase and Accumulo? Or is it open for any other type of existing application? If so, won't it have some common abstraction that is shared by all of them? That is where I see the similarity with Twill. Whereas, if it is a separate effort for each existing application, s

Re: Hoya Proposal

2014-01-14 Thread lars hofhansl
pache.org Sent: Tuesday, January 14, 2014 4:03 AM Subject: Re: Hoya Proposal As a project name "Jena" has been in use for the project for about 13 years now.  1.0 was 9 Jan 2001.  A mere 983K (zipped). The discussion is about Hyena for Hoya.     Andy On 13/01/14 23:38, sebb w

Re: Hoya Proposal

2014-01-14 Thread Steve Loughran
I don't this is something to worry about much -Hoya is good too, lots of things outlive their acroynms. SOAP, for example On 14 January 2014 12:03, Andy Seaborne wrote: > As a project name "Jena" has been in use for the project for about 13 > years now. 1.0 was 9 Jan 2001. A mere 983K (zippe

Re: Hoya Proposal

2014-01-14 Thread Andy Seaborne
As a project name "Jena" has been in use for the project for about 13 years now. 1.0 was 9 Jan 2001. A mere 983K (zipped). The discussion is about Hyena for Hoya. Andy On 13/01/14 23:38, sebb wrote: Jenny ? On 13 January 2014 22:21, Ted Dunning wrote: Too many people will read t

Re: Hoya Proposal

2014-01-14 Thread Bernd Fondermann
Which languages are they? I would expect the english pronounciation would be relevant, where Hyena (see http://en.wiktionary.org/wiki/hyena) is quite different from Jena. Bernd On Mon, Jan 13, 2014 at 9:25 PM, Bertrand Delacretaz wrote: > On Mon, Jan 13, 2014 at 5:36 PM, Bertrand Delacretaz

Re: Hoya Proposal

2014-01-14 Thread Steve Loughran
I'd put more in common with Helix than twill -twill is for building YARN apps, Hoya focused on deploying existing apps into YARN containers. It's a lot more minimal than Helix -it doesn't run its own code in any of the containers other than the AM On 14 January 2014 03:33, Andreas Neumann wrote:

Re: Hoya Proposal

2014-01-13 Thread Andreas Neumann
Hi Steve, Hoya has a lot of good ideas. How do think it relates to Twill (recently incubated at http://twill.incubator.apache.org/)? I feel that there is a lot of overlap in what both projects are trying to achieve. Do you think they complement each other? Is there opportunity for collaboration, p

Re: Hoya Proposal

2014-01-13 Thread larry mccay
Hoya - Hadoop Oriented Yarn Applications. :) As Andrew indicates - stick with Hoya. On Mon, Jan 13, 2014 at 7:18 PM, Andrew Purtell wrote: > There isn't anything in the same domain named Hoya that I am aware of. One > can get to Hoya from other avenues - it is a county and city in Germany; or

Re: Hoya Proposal

2014-01-13 Thread Andrew Purtell
There isn't anything in the same domain named Hoya that I am aware of. One can get to Hoya from other avenues - it is a county and city in Germany; or it is the genus for several hundred tropical plants. According to http://en.wikipedia.org/wiki/Hoya, hoya flowers grow in a configuration referred t

Re: Hoya Proposal

2014-01-13 Thread sebb
Jenny ? On 13 January 2014 22:21, Ted Dunning wrote: > Too many people will read that as Jena, the city in Thuringia. > > https://en.wikipedia.org/wiki/Jena > > -1 > > > > > On Mon, Jan 13, 2014 at 1:57 PM, Andy Seaborne wrote: > >> On 13/01/14 20:25, Bertrand Delacretaz wrote: >> >>> On Mon, Ja

Re: Hoya Proposal

2014-01-13 Thread Ted Dunning
Too many people will read that as Jena, the city in Thuringia. https://en.wikipedia.org/wiki/Jena -1 On Mon, Jan 13, 2014 at 1:57 PM, Andy Seaborne wrote: > On 13/01/14 20:25, Bertrand Delacretaz wrote: > >> On Mon, Jan 13, 2014 at 5:36 PM, Bertrand Delacretaz >> wrote: >> >>> On Mon, Jan

Re: Hoya Proposal

2014-01-13 Thread Andy Seaborne
On 13/01/14 21:57, Andy Seaborne wrote: On 13/01/14 20:25, Bertrand Delacretaz wrote: On Mon, Jan 13, 2014 at 5:36 PM, Bertrand Delacretaz wrote: On Mon, Jan 13, 2014 at 3:33 PM, Steve Loughran wrote: ...What do people think about a project name "Hyena"? It's close enough, lives in the savan

Re: Hoya Proposal

2014-01-13 Thread Andy Seaborne
On 13/01/14 20:25, Bertrand Delacretaz wrote: On Mon, Jan 13, 2014 at 5:36 PM, Bertrand Delacretaz wrote: On Mon, Jan 13, 2014 at 3:33 PM, Steve Loughran wrote: ...What do people think about a project name "Hyena"? It's close enough, lives in the savannah... I think it's too close to http:/

Re: Hoya Proposal

2014-01-13 Thread larry mccay
I agree with Marvin. Either works fine. The original meaning of Hoya doesn't have to continue to be acknowledged. On Mon, Jan 13, 2014 at 12:02 PM, Marvin Humphrey wrote: > On Mon, Jan 13, 2014 at 6:33 AM, Steve Loughran > wrote: > > > On that note, I know we've used the acronym "hoya", HBase

Re: Hoya Proposal

2014-01-13 Thread Bertrand Delacretaz
On Mon, Jan 13, 2014 at 5:36 PM, Bertrand Delacretaz wrote: > On Mon, Jan 13, 2014 at 3:33 PM, Steve Loughran > wrote: >> ...What do people think about a project name "Hyena"? It's close enough, >> lives >> in the savannah... > > I think it's too close to http://jena.apache.org/ to be clear, t

Re: Hoya Proposal

2014-01-13 Thread Dave Fisher
On Jan 13, 2014, at 6:33 AM, Steve Loughran wrote: > On 9 January 2014 21:55, Enis Söztutar wrote: > >> Proposal looks good. Let me know if you need any additional help in >> mentors. >> >> Enis >> > > +1 -I'd really like input from the HBase and Accumulo teams as they are the > first apps w

Re: Hoya Proposal

2014-01-13 Thread Steve Loughran
On 10 January 2014 09:54, Jean-Baptiste Onofré wrote: > Hi Steve, > > can I help during the week end ? > > Regards > JB I'm just running the post-rename tests now; functional test runner came first... -steve > > > On 01/10/2014 10:31 AM, Steve Loughran wrote: > >> I'm going to do the rename o

Re: Hoya Proposal

2014-01-13 Thread Bernd Fondermann
+1 Bernd On Mon, Jan 13, 2014 at 4:44 PM, Jean-Baptiste Onofré wrote: > +1 for Hyena. > > Regards > JB > > > On 01/13/2014 03:33 PM, Steve Loughran wrote: > >> On 9 January 2014 21:55, Enis Söztutar wrote: >> >> Proposal looks good. Let me know if you need any additional help in >>> mentors

Re: Hoya Proposal

2014-01-13 Thread Marvin Humphrey
On Mon, Jan 13, 2014 at 6:33 AM, Steve Loughran wrote: > On that note, I know we've used the acronym "hoya", HBase on YARN, but it is > already a bit out of date. > > What do people think about a project name "Hyena"? It's close enough, lives > in the savannah... Based on Google searches for `ho

Re: Hoya Proposal

2014-01-13 Thread Bertrand Delacretaz
On Mon, Jan 13, 2014 at 3:33 PM, Steve Loughran wrote: > ...What do people think about a project name "Hyena"? It's close enough, lives > in the savannah... I think it's too close to http://jena.apache.org/ -Bertrand - To unsub

Re: Hoya Proposal

2014-01-13 Thread Jean-Baptiste Onofré
+1 for Hyena. Regards JB On 01/13/2014 03:33 PM, Steve Loughran wrote: On 9 January 2014 21:55, Enis Söztutar wrote: Proposal looks good. Let me know if you need any additional help in mentors. Enis +1 -I'd really like input from the HBase and Accumulo teams as they are the first apps we

Re: Hoya Proposal

2014-01-13 Thread Steve Loughran
On 9 January 2014 21:55, Enis Söztutar wrote: > Proposal looks good. Let me know if you need any additional help in > mentors. > > Enis > +1 -I'd really like input from the HBase and Accumulo teams as they are the first apps we're trying to work with. On that note, I know we've used the acronym

Re: Hoya Proposal

2014-01-10 Thread Jean-Baptiste Onofré
Hi Steve, can I help during the week end ? Regards JB On 01/10/2014 10:31 AM, Steve Loughran wrote: I'm going to do the rename over the w/end, I just need to get a functional tests branch in, because merge-over-renames is one of those things you don't want to have to do. On 9 January 2014 17

Re: Hoya Proposal

2014-01-10 Thread Enis Söztutar
Proposal looks good. Let me know if you need any additional help in mentors. Enis On Thu, Jan 9, 2014 at 9:29 AM, Alejandro Abdelnur wrote: > argh, gmail trying to be extra smart collapsed his comment on that and i > missed. sorry > > thx > > Alejandro > (phone typing) > > > On Jan 9, 2014, at

Re: Hoya Proposal

2014-01-10 Thread Steve Loughran
I'm going to do the rename over the w/end, I just need to get a functional tests branch in, because merge-over-renames is one of those things you don't want to have to do. On 9 January 2014 17:29, Alejandro Abdelnur wrote: > argh, gmail trying to be extra smart collapsed his comment on that and

Re: Hoya Proposal

2014-01-09 Thread Alejandro Abdelnur
argh, gmail trying to be extra smart collapsed his comment on that and i missed. sorry thx Alejandro (phone typing) > On Jan 9, 2014, at 9:23, larry mccay wrote: > > Hi Alejandro - > > I believe that Steve has already acknowledged that a package rename is > required and that the project is

Re: Hoya Proposal

2014-01-09 Thread Jean-Baptiste Onofré
Steve did already indeed. Regards JB On 01/09/2014 06:23 PM, larry mccay wrote: Hi Alejandro - I believe that Steve has already acknowledged that a package rename is required and that the project is likely not appropriate for Hadoop proper. thanks, --larry On Thu, Jan 9, 2014 at 11:46 AM,

Re: Hoya Proposal

2014-01-09 Thread larry mccay
Hi Alejandro - I believe that Steve has already acknowledged that a package rename is required and that the project is likely not appropriate for Hadoop proper. thanks, --larry On Thu, Jan 9, 2014 at 11:46 AM, Alejandro Abdelnur wrote: > I may have not been clear enough, I was referring to us

Re: Hoya Proposal

2014-01-09 Thread Alejandro Abdelnur
I may have not been clear enough, I was referring to using 'org.apache.hadoop' as package prefix for a project other than hadoop. Thanks On Thu, Jan 9, 2014 at 8:36 AM, Benson Margulies wrote: > If you can work out a plan to do this directly in Hadoop, there's no > need for the incubator. You j

Re: Hoya Proposal

2014-01-09 Thread Benson Margulies
If you can work out a plan to do this directly in Hadoop, there's no need for the incubator. You just build and and contribute it in cahoots with them, and earn commit over there as you go. On Thu, Jan 9, 2014 at 11:14 AM, Alejandro Abdelnur wrote: > Mmmh, if i recall correctly this has come up i

Re: Hoya Proposal

2014-01-09 Thread Alejandro Abdelnur
Mmmh, if i recall correctly this has come up in the past with other projects and it was decided against it. Could you please check with the hadoop folks about it? Thx > On Jan 9, 2014, at 1:19 AM, Steve Loughran wrote: > > no its wrong, it should all be under org.apache.hoya. > > I had the h

Re: Hoya Proposal

2014-01-09 Thread Henry Saputra
Ah yes, I missed the additional hadoop in the path. Close enough :) On Thursday, January 9, 2014, Steve Loughran wrote: > no its wrong, it should all be under org.apache.hoya. > > I had the hadoop prefix so that I could perhaps put it straight into the > hadoop code as another tools module -no n

Re: Hoya Proposal

2014-01-09 Thread Jean-Baptiste Onofré
Hi Steve, Awesome, thanks. Regards JB On 01/09/2014 10:20 AM, Steve Loughran wrote: thanks, that's a great offer -lovely to have some management oversight from others. I've put your name down On 8 January 2014 15:18, Jean-Baptiste Onofré wrote: Hi Steve, it looks interesting. It's a kin

Re: Hoya Proposal

2014-01-09 Thread Steve Loughran
thanks, that's a great offer -lovely to have some management oversight from others. I've put your name down On 8 January 2014 15:18, Jean-Baptiste Onofré wrote: > Hi Steve, > > it looks interesting. It's a kind of "advanced" provisioning for Hadoop > cluster. I see some potential interesting "

Re: Hoya Proposal

2014-01-09 Thread Steve Loughran
no its wrong, it should all be under org.apache.hoya. I had the hadoop prefix so that I could perhaps put it straight into the hadoop code as another tools module -no need for incubation. But as the actual providers and all tests are related to the deployment of hbase and accumulo, it really comes

Re: Hoya Proposal

2014-01-08 Thread Henry Saputra
I like how the initial code already put under " org.apache.hadoop.hoya" with correct ASF header =) - Henry On Wed, Jan 8, 2014 at 7:08 AM, Steve Loughran wrote: > I'm starting to put together the incubation proposal for Hoya: a tool to > dynamically deploy applications such as HBase or Accumulo

Re: Hoya Proposal

2014-01-08 Thread Jean-Baptiste Onofré
Hi Steve, it looks interesting. It's a kind of "advanced" provisioning for Hadoop cluster. I see some potential interesting "work together" with other projects. I would be please to be mentor on Hoya. Regards JB On 01/08/2014 04:08 PM, Steve Loughran wrote: I'm starting to put together the

Hoya Proposal

2014-01-08 Thread Steve Loughran
I'm starting to put together the incubation proposal for Hoya: a tool to dynamically deploy applications such as HBase or Accumulo on YARN https://wiki.apache.org/incubator/HoyaProposal It does already work to the extent that it can bring up either application, run different clusters of different