Re: [PROPOSAL] Apache Argus Proposal

2014-07-21 Thread Konstantin Boudnik
On Thu, Jul 17, 2014 at 11:41AM, Andrew Purtell wrote: > Thank you for writing back with a detailed clarification. > > Regarding encryption at rest, HDFS is adding it as HDFS-6134, so likely > there will be a new core feature option for the ecosystem to consider > shortly. > > I don’t feel one te

Re: [PROPOSAL] Apache Argus Proposal

2014-07-18 Thread Owen O'Malley
Thanks, Daniel. I'll add you to the proposal. .. Owen > On Jul 18, 2014, at 12:36, Daniel Gruno wrote: > >> On 07/18/2014 09:33 PM, Owen O'Malley wrote: >> Sorry that should be "but I have not found one yet." >> >> >>> On Fri, Jul 18, 2014 at 12:33 PM, Owen O'Malley wrote: >>> >>> On Fri,

Re: [PROPOSAL] Apache Argus Proposal

2014-07-18 Thread Daniel Gruno
On 07/18/2014 09:33 PM, Owen O'Malley wrote: > Sorry that should be "but I have not found one yet." > > > On Fri, Jul 18, 2014 at 12:33 PM, Owen O'Malley wrote: > >> On Fri, Jul 18, 2014 at 11:12 AM, Henry Saputra >> wrote: >> >>> when all PPMCs including mentors and committers are from same >

Re: [PROPOSAL] Apache Argus Proposal

2014-07-18 Thread Owen O'Malley
Sorry that should be "but I have not found one yet." On Fri, Jul 18, 2014 at 12:33 PM, Owen O'Malley wrote: > On Fri, Jul 18, 2014 at 11:12 AM, Henry Saputra > wrote: > >> when all PPMCs including mentors and committers are from same >> organizations >> > > Argus *does* have an external mentor

Re: [PROPOSAL] Apache Argus Proposal

2014-07-18 Thread Owen O'Malley
On Fri, Jul 18, 2014 at 11:12 AM, Henry Saputra wrote: > when all PPMCs including mentors and committers are from same organizations > Argus *does* have an external mentor. Jakob Homan is working at LinkedIn and has never worked at Hortonworks. I've been looking for a second external mentor, bu

Re: [PROPOSAL] Apache Argus Proposal

2014-07-18 Thread Henry Saputra
Hi Owen, Thanks for details explanation about the statement. Really appreciate the clarification. - Henry On Wed, Jul 16, 2014 at 2:46 PM, Owen O'Malley wrote: > On Wed, Jul 16, 2014 at 11:29 AM, Henry Saputra > wrote: > >> HI, >> >> Just curious if you could give reference to "Apache encourag

Re: [PROPOSAL] Apache Argus Proposal

2014-07-18 Thread Chris Douglas
On Wed, Jul 16, 2014 at 4:07 PM, Owen O'Malley wrote: > Chris, I know you are pretty overloaded at the moment with podlings, but > would > you be willing to be a mentor for Argus? I don't have many cycles for this, but if it's a blocker for incubation then I'll make time. -C >> Initial committer

Re: [PROPOSAL] Apache Argus Proposal

2014-07-18 Thread Henry Saputra
> understand them correctly. I encourage you to address concerns raised on > this thread about the complexion of the initial PMC and mentorships. There > have been a few suggestions worth exploring. > +1 to Andrew's comment. Let us be real for a moment, when all PPMCs including mentors and commit

Re: [PROPOSAL] Apache Argus Proposal

2014-07-17 Thread Owen O'Malley
On Thu, Jul 17, 2014 at 2:42 PM, Andrew Purtell wrote: > Establishing trust and a track record of inclusion and > openness will be essential for Argus to achieve your objectives, if I > understand them correctly. I encourage you to address concerns raised on > this thread about the complexion of

Re: [PROPOSAL] Apache Argus Proposal

2014-07-17 Thread Andrew Purtell
> Working this out within the community makes more sense, rather than doing this outside. Not attempting would be counterproductive. Does this not argue directly against the rationale of the Argus proposal? Please correct me if I am wrong, but this suggests addressing security concerns within exis

Re: [PROPOSAL] Apache Argus Proposal

2014-07-17 Thread Don Bosco Durai
Andrews, thanks for your feedback. My responses are inline. Regards Bosco On Jul 17, 2014, at 11:41 AM, Andrew Purtell wrote: > Thank you for writing back with a detailed clarification. > > Regarding encryption at rest, HDFS is adding it as HDFS-6134, so likely > there will be a new core feat

Re: [PROPOSAL] Apache Argus Proposal

2014-07-17 Thread Andrew Purtell
Thank you for writing back with a detailed clarification. Regarding encryption at rest, HDFS is adding it as HDFS-6134, so likely there will be a new core feature option for the ecosystem to consider shortly. ​> I don’t feel one technology or one company or one small group or one approach can sol

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Don Bosco Durai
> How do you define the 'Hadoop complex eco-system'? If that definition Agreed, complex is a relative term. I used the term complex, because now more than 20 products use Hadoop and list is growing. There are 10 products listed on http://hadoop.apache.org/. Then there are others projects like Acc

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Andrew Purtell
This statement might not be quite right: > Even within Hadoop complex eco-system, each components have limited or no security controls. How do you define the 'Hadoop complex eco-system'? If that definition includes projects such as HBase, we have significant security controls, so that wouldn't be

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Don Bosco Durai
Hi JB We will be centralizing the administration and auditing for Knox. And we will be also standardizing the authentication for web applications for all components within Hadoop ecosystem, for which we might consider Shiro. I would like to understand more about Syncope and see how production r

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Owen O'Malley
On Wed, Jul 16, 2014 at 2:14 PM, Alejandro Abdelnur wrote: > Have you considered reaching out to the Sentry community to see if they > would be interested in bringing Argus existing code base into Sentry? > We did consider it, but decided that the challenge of integrating the two distinct code b

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Owen O'Malley
On Wed, Jul 16, 2014 at 1:20 AM, Chris Douglas wrote: > The committer and PPMC list should be honest. If there is no > diversity, that fact must be visible for it to be tracked. > a big +1 Chris, I know you are pretty overloaded at the moment with podlings, but would you be willing to be a ment

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Owen O'Malley
On Wed, Jul 16, 2014 at 11:29 AM, Henry Saputra wrote: > HI, > > Just curious if you could give reference to "Apache encourages > disjoint teams to form independent projects, even when those projects > overlap in scope" statement ? > Henry, It generally comes from the "Community over Code,"

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Alejandro Abdelnur
> There is some overlap between the goals of Argus and Apache > Sentry. Apache encourages disjoint teams to form independent > projects, even when those projects overlap in scope. Additionally, > we feel that the distinct code bases, development teams, and > different approaches to the problem shou

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Andreas Neumann
Is it worth a thought to require that new podlings find a champion who is not employed by the same organization? On Wed, Jul 16, 2014 at 11:53 AM, Henry Saputra wrote: > Definitely +1, active members, with lack diversity, are more useful. > > My original comment was to suggest having mentors co

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Henry Saputra
Definitely +1, active members, with lack diversity, are more useful. My original comment was to suggest having mentors come from different organizations so hopefully could help provide different perspectives and inputs to the podling. Never my intention to suggest false diversity to start an Apach

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Henry Saputra
HI, Just curious if you could give reference to "Apache encourages disjoint teams to form independent projects, even when those projects overlap in scope" statement ? - Henry On Mon, Jul 14, 2014 at 7:16 PM, Selvamohan Neethiraj wrote: > Apache Argus Proposal (http://wiki.apache.org/incubator/A

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Ted Dunning
On Wed, Jul 16, 2014 at 1:20 AM, Chris Douglas wrote: > > So, I am fond of Henry's hope that the project will solicit a more > diversified > > set of mentors and initial committers. > > The committer and PPMC list should be honest. If there is no > diversity, that fact must be visible for it to b

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Chris Douglas
On Tue, Jul 15, 2014 at 11:30 PM, Konstantin Boudnik wrote: > If an objective of a podding is to build a diversified community then perhaps > it should be an explicitly defined graduation criteria? In fact, earlier I > have > raised exactly the same question about Tez but I don't think it ever be

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Jean-Baptiste Onofré
Hi, it looks interesting. Do you have an idea about the interactions with other projects (Knox, Shiro, Syncope, whatever) ? Regards JB On 07/15/2014 04:16 AM, Selvamohan Neethiraj wrote: Apache Argus Proposal (http://wiki.apache.org/incubator/ArgusProposal) == Abstract == Argus is a frame

Re: [PROPOSAL] Apache Argus Proposal

2014-07-15 Thread Konstantin Boudnik
If an objective of a podding is to build a diversified community then perhaps it should be an explicitly defined graduation criteria? In fact, earlier I have raised exactly the same question about Tez but I don't think it ever been satisfactory answered. As for chances of a project to stick with g

Re: [PROPOSAL] Apache Argus Proposal

2014-07-15 Thread Owen O'Malley
On Tue, Jul 15, 2014 at 2:47 PM, Sean Owen wrote: The proposal just says it overlaps, and that it might be good have a > different group of people reimplement some of the same things. Is > there a real gap that people want to build to plug here with overlap > at the edges, or is the scope of the

Re: [PROPOSAL] Apache Argus Proposal

2014-07-15 Thread Sean Owen
I think it would be useful to expand on how this is different from Sentry too: "Argus is a framework to enable, monitor and manage comprehensive data security across the Hadoop platform." "The Apache Knox Gateway is a REST API Gateway for interacting with Hadoop clusters. [for the purposes of...]

Re: [PROPOSAL] Apache Argus Proposal

2014-07-15 Thread Don Bosco Durai
Rob Argus main focus is to holistically solve the security challenges within the complex ecosystem of Hadoop. Argus solution will leverage existing solutions where applicable, which might include using security from Shiro for some of the Web or REST applications authentication. Regards Bosco

Re: [PROPOSAL] Apache Argus Proposal

2014-07-15 Thread Henry Saputra
Hi Andrew, thanks for chiming in =) I like your and Owen's opinion about initial members of an incubator project. And also agree it is responsibility of the polling to achieve better diversity during its time under Apache incubator. For this particular proposal, however, the mentors mostly coming

Re: [PROPOSAL] Apache Argus Proposal

2014-07-15 Thread Henry Saputra
Owen, thanks for the reply. If possible I would like to have mentors coming from different organizations to add some check and balance to the podling. I think most of the incubator projects that have initial members from one organization have diverse mentors from different organizations to help pr

Re: [PROPOSAL] Apache Argus Proposal

2014-07-15 Thread Andrew Purtell
I had started typing up a response to Henry's mail but will discard the beginning of it to say I agree with Owen. A new project coming into the incubator quite naturally could have the initial set of committers entirely from one organization. An organization donating an existing code base, for exam

Re: [PROPOSAL] Apache Argus Proposal

2014-07-15 Thread Owen O'Malley
On Tue, Jul 15, 2014 at 1:59 PM, Henry Saputra wrote: > Maybe we should start asking incubator project to try to build some > kind of momentum or community before going to ASF incubator. > Apache incubator is a great place for new projects to grow their community and diversity. Once a project is

Re: [PROPOSAL] Apache Argus Proposal

2014-07-15 Thread Henry Saputra
Maybe we should start asking incubator project to try to build some kind of momentum or community before going to ASF incubator. All but one PPMC members for this proposal would be from Hortonworks. Personally I think this basically like hosting your project under Hortonwork Github account. I per

Re: [PROPOSAL] Apache Argus Proposal

2014-07-15 Thread Rob Vesse
Interesting proposal, it seems like the core technology being described has a lot in common with Apache Shiro Has collaboration with that community been considered whether just in terms of reusing existing Shiro components wherever possible or something deeper e.g. inviting Shiro developers to hel

[PROPOSAL] Apache Argus Proposal

2014-07-15 Thread Selvamohan Neethiraj
Apache Argus Proposal (http://wiki.apache.org/incubator/ArgusProposal) == Abstract == Argus is a framework to enable, monitor and manage comprehensive data security across the Hadoop platform. The name “Argus” is derived from Argus Panoptes, a 100-eyed giant in Greek mythology, endowed with a