Re: AW: [VFS] Implementing custom hdfs file system using commons-vfs 2.0

2015-01-11 Thread dlmarion
y 10, 2015 9:00:37 PM Subject: AW: [VFS] Implementing custom hdfs file system using commons-vfs 2.0 Yes, it failed with clean as well. I am currently let the Site build run in a Loop and it seems to be stable. Gruss Bernd -- http://bernd.eckenfels.net - Ursprüngliche Nachricht - V

Re: [VFS] Implementing custom hdfs file system using commons-vfs 2.0

2015-01-10 Thread dlmarion
List Subject: Re: [VFS] Implementing custom hdfs file system using commons-vfs 2.0 Hello, Am Sat, 10 Jan 2015 03:12:19 + (UTC) schrieb dlmar...@comcast.net: > Bernd, > > Regarding the Hadoop version for VFS 2.1, why not use the latest on > the first release of the HDFS p

AW: [VFS] Implementing custom hdfs file system using commons-vfs 2.0

2015-01-10 Thread Bernd Eckenfels
; Betreff: Re: [VFS] Implementing custom hdfs file system using commons-vfs 2.0 Glad that you were able to make it work. When it failed for you, were you executing the clean lifecylcle target for maven? It should work in consecutive runs with mvn clean. I did not test with consecutive runs without the

Re: [VFS] Implementing custom hdfs file system using commons-vfs 2.0

2015-01-10 Thread dlmarion
: Bernd Eckenfels Date:01/10/2015 8:37 PM (GMT-05:00) To: Commons Developers List Cc: Subject: Re: [VFS] Implementing custom hdfs file system using commons-vfs 2.0 Hello, with this commit I added a cleanup of the data dir before the DfsMiniCluster is started. I also use absolute file

Re: [VFS] Implementing custom hdfs file system using commons-vfs 2.0

2015-01-10 Thread Bernd Eckenfels
Hello, with this commit I added a cleanup of the data dir before the DfsMiniCluster is started. I also use absolute file names to make debugging a bit easier and I moved initialisation code to the setUp() method http://svn.apache.org/r1650847 & http://svn.apache.org/r1650852 This way the test do

Re: [VFS] Implementing custom hdfs file system using commons-vfs 2.0

2015-01-10 Thread Bernd Eckenfels
Hello, Am Sat, 10 Jan 2015 03:12:19 + (UTC) schrieb dlmar...@comcast.net: > Bernd, > > Regarding the Hadoop version for VFS 2.1, why not use the latest on > the first release of the HDFS provider? The Hadoop 1.1.2 release was > released in Feb 2013. Yes, you are right. We dont need to car

Re: [VFS] Implementing custom hdfs file system using commons-vfs 2.0

2015-01-09 Thread dlmarion
-- From: "Bernd Eckenfels" To: dlmar...@comcast.net Cc: "Commons Developers List" Sent: Friday, January 9, 2015 8:13:27 PM Subject: Re: [VFS] Implementing custom hdfs file system using commons-vfs 2.0 Am Sat, 10 Jan 2015 01:04:56 + (UTC) schrieb dlmar...@co

Re: [VFS] Implementing custom hdfs file system using commons-vfs 2.0

2015-01-09 Thread Bernd Eckenfels
I will see if the version upgrade helps, if yes I will for sure include it in 2.1 Greetings Bernd > > Dave > > - Original Message - > > From: "Bernd Eckenfels" > To: dlmar...@comcast.net > Cc: "Commons Developers List" > Sent: Friday, Ja

Re: [VFS] Implementing custom hdfs file system using commons-vfs 2.0

2015-01-09 Thread dlmarion
this sufficient? Dave - Original Message - From: "Bernd Eckenfels" To: dlmar...@comcast.net Cc: "Commons Developers List" Sent: Friday, January 9, 2015 9:05:55 AM Subject: Re: [VFS] Implementing custom hdfs file system using commons-vfs 2.0 Hello Dave, for the downl

Re: [VFS] Implementing custom hdfs file system using commons-vfs 2.0

2015-01-09 Thread dlmarion
Implementing custom hdfs file system using commons-vfs 2.0 Hello Dave, for the download page (staged: http://people.apache.org/~ecki/commons-vfs/download.html) I need a list of libraries needed to run VFS to access hdfs. Could you maybe produce an example VFS Shell session similiar to https:

Re: [VFS] Implementing custom hdfs file system using commons-vfs 2.0

2015-01-09 Thread Bernd Eckenfels
Hello Dave, for the download page (staged: http://people.apache.org/~ecki/commons-vfs/download.html) I need a list of libraries needed to run VFS to access hdfs. Could you maybe produce an example VFS Shell session similiar to https://wiki.apache.org/commons/VfsReleaseState where you list the c

Re: [VFS] Implementing custom hdfs file system using commons-vfs 2.0

2014-07-28 Thread dlmarion
t: Monday, July 28, 2014 4:50:55 PM Subject: Re: [VFS] Implementing custom hdfs file system using commons-vfs 2.0 Hello, yes by default VFS offers a Input/OutputStream based interface to the FileContent and a RandomAccess interface (which is specific to VFS). I think the current HDFS provid

Re: [VFS] Implementing custom hdfs file system using commons-vfs 2.0

2014-07-28 Thread Bernd Eckenfels
Hello, yes by default VFS offers a Input/OutputStream based interface to the FileContent and a RandomAccess interface (which is specific to VFS). I think the current HDFS provider (VFS2.1) does support only those two (ReadOnly for the Random Access). I am not sure if you can wrap one of the two

Re: [VFS] Implementing custom hdfs file system using commons-vfs 2.0

2014-07-27 Thread Bernd Eckenfels
Hello Peter, I would suggest you use the current Version from CVS or the snapshot builds. This would have the big advantage that you can actually test and contribute to this version in case you miss some features or find some bugs. If you want to implement your own file system provider, you typic

[VFS] Implementing custom hdfs file system using commons-vfs 2.0

2014-07-27 Thread Richards Peter
Hi, I am evaluating commons-vfs 2.0 for one of my use cases. I read that commons--vfs 2.1 has a file system implementation for HDFS. Since commons-vfs 2.1 is still in development and commons-vfs 2.1 does not have all capabilities that we require for hdfs, I would like to implement a custom file sy