In the project I'm working on there is one module that has a very large JAR, and the final application ZIP is super massive. So I'll try with those next and report back with some metrics as well.
On Jan 10, 2015, at 9:06 AM, Kristian Rosenvold <kristian.rosenv...@gmail.com> wrote: > Yes. Everything should be noticeably faster. I have also been working on > features that allows transfer of compressed entries from one jar file to > another without packing/unpacking, which should be great for all kinds of > exploded archives inside zips/jars. I hope to get that into a second beta > soon. > > K > 10. jan. 2015 15:00 skrev "Jeff Jensen" <jeffjen...@upstairstechnology.com>: > >> Sounds like an awesome improvement! Will we see speed improvement on war >> file creation with many megs of jars in the lib dir or only with >> compressing of files into the archive (ignoring the web files for this >> question)? >> >> >> On Sat, Jan 10, 2015 at 7:43 AM, Kristian Rosenvold < >> kristian.rosenv...@gmail.com> wrote: >> >>> I had 950% CPU usage on my 6 core + HT machine here the other day. >>> >>> Kristian >>> >>> >>> 2015-01-10 14:42 GMT+01:00 Kristian Rosenvold < >>> kristian.rosenv...@gmail.com>: >>>> It's faster; a lot faster - and it scales beautifully. But then >>>> again you probably need "war/ear/zip" heavy builds to really get max >>>> effect. The average "jar" plugin does not usually consume that large a >>>> percentage the average build. >>>> >>>> I'll try to make some nice graphs and a blog post some time this >> weekend. >>>> >>>> It's a new api in commons-compress, the existing api did translate >>>> well to multithreading. You can look at plexus-archiver changes if you >>>> want to see how it's used. I've also written some docs in >>>> commons-compress itself. >>>> >>>> K >>>> >>>> >>>> 2015-01-10 14:34 GMT+01:00 Jason van Zyl <ja...@takari.io>: >>>>> Do you have any metrics? I use compress-compress directly so I can >>> certainly try it on some large archives. Anything special need to be >> done? >>> Or do the same code paths still work they just use the cores available >> with >>> the new version? >>>>> >>>>> On Jan 10, 2015, at 7:23 AM, Kristian Rosenvold < >>> kristian.rosenv...@gmail.com> wrote: >>>>> >>>>>> I just released plexus-archiver version 2.10-beta-1 to maven central. >>>>>> >>>>>> This is a "technology preview" of the multithreaded Zip feature I >> have >>>>>> been adding to commons-compress for the last few weeks, and will >>>>>> basically use all available CPU cores when compressing the archive. >>>>>> >>>>>> To test/use this feature, you can add the following clause some >>> plugins: >>>>>> >>>>>> <plugin> >>>>>> <groupId>org.apache.maven.plugins</groupId> >>>>>> <artifactId>maven-assembly-plugin</artifactId> >>>>>> <version>2.5.3</version> >>>>>> <dependencies> >>>>>> <dependency> >>>>>> <groupId>org.codehaus.plexus</groupId> >>>>>> <artifactId>plexus-archiver</artifactId> >>>>>> <version>2.10-beta-1</version> >>>>>> </dependency> >>>>>> <dependency> >>>>>> <groupId>org.codehaus.plexus</groupId> >>>>>> <artifactId>plexus-io</artifactId> >>>>>> <version>2.4.1</version> >>>>>> </dependency> >>>>>> </dependencies> >>>>>> </plugin> >>>>>> >>>>>> This applies to maven-war-plugin, maven-jar-plugin, maven-ear-plugin, >>>>>> maven-assembly-plugin, maven-dependency-plugin and probably a few >>>>>> others too. >>>>>> >>>>>> The feature is basically "done". commons-compress 1.10 has not yet >>>>>> been released, and the moment this happens there will be a non-beta >>>>>> version of plexus-archiver. This version contains a shaded-snapshot >>>>>> version of commons-compress. >>>>>> >>>>>> Please note that if your project basically produces a 30K jar file, >>>>>> there is not much to be expected from this upgrade. The larger your >>>>>> zip/jar/ear/war files, the more you can expect. And, of course, you >>>>>> can use this as an argument towards your boss to get a 6 core CPU. >>>>>> >>>>>> Feedback appreciated ! >>>>>> >>>>>> In other news, the java 1.6 version "3.0" was also released today, >>>>>> which contains "snappy" compression. 3.0 does not yet contain the >>>>>> parallel feature. >>>>>> >>>>>> >>>>>> Kristian >>>>>> >>>>>> --------------------------------------------------------------------- >>>>>> To unsubscribe, e-mail: dev-unsubscr...@maven.apache.org >>>>>> For additional commands, e-mail: dev-h...@maven.apache.org >>>>>> >>>>> >>>>> Thanks, >>>>> >>>>> Jason >>>>> >>>>> ---------------------------------------------------------- >>>>> Jason van Zyl >>>>> Founder, Apache Maven >>>>> http://twitter.com/jvanzyl >>>>> http://twitter.com/takari_io >>>>> --------------------------------------------------------- >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>> >>> --------------------------------------------------------------------- >>> To unsubscribe, e-mail: dev-unsubscr...@maven.apache.org >>> For additional commands, e-mail: dev-h...@maven.apache.org >>> >>> >> Thanks, Jason ---------------------------------------------------------- Jason van Zyl Founder, Apache Maven http://twitter.com/jvanzyl http://twitter.com/takari_io --------------------------------------------------------- A master in the art of living draws no sharp distinction between his work and his play; his labor and his leisure; his mind and his body; his education and his recreation. He hardly knows which is which. He simply pursues his vision of excellence through whatever he is doing, and leaves others to determine whether he is working or playing. To himself, he always appears to be doing both. -- FRANÃOIS AUGUSTE RENÃ CHATEAUBRIAND
