Re: [Beowulf] slow jobs when run through queue

2017-12-19 Thread Nick Evans
I completely agree. We have a web page where people can see - where their jobs are running - what sort of resources were requested - the peak resources actually used - wall time remaining (orange highlighted at 20% remaining and red at 10% remaining) On 20 December 2017 at 03:41,

Re: [Beowulf] Thoughts on git?

2017-12-19 Thread Chris Samuel
On Wednesday, 20 December 2017 3:56:19 AM AEDT Adam DeConinck wrote: > I am also a fan of putting everything in source control. This is useful for > small scripts, but even more so (IMO) for configuration files. Being able > to track changes closely is a lifesaver when something about a system sto

Re: [Beowulf] Thoughts on git?

2017-12-19 Thread Lux, Jim (337K)
The problem with git is that it wasn’t “architected”, it just sort of grew to meet a variety of needs. So the commands don’t necessarily make sense, and there are multiple ways to achieve a particular desired end result, particularly in a simple environment. ( And, of course, like any other s

Re: [Beowulf] Thoughts on git?

2017-12-19 Thread Skylar Thompson
90% of the battle is using a VCS to begin with. Whether that's SVN, git, Mercurial, etc. is somewhat irrelevant - just pick something with the features (and ease of use is a feature!) that you and your team need and stick with it. In my professional life, I've found SVN to suit my needs and be eas

Re: [Beowulf] Intel kills Knights Hill, Xeon Phi line "being revised"

2017-12-19 Thread Gerald Henriksen
On Thu, 16 Nov 2017 10:45:40 +1100, you wrote: >Interesting times (via a colleague on the Australian HPC Slack). > >https://www.top500.org/news/intel-dumps-knights-hill-future-of-xeon-phi-product-line-uncertain/ > >Looks like fallout from the delayed Aurora system. > >Rumours flying that the Xeon

Re: [Beowulf] Thoughts on git?

2017-12-19 Thread Adam DeConinck
I am also a fan of putting everything in source control. This is useful for small scripts, but even more so (IMO) for configuration files. Being able to track changes closely is a lifesaver when something about a system stops working, and you have no idea what has changed. Source control has saved

Re: [Beowulf] Thoughts on git?

2017-12-19 Thread Tim Cutts
I agree it is quite intimidating, but the basic version control features are pretty basic; if you don’t want to branch/merge, you don’t have to. Neither do you have to do all the git pull/push to another git instance somewhere else. You can do basic version control on an entire directory with j

Re: [Beowulf] Thoughts on git?

2017-12-19 Thread Peter Clapham
Thank you, The multi-language component of the link is very useful. One to pass on locally. Pete From: Beowulf on behalf of Alex Chekholko via Beowulf Reply-To: Alex Chekholko Date: Tuesday, December 19, 2017 at 4:45 PM To: John Hearns Cc: Beowulf Mailing List Subject: Re: [Beowulf] Thought

Re: [Beowulf] Thoughts on git?

2017-12-19 Thread Peter Clapham
+1 Also add in the potential for CI and CD as part of the hooks within git and you have a powerful method to ensure changes to your code are unlikely to impact your environment. By integrating with gitlab (etc) a GUI can also help your servicedesk accept proposals and have the updates then dep

Re: [Beowulf] Thoughts on git?

2017-12-19 Thread Alex Chekholko via Beowulf
Here is a user-friendly guide that can provide you with some motivation to use git: http://www-cs-students.stanford.edu/~blynn/gitmagic/ On Tue, Dec 19, 2017 at 8:41 AM John Hearns via Beowulf wrote: > Faraz, I use git every day. > We have Bitbucket here, and have linked the repositories to Ji

Re: [Beowulf] Thoughts on git?

2017-12-19 Thread John Hearns via Beowulf
Faraz - a shorter answer. If you already have a git repository, try using Atom https://atom.io/ On 19 December 2017 at 17:40, John Hearns wrote: > Faraz, I use git every day. > We have Bitbucket here, and have linked the repositories to Jira for our > sprint planning and kanban. > > Anyway - y

Re: [Beowulf] slow jobs when run through queue

2017-12-19 Thread Peter Clapham
Show back of utilization and use patterns openly also removes admins from being “the Police”. Instead each user of the system can see who is requesting excessive memory, using inappropriate queues or just inefficient workloads at scale. This creates a self-Policing environment and certainly bo

Re: [Beowulf] Thoughts on git?

2017-12-19 Thread Brian Oborn
I argue that using a source control system of any kind is useful for answering the questions like "This was working 6 months ago. What have I changed since then?" or "This line of code to work around feature X is odd. When did I change it and what was my motivation at the time?" Git has the advant

Re: [Beowulf] Thoughts on git?

2017-12-19 Thread John Hearns via Beowulf
Faraz, I use git every day. We have Bitbucket here, and have linked the repositories to Jira for our sprint planning and kanban. Anyway - you say something very relevant "I have never had a need to go back to an older version of my script." It is not only about rollback to older versions. If you

[Beowulf] Thoughts on git?

2017-12-19 Thread Faraz Hussain
I am curious what people think of git. On one hand everyone seems to be using it and proclaiming its virtues. On the other hand it seems way overkill for how the majority of people code. I maintain dozens of scripts to manage various HPC environments . None are more than a few hundred lines