Hi Bertrand - > On Mar 4, 2019, at 11:21 AM, Dave Fisher <dave2w...@comcast.net> wrote: > > Hi Bertrand, > >> On Mar 4, 2019, at 8:20 AM, Bertrand Delacretaz <bdelacre...@apache.org> >> wrote: >> >> Hi, >> >> I was looking at streamlining the incubator.a.o website generation, >> currently the build script at [1] calls "python3 clutch.py" to build >> the http://incubator.apache.org/clutch/ page. >> >> Is that information still useful considering how our workflows have >> evolved over time? > > Let’s more fully investigate the clutch process … I think clutch.py is using > a database created by clutch…
Clutch must be run. A lot depends on it. Particularly reporting, but also podling status and history. It might be more useful looking at which columns of data are still useful on the clutch page and also follow up by converting clutch and project main pages to the new jBake format. Here is what is on incubator.apache.org/clutch: <http://incubator.apache.org/clutch:> We can drop the Sponsor column - it is always Incubator. A: startDate B: elapsedDays - <3 <12 <18 <24 >24 months Should we adjust the color thresholds? <4 <12 <24 <36 >36 months I think are more reflective of concerns. C: reportingMonthly (current report: February2019 ) D: reportingGroup - in which set of months do they report: group-1=Jan,Apr,Jul,Oct group-2=Feb,May,Aug,Nov group-3=Mar,Jun,Sep,Dec E: hasReportingGroup - did podling remember to choose a group Combine C, D, and E into one column? F: hasStatusEntry in the main "Currently in incubation" table (i.e. i.a.o/projects generated from content/podlings.xml) G: statusUpdateDate - the status page was last updated H: statusAge - days since the SVN status page was last updated - <2 <4 <9 >9 months I: statusUpdateCounts - number of commits to status file in the previous 2,4,9 months (cumulative) What we do with these depends on how we address the future of the status xml and yml. J: numberCommitters - accounts have been established, total number to date K: numberCommittersNew - new committers added since establishment (gathered from each project's Status page "News" section) J is always a '-' and it looks like few podlings update News in status. Idea - Update to be J: initial size of committers list and K: (current size - initial size.) L: hasSvn - Subversion repository is created Only two podlings have svn - we need to update to reflect the status of gitbox OR svn. M: hasTracker - has an Issue Tracker N: hasMailListDev - has dev mail list and archives O: hasMailListCommits - has commits mail list and archives P: hasWebSite These are important. Q: hasDistributionArea - has w.a.o/dist/incubator/... area (not necessarily yet a release) R: hasKeys - has a PGP "KEYS" file in their distribution area S: hasRelease - has a release in their distribution area These are important too. > >> >> Whimsy provides lots of useful information under >> https://whimsy.apache.org/roster/ppmc/ which is generated >> automatically from LDAP AFAIK, so more reliable (hopefully not derived >> from clutch data, we should verify that) and maybe sufficient. > > AFAIK there is some code in Whimsy to make sure that status in > content/projects/*.xml is kept in sync. > >> >> I also think we should eliminate the XML files under >> https://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/ >> if the relevant data is in LDAP, to eliminate data duplication, or at >> least drastically simplify them, but that's another story. > > The files under content/projects in xml are the complete detailed status of > every podling that is or has been through the Incubator. Eliminating these > files is therefore problematic. There is useful information in there that > goes away with a TLP LDAP or when LDAP goes away with retirement. Also these > xml files do define the podling status page. > > Whimsy also uses yml files under content/podlings/ to document some of the > same information that is in the xml. I think that this better conforms with > our current workflows. I think that the data here should be made to override > and replace the xml files somehow. > > The migration of the Incubator website to jBake and Git is definitely > incomplete. > > Important pages still under the old style. > > https://incubator.apache.org/projects/ > <https://incubator.apache.org/projects/> > https://incubator.apache.org/clutch/ <https://incubator.apache.org/clutch/> > https://incubator.apache.org/ip-clearance/ > <https://incubator.apache.org/ip-clearance/> > > Missing pages “lost in migration": > > https://incubator.apache.org/facilities.html > <https://incubator.apache.org/facilities.html> > https://incubator.apache.org/history <https://incubator.apache.org/history> > > I’ve evaluated ^/incubator/public/trunk/content > Moving onto ^/incubator/public/trunk and clutch I’ve done the README.txt for trunk. I’m checking in the two. Justin - it would be ideal to move the reporting scripts to a directory so that there are less questions. It might be best to do that as we redo the runback and process for the required change to Confluence. Regards, Dave > > Regards, > Dave > >> >> -Bertrand >> >> [1] https://github.com/apache/incubator/blob/master/build_site.sh >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org >> For additional commands, e-mail: general-h...@incubator.apache.org >> >
