Let's not confuse different modules in the same thread. The two modules you speak of have "Hadoop" in the name but IMO they don't *really* have anything to do with each other unless you count some general utility and test JARs. Even the HDFS one doesn't even require HDFS (go fig!). It includes an awesome Directory "BlockCache" isolated to a Java package that has no dependencies. It's a building block of anyone who would want to build remote access to another Directory. I have a fondness for that thing... but I digress...
Next step I think is to solicit users & maintainers. Both Kevin Risden and I have failed to reach Alejandro, a (former?) employee of Cloudera. ~ David On Mon, Oct 21, 2024 at 5:05 PM David Eric Pugh <de...@yahoo.com.invalid> wrote: > I just re-read my copy of Marie Kondo's book The Life-Changing Magic of > Tidying Up[1] and it brought to mind the state of our Hadoop integrations > with Solr. I'd like to gauge the community's thoughts on how we move > forward with Hadoop in Solr 10. > My perspective is that Hadoop is no longer a key part of Solr's future, > and that is reflected in it's lack of maintenance and tech debt that it > appears to carrying. We seem to have a lot of points of discussion where > we want to do something and "but Hadoop doesn't support it" or "the tests > for Hadoop fail". > > I believe everything we would be removing is in:* Hadoop Auth Module* HDFS > Module > > If it's useful to the community I can make a longer argument about why we > need to thank Hadoop for it's service and say good bye. > > Otherwise, I think these are our paths forward: > 1) Just straight up remove both modules in Solr 10 like we did with > analytics. > 2) Move both modules to the solr-sandbox repository. Can we just leave > them there on Solr 9 and see if they get some new life?3) Actively recruit > someone to be a committer focused on the Hadoop code to bring them up to > date and allow them to stay? I would want to time box this effort. > 4) If someone volunteers to maintain them, move those modules to > independent GitHub repos like we did with DIH. > Thoughts? Other suggestions? > > Eric > > > > [1] https://en.wikipedia.org/wiki/Marie_Kondo > >
