Just to highlight the usage and importance of some of the items here. 1. HDFS Backup/Restore is integral to our system architecture, index distribution and Disaster Recovery (system used by 1000+ users internally) 2. HDFS Directory factory, Embedded Solr, these items too are very important for offline index generation at large scale (~5-10TB big source data)
We really use these items and they are very relevant for companies that run Solr to augment Big Data analysis. I just wanted to mention this in case these features’ need and value to customers/users were not represented as yet. I do support the cleansing of the core as long these items are still available via dedicated module/plug-ins. Thanks for the discussion around this. I hope the PMC community will consider these things and guide accordingly. Regards Aroop > On Jul 16, 2020, at 1:30 AM, Anshum Gupta <ans...@anshumgupta.net> wrote: > > Thanks for the feedback, Colvin. We'll certainly try and do something > around making the deprecations more visible and easier to track for all > users. I'm not sure if 'news' is the right section, but I think it might be > good to have a section on the website for users to look at and get a better > idea about. > > The PMC and committers are certainly aware of the importance of not > dropping desirable features but let's not hijack the release announcement > thread for this discussion. > > On Thu, Jul 16, 2020 at 1:09 AM Colvin Cowie <colvin.cowie....@gmail.com> > wrote: > >> Perhaps the deprecation notices should feature on >> https://lucene.apache.org/solr/news.html ? Because right now, they're not >> *very >> *visible in the changes. >> >> On Thu, 16 Jul 2020 at 01:18, Aroop Ganguly <aroopgang...@icloud.com >> .invalid> >> wrote: >> >>> May we ask what in hdfs support is being deprecated? Is Hdfs backup and >>> restore being deprecated ? >>> >>> Sent from my iPhone >>> >>>> On Jul 15, 2020, at 3:41 PM, Houston Putman <houstonput...@gmail.com> >>> wrote: >>>> >>>> To address your concern Bernd, >>>> >>>> The goal of this deprecation is not to remove the functionality >> entirely. >>>> The primary purpose is to remove the code from Solr Core. Before >>> removing a >>>> feature we aim to either: >>>> >>>> - Move the code to another repository, and have it be loadable via a >>>> plugin >>>> - Replace the feature with something more stable and/or scalable. >>>> (Likely loadable via a plugin or run in a separate application) >>>> >>>> I understand your frustration, but the ultimate goal here is to make >> Solr >>>> more customizable and plugable (and therefore learner by default). This >>> way >>>> the base Solr functionality can be as bug-free and performant as >>> possible, >>>> and any extra features can be added on top as needed. >>>> >>>> We would appreciate feedback for how the community would prefer these >>>> features be provided in the future, so that we make the transition >>> smoother >>>> and the end product better. >>>> >>>> - Houston >>>> >>>>> On Wed, Jul 15, 2020 at 5:51 PM Ishan Chattopadhyaya < >>>>> ichattopadhy...@gmail.com> wrote: >>>>> >>>>> On Wed, 15 Jul, 2020, 8:37 pm Bernd Fehling, < >>>>> bernd.fehl...@uni-bielefeld.de> >>>>> wrote: >>>>> >>>>>> >>>>>> >>>>>> Am 15.07.20 um 16:07 schrieb Ishan Chattopadhyaya: >>>>>>> Dear Solr Users, >>>>>>> >>>>>>> In this release (Solr 8.6), we have deprecated the following: >>>>>>> >>>>>>> 1. Data Import Handler >>>>>>> >>>>>>> 2. HDFS support >>>>>>> >>>>>>> 3. Cross Data Center Replication (CDCR) >>>>>>> >>>>>> >>>>>> Seriously? :-( >>>>>> >>>>> >>>>> Please see SOLR-14022. >>>>> >>>>> >>>>>> So next steps will be kicking out Cloud and go back to single node or >>>>> what? >>>>>> >>>>> >>>>> Not something we've considered yet. >>>>> >>>>> >>>>>> Why don't you just freeze the whole Solr development and switch to >>>>> Elastic? >>>>>> >>>>> >>>>> Not something we've considered yet. >>>>> >>>>> >>>>>> >>>>>>> >>>>>>> >>>>>>> All of these are scheduled to be removed in a future 9.x release. >>>>>>> >>>>>>> It was decided that these components did not meet the standards of >>>>>> quality >>>>>>> and support that we wish to ensure for all components we ship. Some >> of >>>>>>> these also relied on design patterns that we no longer recommend for >>>>> use >>>>>> in >>>>>>> critical production environments. >>>>>>> >>>>>>> If you rely on these features, you are encouraged to try out >> community >>>>>>> supported versions of these, where available [0]. Where such >> community >>>>>>> support is not available, we encourage you to participate in the >>>>>> migration >>>>>>> of these components into community supported packages and help >>> continue >>>>>> the >>>>>>> development. We envision that using packages for these components >> via >>>>>>> package manager will actually make it easier for users to use such >>>>>> features. >>>>>>> >>>>>>> Regards, >>>>>>> >>>>>>> Ishan Chattopadhyaya >>>>>>> >>>>>>> (On behalf of the Apache Lucene/Solr PMC) >>>>>>> >>>>>>> [0] - >>>>>>> >>>>>> >>>>> >>> >> https://cwiki.apache.org/confluence/display/SOLR/Community+supported+packages+for+Solr >>>>>>> >>>>>>> On Wed, Jul 15, 2020 at 2:30 PM Bruno Roustant < >>>>> bruno.roust...@gmail.com >>>>>>> >>>>>>> wrote: >>>>>>> >>>>>>>> The Lucene PMC is pleased to announce the release of Apache Solr >>>>> 8.6.0. >>>>>>>> >>>>>>>> >>>>>>>> Solr is the popular, blazing fast, open source NoSQL search >> platform >>>>>> from >>>>>>>> the Apache Lucene project. Its major features include powerful >>>>> full-text >>>>>>>> search, hit highlighting, faceted search, dynamic clustering, >>> database >>>>>>>> integration, rich document handling, and geospatial search. Solr is >>>>>> highly >>>>>>>> scalable, providing fault tolerant distributed search and indexing, >>>>> and >>>>>>>> powers the search and navigation features of many of the world's >>>>> largest >>>>>>>> internet sites. >>>>>>>> >>>>>>>> >>>>>>>> Solr 8.6.0 is available for immediate download at: >>>>>>>> >>>>>>>> >>>>>>>> <https://lucene.apache.org/solr/downloads.html> >>>>>>>> >>>>>>>> >>>>>>>> ### Solr 8.6.0 Release Highlights: >>>>>>>> >>>>>>>> >>>>>>>> * Cross-Collection Join Queries: Join queries can now work >>>>>>>> cross-collection, even when shared or when spanning nodes. >>>>>>>> >>>>>>>> * Search: Performance improvement for some types of queries when >>>>> exact >>>>>>>> hit count isn't needed by using BlockMax WAND algorithm. >>>>>>>> >>>>>>>> * Streaming Expression: Percentiles and standard deviation >>>>> aggregations >>>>>>>> added to stats, facet and time series. Streaming expressions added >>> to >>>>>>>> /export handler. Drill Streaming Expression for efficient and >>>>> accurate >>>>>>>> high cardinality aggregation. >>>>>>>> >>>>>>>> * Package manager: Support for cluster (CoreContainer) level >> plugins. >>>>>>>> >>>>>>>> * Health Check: HealthCheckHandler can now require that all cores >> are >>>>>>>> healthy before returning OK. >>>>>>>> >>>>>>>> * Zookeeper read API: A read API at /api/cluster/zk/* to fetch raw >> ZK >>>>>>>> data and view contents of a ZK directory. >>>>>>>> >>>>>>>> * Admin UI: New panel with security info in admin UI's dashboard. >>>>>>>> >>>>>>>> * Query DSL: Support for {param:ref} and {bool: {excludeTags:""}} >>>>>>>> >>>>>>>> * Ref Guide: Major redesign of Solr's documentation. >>>>>>>> >>>>>>>> >>>>>>>> Please read CHANGES.txt for a full list of new features and >> changes: >>>>>>>> >>>>>>>> >>>>>>>> <https://lucene.apache.org/solr/8_6_0/changes/Changes.html> >>>>>>>> >>>>>>>> >>>>>>>> Solr 8.6.0 also includes features, optimizations and bugfixes in >> the >>>>>>>> corresponding Apache Lucene release: >>>>>>>> >>>>>>>> >>>>>>>> <https://lucene.apache.org/core/8_6_0/changes/Changes.html> >>>>>>>> >>>>>>>> >>>>>>>> Note: The Apache Software Foundation uses an extensive mirroring >>>>> network >>>>>>>> for >>>>>>>> >>>>>>>> distributing releases. It is possible that the mirror you are using >>>>> may >>>>>>>> not have >>>>>>>> >>>>>>>> replicated the release yet. If that is the case, please try another >>>>>> mirror. >>>>>>>> >>>>>>>> This also applies to Maven access. >>>>>>>> >>>>>>> >>>>>> >>>>> >>> >> > > > -- > Anshum Gupta
