Solr field auditing

Hi, I am trying to implement some auditing fields in solr to track when was the last time a document was updated. Basically when a document is updated, I would like to store when the last time updated + the current timestamp. example : *First time indexing* Doc1 : {id:1, category:shoes, update_date

Re: Sample JWT Solr configuration

Jan Can my jwk object be something like {alg": "HS256", "typ": "JWT", "sub": "1234567890", "name": "John Doe", "iat": 1516239022, “k" : "secret-key"} Where k is the JWT secret key? Sent from my iPhone > On Sep 9, 2019, at 1:48 AM, Jan Høydahl wrote: > > In your security.json, add a JWK ma

[SECURITY] CVE-2019-12401: XML Bomb in Apache Solr versions prior to 5.0

Severity: Medium Vendor: The Apache Software Foundation Versions Affected: 1.3.0 to 1.4.1 3.1.0 to 3.6.2 4.0.0 to 4.10.4 Description: Solr versions prior to 5.0.0 are vulnerable to an XML resource consumption attack (a.k.a. Lol Bomb) via it’s update handler. By leveraging XML DOCTYPE and ENTITY

CDCR tlog corruption leads to infinite loop

We are running Solr 7.2.0 Our configuration has several collections that are loaded into a solr cloud which is set to replicate using CDCR to 3 different solrclouds. All of our target collections have 2 shards with two replicas per shard. Our source collection has 2 shards, and 1 replica per sh

Re: Incremental export of a huge collection

Isn't _version_ a timestamp of insertion by default? On Mon, Sep 9, 2019 at 9:47 PM Vidit Asthana wrote: > Hi, > > I am building a service where I have to continously read data from a Solr > collection and insert it into another database. Collection will receive > daily updates. Initial size of

Re: Incremental export of a huge collection

Vidit Asthana wrote: > My documents don't have anything like timestamp which I can use to fetch > "only newly added" documents after a certain point. Is there any internal > field which I can use to create this checkpoint and then later use that to > fetch "only incremental updates" from that poin

Incremental export of a huge collection

Hi, I am building a service where I have to continously read data from a Solr collection and insert it into another database. Collection will receive daily updates. Initial size of collection is very large. After I have indexed whole data(through cursor mark), on daily basis I want to only do incr

Re: Migrating Bounding box from Lucene to Solr

Hi Amjad, As you've seen from the ref guide, an arbitrary rectangle query *is* supported. Your query looks fine, though I can't be sure if the particular shape/coordinates are what you intend. You have a horizontal line in the vicinity of the US state of Oklahoma. Your data, on the other hand,

Re: SQL data import handler

Thank you for your responses Vadim and Jörn. You both prompted me to try again and this time I succeeded. The trick seemed to be the way that I installed Java using Open JDK versus from Oracle. In addition, I imagine I accidentally had a lot of old versions of JAR files lying around so it was ea

Limitations of StempelStemmer

Hi, I have just checked out the latest version of Lucene from Git master branch. I have tried to stem a few words using StempelStemmer for Polish. However, it looks it cannot handle some words properly, e.g. joyce -> ąć wielce -> ąć piwko -> ąć royce -> ąć pip -> ąć xyz -> xyz 1. I surprised it

Limitations of StempelStemmer

Hi, I have just checked out the latest version of Lucene from Git master branch. I have tried to stem a few words using StempelStemmer for Polish. However, it looks it cannot handle some words properly, e.g. joyce -> ąć wielce -> ąć piwko -> ąć royce -> ąć pip -> ąć xyz -> xyz 1. I surprised it

RE: SQL data import handler

Hi, Latest jdbc driver 7.4.1 seems to support JRE 8, 11, 12 https://www.microsoft.com/en-us/download/details.aspx?id=58505 You have to delete all previous versions of Sql Server jdbc driver from Solr installation (/solr/server/lib/ in my case) -- Vadim > -Original Message- > From: Frisc

Re: SQL data import handler

Hi Michael, Thank you for sharing. You are right about your approach to not customize the distribution. Solr supports JDK8 and it latest versions (8.x) also JDK11. I would not recommend to use it with JDK9 or JDK10 as they are out of support in many Java distributions. It might be also that yo

SQL data import handler

I setup SOLR on Ubuntu 18.04 and installed Java from apt-get with default-jre which installed version 11. So after a day of trying to make my Microsoft SQL Server data import handler work and failing, I built a new VM and installed JRE 8 and then everything works perfectly. The root of the prob

Re: Issue with delete

On Mon, Sep 9, 2019 at 11:11 AM Jörn Franke wrote: > Do you commit after running the delete? > The "commit=true" part would take care of that? > > Am 09.09.2019 um 06:59 schrieb Jayadevan Maymala < > jayade...@ftltechsys.com>: > > > > Hello All, > > > > I have a 3-node Solr cluster using a 3

Re: Suggestion Needed: Exclude documents that are already served / viewed by a customer

Hi Experts, We are migrating our entire search platform from SPHINX to SOLR, we wanted to do this without any flaw so any suggestion would be greatly appreciated. Thanks! On Fri, Sep 6, 2019 at 11:13 AM Doss wrote: > Dear Experts, > > For a matchmaking portal, we have one requirement where in

Re: Block Join Queries parsed incorrectly

This change was done in Solr-7.2. SOLR-11501 has the details about the change Regards, Munendra S N On Mon, Sep 9, 2019 at 1:16 PM Enna Raerinne (TAU) wrote: > Hi! > > I've been using block join queries with Solr version 7.1 and with request

Block Join Queries parsed incorrectly

Hi! I've been using block join queries with Solr version 7.1 and with request handler where defType is edismax and everything has worked fine. I recently updated my Solr to 8.1 and updated the luceneMatchVersion also to 8.1 in solrconfig.xml. However, now my block join queries don't work anymor

Re: upgrading from solr4 to solr8 searches taking 4 to 10 times as long to return

On Sun, 2019-09-08 at 21:10 +0200, Günter Hipler wrote: > I have seen you have done a lot of work at the end of version 7 for > version 8 but was not sure if it is related to this issue. It is directly related to DocValues, but it is unclear if that is Russell's challenge. Our setup is at the far