Events on updating documents
Hello, We at VNC are using Solr for search and as a data store. We have a use-case in which we want to hit a REST endpoint whenever documents are inserted, updated, or deleted in Solr with the documents under consideration as well. When exploring the Solr documentation, we found Event Listeners with postCommit and postOptimize events. We have configured Solr to do soft-commits every second and hard-commits every ten minutes to keep real-time indexing intact. With that in mind the questions are: Do we get the documents updated in the postCommit event? (Not able to find any examples) Are there other events that are triggered when a doc is updated, deleted, or inserted like those we have in an RDBMS? Is there a postSoftCommit event as well? (not mentioned in official docs) Mit freundlichen Grüssen / Kind regards Muhammad Haris Khan VNC - Virtual Network Consult -- Solr Ingenieur --
NRT - Indexing
Hello, Hope you're doing good. I am trying to configure NRT - Indexing in my project. For this reason, I have configured autoSoftCommit to execute every second and autoCommit to execute every 5 minutes. Everything works as expected on the dev and test server. But on the production server, there are more than 6 million documents indexed in Solr, so whenever a new document is indexed it takes 2-3 minutes before appearing in the search despite the setting I have described above. Since the target is to develop a real-time system, this delay of 2-3 minutes is not acceptable. How can I reduce this time window? Plus any advice on better scaling the Solr considering more than 6 million records would be very helpful. Thank you in advance. Mit freundlichen Grüssen / Kind regards Muhammad Haris Khan VNC - Virtual Network Consult -- Solr Ingenieur --
NRT - Indexing
Hello, Hope you're doing good. I am trying to configure NRT - Indexing in my project. For this reason, I have configured autoSoftCommit to execute every second and autoCommit to execute every 5 minutes. Everything works as expected on the dev and test server. But on the production server, there are more than 6 million documents indexed in Solr, so whenever a new document is indexed it takes 2-3 minutes before appearing in the search despite the setting I have described above. Since the target is to develop a real-time system, this delay of 2-3 minutes is not acceptable. How can I reduce this time window? Plus any advice on better scaling the Solr considering more than 6 million records would be very helpful. Thank you in advance. Mit freundlichen Grüssen / Kind regards Muhammad Haris Khan VNC - Virtual Network Consult -- Solr Ingenieur --
Re: NRT - Indexing
Hello,I am attaching the solrconfig.xml along with this email, also I am attaching a text document that has JSON object regarding the system information I am using a service that fetches data from the Postgres database and indexes it to solr. The service runs with a delay of 5 seconds.RegardsMit freundlichen Grüssen / Kind regardsMuhammad Haris KhanVNC - Virtual Network Consult-- Solr Ingenieur --- On 1 February, 2021 3:50 PM, Dominique Bejean <dominique.bej...@eolya.fr> wrote:Hi,What is your Solr version ?Can you share your solrconfig.xml ?How is your sharding ?Did you grep your solr logs on with the "commit' pattern in order to seehard and soft commit occurrences ?How are you pushing new docs or updates in the collection ?Regards.DominiqueLe lun. 1 févr. 2021 à 08:08, <haris.k...@vnc.biz> a écrit :> Hello,>> Hope you're doing good. I am trying to configure NRT - Indexing in my> project. For this reason, I have configured *autoSoftCommit* to execute> every second and *autoCommit* to execute every 5 minutes. Everything> works as expected on the dev and test server. But on the production server,> there are more than 6 million documents indexed in Solr, so whenever a new> document is indexed it takes 2-3 minutes before appearing in the search> despite the setting I have described above. Since the target is to develop> a real-time system, this delay of 2-3 minutes is not acceptable. How can I> reduce this time window?>> Plus any advice on better scaling the Solr considering more than 6 million> records would be very helpful. Thank you in advance.>>>> Mit freundlichen Grüssen / Kind regards>> Muhammad Haris Khan>> *VNC - Virtual Network Consult*>> *-- Solr Ingenieur --*> solrconfig.xml Description: XML document
