Soft commit and reading data just after the commit

Hello devs, I'm here with another problem i'm facing. I'm trying to do a commit (soft commit) through solrj and just after the commit, retrieve the data from solr (requirement is to get updated data list). I'm using soft commit instead of the hard commit, is previously I got an error "Exceeded li

Re: Soft commit and reading data just after the commit

Hi Lasitha, What is your indexing / querying requirements. Do you have an index heavy/light - query heavy/light system? Kind Regards, Furkan KAMACI On Sun, Dec 18, 2016 at 11:35 AM, Lasitha Wattaladeniya wrote: > Hello devs, > > I'm here with another problem i'm facing. I'm trying to do a com

Re: Soft commit and reading data just after the commit

Hi furkan, Thanks for your reply, it is generally a query heavy system. We are using realtime indexing for editing the available data Regards, Lasitha Lasitha Wattaladeniya Software Engineer Mobile : +6593896893 Blog : techreadme.blogspot.com On Sun, Dec 18, 2016 at 8:12 PM, Furkan KAMACI wro

Re: Confusing debug=timing parameter

Hi, Let me explain you *time* *parameters in Solr*: *Timing* parameter of debug returns information about how long the query took to process. *Query time* shows information of how long did it take in Solr to get the search results. It doesn't include reading bits from disk, etc. Also, there is

Re: Soft commit and reading data just after the commit

Hi Lasitha, First of all, did you check these: https://cwiki.apache.org/confluence/display/solr/Near+Real+Time+Searching https://lucidworks.com/blog/2013/08/23/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/ after that, if you cannot adjust your configuration you can give more

Re: Separating Search and Indexing in SolrCloud

Hi Erick, Not talking about separation any more. I merely summarized message from Pushkar. As I said it was clear that it was not possible. About the RAMBufferSizeMB, getting back to my original question, is this buffer for storing update requests or ready to index, analyzed documents? Documen

Re: Soft commit and reading data just after the commit

Hi Furkan, Thanks for the links. I had read the first one but not the second one. I did read it after you sent. So in my current solrconfig.xml settings below are the configurations, ${solr.autoSoftCommit.maxTime:1} 15000 false The problem i'm facing is, just after adding the do

Re: Has anyone used linode.com to run Solr | ??Best way to deliver PHP/Apache clients with Solr question

Yeah, I'll look at the proxy you suggested shortly. I've discovered that the idea of making a zookeeper aware app is pointless when scripting REST calls right after I installed libzookeeper. Zookeeper is there to provide the zookeeping for Solr: End of story. Me thinks I believe what reall

Re: Soft commit and reading data just after the commit

There's a very high probability that you're using the wrong tool for the job if you need 1ms softCommit time. Especially when you always need it (ex there are apps where you need commit-after-insert very rarely). So explain what you're using it for ? On Sun, Dec 18, 2016 at 3:38 PM, Lasitha Watta

Re: Has anyone used linode.com to run Solr | ??Best way to deliver PHP/Apache clients with Solr question

On Sun, Dec 18, 2016 at 3:48 PM, GW wrote: > Yeah, > > > I'll look at the proxy you suggested shortly. > > I've discovered that the idea of making a zookeeper aware app is pointless > when scripting REST calls right after I installed libzookeeper. > > Zookeeper is there to provide the zookeeping

Re: Soft commit and reading data just after the commit

1 ms autocommit is far too frequent. And it's not helping you anyway. There is some lag between when a commit happens and when the docs are really available. The sequence is: 1> commit (soft or hard-with-opensearcher=true doesn't matter). 2> a new searcher is opened and autowarming starts 3> until

Re: Separating Search and Indexing in SolrCloud

Analyzed documents. The transaction log stores the raw input. On Sun, Dec 18, 2016 at 5:32 AM, Jaroslaw Rozanski wrote: > Hi Erick, > > > Not talking about separation any more. I merely summarized message from > Pushkar. As I said it was clear that it was not possible. > > > About the RAMBufferS

Re: Separating Search and Indexing in SolrCloud

Stop 16 дек. 2016 г. 3:31 PM пользователь "Jaroslaw Rozanski" < m...@jarekrozanski.com> написал: > Hi all, > > According to documentation, in normal operation (not recovery) in Solr > Cloud configuration the leader sends updates it receives to all the > replicas. > > This means and all nodes in t

Re: Has anyone used linode.com to run Solr | ??Best way to deliver PHP/Apache clients with Solr question

Wow, thanks. So assuming I have a five node ensemble and one machine is rolling along as leader, am I correct to assume that as a leader becomes taxed it can lose the election and another takes over as leader? The leader actually floats about the ensemble under load? I was thinking the leader was

Re: Confusing debug=timing parameter

Thank you Furkan. I am still a little confused. So I will shorten the response and post only the relevant pieces for easier understanding. "responseHeader": { "status": 0, "QTime": 2978 } "response": { "numFound": 1565135270, }, "debug": { "timing": { "time": 19320,

Re: Solr on HDFS: Streaming API performance tuning

Ok, based on the stack trace I suspect one of your sort fields has NULL values, which in the 5x branch could produce null pointers if a segment had no values for a sort field. This is also fixed in the Solr 6x branch. Joel Bernstein http://joelsolr.blogspot.com/ On Sat, Dec 17, 2016 at 2:44 PM, C

Re: Stemming with SOLR

Thank you all for the replies. I am considering the suggestions On 17 Dec 2016 01:50, "Susheel Kumar" wrote: > To handle irregular nouns ( > http://www.ef.com/english-resources/english-grammar/ > singular-and-plural-nouns/), > the simplest way is handle them using StemOverriderFactory. The lis

Re: Very long young generation stop the world GC pause

Thanks a lot, PushKar! And sorry for late response. Our OS ram is 128GB. And we have 2 solr nodes on one machine. Each solr node has max heap size 32GB. And we do not have swap. -- View this message in context: http://lucene.472066.n3.nabble.com/Very-long-young-generation-stop-the-world-GC-pau

Re: Soft commit and reading data just after the commit

Hi all, Thanks for your replies, @dorian : the requirement is, we are showing a list of entries on a page. For each user there's a read / unread flag. The data for listing is fetched from solr. And you can see the entry was previously read or not. So when a user views an entry by clicking. We

Re: Soft commit and reading data just after the commit

I didn't look much onto REALTIME GET handler. Thanks for mentioning that. I'm checking it now On 19 Dec 2016 10:09, "Lasitha Wattaladeniya" wrote: > Hi all, > > Thanks for your replies, > > @dorian : the requirement is, we are showing a list of entries on a page. > For each user there's a re

Re: Very long young generation stop the world GC pause

Sorry for my wrong memory. The swap is 16GB. -- View this message in context: http://lucene.472066.n3.nabble.com/Very-long-young-generation-stop-the-world-GC-pause-tp4308911p4310301.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: regex-urlfilter help

Yeah,, I'm curious why this thread is used to talk that topic. I'll start a new thread on my questions. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-cannot-provide-index-service-after-a-large-GC-pause-but-core-state-in-ZK-is-still-active-tp4308942p4310302.html Sent