Re: Limit amount of search result

hi Samee, Thank you very much for your suggestion. Now I got it worked now;) Chun. -- View this message in context: http://lucene.472066.n3.nabble.com/Limit-amount-of-search-result-tp4117062p4117952.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Preventing multiple on-deck searchers without causing failed commits

On 2/17/2014 7:06 PM, Colin Bartolome wrote: > Increasing the maxTime value doesn't actually solve the problem, though; > it just makes it a little less likely. Really, the soft commits aren't > the problem here, as far as we can tell. It's that a request that > triggers a hard commit simply fails

Re: Preventing multiple on-deck searchers without causing failed commits

On 02/17/2014 05:38 PM, Shawn Heisey wrote: On 2/17/2014 6:06 PM, Colin Bartolome wrote: We're using Solr version 4.2.1, in case new functionality has helped with this issue. We have our Solr servers doing automatic soft commits with maxTime=1000. We also have a scheduled job that triggers a ha

Re: Slow 95th-percentile

On 2/17/2014 6:12 PM, Allan Carroll wrote: > I'm having trouble getting my Solr setup to get consistent performance. > Average select latency is great, but 95% is dismal (10x average). It's > probably something slightly misconfigured. I’ve seen it have nice, low > variance latencies for a few ho

Re: Preventing multiple on-deck searchers without causing failed commits

On 2/17/2014 6:06 PM, Colin Bartolome wrote: > We're using Solr version 4.2.1, in case new functionality has helped > with this issue. > > We have our Solr servers doing automatic soft commits with maxTime=1000. > We also have a scheduled job that triggers a hard commit every fifteen > minutes. Wh

Slow 95th-percentile

Hi all, I'm having trouble getting my Solr setup to get consistent performance. Average select latency is great, but 95% is dismal (10x average). It's probably something slightly misconfigured. I’ve seen it have nice, low variance latencies for a few hours here and there, but can’t figure out w

Preventing multiple on-deck searchers without causing failed commits

We're using Solr version 4.2.1, in case new functionality has helped with this issue. We have our Solr servers doing automatic soft commits with maxTime=1000. We also have a scheduled job that triggers a hard commit every fifteen minutes. When one of these hard commits happens while a soft com

Re: SOLR suggester component - Get suggestion dump

I started using terms component to view the terms and the counts... terms?terms.fl=autocomplete_phrase&terms.regex=a.*&terms.limit=1000 -- View this message in context: http://lucene.472066.n3.nabble.com/SOLR-suggester-component-Get-suggestion-dump-tp4110026p4117913.html Sent from the Solr - U

Re: Could not connect or ping a core after import a big data into it...

Glad it's resolved, thanks for letting us know, it removes some uncertainty. Erick On Mon, Feb 17, 2014 at 12:23 PM, Eric_Peng wrote: > I solved it , my mistake > I was using Solr4.6.1 jars, but in my solrconfig.xml I used > LucenMatcheVersion 4.5 > I just coped from last project and didn't ch

Re: Solr Autosuggest - Strange issue with leading numbers in query

Ah, OK, I though you were indexing things like 123412335ga, but not so. Afraid I'm fresh out of ideas. Although I might try using TermsComponent to examine the index and see if, somehow, there _are_ terms with leading numbers in the output. It's also possible that numbers are stripped when bu

Escape \\n from getting highlighted - highlighter component

Hi, When searching for a text like 'talk n text' the highlighter component also adds the tags to the special characters like \n. Is there a way to avoid highlighting the special characters? \\r\\n Family Messaging is getting replaced as \\r\\n Family Messaging -- View this message in con

DIH and Tika

Is there a way to specify the document types that Tika parses? In my DIH I index the content of a SQL database which has a field that points to the SQL record's binary file (which could be Word, PDF, JPG, MOV, etc.). Tika then uses the document URL to index that document's content. However there ar

Re: Boost Query Example

Hi, Filter queries don't affect score, so boosting won't have an effect there. If you want those query terms to get boosted, move them into the q parameter. http://wiki.apache.org/solr/CommonQueryParameters#fq Hope that helps! Michael Della Bitta Applications Developer o: +1 646 532 3062 app

Re: Facet cache issue when deleting documents from the index

I tried to set the expungeDeletes flag but it didn't fix the problem. The SolrServer doesn't expose a way to set this flag so I had to use: new UpdateRequest().setAction(UpdateRequest.ACTION.COMMIT, true, true, 1, true).process(solrServer); Any other hints? Note that I managed to run my test in

Boost Query Example

Hi can some one help me on the Boost & Sort query example. http://localhost:8983/solr/ ProductCollection/select?q=*%3A*&wt=json&indent=true&fq=SKU:223-CL10V3^100 OR SKU:223-CL1^90 There is not different in the query Order, Let me know if I am missing something. Also I like to Order with the e

Re: Best way to copy data from SolrCloud to standalone Solr?

I do know for certain that the backup command on a cloud core still works. We have a script like this running on a cron to snapshot indexes: curl -s ' http://localhost:8080/solr/#{core}/replication?command=backup&numberToKeep=4&location=/tmp ' (not really using /tmp for this, parameters changed t

Re: Could not connect or ping a core after import a big data into it...

I solved it , my mistake I was using Solr4.6.1 jars, but in my solrconfig.xml I used LucenMatcheVersion 4.5 I just coped from last project and didn't check it. My really stupid mistake -- View this message in context: http://lucene.472066.n3.nabble.com/Could-not-connect-or-ping-a-core-afte

Is it possible to load new elevate.xml on the fly?

Hi, I am trying to figure out a way to use multiple elevate.xml using the query parameters on the fly. We have a scenario where we need to elevate documents based on authentication (same core) without creating a new search handler. * For authenticated customers * elevate documents based on elevat

Re: Could not connect or ping a core after import a big data into it...

I found out in this stranger situation, I could import, update, or delete data(using DIH or SolrJ) But the query will waiting forever. So I delete all the documents or just reduce the document number and then restart the server, problem disappeared -- View this message in context: http://l

Re: SolrJ Socket Leak

Kiran & Shawn, Thank you both for the info and you are both absolutely correct. The issue was not that sockets were leaked, but that wait time thing is a killer. I ended up fixing the problem by changing the system property of "http.maxConnections" which is used internally to Apache httpclient t

Re: Could not connect or ping a core after import a big data into it...

Sir, after I made experiment if I there are more than 1000(roughly) documents in the core, the problem will show up. then I make a query in command window it shows Exception in thread "main" org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Error opening new searcher. exceeded

Re: Solr Autosuggest - Strange issue with leading numbers in query

Hi Erik, Thanks a lot for your reply. I expect it to return zero suggestions since the suggested keyword doesnt actually start with numbers. Expected results Searching for ga -> returns galaxy Searching for gal -> returns galaxy Searching for 12321312321312ga -> should not return any suggestio

Re: Solrcloud: no registered leader found and new searcher error

Well, first determine whether they are running or not. Then look at the Solr log for that node when you try to start it up. Then post the results if you're still puzzled. You've given us no information about what the error (if any) is, I'm speculating here. You might want to review: http://wiki

Re: Solr cloud hangs

There are also many errors in solr log like that one: org.apache.solr.update.StreamingSolrServers$1; error org.apache.http.conn.ConnectionPoolTimeoutException: Timeout waiting for connection from pool at org.apache.http.impl.conn.PoolingClientConnectionManager.leaseConnection(PoolingClient

Re: Best way to copy data from SolrCloud to standalone Solr?

On 2/17/2014 8:32 AM, Daniel Bryant wrote: > I have a production SolrCloud server which has multiple sharded indexes, > and I need to copy all of the indexes to a (non-cloud) Solr server > within our QA environment. > > Can I ask for advice on the best way to do this please? > > I've searched the

Re: Solr cloud hangs

Hi, Here is the whole stack trace: https://gist.github.com/anonymous/9056783 -- Pawel On Mon, Feb 17, 2014 at 4:53 PM, Mark Miller wrote: > Can you share the full stack trace dump? > > - Mark > > http://about.me/markrmiller > > On Feb 17, 2014, at 7:07 AM, Pawel Rog wrote: > > > Hi, > > I have

Re: Solrcloud: no registered leader found and new searcher error

How do i get them running? -- View this message in context: http://lucene.472066.n3.nabble.com/Solrcloud-no-registered-leader-found-and-new-searcher-error-tp4117724p4117830.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: block join and atomic updates

Hello, It sounds like you need to switch to query time join. 15.02.2014 21:57 пользователь написал: > Any suggestions? > > > Zitat von m...@preselect-media.com: > > Yonik Seeley : >> >>> On Thu, Feb 13, 2014 at 8:25 AM, wrote: >>> Is there any workaround to perform atomic updates on bloc

Re: Solrcloud: no registered leader found and new searcher error

I think commits are not really the issue here. It _looks_ like at least one node in your "document" collection is failing to start, in fact your shard 2. On the Solr admin screen, the "cloud" section on the left should show you the states of all your nodes, make sure they're all green. My guess is

Re: Solr cloud hangs

Can you share the full stack trace dump? - Mark http://about.me/markrmiller On Feb 17, 2014, at 7:07 AM, Pawel Rog wrote: > Hi, > I have quite annoying problem with Solr cloud. I have a cluster with 8 > shards and with 2 replicas in each. (Solr 4.6.1) > After some time cluster doesn't respond

Best way to copy data from SolrCloud to standalone Solr?

Hi all, I have a production SolrCloud server which has multiple sharded indexes, and I need to copy all of the indexes to a (non-cloud) Solr server within our QA environment. Can I ask for advice on the best way to do this please? I've searched the web and found solr2solr (https://github.co

Re: Facet cache issue when deleting documents from the index

On Mon, Feb 17, 2014 at 2:00 PM, Ahmet Arslan wrote: > Hi, > > Also I noticed that in your code snippet you have server.delete("foo"); which > does not exists. deleteById and deleteByQuery methods are defined in > SolrServer implementation. Yes, sorry, I have a wrapper over the SolrInstance th

Solr cloud hangs

Hi, I have quite annoying problem with Solr cloud. I have a cluster with 8 shards and with 2 replicas in each. (Solr 4.6.1) After some time cluster doesn't respond to any update requests. Restarting the cluster nodes doesn't help. There are a lot of such stack traces (waiting for very long time):

Re: Facet cache issue when deleting documents from the index

Hi, Also I noticed that in your code snippet you have server.delete("foo"); which does not exists. deleteById and deleteByQuery methods are defined in SolrServer implementation. On Monday, February 17, 2014 1:42 PM, Ahmet Arslan wrote: Hi Marius, Facets are computed from indexed terms. Can

Solr Suggester not working in sharding (distributed search)

I have two solr server (solr 4.5.1) which is running in shard.. I have implemented solr suggester using spellcheckComponent for auto-suggester. when i execute suggest url on individual core then the solr suggestion is coming properly. mysolr.com:8986/solr/core1/suggest?spellcheck.q=city%20o

Re: Facet cache issue when deleting documents from the index

Hi Marius, Facets are computed from indexed terms. Can you commit with expungeDeletes=true flag? Ahmet On Monday, February 17, 2014 12:17 PM, Marius Dumitru Florea wrote: Hi guys, I'm using Solr 4.6.1 (embedded) and for some reason the facet cache is not invalidated when documents are dele

Re: DIH

On Mon, Feb 17, 2014 at 1:11 PM, Ahmet Arslan wrote: > My understanding is that there is no multi-threading support in DIH. For > some reasons, it won't have. Am I correct? threads parameter seems working in 3.6 or so, but was removed from 4.x as causes a lot of instability. Regarding apache f

Solr Suggester not working in sharding (distributed search)

I have two solr server (solr 4.5.1) which is running in shard.. I have implemented solr suggester using spellcheckComponent for auto-suggester. when i execute suggest url on individual core then the solr suggestion is coming properly. http://localhost:8986/solr/core1/suggest?spellcheck.q=city%20

Facet cache issue when deleting documents from the index

Hi guys, I'm using Solr 4.6.1 (embedded) and for some reason the facet cache is not invalidated when documents are deleted from the index. Sadly, for me, I cannot reproduce this issue with an integration test like this: --8<-- SolrInstance server = getSolrInstance(); SolrInputDoc

Re: SolrCloud how to spread out to multiple nodes

Thanks, Im going to give this a try -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-how-to-spread-out-to-multiple-nodes-tp4116326p4117728.html Sent from the Solr - User mailing list archive at Nabble.com.

Solrcloud: no registered leader found and new searcher error

I have configured solrcloud as follows, Solr.xml: I have added all the required config for solrcloud, referred this : http://wiki.apache.org/solr/SolrCloud#Required_Config I am adding data to core:document. Now w

Re: Solr Load Testing Issues

Sorry I didn't make myself clear. I have 20 machines in the configuration, each shard/replica is on it's own machine. On 14 February 2014 19:44, Shawn Heisey wrote: > On 2/14/2014 5:28 AM, Annette Newton wrote: > > Solr Version: 4.3.1 > > Number Shards: 10 > > Replicas: 1 > > Heap size: 15GB >

Re: DIH

I haven't tried Apache Flume but the manual seems to suggest 'yes' to a large number of your checklist items: http://flume.apache.org/FlumeUserGuide.html When you say 'rich document' indexing, the keyword you are looking for is (Apache) Tika, as that's what actually doing the job under the covers.

Re: DIH

Hi Mikhail, Can you please elaborate what do you mean?  My understanding is that there is no multi-threading support in DIH. For some reasons, it won't have. Am I correct? Regarding apache flume, how it can be dih replacement? Can I index rich documents on my disk using flume? Can I fetch docum

Re: DIH

There has been a couple of discussions to find DIH successor (including on HelioSearch list), but no real momentum as far as I can tell. I think somebody will have to really pitch in and do the same couple of scenarios DIH does in several different frameworks (TodoMVC style). That should get it go

Re: Solr index filename doesn't match with solr vesion

Thanks Shawn, Tri for your infos, explanation. Tien On Mon, Feb 17, 2014 at 1:36 PM, Tri Cao wrote: > Lucene main file formats actually don't change a lot in 4.x (or even 5.x), > and the newer codecs just delegate to previous versions for most file > types. The newer file types don't typically

Re: DIH

On Sat, Feb 15, 2014 at 1:07 PM, Shawn Heisey wrote: > On 2/14/2014 10:45 PM, William Bell wrote: > > On virtual cores the DIH handler is really slow. On a 12 core box it only > > uses 1 core while indexing. > > > > Does anyone know how to do Java threading from a SQL query into Solr? > > Example

Re: SolrJ Socket Leak

Jared, I faced a similar issue when using CloudSolrServer with Solr. As Shawn pointed out the 'TIME_WAIT' status happens when the connection is closed by the http client. HTTP client closes connection whenever it thinks the connection is stale (https://hc.apache.org/httpcomponents-client-ga/tutori