Re: Total Term Frequency per ResultSet in Solr 4.3 ?

2013-07-04 Thread Tony Mullins
OK. Thanks Tricia , Jack & Yonik for your suggestions and time. Regards, Tony. On Fri, Jul 5, 2013 at 1:20 AM, P Williams wrote: > Hi Tony, > > Have you seen the > TermVectorComponent? > It will return the TermVectors for the documents in your

Re: Concurrent Modification Exception

2013-07-04 Thread Dmitry Kan
Can you repeat the test with for example jetty? In case jboss (?) has some issues in the case. What type of query was this? On 2 Jul 2013 19:27, "adityab" wrote: > Anyone , any suggestion or pointers for this issue? > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/

Early Access Release #2 for Solr 4.x Deep Dive book is now available for download on Lulu.com

2013-07-04 Thread Jack Krupansky
Okay, it’s hot off the e-presses: Solr 4.x Deep Dive, Early Access Release #2 is now available for purchase and download as an e-book for $9.99 on Lulu.com at: http://www.lulu.com/shop/jack-krupansky/solr-4x-deep-dive-early-access-release-1/ebook/product-21079719.html (That link says “1”, but

Re: Auto Soft commit not working !!!

2013-07-04 Thread Rohit Kumar
1. Do you have an update processor chain that doesn't have RunUpdate in it?*- No * 2. Is the solrconfig directive missing? - *Bang On. It was still commented !!!* 3. Is _version_ missing from your schema? *Checked it. and its present * *I will test again and update soon . * *Thanks * On

Re: Moving from single Solr instance to Solr Cloud

2013-07-04 Thread Otis Gospodnetic
Hello, In SolrCloud works Collections (logical indices) have shards and replicas, so you would probably want to create a new Collection with some number of shards and replicas and reindex into it. That would be the cleanest. Otis -- Solr & ElasticSearch Support -- http://sematext.com/ Performanc

Re: Auto Soft commit not working !!!

2013-07-04 Thread Jack Krupansky
1. Do you have an update processor chain that doesn't have RunUpdate in it? 2. Is the solrconfig directive missing? 3. Is _version_ missing from your schema? -- Jack Krupansky -Original Message- From: Rohit Kumar Sent: Thursday, July 04, 2013 9:22 PM To: solr-user@lucene.apache.org

Re: Auto Soft commit not working !!!

2013-07-04 Thread Rohit Kumar
I checked with the tomcat logs. Although the config says it to commit every 15000ms 15000 false Strangely there are no commit logs. Did i miss anything? - Having issues in Soft Auto commit (Near Real

Re: Find related words

2013-07-04 Thread Koji Sekiguchi
Hi Dotan, (13/07/04 23:51), Dotan Cohen wrote: Thank you Jack and Koji. I will take a look at MLT and also at the .zip files from LUCENE-474. Koji, did you have to modify the code for the latest Solr? Yes. As the Lucene APIs for accessing index have been changed, I had to modify the code. koj

Re: Total Term Frequency per ResultSet in Solr 4.3 ?

2013-07-04 Thread P Williams
Hi Tony, Have you seen the TermVectorComponent? It will return the TermVectors for the documents in your result set (note that the rows parameter matters if you want results for the whole set, the default is 10). TermVectors also must be stored fo

Re: Auto Soft commit not working !!!

2013-07-04 Thread Daniel Collins
You should see the commit messages in the solr logs, do they come up at the expected frequency? On 4 July 2013 15:35, Rohit Kumar wrote: > My solr config has : > > >15000 >false > > > > > 1000 > > > > Machine is ubuntu 13 / 4 cores / 16G

Re: Total Term Frequency per ResultSet in Solr 4.3 ?

2013-07-04 Thread Jack Krupansky
These statistics are use for determining document relevance or score for the query itself. As such, they are one of two things: 1) (per field) per document, or for the universe of documents in the collection. That's it, one of the two. You keep referring to "ResultSet", but there is no such co

Re: Total Term Frequency per ResultSet in Solr 4.3 ?

2013-07-04 Thread Tony Mullins
So what is the workaround for this problem ? Can it be done without changing any source code ? Thanks, Tony On Thu, Jul 4, 2013 at 8:01 PM, Yonik Seeley wrote: > Ah, sorry - I thought you were after docfreq, not termfreq. > -Yonik > http://lucidworks.com > > On Thu, Jul 4, 2013 at 10:57 AM, To

RE: SOLR 4.0 frequent admin problem

2013-07-04 Thread David Quarterman
Cheers, Roman! It was a default Jetty set up so now added a 'work' directory and that's in use now. -Original Message- From: Roman Chyla [mailto:roman.ch...@gmail.com] Sent: 04 July 2013 15:00 To: solr-user@lucene.apache.org Subject: Re: SOLR 4.0 frequent admin problem Yes :-) see SOLR

Re: Total Term Frequency per ResultSet in Solr 4.3 ?

2013-07-04 Thread Yonik Seeley
Ah, sorry - I thought you were after docfreq, not termfreq. -Yonik http://lucidworks.com On Thu, Jul 4, 2013 at 10:57 AM, Tony Mullins wrote: > Hi Yonik, > > With facet it didn't work. > > Please see the result set doc below > > http://localhost:8080/solr/collection2/select?fl=*,amazing_freq:term

Re: Total Term Frequency per ResultSet in Solr 4.3 ?

2013-07-04 Thread Tony Mullins
Hi Yonik, With facet it didn't work. Please see the result set doc below http://localhost:8080/solr/collection2/select?fl=*,amazing_freq:termfreq%28product,%27amazing%27%29,spider_freq:termfreq%28product,%27spider%27%29&fq=id%3A27&q=spider&fl=*&df=product&wt=xml&indent=true&facet=true&facet.quer

Re: Find related words

2013-07-04 Thread Dotan Cohen
Thank you Jack and Koji. I will take a look at MLT and also at the .zip files from LUCENE-474. Koji, did you have to modify the code for the latest Solr? -- Dotan Cohen http://gibberish.co.il http://what-is-what.com

Auto Soft commit not working !!!

2013-07-04 Thread Rohit Kumar
My solr config has : 15000 false 1000 Machine is ubuntu 13 / 4 cores / 16GB RAM. Given 6gb to Solr running over tomcat. Still when i am adding documents to solr and searching its returning 0 hits. Its taking long before the document actu

Re: Find related words

2013-07-04 Thread Koji Sekiguchi
You may want collocations a given word? I've implemented LUCENE-474 for Solr a while ago and I found it worked pretty well. https://issues.apache.org/jira/browse/LUCENE-474 Hope this helps. koji -- http://soleami.com/blog/automatically-acquiring-synonym-knowledge-from-wikipedia.html (13/07/04

Re: Total Term Frequency per ResultSet in Solr 4.3 ?

2013-07-04 Thread Yonik Seeley
If you just want to retrieve those counts, this seems like simple faceting. q=something facet=true facet.query=product:hunger facet.query=product:games -Yonik http://lucidworks.com On Thu, Jul 4, 2013 at 9:45 AM, Tony Mullins wrote: > Hi , > > I have lots of crawled data, indexed in my Solr (4.

Re: Find related words

2013-07-04 Thread Jack Krupansky
You can take a look at the MoreLikeThis/Find Similar feature. That gives you an approximation, but using documents rather than discrete terms. You would have to write a custom component of your own based on logic from MLT. -- Jack Krupansky -Original Message- From: Dotan Cohen Sent:

Re: SOLR 4.0 frequent admin problem

2013-07-04 Thread Roman Chyla
Yes :-) see SOLR-118, seems an old issue... On 4 Jul 2013 06:43, "David Quarterman" wrote: > Hi, > > About once a week the admin system comes up with SolrCore Initialization > Failures. There's nothing in the logs and SOLR continues to work in the > application it's supporting and in the 'direct

Re: Total Term Frequency per ResultSet in Solr 4.3 ?

2013-07-04 Thread Jack Krupansky
Sorry, but there is no such feature in Solr at this time - you would have to do it manually, either by retrieving all of the results or by writing a custom "value source" (function) that does the desired calculation within Solr. Feel free to file a Jira for suggesting such a new feature/improv

Solr Phonetic Search returning documents but not Highlight Information

2013-07-04 Thread snkar
We have a pretty simple Solr Schema: DocId

Total Term Frequency per ResultSet in Solr 4.3 ?

2013-07-04 Thread Tony Mullins
Hi , I have lots of crawled data, indexed in my Solr (4.3.0) and lets say user creates a search criteria 'X1' and he/she wants to know the occurrence of a specific term in the result set of that 'X1' search criteria. And then again he/she creates another search criteria 'X2' and he/she wants to kn

Re: Joins with SolrCloud

2013-07-04 Thread Yonik Seeley
Yes, joins support distributed search fine, provided that the individual documents that are joined reside on the same shard. For example, if you are modeling blogs and posts (one blog object as many posts) shard1 -- joe!blog_info joe!post1 shard2 -- mary!blog_info

Re: Moving from single Solr instance to Solr Cloud

2013-07-04 Thread Ali, Saqib
Hello Furkan, We are using Solr 4.3 Thanks On Thu, Jul 4, 2013 at 1:43 AM, Furkan KAMACI wrote: > Which version of Solr you are using? > > 2013/7/4 Ali, Saqib > > > We have single Solr instance with lot of indexed document. Now we would > > like to move to SolrCloud implementation. > > > > Ca

Find related words

2013-07-04 Thread Dotan Cohen
How might one find the top related words for a given word in a Solr index? For instance, given the following single-field documents: 1: I love chocolate 2: I love Solr 3: I eat chocolate cake 4: You will eat chocolate candy Thus, given the word "Chocolate" Solr might find these top words: I (3 ti

Re: Surprising score?

2013-07-04 Thread Upayavira
And be sure to re-index your content. Upayavira On Thu, Jul 4, 2013, at 11:28 AM, Jeroen Steggink wrote: > Hi Alexander, > > This is because you have length normalization enabled for that field. > http://ir.dcs.gla.ac.uk/wiki/Length_Normalisation > > If you want it disabled set the following: >

ClassNotFoundException regarding SolrInfoMBean under Tomcat 7

2013-07-04 Thread Michael Bakonyi
Hi everyone, I'm trying to get the CMS "TYPO3" connected with Solr 3.6.2. By now I followed the installation at http://wiki.apache.org/solr/SolrTomcat except that I didn't copy the .war-file into the $SOLR_HOME but referencing to it at a different location via Tomcat Context fragment file. Unt

SOLR 4.0 frequent admin problem

2013-07-04 Thread David Quarterman
Hi, About once a week the admin system comes up with SolrCore Initialization Failures. There's nothing in the logs and SOLR continues to work in the application it's supporting and in the 'direct access' mode (i.e. http://123.465.789.100:8080/solr/collection1/select?q=bingo:*). The cure is to

Re: PropagateServer Implementation for Solr

2013-07-04 Thread Furkan KAMACI
Here is an example how I use PropagateServer inside CloudSolrServer: public static List customListStatistics(CloudSolrServer solrServer) { NamedList namedList = new SimpleOrderedMap(); try { namedList = solrServer.request(new LukeRequest()); } catch (SolrServerException e) { e.printS

Re: Surprising score?

2013-07-04 Thread Jeroen Steggink
Hi Alexander, This is because you have length normalization enabled for that field. http://ir.dcs.gla.ac.uk/wiki/Length_Normalisation If you want it disabled set the following: Jeroen On 4-7-2013 11:10, Lochschmied, Alexander wrote: Hi Solr people! querying for "series:RCWP" returns me t

Surprising score?

2013-07-04 Thread Lochschmied, Alexander
Hi Solr people! querying for "series:RCWP" returns me the response below. Why does "RCWP Moisture Resistant" score worse than "D/CRCW-P e3" with the field definition below? OK, we are ignoring dashes and spaces, but I would have expected that matches towards the beginning score better. Can I ch

Re: PropagateServer Implementation for Solr

2013-07-04 Thread Daniel Collins
Ok, in the scenario where the calling "app" uses SolrJ and creates a CloudSolrServer to send all its requests in. In that case, yes I can see the logic that says CloudSolrServer shouldn't load balance that (its not that type of request), it should forward it on to all the servers in the cloud. Wh

Re: Moving from single Solr instance to Solr Cloud

2013-07-04 Thread Furkan KAMACI
Which version of Solr you are using? 2013/7/4 Ali, Saqib > We have single Solr instance with lot of indexed document. Now we would > like to move to SolrCloud implementation. > > Can we move the existing index to SolrCloud? If so, how? Or do we need to > reindex our data in SolrCloud? > > Thanks

Re: Advice for performance issues with group.facet=true

2013-07-04 Thread Daniel Bryant
Many thanks for your response Otis - I had feared as much, but it's good to have it confirmed. Best wishes, Daniel On 03/07/2013 17:05, Otis Gospodnetic wrote: Hi, I think nobody in the community is focused on field collapsing/grouping, so I suspect there won't be a fix until somebody gets

Re: Simple Moving Average of Query Durations

2013-07-04 Thread Alan Woodward
I started some work on https://issues.apache.org/jira/browse/SOLR-4735, which may help here. Have been pulled away onto other things, but I want to get back to it soon. Alan Woodward www.flax.co.uk On 3 Jul 2013, at 23:54, Otis Gospodnetic wrote: > Hi Jan, > > http://search-lucene.com/?q=pe

Re: Joins with SolrCloud

2013-07-04 Thread slevytam
Hi Yonik, Thanks for the reply. It was very helpful. This may be a newb question but will this work on a individual rows of a query or do all the queries' results need to be on the same shard. ex. if the main query would return - user15 (shard 1) - user16 (shard 2) - user17 (shard 3) is it a

[Solr 4.2] deleteInstanceDir is added to CoreAdminHandler but is not supported in Unload CoreAdminRequest

2013-07-04 Thread Lyuba Romanchuk
Hi, I need to unload core with deleting instance directory of the core. According to code of Solr4.2 I don't see the support for this parameter in solrj. Is there the fix or open issue for this? Best regards, Lyuba