Facet Query

Hi, Is facet query and fq parameters works only for range queries. can i make a general query for it like searching a facet.query=city:mumbai and getting results back. please suggest. When i made this query i am only getting count back for it . How can i get documents for it. -- View this messag

Problem in faceting

Dear sir, i have problem with faceting. I am searching a text "water treatment plant" on solr using dismax request handler. The final query which goes to solr is here - +((TDR_SUBIND_PROD_NAMES:water^2.5 | TDR_SUBIND_LOC_ZIP:water^2.5 | TDR_SUBIND_COMP_NAME:water^1.5 | TDR_SUBIND_TENDER_NO:

Re: Solr faceting on score

Thanks for reply -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-faceting-on-score-tp2422076p2422147.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr faceting on score

No ,You can not get facets on score ,score is not defined in schema facet can be get only fields defined in schema as I know. - Thanx: Grijesh http://lucidimagination.com -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-faceting-on-score-tp2422076p2422121.html Sent f

Re: SOLR 1.4 and Lucene 3.0.3 index problem

Hi, I would not try to change the lucene version in Solr 1.4.1 from 2.9.x to 3.0.x. As said Koji, the best solution is to get the branch 3.x or the trunk and build it. You need svn and ant. 1. Create a working directory $ mkdir ~/solr 2. Get the source $ cd ~/solr $ svn co http://svn.ap

Re: Using terms and N-gram

Okay so as suggested Shingle works perfectly well for what I need ! Thank you Erick 2011/2/3 openvictor Open > Thank you for these inputs. > > I was silly asking for ngrams because I already knew it. I think I was > tired yesterday... > > Thank you Eric Erickson, once again you gave me a more th

Re: Use Parallel Search

I am having similar kind of problem. I need to scale out. Could you explain how you have done distributed indexing and search using Lucene. Regards Ganesh - Original Message - From: "Gustavo Maia" To: Sent: Thursday, February 03, 2011 11:36 PM Subject: Use Parallel Search > Hello,

Re: facet.mincount

Thanks to all On 3 February 2011 20:21, Grijesh wrote: > > Hi > > facet.mincount not works with facet.date option afaik. > There is an issue for it as solr-343, but resolved. > Try apply patch, provided as a solution in this issue may solve the > problem. > Fix version for this may be 1.5 > > --

Re: HTTP ERROR 400 undefined field: *

: I was working on an checkout of the 3.x branch from about 6 months ago. : Everything was working pretty well, but we decided that we should update and : get what was at the head. However after upgrading, I am now getting this FWIW: please be specific. "head" of what? the 3x branch? or trunk?

Re: HTTP ERROR 400 undefined field: *

How you have upgraded ? are you changed every thing all jars ,data,config or any thing using from older version? - Thanx: Grijesh http://lucidimagination.com -- View this message in context: http://lucene.472066.n3.nabble.com/HTTP-ERROR-400-undefined-field-tp2417938p2421569.html Sent from

RE: Index Not Matching

http://localhost:8080/select/?q=*:* will return all records form solr - Thanx: Grijesh http://lucidimagination.com -- View this message in context: http://lucene.472066.n3.nabble.com/Index-Not-Matching-tp2417612p2421560.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: response when using my own QParserPlugin

Are looking your output in any Browser? Which browser you are using? If chrome then look for view source it will give your desired xml output or change any other browser to see xml output - Thanx: Grijesh http://lucidimagination.com -- View this message in context: http://lucene.472066.n3.n

Re: Function Question

I like it. You would think it would be easy to get the values from a multiValue field in the geodist() function, but I guess it was not built for that. If anyone has done something similar, let me know. Thanks. Bill On Thu, Feb 3, 2011 at 3:18 PM, Geert-Jan Brits wrote: > I don't have a direct

Re: Scale out design patterns

I am also in the same idea. Based on the field, I could shard but there are two practical difficulties. 1. If normal user logged-in then result could be fetched from the corresponding search server but if Admin user logged-in, then he may need to see all data. The query should be issued across

response when using my own QParserPlugin

Hi, I wrote a QParserPlugin.  When I hit solr and use this QParserPlugin, the response does not have the column names associated with the data such as: 0 29 0 {!tnav} faketn1 CA city san francisco US 10 - - 495,496,497 500,657,498,499 us:ca:san francisco faketn,fakeregression 037.74 -12

RE: Index Not Matching

Hello Hoss, That is exactly what it is going on. It seems to be failing in the analysis of the record. How do I get all the records from SOLR? http://localhost:8080/select?*.* ? Thanks! -Original Message- From: Chris Hostetter [mailto:hossman_luc...@fucit.org] Sent: Thursday, February 0

Re: Index Not Matching

which field type are you specifying in your schema.xml for the fields that you search upon? if you are using "text" then this causes your input text to be stemmed to a common root making your searches more flexible. For instance: if you have the term "dreaming" in one row/document and the term "dre

RE: Index Not Matching

: At first I thought it could be a schema problem, but we went though it : with a fine comb and compared it to the one in our stage environment. : What is really weird is that I grabbed one of the product ID that are : not showing up in SOLR from the DB, search through the SOLR GUI and it : found i

Re: Index Not Matching

Make sure your index is completely commited. curl 'http://localhost:8983/solr/update?commit=true' http://wiki.apache.org/solr/UpdateXmlMessages#A.22commit.22_and_.22optimize.22 for an overview: http://lucene.apache.org/solr/tutorial.html hth, Geert-Jan

RE: Index Not Matching

Both the application and the SOLR gui match (with the incorrect number of course :-) ) At first I thought it could be a schema problem, but we went though it with a fine comb and compared it to the one in our stage environment. What is really weird is that I grabbed one of the product ID that are

DB2 and DataImportHandler

I get the following error when trying to index using a DataImportHandler with solr 1.4.1. I see that there is an open JIRA with no resolution. Do I have to write my own data import handler to work around this issue? Thanks, Mark Feb 3, 2011 5:21:09 PM org.apache.solr.handler.dataimport.JdbcData

Re: Function Question

I don't have a direct answer to your question, but you could consider having fields: latCombined and LongCombined where you pairwise combine the latitudes and longitudes, e.g: latCombined: 48.0-49.0-50.0 longcombined: 2.0-3.0-4.0 Than in your custom scorer above split latC

Re: Index Not Matching

that's odd..are you viewing the results through your application or the admin console? if you aren't, I'd suggest you use the admin console just to eliminate the possibility of an application bug. We had a similar problem in the past and turned out to be a mixup of our dev/test instances.. On 3 Fe

RE: Index Not Matching

Hello Saavs, I am 100% sure we are not updating the DB after we index the data. We are specifying the same fields on both queries. Our prod boxes do not have access to QA or DEV, so I would expect a connection error when indexing if this is the case. No connection errors in the logs. -Orig

Re: Function Question

Thoughts? On Wed, Feb 2, 2011 at 10:38 PM, Bill Bell wrote: > > This is posted as an enhancement on SOLR-2345. > > I am willing to work on it. But I am stuck. I would like to loop through > the lat/long values when they are stored in a multiValue list. But it > appears that I cannot figure out to

Re: Index Not Matching

Hello, Are you definitely positive your database isn't updated after you index your data? Are you querying against the same field(s) specifying the same criteria both in Solr and in the database? Any chance you might be pointing to a dev/test instance of Solr ? Regards, - Savvas On 3 February 20

HTTP ERROR 400 undefined field: *

Hey Guys, I was working on an checkout of the 3.x branch from about 6 months ago. Everything was working pretty well, but we decided that we should update and get what was at the head. However after upgrading, I am now getting this error through the admin: HTTP ERROR 400 undefined field: *

Index Not Matching

Greetings! My organization is new to SOLR, so please bare with me. At times, we experience an out of sync condition between SOLR index files and our Database. We resolved that by clearing the index file and performing a full crawl of the database. Last time we noticed an out of sync conditi

Re: Use Parallel Search

Can you describe a bit more what you are searching (types of docs) and what your query rate looks like? Also, what features are you using? Faceting? Sorting? ... On Feb 3, 2011, at 1:06 PM, Gustavo Maia wrote: > Hello, > > Let me give a brief description of my scenario. > Today I am only us

DataImportHandler usage with RDF database

Hello List, I am very interested in DataImportHandler. I have data stored in an RDF db and wish to use this data to boost query results via Solr. I wish to keep this data stored in db as I have a web app which directly maintains this db. Is it possible to use a DataImportHandler to read RDF dat

Re: geodist and spacial search

Use a filter query? See the {!geofilt} stuff on the wiki page. That gives you your filter to restrict down your result set, then you can sort by exact distance to get your sort of just those docs that make it through the filter. On Feb 3, 2011, at 10:24 AM, Eric Grobler wrote: > Hi Erick, >

Re: Solr for finding similar word between two documents

Lets say 1 have document(file) which is large and contains word inside it. And the 2nd document also is a text file. Problem is to find all those words in 2nd document which is present in first document when both of the files are large enough. Regards Rohan On Fri, Feb 4, 2011 at 1:01 AM, openv

Re: Use Parallel Search

Hello Gustavo, well, I did not use Nutch at all, but I got some experience with using Solr. In Solr you could use a multicore-setup where each core points to another hard-drive of your server. For other Solr-Servers ( and cores as well ) each core is a seperate index, so to query all drives of on

Re: Solr for finding similar word between two documents

Rohan : what you want to do can be done with quite little effort if your document has a limited size (up to some Mo) with common and basic structures like Hasmap. Do you have any additional information on your problem so that we can give you more useful inputs ? 2011/2/3 Gora Mohanty > On Thu,

Re: Solr for finding similar word between two documents

On Thu, Feb 3, 2011 at 11:32 PM, rohan rai wrote: > Is there a way to use solr and get similar words between two document > (files). [...] This is *way* too vague t make any sense out of. Could you elaborate, as I could have sworn that what you seem to want is the essential function of a search e

Re: Using terms and N-gram

Thank you for these inputs. I was silly asking for ngrams because I already knew it. I think I was tired yesterday... Thank you Eric Erickson, once again you gave me a more than useful comment. Indeed Shingles seems to be the perfect fit for the work I want to do. I will try to implement that ton

Re: Using terms and N-gram

First, you'll get a lot of insight by defining something simply and looking at the analysis page from solr admin. That's a very valuable page. To your question: commongrams are "shingles" that work between stopwords and other words. For instance, "this is some text" gets analyzed into this, this_i

RE: Using terms and N-gram

I don't suppose it's something silly like the fact that your indexing chain includes 'words="stopwords.txt"', and your query chain does not? Bob Sandiford | Lead Software Engineer | SirsiDynix P: 800.288.8020 X6943 | bob.sandif...@sirsidynix.com www.sirsidynix.com  _ Early COSUGI birds get th

Re: chaning schema

It could be related Tomcat. I've had inconsistent experiences there too, I _thought_ I could delete just the contents of the data/ directory, but at some point I realized that wasn't working, confusing me as to whether I was remembering correctly that deleting just the contents ever worked.

Use Parallel Search

Hello, Let me give a brief description of my scenario. Today I am only using Lucene 2.9.3. I have an index of 30 million documents distributed on three machines and each machine with 6 hds (15k rmp). The server queries the search index using the remote class search. And each machine is made to sea

What is the best protocol for data transfer rate HTTP or RMI?

Hello, I am doing a comparative study between Lucene and Solr and wish to obtain more concrete data on the data transfer using the lucene RemoteSearch that uses RMI and data transfer of SOLR that uses the HTTP protocol. Gustavo Maia

Solr for finding similar word between two documents

Is there a way to use solr and get similar words between two document (files). Any ideas Regards Rohan

Re: Terms and termscomponent questions

Ah, good. Good luck with the rest of your app! WordDelimiterFilterFactory is powerful, but tricky ... Best Erick On Thu, Feb 3, 2011 at 9:51 AM, openvictor Open wrote: > Dear Erick, > > You were totally right about the fact that I didn't use any space to > separate words, cause SolR to concatena

Re: Open Too Many Files

Try it. ulimit -n20 2011/2/3 Grijesh > > best option to use > true > > decreasing mergeFactor may cause indexing slow > > - > Thanx: > Grijesh > http://lucidimagination.com > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Open-Too-Many-Files-tp2406289p2412415.

Re: chaning schema

Well, the nice thing is that I have an Amazon based dev server, and it's AMI stored. So if I screw something up, I just throw away that server and get a fresh one all configured and full of dev data and BAM back to where I was. So I'll try it again with the -rf flags. I did shut down the serve

Re: geodist and spacial search

Hi Erick, Thanks I saw that example, but I am trying to sort by distance AND specify the max distance in 1 query. The reason is: running bbox on 2 million documents with a 20km distance takes only 200ms. Sorting 2 million documents by distance takes over 1.5 seconds! So it will be much faster fo

Re: Using terms and N-gram

Thank you, I will do that and hopefuly it will be handy ! But can someone explain me difference between CommonGramFIlterFactory et NGramFilterFactory ? ( Maybe the solution is there) Thank you all, best regards 2011/2/3 Grijesh > > Use analysis.jsp to see what happening at index time and query

Re: chaning schema

On Thu, Feb 3, 2011 at 6:47 PM, Erick Erickson wrote: > Erik: > > Is this a Tomcat-specific issue? Because I regularly delete just the > data/index directory on my Windows > box running Jetty without any problems. (3_x and trunk) > > Mostly want to know because I just encouraged someone to jus

Re: facet.mincount

Hi facet.mincount not works with facet.date option afaik. There is an issue for it as solr-343, but resolved. Try apply patch, provided as a solution in this issue may solve the problem. Fix version for this may be 1.5 - Thanx: Grijesh http://lucidimagination.com -- View this message in con

Re: Terms and termscomponent questions

Dear Erick, You were totally right about the fact that I didn't use any space to separate words, cause SolR to concatenate words ! Everything is solved now. Thank you very much for your help ! Best regards, Victor Kabdebon 2011/2/3 Erick Erickson > There are a couple of things going on here. F

Re: My spellchecker experiment

On Thu, Feb 3, 2011 at 8:55 AM, Emmanuel Espina wrote: > It uses fuzzy queries instead of a ngram query, and then I rank the results > by word frequency in the text with the aid of a python script (all that is > explained in the post). I got pretty good results (between 50% and 90% > improvements)

Re: facet.mincount

ahh..I see your point..well if that's true, then facet.missing/facet.method are also not supported? I'm not sure if this is the case, or the Date Faceting Parameters = Field Value Faceting Parameters + the extra ones. Maybe the page author(s) can clarify. On 3 February 2011 11:32, dan sutton wr

RE: value for maxFieldLength

Thank you Erick Lewis -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: 03 February 2011 13:25 To: solr-user@lucene.apache.org Subject: Re: value for maxFieldLength This is not really vary large, Solr should handle this easily (assuming you've given it enoug

Re: DataImportHandler: no queries when using entity=something

Here's a magic URL, not available from the admin page that may help debugging: /solr/admin/dataimport.jsp Best Erick On Wed, Feb 2, 2011 at 7:38 PM, Jon Drukman wrote: > So I'm trying to update a single entity in my index using > DataImportHandler. > > http://solr:8983/solr/dataimport?comm

Re: Reg filter criteria on multivalued attribute

Hmmm, why doesn't +relationship:DEF_BY -relationship:BEL_TO work? Then I don't think the second part matters... Best Erick On Wed, Feb 2, 2011 at 12:09 PM, bbarani wrote: > > Hi, > > I have a question on filters on multivalued atrribute. Is there a way to > filter a multivalue attribute based

Re: geodist and spacial search

Further down that very page ... Here's an example of sorting by distance ascending: - ...&q=*:*&sfield=store&pt=45.15,-93.85&sort=geodist() asc The key is just t

Re: value for maxFieldLength

This is not really vary large, Solr should handle this easily (assuming you've given it enough memory) so I'd go with a large number, say 20M. If you start running out of memory, then you've probably given the JVM too little memory. But Solr should handle this without a burp. Best Erick On Wed,

Re: Partial matches don't work (solr.NGramFilterFactory

On Wed, Feb 2, 2011 at 4:44 PM, Script Head wrote: > Yes, I have tried searching on text_ngrams as well and it produces no > results. > > On a related note, since I have dest="text"/> wouldn't the ngrams produced by text_ngrams field > definition also be available within the text field? > No, lo

Re: chaning schema

Erik: Is this a Tomcat-specific issue? Because I regularly delete just the data/index directory on my Windows box running Jetty without any problems. (3_x and trunk) Mostly want to know because I just encouraged someone to just delete the index dir based on my experience... Thanks Erick On

Re: Terms and termscomponent questions

There are a couple of things going on here. First, WordDelimiterFilterFactory is splitting things up on letter/number boundaries. Take a look at: http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters for a list of *some* of the available tokenizers. You may want to just use one of the others

Re: escaping parenthesis in search query don't work...

WordDelimiterFilterFactory is probably stripping out the parens. If you try running your terms through http://localhost:8983/solr/admin/analysis.jsp you'll see the effects of various tokenizers and filters, be sure to check the "verbose" checkbox.

Re: Malformed XML with exotic characters

Hi I've seen almost all funky charsets but gothic is always trouble. I'm also unsure if its really a bug in Solr. It could well be the Xerces being unable to cope. Besides, most systems indeed don't go well with gothic. This mail client does, but my terminal can't find its cursor after (properl

Re: facet.mincount

facet.mincount is grouped only under field faceting parameters not date faceting parameters On Thu, Feb 3, 2011 at 11:08 AM, Savvas-Andreas Moysidis wrote: > Hi Dan, > > I'm probably just not able to spot this, but where does the wiki page > mention that the facet.mincount is not applicable on da

How effective are faceted queries ?

Hi, I was wondering if there exists any performance characteristica for facets. As I understand facets, they are a subqueries, that will perform certain counts on the resultset. This mean that a facet will be evaluated on every shard along with the main query. But how will the facet query evalu

Re: facet.mincount

I am also not getting where in wiki its mention that facet.mincount will not work with date faceting. But I have checked by query its not working with me also. Have to report a bug. - Thanx: Grijesh http://lucidimagination.com -- View this message in context: http://lucene.472066.n3.nabble

Re: facet.mincount

Hi Dan, I'm probably just not able to spot this, but where does the wiki page mention that the facet.mincount is not applicable on date fields? On 3 February 2011 10:55, Isan Fulia wrote: > I am using solr1.4.1 release version > I got the following error while using facet.mincount > java.lang.I

Re: facet.mincount

I am using solr1.4.1 release version I got the following error while using facet.mincount java.lang.IllegalStateException: STREAM at org.mortbay.jetty.Response.getWriter(Response.java:571) at org.apache.jasper.runtime.JspWriterImpl.initOut(JspWriterImpl.java:158) at org.apac

Re: facet.mincount

I don't think facet.mincount works with date faceting, see here: http://wiki.apache.org/solr/SimpleFacetParameters Dan On Thu, Feb 3, 2011 at 10:11 AM, Isan Fulia wrote: > Any query followed by > > &facet=on&facet.date=aUpdDt&facet.date.start=2011-01-02T08:00:00.000Z&facet.date.end=2011-02-03T0

Re: from long to tlong, compatible?

Thanks for the fast answer. Yeah, I was afraid that I needed to re-index for the precision to take effect in this case. - Original Message From: Yonik Seeley To: solr-user@lucene.apache.org Sent: Wed, February 2, 2011 10:12:42 PM Subject: Re: from long to tlong, compatible? On Wed, F

Re: Open Too Many Files

best option to use true decreasing mergeFactor may cause indexing slow - Thanx: Grijesh http://lucidimagination.com -- View this message in context: http://lucene.472066.n3.nabble.com/Open-Too-Many-Files-tp2406289p2412415.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: facet.mincount

Have you seen your log file ,what saying the log file . Is there any exception occur? I have never seen that facet.mincont=1 not working. What version of solr you are using? - Thanx: Grijesh http://lucidimagination.com -- View this message in context: http://lucene.472066.n3.nabble.com/face

Re: facet.mincount

Any query followed by &facet=on&facet.date=aUpdDt&facet.date.start=2011-01-02T08:00:00.000Z&facet.date.end=2011-02-03T08:00:00.000Z&facet.date.gap=%2B1HOUR&facet.mincount=1 On 3 February 2011 15:14, Savvas-Andreas Moysidis < savvas.andreas.moysi...@googlemail.com> wrote: > could you post the que

Re: Open Too Many Files

Or decrease the mergeFactor. > or change the index to a compound-index > > solrconfig.xml: true > > so solr creates one index file and not thousands. > > - > --- System > > > One Server, 12 GB RAM, 2 Solr Instances, 7 Cor

Re: DataImportHandler: no queries when using entity=something

On Thu, Feb 3, 2011 at 3:23 PM, Darx Oman wrote: > add to url "&clean=false" > http://solr:8983/solr/dataimport?command=full-import&entity=games&; > clean=false > > *clean* : (default 'true'). Tells whether to clean up the index before the > indexing is started [...] Sorry, what does that have to

Re: DataImportHandler: no queries when using entity=something

check your log file you might have a connection problem

Re: DataImportHandler: no queries when using entity=something

add to url "&clean=false" http://solr:8983/solr/dataimport?command=full-import&entity=games&; clean=false *clean* : (default 'true'). Tells whether to clean up the index before the indexing is started >

Re: facet.mincount

could you post the query you are submitting to Solr? On 3 February 2011 09:33, Isan Fulia wrote: > Hi all, > Even after making facet.mincount=1 , it is showing the results with count = > 0. > Does anyone know why this is happening. > > -- > Thanks & Regards, > Isan Fulia. >

facet.mincount

Hi all, Even after making facet.mincount=1 , it is showing the results with count = 0. Does anyone know why this is happening. -- Thanks & Regards, Isan Fulia.

Re: Open Too Many Files

or change the index to a compound-index solrconfig.xml: true so solr creates one index file and not thousands. - --- System One Server, 12 GB RAM, 2 Solr Instances, 7 Cores, 1 Core with 31 Million Documents other Cores