Re: How to add TrieIntField to a SolrInputDocument?

2011-07-13 Thread Gabriele Kahlout
this works: doc.remove("wc"); SolrInputField wcField = new SolrInputField("wc"); wcField.setValue(150, 1.0f); doc.put("wc",wcField); On Wed, Jul 13, 2011 at 4:19 PM, Gabriele Kahlout wrote: > SolrInputDocument doc = new SolrInputDocument(); > doc.s

Readercycle script issue

2011-07-13 Thread Pawan Darira
Hi my readercycle script is not reloading the searcher. where i may be wrong. please help Thanks Pawan

Re: POST for queries, length/complexity limit of fq?

2011-07-13 Thread Sujatha Arun
I have used long fq with POST for persmission of the type fq= id:( 1...n) and they are limited by the MAX boolean Clause Exception in the solrconfig.xml. Regards Sujatha On Wed, Jul 13, 2011 at 4:40 PM, pravesh wrote: > >1. I assume that it's worthwhile to rely on POST method instead of GET >

Re: ' invisible ' words

2011-07-13 Thread deniz
Hi Jayendra, I have changed the order and also removed the line related with synonyms... but the result is still the same... somehow some words are just invisible during my searches... - Zeki ama calismiyor... Calissa yapar... -- View this message in context: http://lucene.472066.n3.nabble.c

Re: solr/velocity: funtion for sorting asc/desc

2011-07-13 Thread okayndc
Awesome, thanks Erik! -- View this message in context: http://lucene.472066.n3.nabble.com/solr-velocity-funtion-for-sorting-asc-desc-tp3163549p3167662.html Sent from the Solr - User mailing list archive at Nabble.com.

XInclude Multiple Elements

2011-07-13 Thread Stephen Duncan Jr
I've spent some time looking at various conversations on this problem, but I can't find a solution that works. XInclude has to point a valid XML document, with a single root element. It should be possible to use xpointer to specify children elements to include, but as far as I can tell, the xpoin

Re: Edismax parser and complex boolean queries

2011-07-13 Thread Jamie Johnson
this may have been a silly question, looking at https://issues.apache.org/jira/browse/SOLR-1553, it says that in the absence of syntax errors the full query syntax is supported. Still would be nice to confirm though. On Wed, Jul 13, 2011 at 6:18 PM, Jamie Johnson wrote: > I was wondering if anyo

Re: podcasts

2011-07-13 Thread Erik Hatcher
On Jul 13, 2011, at 15:34 , Mourad K wrote: > Are there any good podcasts for beginners in SOLR There's a bunch of stuff we've created and posted to our site here: Erik

Edismax parser and complex boolean queries

2011-07-13 Thread Jamie Johnson
I was wondering if anyone had details about what the edismax parser does to complex boolean queries?

podcasts

2011-07-13 Thread Mourad K
Hello, Are there any good podcasts for beginners in SOLR Thanks Moumou

Re: use query to set filter on fields

2011-07-13 Thread Igor Muntyan
Use the following query: /select?q=*:*&rows=0&wt=json&indent=true&fl=NOT_IMPORTANT&facet=true&facet.zeros=false&fq={!tag=mk q.op=OR}make:(Ford red 2010)&fq={!tag=cl q.op=OR}color:(Ford red 2010)&fq={!tag=yr q.op=OR}year:(Ford red 2010)&facet.field={!ex=cl,yr key=mk}make&facet.field={!ex=mk,yr k

Re: Exception using "Analyze" from the Solr Admin app

2011-07-13 Thread xcbt212x
I had this same problem. In my case, I was able to correct it by removing (perhaps safer to move instead of remove) my /work/Catalina/ directory. Restarting tomcat caused that directory to be recreated, and after that it worked for me. Hope this helps anyone else who runs into this in the futu

Re: Query Rewrite

2011-07-13 Thread Jamie Johnson
Ok, so I think I have something working relatively well. I have a few issues which I'm not sure how to address though. Currently when I create my ParserPlugin in solrconfig I do the following person_name^1.0 person_name_first^0.5 person_name_last^0.5 then in

Upgrading solr from 1.4 to latest version

2011-07-13 Thread rvidela
Hi, I am new to Solr. In little time, I am very much impressed with its search performance. I have installed Solr on Ubuntu using "*apt-get install solr-tomcat curl -y*" command. From admin page, I can see that solr version is 1.4.1. But i see there is 3.x version already available. Just wondering

Re: omitTermFreq only?

2011-07-13 Thread Jibo John
Sorry I should have made the objectives clear. The goal is to reduce the index size by avoiding TermFrequency stored in the index (in .frq segment files). After exploring a bit more, realized that LUCENE-2048 now allows omitPositions. Similarly, I'm looking for a omitFrequency option. Thanks,

Test document generator (in PHP)

2011-07-13 Thread Marian Steinbach
Hi! I needed to fill an index with content and created myself a test document generator. It generates random text documents based on english terms. The content doesn't make sense, but allows for testing of some search features. Each document is unique. Document length is configured to vary within

Re: solr/velocity: funtion for sorting asc/desc

2011-07-13 Thread Erik Hatcher
You'll have to add some logic in your Velocity templates string process the sort parameter and determine whether to set the link to be "asc"ending or "desc"ending. It'll require learning some Velocity techniques to do this with #if and how to navigate the objects Solr puts into the Velocity con

Re: omitTermFreq only?

2011-07-13 Thread Markus Jelsma
A dirty hack is to return 1.0f for each tf > 0. Just a couple of lines code for a custom similarity class. > Hello, > > I was wondering if there is a way we can omit only the Term Frequency in > solr? > > omitTermFreqAndPositions =true wouldn't work for us since we need the > positions for supp

Re: solr/velocity: funtion for sorting asc/desc

2011-07-13 Thread okayndc
Thanks Eric. So if I had a link "Sort Title" and the default is &sort=title desc how can i switch that to &sort=title asc? example: http://# Sort Tile (default &sort=title desc) user clicks on link and sort should toggle(or switch) to &sort=title asc how can this be achieved? -- View this m

deletedPkQuery fails

2011-07-13 Thread Elaine Li
Hi Folks, I am trying to use the deletedPkQuery to enable deltaImport to remove the inactive products from solr. I am keeping getting the syntax error saying the query syntax is not right. I have tried many alternatives to the following query. Although all of them work in the mysql prompt directly

extending edismax?

2011-07-13 Thread solr nps
I am using Solr 3.3. I am using the edismax query parser and I am getting great results. To improve relevancy I want to add some semantic filters to the query. E.g. I want to pass the query "red shoes" as q="shoes"&fq=color:red. I have a service that can tell me that in the phrase "red shoes" the

omitTermFreq only?

2011-07-13 Thread Jibo John
Hello, I was wondering if there is a way we can omit only the Term Frequency in solr? omitTermFreqAndPositions =true wouldn't work for us since we need the positions for supporting phrase queries. Thanks, -Jibo

omitTermFreq only?

2011-07-13 Thread Jibo John
Hello, I was wondering if there is a way we can omit only the Term Frequency in solr? omitTermFreqAndPositions =true wouldn't work for us since we need the positions for supporting phrase queries. Thanks, -Jibo

SolrCloud Shardding

2011-07-13 Thread Jamie Johnson
Reading the SolrCloud wiki I see that there are goals to support different shardding algorithms, what is currently implemented today? Is the shardding logic the responsibility of the application doing the index?

Re: ContentStreamLoader Problem

2011-07-13 Thread Tod
On 07/12/2011 6:52 PM, Erick Erickson wrote: This is a shot in the dark, but this smells like a classpath issue, and since you have a 1.4.1 installation on the machine, I'm *guessing* that you're getting a mix of old and new Jars. What happens if you try this on a machine that doesn't have 1.4.1

Re: Preserve XML hierarchy

2011-07-13 Thread Gora Mohanty
On Wed, Jul 13, 2011 at 10:30 PM, Lucas Miguez wrote: > Hi, > > is it possible to do that in Apache Solr? If i make a search, how I > know from where it comes the result? [...] Your question is not very clear, and I happen unfortunately to be out of crystal balls and Tarot cards. Is it possible

Re: Grouping / Collapse Query

2011-07-13 Thread entdeveloper
I guess that's a possible solution, but the two concerns I would have are 1) putting the burden of sorting on the client instead of solr, where it belongs. And 2) needing to request more results than I'd want to display in order to guarantee I could populate the entire page of results to compensate

Re: Wildcard

2011-07-13 Thread François Schiettecatte
http://lucene.apache.org/java/2_9_1/queryparsersyntax.html http://wiki.apache.org/solr/SolrQuerySyntax François On Jul 13, 2011, at 1:29 PM, GAURAV PAREEK wrote: > Hello, > > What are wildcards we can use with the SOLR ? > > Regards, > Gaurav

Wildcard

2011-07-13 Thread GAURAV PAREEK
Hello, What are wildcards we can use with the SOLR ? Regards, Gaurav

Preserve XML hierarchy

2011-07-13 Thread Lucas Miguez
Hi, is it possible to do that in Apache Solr? If i make a search, how I know from where it comes the result? Thanks! I have an XML like this: some Text another text text more text text some Text text some Text another text text more text text text text

Multivalued field: get only the str that matches with the query

2011-07-13 Thread Lucas Miguez
Hi all, I have a multivalued field. I need to make a search in the multivalued field and get only the values that match with the query. Example: aaa bbb ccc aaa ccc So, if I make a search like "text:aaa" the 3 values are returned, when only results one and two are the correct. I am using the

Re: Index Solr Logs

2011-07-13 Thread Gora Mohanty
On Wed, Jul 13, 2011 at 8:31 PM, O. Klein wrote: > Im also interested in this. > > Noone has ever tried to index solr log with DIH? [...] Just upstream in this thread, Mike pointed out Logg.ly: http://www.loggly.com/ Regards, Gora

Re: (Solr-UIMA) Indexing problems with UIMA fields.

2011-07-13 Thread Sowmya V.B.
Hello Tomasso Thanks for the reply. I did added uima chain to /javabin handler as you suggested. Now, I get an internal server error! Here is the stacktrace. request: http://localhost:8080/apache-solr-3.3.0/update/javabin?wt=javabin&version=2 org.apache.solr.common.SolrException: Internal Serve

Re: about standardAnaylzer in solr

2011-07-13 Thread Kiwi de coder
ok, work now ! thx :) kiwi On Wed, Jul 13, 2011 at 11:06 PM, Edoardo Tosca wrote: > Try to change from StandardTolkenizerFactory to ClassicTokenizerFactory or > create your own fieldType > > positionIncrementGap="100"> > >** >... > > > > Edo > > On Wed, Jul 13, 2011 at

Re: about standardAnaylzer in solr

2011-07-13 Thread Edoardo Tosca
Try to change from StandardTolkenizerFactory to ClassicTokenizerFactory or create your own fieldType ** ... Edo On Wed, Jul 13, 2011 at 3:40 PM, Kiwi de coder wrote: > hi, > > I using solr 3.3 which in schema.xml contain this : > > > > > > i use the

Re: Index Solr Logs

2011-07-13 Thread O. Klein
Im also interested in this. Noone has ever tried to index solr log with DIH? Or is there some way to store solr logs in mysql db? -- View this message in context: http://lucene.472066.n3.nabble.com/Index-Solr-Logs-tp3109956p3166302.html Sent from the Solr - User mailing list archive at Nabble.c

Re: about standard analyzer

2011-07-13 Thread Kiwi de coder
hi, sorry.. i accidentally sending out this uncomplete mail.. actually I had send another one, please ignore this thx :) kiwi On Wed, Jul 13, 2011 at 10:52 PM, Erick Erickson wrote: > You're probably seeing the effects of a number of the filters that > Solr is applying (see the fieldType definit

Re: Can we use crawled data by Nutch 0.9 in other versions of Nutch

2011-07-13 Thread Markus Jelsma
You're on the wrong side of the fence. Anyway, you need to get Nutch 1.1 first as it has a CrawlDB converter. Convert your 0.9 CrawlDB first with Nutch 1.1, then upgrade to 1.3. On Wednesday 13 July 2011 16:48:24 serenity keningston wrote: > Hello, > > I have a question and I apologize if it so

Re: about standard analyzer

2011-07-13 Thread Erick Erickson
You're probably seeing the effects of a number of the filters that Solr is applying (see the fieldType definition). In particular, this looks like the result of WordDelimiterFilterFactory. If you click the "verbose" box on the analysis page, you should see the results of each step in the analysis c

Re: (Solr-UIMA) Indexing problems with UIMA fields.

2011-07-13 Thread Tommaso Teofili
Hello, I think the problem might be the following, if you defined the update request handlers like in the sample solrconfig : uima ... then the uima update chain will be executed only for HTTP POSTs on /update and not for /update/javabin (that is

Can we use crawled data by Nutch 0.9 in other versions of Nutch

2011-07-13 Thread serenity keningston
Hello, I have a question and I apologize if it sounds stupid. I just want to know, if we can use the crawled data by Nutch 0.9 in Nutch 1.3 because search has been delegated to Solr in Nutch 1.3 and I want to get the search results from the crawled data by Nutch 0.9 in Nutch 1.3 Serenity

about standardAnaylzer in solr

2011-07-13 Thread Kiwi de coder
hi, I using solr 3.3 which in schema.xml contain this : i use the sentences as example "XY&Z Corporation - x...@example.com" however, when I try on /analysis.jsp, it show difference result compare to using Lucene. using solr I got result below when using "text_standard" and "t

Using Solr for searching in a social network

2011-07-13 Thread Kien Nguyen
Hi everyone, I'm building a social network site and I need to build a search module, which is someway similar to Facebook Search. Say this module can search people by their names, based on the following priority levels: - My friends: has the 1st priority (highest) - Friends of my friends, or any

about standard analyzer

2011-07-13 Thread Kiwi de coder
hi, I using solr 3.3 which in schema.xml contain this : i use the sentences as example "XY&Z Corporation - x...@example.com" however, when I try on /analysis.jsp, it show difference result compare to using Lucene. using solr I got result below when using "text_standard" and "t

Re: Can I still search documents once updated?

2011-07-13 Thread Michael Kuhlmann
Am 13.07.2011 16:09, schrieb Gabriele Kahlout: > Solr is already configured by default not to store more than a > anyway. Usually one stores content only to display > snippets. Yes, but the snippets must come from somewhere. For instance, if you're using Solr's highlighting feature, all highligh

How to add TrieIntField to a SolrInputDocument?

2011-07-13 Thread Gabriele Kahlout
SolrInputDocument doc = new SolrInputDocument(); doc.setField(id, "0"); doc.setField("url", getURL("0")); doc.setField(content, "blah blah blah"); *doc.setField(wc, 150); //wc is of solr.TrieIntField field type in schema.xml* assertU(adoc(doc));

Re: Can I still search documents once updated?

2011-07-13 Thread Gabriele Kahlout
On Wed, Jul 13, 2011 at 3:54 PM, Michael Kuhlmann wrote: > Am 13.07.2011 15:37, schrieb Gabriele Kahlout: > > Well, I'm !sure how usual this scenario would be: > > 1. In general those using solr with nutch don't store the content field > to > > avoid storing the whole web/intranet in their index,

Re: Can I still search documents once updated?

2011-07-13 Thread Michael Kuhlmann
Am 13.07.2011 15:37, schrieb Gabriele Kahlout: > Well, I'm !sure how usual this scenario would be: > 1. In general those using solr with nutch don't store the content field to > avoid storing the whole web/intranet in their index, twice (1 in the form of > stored data, and one in the form of indexe

Re: Can I still search documents once updated?

2011-07-13 Thread Gabriele Kahlout
Well, I'm !sure how usual this scenario would be: 1. In general those using solr with nutch don't store the content field to avoid storing the whole web/intranet in their index, twice (1 in the form of stored data, and one in the form of indexed data). Now everytime they need to update a field unr

Re: Can I still search documents once updated?

2011-07-13 Thread Michael Kuhlmann
Am 13.07.2011 14:05, schrieb Gabriele Kahlout: > this is what i was expecting. Otherwise updating a field of a document that > has an unstored but indexed field is impossible (without losing the unstored > but indexed field. I call this updating a field of a document AND > deleting/updating all its

Solr versioning policy

2011-07-13 Thread Mike Squire
Hi, I've noticed that since the 3.1 release new minor version releases have been happening about every two months. I have a couple of questions: 1. Is this the plan moving forward (to aim for a new minor release approximately every couple of months)? 2. Will minor version increases always be back

Re: (Solr-UIMA) Indexing problems with UIMA fields.

2011-07-13 Thread Erick Erickson
I'll have to punt here. I don't know the internals well enough to say. I suppose it's possible that the "required fields" check happens *before* the UIMA stuff happens, but since I know so little about UIMA that's a blind guess at best... Anyone with real knowledge want to chime in here? Erick O

Re: (Solr-UIMA) Indexing problems with UIMA fields.

2011-07-13 Thread Sowmya V.B.
Hi Eric* >>If I'm reading this right, you're labeling certain fields as required. All docs MUST have those fields (I admit the error message could be more informative). So it sounds like things are behaving as I'd expect, your documents just don't contain the required fields.* - But, the UIMA pipe

Re: Can I still search documents once updated?

2011-07-13 Thread Gabriele Kahlout
On Wed, Jul 13, 2011 at 1:57 PM, Erick Erickson wrote: > Wait, you directly contradicted yourself You say it's > not stored, then you say it's stored and indexed, which is it? > ja, i meant indexed and not stored. > > When you fetch a document, only stored fields are returned > and the ret

Re: (Solr-UIMA) Indexing problems with UIMA fields.

2011-07-13 Thread Erick Erickson
If I'm reading this right, you're labeling certain fields as required. All docs MUST have those fields (I admit the error message could be more informative). So it sounds like things are behaving as I'd expect, your documents just don't contain the required fields. Best Erick On Wed, Jul 13, 2011

Re: Can I still search documents once updated?

2011-07-13 Thread Erick Erickson
Wait, you directly contradicted yourself You say it's not stored, then you say it's stored and indexed, which is it? When you fetch a document, only stored fields are returned and the returned data is the verbatim copy of the original data. No attempt is made to return un-stored fields. This

Re: Grouping / Collapse Query

2011-07-13 Thread Erick Erickson
Could you just return the score with the documents, group by type and order them any way you wanted? Best Erick On Tue, Jul 12, 2011 at 9:36 PM, entdeveloper wrote: > I'm messing around with the field collapsing in 4.x > http://wiki.apache.org/solr/FieldCollapsing . Is it currently possible to >

Re: How do I specify a different analyzer at search-time?

2011-07-13 Thread pravesh
You can configure analyzer for 'index-time' & for 'search-time' for each of your field-types in schema.xml Thanx Pravesh -- View this message in context: http://lucene.472066.n3.nabble.com/How-do-I-specify-a-different-analyzer-at-search-time-tp3159463p3165593.html Sent from the Solr - User maili

Re: POST for queries, length/complexity limit of fq?

2011-07-13 Thread pravesh
>1. I assume that it's worthwhile to rely on POST method instead of GET when issuing a search. Right? As I can see, this should work. We do restrict users search by passing unique id's(sometimes in thousands) in 'fq' and use POST method Thanx Pravesh -- View this message in context: http://luc

Re: how to build lucene-solr (espeically if behind a firewall)?

2011-07-13 Thread pravesh
If behind proxy; then use: ant dist ${build_files:autoproxy} Thanx Pravesh -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-build-lucene-solr-espeically-if-behind-a-firewall-tp3163038p3165568.html Sent from the Solr - User mailing list archive at Nabble.com.

Geo search with spatial-solr-plugin

2011-07-13 Thread Isha Garg
Hello, Spatial-solr-2.0-RC5.jar works successfully with Solr-1.4.1. With release of solr-3.1, is the support for spatial-solr-plaugin going to continue or not? Thanks! Isha

Re: nutch 1.2, solr 3.3, tomcat6. java.io.IOException: Job failed! problem when building solrindex

2011-07-13 Thread Markus Jelsma
If you're using Solr anyway, you'd better upgrade to Nutch 1.3 with Solr 3.x support. > Works like a charm. > > Thanks, > > Leo > > On Wed, 2011-07-13 at 11:31 +0530, Geek Gamer wrote: > > you need to update the solrj libs to 3.x version. the java bin format > > has changed . > > I made the ch

(Solr-UIMA) Indexing problems with UIMA fields.

2011-07-13 Thread Sowmya V.B.
Hi All I have a problem making the indexer work with the UIMA fields. Here is what I did (With the help of this community): I compiled a Solr-UIMA-snapshot, using "ant clean dist", by adding my own annotators there. It compiled without any errors. and i obtained a jar file. Now, following the in

omitNorms

2011-07-13 Thread Gastone Penzo
Hi, my field category (string) has omitNorms=True and omitTermFreqAndPositions=True. i have indexed all docs but when i do a search like: http://xxx:xxx/solr/select/?q=category:A&debugQuery=on i see there's normalization and idf and tf. Why? i can't understand the reason. 8.676225 = (MATCH) fi

Re: nutch 1.2, solr 3.3, tomcat6. java.io.IOException: Job failed! problem when building solrindex

2011-07-13 Thread Leo Subscriptions
Works like a charm. Thanks, Leo On Wed, 2011-07-13 at 11:31 +0530, Geek Gamer wrote: > you need to update the solrj libs to 3.x version. the java bin format > has changed . > I made the change a few months back, you can pull the changes from > https://github.com/geek4377/nutch/tree/geek5377-1.2

Re: ' invisible ' words

2011-07-13 Thread Jayendra Patil
Hi Denis, The order of the filter during index time and query time are different e.g. the synonyms filter. Do you have a custom synonyms text file which may be causing the issues ? It usually works fine if you have the same filter order during Index and Query time. You can try out. Regards, Jaye