Re: How to Update Value of One Field of a Document in Index?

There is no way to update any field in solr,You have to reindex that entire document again. you can get that doc from index create xml with existing fields with your updated field and post that xml to solr. - Grijesh -- View this message in context: http://lucene.472066.n3.nabble.com/How-t

Re: How to extend IndexSchema and SchemaField

Hi Renaud: Right now we faced the same issue: while developing a new RequestHandler we needed to add some information per field (in our case to define some fields as defaultSearchFields). We thought that this could be added externally in a configuration file or in the schema as new attributes. Lo

How to Update Value of One Field of a Document in Index?

I use nutch to crawl and index to Solr.  My code is working.  Now, I want to update the value of one of the fields of a document in the solr index after the document was already indexed, and I have only the document id.  How do I do that?  Thanks.

Re: Distance sorting with spatial filtering

On Thu, Sep 9, 2010 at 21:00, Lance Norskog wrote: > I just checked out the trunk, and branch 3.x This query is accepted on both, > but gives no responses: > http://localhost:8983/solr/select/?q=*:*&sort=dist(2,x_dt,y_dt,0,0)+asc So you are saying when you add the sort parameter you get no result

Re: Distance sorting with spatial filtering

I just checked out the trunk, and branch 3.x This query is accepted on both, but gives no responses: http://localhost:8983/solr/select/?q=*:*&sort=dist(2,x_dt,y_dt,0,0)+asc x_dt and y_dt are wildcard fields with the tdouble type. "tdouble" explicitly says it is stored and indexed. Your 'longitu

Re: Indexing checksum of field value

Look at Deduplication: http://wiki.apache.org/solr/Deduplication It implements a unique hashcode (Lookup3Signature ) as a tool that avoids rewriting the same document over and over. It declares this in solrconfig.xml instead of schema.xml. Lanc

Re: how to normalize a query

In the general case, this would require a new method on compound queries to sort themselves into a "canonical" order, or refuse to. Somehow, I don't think this will happen. However, it could be done with boolean queries only, which would make it somewhat easier to combinatorically compose OR fi

Re: org.apache.lucene.store.LockObtainFailedException: Lock obtain timed out : SingleInstanceLock: write.lock

iwAccess is the reader lock to iwCommit's writer lock - so the scenario you bring up should be protected - the reader lock is used in only one place in the class (addDoc), while every other call to openWriter is protected by the writer lock. I'd worry more about the case where two add documents hi

Change what gets logged when service is disabled

I use the PingRequestHandler option that tells my load balancer whether a machine is available. When the service is disabled, every one of those requests, which my load balancer makes every five seconds, results in the following in the log: Sep 9, 2010 6:06:58 PM org.apache.solr.common.SolrE

Re: PatternReplaceCharFilterFactory?

On 9/9/2010 5:38 PM, Erick Erickson wrote: Could you give us an idea of why you think it isn't present? As far as I can tell, it's been around for a while. Are you getting an error and if so, can you show it to us? Look in schema.xml of what you downloaded (probably in the example directory). I

Re: Delta Import with something other than Date

On 9/9/2010 1:23 PM, Vladimir Sutskever wrote: Shawn, Can you provide a sample of passing the parameter via URL? And how using it would look in the data-config.xml Here's the URL that I send to do a full build on my last shard: http://idxst5-a:8983/solr/build/dataimport?command=full-import

Re: How to load data to embedded server

The stream.file and stream.url parameters should do this. Lance Rico Lelina wrote: Hi, I'm using EmbeddedSolrServer for my unit tests. I just can't figure out how to add my data (stored in xml files similar to those in the example application example/exampleDocs) after instantiating the server

Re: org.apache.lucene.store.LockObtainFailedException: Lock obtain timed out : SingleInstanceLock: write.lock

Hello- There were a few bugs in this area that are fixed in Solr 1.4. There are many other bugs which were also fixed. We suggest everyone upgrade to 1.4. There are different locking managers, and you may be able to use a different one. Also, if this is over NFS that can cause further problem

Re: Date faceting +1MONTH problem

Hi Chris, Yes, I saw the facet.range.include feature and briefly tried to implement it before realising that it was Solr 3.1 only :) I agree that it seems like the best solution to problem. Reindexing with a +1MILLI hack had occurred to me and I guess that's what I'll do in the meantime; it just

Re: PatternReplaceCharFilterFactory?

Could you give us an idea of why you think it isn't present? As far as I can tell, it's been around for a while. Are you getting an error and if so, can you show it to us? Look in schema.xml of what you downloaded (probably in the example directory). Is it mentioned there? If so, it should "just b

Re: Help on spelling.

Okay putting "spellcheck=true" makes all the difference in the world. Thanks On 9/9/10 1:58 PM, "Markus Jelsma" wrote: > I don't see you passing spellcheck parameters in the query string. Are they > configured as default in your search handler? >   > -Original message- > From: Gregg

PatternReplaceCharFilterFactory?

I didn't build SOLR, I downloaded a prebuilt zip file. Am I correct in my understanding that the charFilter class PatternReplaceCharFilterFactory is not part of the prebuilt SOLR 1.4.1 distribution? If that's right, how do I go about adding it? The more explicit the instructions the better, as I ha

Re: Date faceting +1MONTH problem

: I'm trying to break down the data over a year into facets by month; to avoid : overlap, I'm using -1MILLI on the start and end dates and using a gap of : +1MONTH. : : However, it seems like February completely breaks my monthly cycles, leading Yep. Everything you posted makes sense to me in ho

Re: Is there a way to fetch the complete list of data from a particular column in SOLR document?

You're right for the general case. I should have added that our setup is perhaps a little bit out of the ordinary in that we send explicit commits to solr as part of our indexing app. Once a commit has finished we're sure all docs until then are present in solr. For us it's much more difficult to d

Building query based on value of boolean field

I have this field in my schema.xml: This one in my data-config: Now, how can I return all results for which partylocation = true? Thanks! -- View this message in context: http://lucene.472066.n3.nabble.com/Building-query-based-on-value-of-boolean-field-tp1449018p1449018.h

How to load data to embedded server

Hi, I'm using EmbeddedSolrServer for my unit tests. I just can't figure out how to add my data (stored in xml files similar to those in the example application example/exampleDocs) after instantiating the server. The source code for the simple post tool seems to require a stream to write the fi

Re: Is there a way to fetch the complete list of data from a particular column in SOLR document?

But how do you know when the document actually makes it to solr, especially if you are using commitWithin and not explicitly calling commit. One solution is to have a status field in the database such as 0 - unindexed 1 - indexing 2 - committed / verified And have a separate process query solr fo

RE: Help on spelling.

I don't see you passing spellcheck parameters in the query string. Are they configured as default in your search handler?   -Original message- From: Gregg Hoshovsky Sent: Thu 09-09-2010 22:40 To: solr-user@lucene.apache.org; Subject: Help on spelling. I am trying to use the spellchecker

Configurable dataimport.properties location in Solr 1.4

Hi, I am using solr 1.4 and was wondering if the dataimport.properties location can be configured for DataImportHandler. Is there a config file or a property that I can use to specify a custom location ? Thanks, Manali

Help on spelling.

I am trying to use the spellchecker but cannot get past the point of having the spelling possibilities returned. I have a text field define in the schema.xml file as: I modified solrconfig.xml to point the analyzer to the same field type and have the name set the same. text_ws

Extending org.apache.solr.hander.dataimport.Transformer

Hi All, I am building a custom DIH transformer to massage the data before its indexed. Extending org.apache.solr.hander.dataimport.Transformer requires me to implement the transformRow(Map row, Context context) During the actual import - SOLR complains because its looking for method with si

RE: Delta Import with something other than Date

Shawn, Can you provide a sample of passing the parameter via URL? And how using it would look in the data-config.xml Thanks! -Vladimir -Original Message- From: Shawn Heisey [mailto:elyog...@elyograg.org] Sent: Thursday, September 09, 2010 3:04 PM To: solr-user@lucene.apache.org Subje

Re: Delta Import with something other than Date

On 9/8/2010 4:32 PM, David Yang wrote: I have a table that I want to index, and the table has no datetime stamp. However, the table is append only so the primary key can only go up. Is it possible to store the last primary key, and use some delta query="select id where id>${last_id_value}" I

Re: Inconsistent search results with multiple keywords

sorry, mm was set to 2<-35%, not 2->25%, but nevermind. Steph. On Thu, Sep 9, 2010 at 3:13 PM, Stéphane Corlosquet wrote: > Thank you Erick, Markus and Ahmet! That answered my question. Changing the > value of the mm parameter in solrconfig.xml did have an effect on the 3 > keyword query (it was

Re: Inconsistent search results with multiple keywords

Thank you Erick, Markus and Ahmet! That answered my question. Changing the value of the mm parameter in solrconfig.xml did have an effect on the 3 keyword query (it was set to 2->25%), and removing it entirely forced all keywords to be present, and the number of hits was decreasing as expected. I'

RE: Re: Re: Invariants on a specific fq value

It works as expected. The append, well, appends the parameter and because each collection has a unique value, specifying two filters on different collections will always yield zero results.   This, of course, won't work for values that are shared between collections.   -Original message

Re: roadmap

On 09.09.2010, at 20:47, Markus Jelsma wrote: > You should check Jira's roadmap [1] instead. It shows a clear picture of what > has been done since the 1.4.1 release and pending issues for the 3.x branch > and others. > > > > [1]: > https://issues.apache.org/jira/browse/SOLR?report=com.atl

RE: roadmap

You should check Jira's roadmap [1] instead. It shows a clear picture of what has been done since the 1.4.1 release and pending issues for the 3.x branch and others.   [1]: https://issues.apache.org/jira/browse/SOLR?report=com.atlassian.jira.plugin.system.project:roadmap-panel     -Orig

RE: Re: Inconsistent search results with multiple keywords

Indeed, it's the dismax, i missed it! My bad..   -Original message- From: Ahmet Arslan Sent: Thu 09-09-2010 20:37 To: solr-user@lucene.apache.org; Subject: Re: Inconsistent search results with multiple keywords > yes, my schema.xml file have  defaultOperator="AND"/> which > is why I th

Re: Inconsistent search results with multiple keywords

> yes, my schema.xml file have  defaultOperator="AND"/> which > is why I thought that the number of hits would decrease > every time you add a > keyword. You are using dismax so, it is determined by mm parameter. http://wiki.apache.org/solr/DisMaxQParserPlugin#mm_.28Minimum_.27Should.27_Match.29

Using more than one name for a query field - aliases

I find myself in need of the ability to access one field by more than one name, for application transition purposes. Right now we have a field (ft_text, by far the largest part of the index) that is indexed but not stored. This field and three others are copied into an additional field calle

roadmap

Hi, With the Lucene svn merge a lot of tentative release dates seemed to have slipped. Which is fine, because I think the merge is for the greater good of both projects in the long run. However I do subscribe to the school of thought that believes OSS is best served with a release often mantra

Re: svn branch issues

: $ svn co : http://svn.apache.org/viewvc/lucene/solr/branches/branch-1.5-dev : svn: Repository moved permanently to : '/viewvc/lucene/solr/branches/branch-1.5-dev/'; please relocate those aren't SVN URLs, those are urls for the "viewvc" SVN Browsing tool your SVN client is trying to

Re: Inconsistent search results with multiple keywords

Hi Markus, On Thu, Sep 9, 2010 at 9:55 AM, Markus Jelsma wrote: > Looks like AND is your defaultOperator [1]. yes, my schema.xml file have which is why I thought that the number of hits would decrease every time you add a keyword. > Check your schema.xml and try > adding q.op=or to your qu

Re: Inconsistent search results with multiple keywords

Hi Erick, On Thu, Sep 9, 2010 at 9:41 AM, Erick Erickson wrote: > Could you show us the definitions for your fields? I suspect > you're not getting the tokens you expect. This will almost certainly > be true if the type is "string" rather than "text". > I should mention that I use solr via the

Re: How to extend IndexSchema and SchemaField

Hi, so I suppose there is no solution. Is there a chance that SchemaField becomes extensible in the future ? Because, at the moment, all the field attributes (indexed, stored, etc.) are hardcoded inside SchemaField. Do you think it is worth opening an issue about it ? -- Renaud Delbru On 07

Re: SolrCloud distributed indexing (Re: anyone use hadoop+solr?)

On Thu, Sep 9, 2010 at 11:51 AM, Grant Ingersoll wrote: > On Sep 6, 2010, at 10:41 AM, Yonik Seeley wrote: >> For SolrCloud, I don't think we'll end up using consistent hashing - >> we don't need it (although some of the concepts may still be useful). > > Can you elaborate on why we don't need it?

custom sorting / help overriding FieldComparator

Hi I'm trying to get my (overly complex and strange) product IDs sorting properly in Solr. Approaches I've tried so far, that I've given up on for various reasons: --Normalizing/padding the IDs so they naturally sort alphabetically/alphanumerically. --Splitting the ID into multiple Solr fields

Re: SolrCloud distributed indexing (Re: anyone use hadoop+solr?)

On Sep 6, 2010, at 10:41 AM, Yonik Seeley wrote: > > For SolrCloud, I don't think we'll end up using consistent hashing - > we don't need it (although some of the concepts may still be useful). Can you elaborate on why we don't need it?

Re: Solr, c/s type ?

On Thu, Sep 9, 2010 at 1:20 AM, Jonathan Rochkind wrote: > You _could_ use SolrJ with EmbeddedSolrServer.  But personally I wouldn't > unless there's a reason to.  There's no automatic reason not to use the > ordinary Solr HTTP api, even for an in-house application which is not a web > applicat

Re: how to normalize a query

Those two queries might NOT always be 'the same', depending on how you have your Solr request handler set up. For instance, if you have dismax with a ps boost, then "two one" may end up with different relevancy scores than "one two", because the query as a phrase will be used for boosting, and

Re: Garbled facets even in a zero hit search

Thanks, that did it. On 09/09/2010, at 16.14, Markus Jelsma wrote: > That's normal behavior if you haven't configured facet.mincount. Check the > wiki. > > On Thursday 09 September 2010 16:05:01 Dennis Schafroth wrote: >> I am definitely not excluding the idea that index is garbled, but.. it

Re: how to normalize a query

What I wanted was a was to determine that simply the query q="one two" is equivalent to q="two one", by normalizing I might have q="one two" for both for example, and then the q.hashCode() would be the same Simply using q.hashCode() returns different values for each query above so this is not su

Re: how to normalize a query

LuceneQParser http://lucene.apache.org/java/2_4_0/queryparsersyntax.html#Proximity%20Searches DismaxQParser http://wiki.apache.org/solr/DisMaxQParserPlugin#qs_.28Query_Phrase_Slop.29 On Thursday 09 September 2010 15:08:41 dan sutton wrote: > Hi, > > Does anyone know how I might normalized a que

Date faceting +1MONTH problem

Evening, I'm trying to break down the data over a year into facets by month; to avoid overlap, I'm using -1MILLI on the start and end dates and using a gap of +1MONTH. However, it seems like February completely breaks my monthly cycles, leading to incorrect counts further down the line; facets th

Re: Garbled facets even in a zero hit search

That's normal behavior if you haven't configured facet.mincount. Check the wiki. On Thursday 09 September 2010 16:05:01 Dennis Schafroth wrote: > I am definitely not excluding the idea that index is garbled, but.. it > doesn't explain that I get facets on zero hit. > > The schema is as followin

AW: SolrException log

Hi Tommaso, hi solr-users, i raised both maxCommitAge and maxCommitsToKeep and tracked the occurance of the "read past EOF Exception". i started with 2 commits and 60MINUTES, and now im at 15commits and 180MINUTES, but with no luck, the Exception still pops up in nearly same frequency as before (

Re: Garbled facets even in a zero hit search

I am definitely not excluding the idea that index is garbled, but.. it doesn't explain that I get facets on zero hit. The schema is as following: satay.xml Description: XML document where I have copied field for the facets (author_exact, subject_exact, title_exact), as I don't want tokeniz

Re: Inconsistent search results with multiple keywords

Looks like AND is your defaultOperator [1]. Check your schema.xml and try adding q.op=or to your query. [1]: http://wiki.apache.org/solr/SearchHandler#q.op On Thursday 09 September 2010 15:34:52 Stéphane Corlosquet wrote: > Hi all, > > I'm new to solr so please let me know if there is a more a

Re: Inconsistent search results with multiple keywords

Could you show us the definitions for your fields? I suspect you're not getting the tokens you expect. This will almost certainly be true if the type is "string" rather than "text". The solr admin page (especially analysis) will help you a lot here, as will adding &debugQuery=on to your query and

Inconsistent search results with multiple keywords

Hi all, I'm new to solr so please let me know if there is a more appropriate place for my question below. I'm noticing a rather unexpected number of results when I add more keywords to a search. I'm listing below a example (where I replaced the real keywords with placeholders): keyword1 851 hits

Re: Garbled facets even in a zero hit search

That looks...er...unfortunate. The very first thing I'd do is check your index and see if there are such weird values in your facet fields. My guess is that SOLR is working fine, but you somehow have garbage values in your index, but that's only a guess. I'd try that before trying to debug, GIGO.

how to normalize a query

Hi, Does anyone know how I might normalized a query so that e.g. q="one two" equals q="two one" Cheers, Dan

Garbled facets even in a zero hit search

Hi, Running on a Debian 5.0.5 64bit box. Usingsolr-1.4.1 with Java version "1.6.0_20"I am seeing weird facets results along with the "right" looking ones. Garbled data, stuff that looks like a buffer overflow / index off by ...And I even get them when I do a zero hit search. I wouldn't expect any f

Re: Indexing checksum of field value

Hi, You can use an UpdateProcessor to do so. This can be used to deduplicate documents based on exact or near matches with fields in other documents. Check the wiki page on deduplication [1] for an example. [1]: http://wiki.apache.org/solr/Deduplication Cheers, On Thursday 09 September 2010 1

Indexing checksum of field value

Hi, I am looking for a way to store the checksum of a field's value, something like: ... I haven't found anything like that in the docs or on google. Did I miss something? If not, would a custom tokenizer be a good way to implement it? /Staffan

Problem in using solrJs

Hello, I am using solrJs. I am trying to do Reuters example. I have followed all the steps but it's giving error in error console of browser that "AjaxSolr is undefined". I have all the jar files that are required. So tell me what should i do? Can you give me simple example of solrJS for

Re: svn branch issues

Well, it's under heavy development but the 3.x branch is more likely to become released than 1.5.x, which is highly unlikely to be ever released. On Thursday 09 September 2010 13:04:38 Mark Allan wrote: > Thanks. Are you suggesting I use branch_3x and is that considered > stable? > Cheers > Mark

notice: index corruption on Solr/Lucene trunk/3.x branch

If you are using SimpleFSDirectory (either explicitly or via FSDirectory.open on Windows) with Solr/Lucene trunk or 3.x branch since July 30, you might have index corruption and you should svn up and rebuild. More details available here: https://issues.apache.org/jira/browse/LUCENE-2637

Re: svn branch issues

Thanks. Are you suggesting I use branch_3x and is that considered stable? Cheers Mark On 9 Sep 2010, at 10:47 am, Markus Jelsma wrote: http://svn.apache.org/repos/asf/lucene/dev/branches/ -Original message- From: Mark Allan Sent: Thu 09-09-2010 10:44 To: solr-user@lucene.apache.org

Re: Batch update, order of evaluation

I can't reproduce reliably, so I'm suspecting there are issues in our code. I'm refactoring to avoid the problem entirely. Thanks for the response though Erick. Greg On 8 September 2010 21:51, Greg Pendlebury wrote: > Thanks, > > I'll create a deliberate test tomorrow feed some random data thro

RE: svn branch issues

 http://svn.apache.org/repos/asf/lucene/dev/branches/   -Original message- From: Mark Allan Sent: Thu 09-09-2010 10:44 To: solr-user@lucene.apache.org; Subject: svn branch issues Hi all, As I've mentioned in the past, I've created some custom field types   which make use of the Abstract

Re: Indexing data on MSSQL failed: Caused by: org.apache.solr.common.SolrException: Error loading class 'com.micros oft.sqlserver.jdbc.SQLServerDriver'

Hi Peter, I've also faced the same problem which you did. I also changed my data-config.xml file same as yours and checked that my MS Sql Server is running on default port i.e, 3306 given the same to connection string but still its not working. Could you pls. share your solrconfig.xml and schema

svn branch issues

Hi all, As I've mentioned in the past, I've created some custom field types which make use of the AbstractSubTypeFieldType class in the current trunk version of solr for a service we're working on. We're getting close to putting our service into production (early 2011) and we're now look

Re: Regarding WordDelimiterFactory

set splitWordsPart=0,splitNumberPart=0 - Grijesh -- View this message in context: http://lucene.472066.n3.nabble.com/Regarding-WordDelimiterFactory-tp1444694p1444742.html Sent from the Solr - User mailing list archive at Nabble.com.

org.apache.lucene.store.LockObtainFailedException: Lock obtain timed out : SingleInstanceLock: write.lock

Hi, We are using SOLR 1.3 and getting this error often. There is only one instance that index the data. I did some analysis which I have put below and scenario when this error can happen. Can you guys please validate the issue? thanks a lot in advance. SEVERE: org.apache.lucene.store.LockObtainFa

Re: Regarding WordDelimiterFactory

On Thu, Sep 9, 2010 at 3:57 AM, Sandhya Agarwal wrote: > Hello, > > I have a file with the input string "91{40}9490949090", and I wanted to > return this file when I search for the query string "+91?40?9*". The > problem is that, the input string is getting indexed as 3 terms "91", "40", > "94909

Regarding WordDelimiterFactory

Hello, I have a file with the input string "91{40}9490949090", and I wanted to return this file when I search for the query string "+91?40?9*". The problem is that, the input string is getting indexed as 3 terms "91", "40", "9490949090". Is there a way to consider "{" and "}" as part of the