Re: Explanation of the different caches.

2010-12-24 Thread Lance Norskog
The Field Cache is down in Lucene and has no eviction policy. You search, it loads into the Field Case, and that's it. If there's not enough memory allocated, you get OutOfMemory. In fact there's a separate one for each segment. You flush the Field Cache by closing the index and re-opening it. Und

Re: Solr branch_3x problems

2010-12-24 Thread Lance Norskog
More details, please. You tried all of the different GC implementations? Is there enough memory assign to the JVM to run comfortably but no much more? (The OS uses spare memory as disk buffers a lot better than Java does.) How many threads are there? Distributed search uses two searches, both para

Re: [Import Timeout] using /dataimport

2010-12-24 Thread Adam Estrada
All, That link is great but I am still getting timeout issues which causes the entire import to fail. The feeds that are failing are like Newsweek and USA Today which are very widely used. It's strange because sometimes they work and sometimes they don't. I think that there are still timeout issue

Re: Map failed at getSearcher

2010-12-24 Thread Robert Muir
ok i opened https://issues.apache.org/jira/browse/LUCENE-2832 On Fri, Dec 24, 2010 at 12:44 PM, Robert Muir wrote: > On Fri, Dec 24, 2010 at 12:28 PM, Yonik Seeley > wrote: >> On Fri, Dec 24, 2010 at 10:23 AM, Robert Muir wrote: >>> hmm, i think you are actually running out of virtual address s

Re: Map failed at getSearcher

2010-12-24 Thread Robert Muir
On Fri, Dec 24, 2010 at 12:28 PM, Yonik Seeley wrote: > On Fri, Dec 24, 2010 at 10:23 AM, Robert Muir wrote: >> hmm, i think you are actually running out of virtual address space, >> even on 64-bit! > > I don't know if there are any x86 processors that allow 64 bits of > address space yet. > AFAI

Re: Map failed at getSearcher

2010-12-24 Thread Yonik Seeley
On Fri, Dec 24, 2010 at 10:23 AM, Robert Muir wrote: > hmm, i think you are actually running out of virtual address space, > even on 64-bit! I don't know if there are any x86 processors that allow 64 bits of address space yet. AFAIK, they are mostly 48 bit. > http://msdn.microsoft.com/en-us/libr

Extensibility of compressed='true'

2010-12-24 Thread Benson Margulies
I'd like to have a field that transparently uses FastInfoset to store XML compactly. Ideally, I could supply the XML already in FIS format to solrj, but have application retrieve the field and get the XML 'reconstituted'. Obviously, I'm writing code here, but what? The field would be indexed='fal

Re: Map failed at getSearcher

2010-12-24 Thread Robert Muir
hmm, i think you are actually running out of virtual address space, even on 64-bit! http://msdn.microsoft.com/en-us/library/aa366778(v=VS.85).aspx#memory_limits Apparently windows limits you to 8TB virtual address space (ridiculous), so i think you should try one of the following: * continue usin

Re: How to write a custom stemmer for Apache Solr

2010-12-24 Thread Erick Erickson
In trunk, it'll be somewhere like: \modules\analysis\common\src\java\org\apache\lucene\analysis\nl but you haven't said what version you're using. Modules is a relatively new division of code, so it may be in contrib if you're on an earlier version. I have no clue about the details of what a Mara

Re: Map failed at getSearcher

2010-12-24 Thread Erick Erickson
At root, it's an OOM: Caused by: java.lang.OutOfMemoryError: Map failed at I'm guessing that you're optimizing after the import? What are the JVM settings you're using? The standard response is "increase the amount of memory available to the JVM", but it's expensive to change it and only find out

Re: spellcheck

2010-12-24 Thread Hasnain
Hi, Im facing the same problem, did anyone find a solution? -- View this message in context: http://lucene.472066.n3.nabble.com/spellcheck-tp506116p2140923.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: error in html???

2010-12-24 Thread lee carroll
Hi Satya, This is not a solr issue. In your client which makes the json request you need to have some error checking so you catch the error. Occasionally people have apache set up to return a 200 ok http response with a custom page on http errors (often for spurious security considerations) but t

How to write a custom stemmer for Apache Solr

2010-12-24 Thread nitishgarg
have figured out that the stemmers already built in Apache Solr are contained in org.apache.lucene.analysis.nl.* (for Dutch) but I can't find this package in my Lucene folder. Also I need to write a stemmer for marathi language, any help how should I proceed? -- View this message in context: h