Re: is replication eating up OldGen space

2011-05-30 Thread Bernd Fehling
Some more info, after one week the servers have the following status: Master (indexing only) + looks good and has heap size of about 6g from 10g OldGen + has loaded meanwhile 2 times the index from scratch via DIH + has added new documents into existing index via DIH + has optimized and replicate

Re: How to display solr search results in Json format

2011-05-30 Thread Romi
Thanks for reply, But i want to know how Json does it internally, I mean how it display results as Field:value. - Thanks & Regards Romi -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-display-solr-search-results-in-Json-format-tp3004734p3004768.html Sent from the So

Re: How to display solr search results in Json format

2011-05-30 Thread bmdakshinamur...@gmail.com
Hi Romi, When querying the Solr index, use 'wt=json' as part of your query string to get the results back in json format. On Tue, May 31, 2011 at 11:35 AM, Romi wrote: > I have indexed all my database data in solr, now I want to rum search on it > and display results in JSON. what i need to do

How to display solr search results in Json format

2011-05-30 Thread Romi
I have indexed all my database data in solr, now I want to rum search on it and display results in JSON. what i need to do for it. - Thanks & Regards Romi -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-display-solr-search-results-in-Json-format-tp3004734p3004734.h

Re: Indexing files Solr cell and Amazon S3

2011-05-30 Thread Jan Høydahl
Hi, You can use parameter stream.file to tell Solr to read the file from local disk, not stream across network: http://lucene.472066.n3.nabble.com/Example-of-using-quot-stream-file-quot-to-post-a-binary-file-to-solr-td781172.html -- Jan Høydahl, search solution architect Cominvent AS - www.comin

Resolved- Re: Replication Error - Index fetch failed - File Not Found & OverlappingFileLockException

2011-05-30 Thread Renaud Delbru
Hi, I found out the problem by myself. The reason was a bad deployment of of Solr on tomcat. Two instances of solr were instantiated instead of one. The two instances were managing the same indexes, and therefore were trying to write at the same time. My apologies for the noise created on the

Replication Error - Index fetch failed - File Not Found & OverlappingFileLockException

2011-05-30 Thread Renaud Delbru
Hi, For months, we were using apache solr 3.1.0 snapshots without problems. Recently, we have upgraded our index to apache solr 3.1.0, and also moved to a multi-core infrastructure (4 core per nodes, each core having its own index). We found that one of the index slave started to show failure,

Indexing files Solr cell and Amazon S3

2011-05-30 Thread Greg Georges
Hello everyone, We have our infrastructure on Amazon cloud servers, and we use the S3 file system. We need to index files using Solr Cell. From what I have read, we need to stream files to Solr in order for it to extract the metadata into the index. If we stream data through a public url there

Solr Dismax bf & bq vs. q:{boost ...}

2011-05-30 Thread chazzuka
I tried to do this: #1. search phrases in title^3 & text^1 #2. based on result #1 add boost for field closed:0^2 #3. based on result in #2 boost based on last_modified and i tried like these: /solr/select ?q={!boost b=$dateboost v=$qq defType=dismax} &dateboost=recip(ms(NOW/HOUR,modified),86400

Explain the difference in similarity and similarityProvider

2011-05-30 Thread Brian Lamb
I'm looking over the patch notes from https://issues.apache.org/jira/browse/SOLR-2338 and I do not understand the difference between param value and is there an echo? When would I use one over the other? Thanks, Brian Lamb

Re: SOLR-1155 on 3.1

2011-05-30 Thread Otis Gospodnetic
I think the answers to both are negative. Vote for it! Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search :: http://search-lucene.com/ - Original Message > From: Ofer Fort > To: solr-user@lucene.apache.org > Sent: Mon, May 30, 2011 7:50:15 AM

Re: Can we stream binary data with StreamingUpdateSolrServer ?

2011-05-30 Thread Otis Gospodnetic
I'm not looking at the source code, but this doesn't sound right. I think it uses javabin. Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search :: http://search-lucene.com/ - Original Message > From: pravesh > To: solr-user@lucene.apache.org >

Re: n-gram speed

2011-05-30 Thread Otis Gospodnetic
Denis, Also, what are your documents and queries like? Maybe give a few examples so we can help. Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search :: http://search-lucene.com/ - Original Message > From: Tor Henning Ueland > To: solr-user@l

Re: DataImportHandler

2011-05-30 Thread Jeffrey Chang
I faced the same problem before, but that's because some parent classloader has loaded the DataImport class instead of using the SolrResourceLoader's delegated classloader. How are you starting your Solr? Via Eclipse? If you try starting Solr using cmdline, will you encounter the same issue?

Re: return unaltered complete multivalued fields with Highlighted results

2011-05-30 Thread lboutros
Hi Alexei, We have the same issue/behavior. The highlighting component fragments the fields to highlight and choose the bests to be returned and highlighted. You can return all fragments with the maximum size for each one, but it will never return fragments with scores equal to 0, I mean without a

Solr 3.1 commit errors

2011-05-30 Thread Denis Kuzmenok
After restart i have these errors every time i do commit via post.jar. Config: multicore / 5 cores, Solr 3.1 Lock obtain timed out: SimpleFSLock@/home/ava/solr/example/multicore/context/data/index/write.lock org.apache.lucene.store.LockObtainFailedException: Lock obtain timed out: SimpleFSLoc

Re: return unaltered complete multivalued fields with Highlighted results

2011-05-30 Thread alexei
Thank you for the reply Erick. I can return the stored content but I would like to show the highlighted results. With multivalued fields there seems to be some sorting of highlighed results (in order of importance?) going on. The problem is: 1 - I could not find a way to keep the original order

Spellcheck component not returned with numeric queries

2011-05-30 Thread Markus Jelsma
Hi, The spell check component's output is not written when sending queries that consist of numbers only. Clients depending on the availability of the spellcheck output need to check if the output is actually there. This is with a very recent Solr 3.x check out. Is this a feature or a bug? File

is replication eating up OldGen space

2011-05-30 Thread Bernd Fehling
Dear list, after switching from FAST to Solr I get the first _real_ data. This includes search times, memory consumption, perfomance of solr,... What I recognized so far is that something eats up my OldGen and I assume it might be replication. Current Data: one master - indexing only two slaves

DataImportHandler

2011-05-30 Thread adpablos
Hi, i've tryed to install DataImportHandler but i've some problems when run up solr. GRAVE: org.apache.solr.common.SolrException: Error Instantiating Request Handler, org.apache.solr.handler.dataimport.DataImportHandler is not a org.apache.solr.request.SolrRequestHandler This is the log. I've

Re: n-gram speed

2011-05-30 Thread Tor Henning Ueland
2011/5/30 Denis Kuzmenok : > I have a database with n-gram field, about 5 millions documents. QTime > is  about 200-1000 ms, database is not optimized because it must reply > to  queries  everytime  and  data  are updated often. Is it normal? > Solr: 3.1, java -Xms2048M -Xmx4096M > Server: i7, 12Gb

Can we stream binary data with StreamingUpdateSolrServer ?

2011-05-30 Thread pravesh
Hi, I'm using StreamingUpdateSolrServer to post a batch of content to SOLR1.4.1. By looking at StreamingUpdateSolrServer code, it looks it only provides the content to be streamed in XML format only. Can we use it to stream data in binary format? -- View this message in context: http://lucene

SOLR-1155 on 3.1

2011-05-30 Thread Ofer Fort
Hey all, In the last comment on SOLR-1155 by Jayson Minard ( https://issues.apache.org/jira/browse/SOLR-1155?focusedCommentId=13019955&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13019955 ) "I'll look at updating this for 3.1" was it integrated into 3.1? if not is

collapse component with pivot faceting

2011-05-30 Thread Isha Garg
Hi All! Can anyone tell me how pivot faceting works in combination with field collapsing.? Please guide me in this respect. Thanks! Isha Garg

n-gram speed

2011-05-30 Thread Denis Kuzmenok
I have a database with n-gram field, about 5 millions documents. QTime is about 200-1000 ms, database is not optimized because it must reply to queries everytime and data are updated often. Is it normal? Solr: 3.1, java -Xms2048M -Xmx4096M Server: i7, 12Gb

Re: wildcards and German umlauts

2011-05-30 Thread Jan Høydahl
Hi, Agree that this is annoying for foreign languages. I get the idea behind the original behaviour, but there could be more elegant ways of handling it. It would make sense to always run the CharFilters. Perhaps a mechanism where TokenFilters can be tagged for exclusion from wildcard terms wou

Re: Problem with spellchecking, dont want multiple request to SOLR

2011-05-30 Thread Jan Høydahl
Hi, Define two searchComponents with different names. Then refer to both in in your Search Request Handler config. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com On 27. mai 2011, at 10.01, roySolr wrote: > mm ok. I configure 2 spellcheckers: > > > >

Re: Bulk indexing, UpdateProcessor overwriteDupes and poor IO performances

2011-05-30 Thread Tanguy Moal
Hello, Sorry for re-posting this but it seems my message got lost in the mailing list's messages stream without hitting anyone's attention... =D Shortly, has anyone already experienced dramatic indexing slowdowns during large bulk imports with overwriteDupes turned on and a fairly high dupli

Re: Problem with caps and star symbol

2011-05-30 Thread Saumitra Chowdhury
I am sending some xml to understand the scenario. Indexed term = ROLE_DELETE Search Term = roledelete 0 4 on 0 name : roledelete 2.2 10 Indexed term = ROLE_DELETE Search Term = role 0 5 on 0 name : role 2.2 10 Mon May 30 13:09:14 BDST 2011 Global Role for Deletion role:9223372036854