Creating new Solr cores using relative paths

2010-08-16 Thread Jay Hill
I'm having trouble getting the core CREATE command to work with relative paths in the solr.xml configuration. I'm working with a layout like this: /opt/solr [this is solr.solr.home: $SOLR_HOME] /opt/solr/solr.xml /opt/solr/core0/ [this is the "template" core] /opt/solr/core0/conf/schema.xml [etc.]

Re: OutOfMemoryErrors

2010-08-16 Thread Grijesh.singh
put that line in your startup script or u can set as env var export CATALINA_OPTS=-Xms256m -Xmx1024m; -- View this message in context: http://lucene.472066.n3.nabble.com/OutOfMemoryErrors-tp1181731p1182708.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: OutOfMemoryErrors

2010-08-16 Thread Grijesh.singh
U can set up in startup script of tomcat -- View this message in context: http://lucene.472066.n3.nabble.com/OutOfMemoryErrors-tp1181731p1182582.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: OutOfMemoryErrors

2010-08-16 Thread rajini maski
Hello There, Even I am facing same errors... @Grijesh, Where exactly I need to make these changes of increasing JVM heap space..I mean where i need to specify them... ? I had made changes in tomcat config Java(JVM) initial memory pool and maximum memory pool to 256-1024MB..Yet the error persists i

Re: indexing???

2010-08-16 Thread satya swaroop
hi all, the error i got is ""Unexpected RuntimeException from org.apache.tika.parser.pdf.pdfpar...@8210fc"" when i indexed a file similar to the one in https://issues.apache.org/jira/browse/PDFBOX-709/samplerequestform.pdfcant we index those type files in solr??? regards, satya

Re: OutOfMemoryErrors

2010-08-16 Thread Grijesh.singh
increase your JVM Heap space by using params -Xms1024m -Xmx4096m Like this. -- View this message in context: http://lucene.472066.n3.nabble.com/OutOfMemoryErrors-tp1181731p1181892.html Sent from the Solr - User mailing list archive at Nabble.com.

OutOfMemoryErrors

2010-08-16 Thread Chamnap Chhorn
I got this error, anyone could explain and solve this? SEVERE: Exception invoking periodic operation: java.lang.OutOfMemoryError: Java heap space at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:114) at org.apache.catalina.core.ContainerBase.bac

Solr-HOW TO HANDLE THE LOCK FILE CREATION WHILE INDEXING AND OPERATION TIMED OUT WEB EXCEPTION ERROR

2010-08-16 Thread rajini maski
Hello Everyone, Please help me knowing the logic behind this lock file generation while indexing data in solr! The trouble I am facing is as follows: The data that I indexed is nearly in millions. At the initial level of indexing I find no errors unless it cross up-to 10lacs documen

a small problem of distributed search

2010-08-16 Thread Li Li
current implementation of distributed search use unique key in the STAGE_EXECUTE_QUERY stage. public int distributedProcess(ResponseBuilder rb) throws IOException { ... if (rb.stage == ResponseBuilder.STAGE_EXECUTE_QUERY) { createMainQuery(rb); return ResponseBuilder.STAGE_

Re: analysis tool vs. reality

2010-08-16 Thread Robert Muir
On Mon, Aug 16, 2010 at 5:23 PM, Steven A Rowe wrote: > Hi Robert, > > You wrote in response to Hoss: > > Maybe for once your argument isn't completely bogus > > Attacking people here is really uncalled for. > > actually, he asked for it: > you're right, we should just fix the bug that the query

Re: Solr Reports

2010-08-16 Thread Lance Norskog
Analysis of the indexed data has to be done with your own custom queries. The Solr logs include the query string, number of documents found and query time. You'll have to code your own tool for this. On Mon, Aug 16, 2010 at 1:08 AM, Karthik K wrote: > Lucidgaze might help. > > Karthik > -- L

RE: Re: Solr searching performance issues, using large documents

2010-08-16 Thread Markus Jelsma
I've no idea if it's possible but i'd at least try to return an ArrayList of rows instead of just a single row. And if it doesn't work, which is probably the case, how about filing an issue in Jira?   Reading the docs in the matter, i think it should (made) to be possible to return multiple ro

Re: Solr searching performance issues, using large documents

2010-08-16 Thread Peter Spam
Still stuck on this - any hints on how to write the JavaScript to split a document? Thanks! -Pete On Aug 5, 2010, at 8:10 PM, Lance Norskog wrote: > You may have to write your own javascript to read in the giant field > and split it up. > > On Thu, Aug 5, 2010 at 5:27 PM, Peter Spam wrote:

Re: possible bug in sorting by Function?

2010-08-16 Thread Chris Hostetter
: issue resolve. problem was that solr.war was silently not being overwritten : by new version. : : will try to spend more time debugging before posting. Glad you were able to figure it out. For future refrence: problems like these are pretty much impossible for people to help you with unless

Re: Solrj ContentStreamUpdateRequest Slow

2010-08-16 Thread Chris Hostetter
: > I think your problem may be that StreamingUpdateSolrServer buffers up : > commands and sends them in batches in a background thread. if you want to : > send individual updates in real time (and time them) you should just use : > CommonsHttpSolrServer : : My goal is to batch updates. My cont

RE: analysis tool vs. reality

2010-08-16 Thread Steven A Rowe
Hi Robert, You wrote in response to Hoss: > Maybe for once your argument isn't completely bogus Attacking people here is really uncalled for. -1 from me. Steve

Re: DataImportHandler and SAXParseExceptions with Jetty

2010-08-16 Thread Chris Hostetter
: > page. Use < instead of <. When I first ran into this, I was : > surprised that &rt; was not required as well, but it's probably a good : > idea to use it, just in case things tighten up in the future. : > : : Thanks, confirming this worked using '<'; instead of <. It would help : to no

Re: Can a Solr Server be both master and slave?

2010-08-16 Thread Amit Nithian
Ugh I should have checked there first! Thanks for the reply.. that helps a lot. Sincerely Amit On Mon, Aug 16, 2010 at 10:57 AM, Gora Mohanty wrote: > On Mon, 16 Aug 2010 10:43:38 -0700 > Amit Nithian wrote: > > > I am not sure if this is the best approach to this problem but I > > was curious

Re: Index compatibility 1.4 Vs 3.1 Trunk

2010-08-16 Thread Chris Hostetter
: "We will only provide a conversion tool that can convert indexes from : the last "branch_3x" up to this trunk (4.0) release, so they can be : read later, but may not contain terms with all current analyzers, so : people need mostly reindexing. Older indexes will not be able to be : read natively

Re: analysis tool vs. reality

2010-08-16 Thread Robert Muir
On Mon, Aug 16, 2010 at 4:20 PM, Chris Hostetter wrote: > > Even if you convince folks to make every change you think should be made > to the Lucene QueryParser (again: please take that up in a seperate > thread) it won't change the fact that people using analysis.jsp should > understand the disti

Re: analysis tool vs. reality

2010-08-16 Thread Chris Hostetter
: > even if you change the Lucene QUeryParser so that whitespace isn't a meta : > character it doens't affect the underlying issue: analysis.jsp is agnostic : > about QueryParsers. : analysis.jsp isn't agnostic about queryparsers, its ignorant of them, and : your default queryparser is actually a

Re: analysis tool vs. reality

2010-08-16 Thread Chris Hostetter
: Maybe, separate from analysis.jsp (showing only how text is analyzed), : Solr needs a debug page showing the steps the field's QueryParser goes : through on a given query, to debug such tricky QueryParser/Analyzer : interactions? As mentioned earlier in this thread, i set out to build something

Re: edismax pf2 and ps

2010-08-16 Thread Chris Hostetter
: Perhaps fold it into the pf/pf2 syntax? : : pf=text^2// current syntax... makes phrases with a boost of 2 : pf=text~1^2 // proposed syntax... makes phrases with a slop of 1 and : a boost of 2 : : That actually seems pretty natural given the lucene query syntax - an : actual boosted sloppy

RE: help on facet range

2010-08-16 Thread Markus Jelsma
No   http://wiki.apache.org/solr/SimpleFacetParameters#Facet_by_Range https://issues.apache.org/jira/browse/SOLR-1240   -Original message- From: Peng, Wei Sent: Mon 16-08-2010 20:25 To: solr-user@lucene.apache.org; Subject: RE: help on facet range The solr version that I am using is 1

Re: question: havnig multiple solrCloud configuration on the same machine

2010-08-16 Thread Mark Miller
On 8/16/10 1:55 AM, Yatir Ben Shlomo wrote: > Hi! > I am using solrCloud with tomcat5.5 > in my setup every lanugage has an its own index and its own solr filters so > it needs a seprated solr configuration files. > > in solrCLoud examples posted here : http://wiki.apache.org/solr/SolrCloud > I n

RE: help on facet range

2010-08-16 Thread Peng, Wei
The solr version that I am using is 1.4.0. Does it support facet.range? Wei -Original Message- From: Peng, Wei [mailto:wei.p...@xerox.com] Sent: Monday, August 16, 2010 2:12 PM To: solr-user@lucene.apache.org Subject: help on facet range I have been trying to use facet by range. Howeve

help on facet range

2010-08-16 Thread Peng, Wei
I have been trying to use facet by range. However no matter how I tried, I did not get anything from facet range ( I do get results from facet fields: topic and author). The query is http://localhost:8983/solr/select/?facet.range=timestamp&facet.range.sta rt=0&facet.range.end=1277942270&facet.ran

Re: Can a Solr Server be both master and slave?

2010-08-16 Thread Gora Mohanty
On Mon, 16 Aug 2010 10:43:38 -0700 Amit Nithian wrote: > I am not sure if this is the best approach to this problem but I > was curious if a single solr server could be both a master and a > slave without causing index corruption? It seems that you could > setup multiple replication handlers in t

Can a Solr Server be both master and slave?

2010-08-16 Thread Amit Nithian
I am not sure if this is the best approach to this problem but I was curious if a single solr server could be both a master and a slave without causing index corruption? It seems that you could setup multiple replication handlers in the SOLR config, /replication /replication2 and have one be master

RE: Newbie question about search behavior

2010-08-16 Thread Markus Jelsma
You can append it in your middleware, or try the EdgeNGramTokenizer [1]. If you're going for the latter, don't forget to reindex and expect a larger index.   [1]: http://lucene.apache.org/java/2_9_0/api/all/org/apache/lucene/analysis/ngram/EdgeNGramTokenizer.html -Original message- From

Newbie question about search behavior

2010-08-16 Thread Mike Thomsen
Is it possible to set up Lucene to treat a keyword search such as title:News implicitly like title:News* so that any title that begins with News will be returned without the user having to throw in a wildcard? Also, are there any common filters and such that are generally considered a good pra

Solr for multiple websites

2010-08-16 Thread Hitendra Molleti
Hi We have a news portal built on a CMS that heavily uses solr for indexing. Going ahead we will be migrating all our other portals to the same platform and are not sure how do we work with Solr for multiple websites. The options are: 1) Using multiple publications/indexes within solr for each s

Re: how to create a custom type in Solr

2010-08-16 Thread Thomas Joiner
Thanks you very much. I know the feeling, I've definitely had times when I just got busy and didn't reply, but I've had plenty to do that didn't require that to be done first, so no worries. Thanks, Thomas On Mon, Aug 16, 2010 at 9:14 AM, Mark Allan wrote: > Hi Thomas, > > Sorry for not replyi

Re: how to create a custom type in Solr

2010-08-16 Thread Mark Allan
Hi Thomas, Sorry for not replying before now - I've had your email flagged in my mail client to remind me to reply, but I've been so busy recently I never got round to it. I'll package up the necessary java files and send you the attachment directly instead of posting a zip file to the ma

Re: how to create a custom type in Solr

2010-08-16 Thread Thomas Joiner
Sorry to bother you, but since I haven't had a reply in a week, I figured I'd try asking again... What build of Solr are you using personally? Are you just using a nightly build, or is there a specific build that you are using? Has it had any major screw-ups for you? And I still would love to s

Re: Analyser depending on field's value

2010-08-16 Thread Damien Dudognon
Thank you for your reply. I'll apply your patch and try this new feature to see if it meets my needs. If I understand correctly, your solution is to have a field by type and to select the field to use depending on the value of another field. Ideally, I would apply a different pre-treatment to my

Re: Wiki documentation Packaged as single HTML or PDF

2010-08-16 Thread Jan Høydahl / Cominvent
Use a tool to download a site to local disk, and ship the resulting HTML as a folder or ZIP. If that is not good enough, consider shipping the Reference Guide by LucidImagination. It is one PDF and contains most of what you need. The customer may be confused by LucidWorks specific chapters but i

Re: Analyser depending on field's value

2010-08-16 Thread Andrzej Bialecki
On 2010-08-16 10:06, Damien Dudognon wrote: Hi all, I want to use a specific stopword list depending on a field's value. For example, if type == 1 then I use stopwords1.txt to index "text" field, else I use stopwords2.txt. I thought of several solutions but no one really satisfied me: 1) use o

Re: maxMergeDocs and performance tuning

2010-08-16 Thread Marc Sturlese
As far as I know, the higher you set the value, the faster the indexing process will be (because more things are kept in memory). But depending on which are your needs, it may not be the best option. If you set a high mergeFactor and you want to optimize the index once the process is done, this op

Re: Solr Reports

2010-08-16 Thread Karthik K
Lucidgaze might help. Karthik

Analyser depending on field's value

2010-08-16 Thread Damien Dudognon
Hi all, I want to use a specific stopword list depending on a field's value. For example, if type == 1 then I use stopwords1.txt to index "text" field, else I use stopwords2.txt. I thought of several solutions but no one really satisfied me: 1) use one Solr instance by type, and therefore a di