RE: need some guidance about how to configure a specific solr solution.

2011-08-12 Thread Jonathan Rochkind
I don't know anything about LifeRay (never heard of it), but it sounds like you've actually figured out what you need to know about LifeRay, all you've got left is: "how to replicate the writer solr server content into the readers." This should tell you how: http://wiki.apache.org/solr/SolrRepl

Re: custom velocity tool

2011-08-12 Thread Erik Hatcher
Stephane - Also - I don't think even with v.properties=velocity.properties that it'd be picked up from the /conf directory the way the code is loading it using SolrResourceLoader. The .properties file would need to be in your JAR file for your custom tool (or in the classpath somehow seen by t

sorting distance in solr 1.4.1

2011-08-12 Thread Tri Nguyen
Hi,   We are using solr 1.4.1 and we need to sort our results by distance. We have lat lons for each document in the response and our reference point.   Is it possible?  I read about the spatial plugin but the does range searching:   http://blog.jayway.com/2010/10/27/geo-search-with-spatial-solr-p

Re: dataimporthandler large dataset

2011-08-12 Thread Shawn Heisey
On 8/12/2011 3:32 PM, Eric Myers wrote: Recently started looking into solr to solve a problem created before my time. We have a dataset consisting of 390,000,000+ records that had a search written for it using a simple query. The problem is that the dataset needs additional indices to keep oper

Re: dataimporthandler large dataset

2011-08-12 Thread Kyle Lee
We have a 200,000,000 record index with 14 fields, and we can re-index the entire data set in about five hours. One thing to note is that the DataImportHandler uses one thread per entity by default. If you have a multcore box, you can drastically speed indexing by specifying a threadcount of n+1, w

dataimporthandler large dataset

2011-08-12 Thread Eric Myers
Recently started looking into solr to solve a problem created before my time. We have a dataset consisting of 390,000,000+ records that had a search written for it using a simple query. The problem is that the dataset needs additional indices to keep operating. The DBA says no go, too large a da

Re: sorting issue with solr 3.3

2011-08-12 Thread Yonik Seeley
I've checked in an improved TestSort that adds deleted docs and randomizes things a lot more (and fixes the previous reliance on doc ids not being reordered). I still can't reproduce this error though. Is this stock solr? Can you verify that the documents are in the wrong order also (and not just

Re: Some questions about SolrJ

2011-08-12 Thread Shawn Heisey
On 8/12/2011 1:49 PM, Shawn Heisey wrote: I am sure that I have more questions, but I may be able to answer a lot of them myself if I can see better examples. Thought of another question. My Perl build system uses DIH for all indexing, but with the Java rewrite I am planning to do all actions

Some questions about SolrJ

2011-08-12 Thread Shawn Heisey
I currently have a build system for my Solr index written in Perl. I am in the process of rewriting it in Java. I've reached the part of the project where I'm using SolrJ, and I have a bunch of questions. All of the SolrJ examples I can find are too simple to answer them. A note before I la

Re: sorting issue with solr 3.3

2011-08-12 Thread Yonik Seeley
On Fri, Aug 12, 2011 at 2:08 PM, Yonik Seeley wrote: > On Fri, Aug 12, 2011 at 1:04 PM, Yonik Seeley > wrote: >> On Fri, Aug 12, 2011 at 9:53 AM, Bernd Fehling >> wrote: >>> It turned out that there is a sorting issue with solr 3.3. >>> As fas as I could trace it down currently: >>> >>> 4 docs i

custom velocity tool

2011-08-12 Thread Stéphane Campinas
Hi, I am working with the velocity response writer, and I want to develop a custom velocity tool. To do so, I have written a JAVA class that looks like that: @DefaultKey("mytool") public class MyCustomTool { public MyCustomTool() { } public String doit(Object arg) {

Re: sorting issue with solr 3.3

2011-08-12 Thread Yonik Seeley
On Fri, Aug 12, 2011 at 1:04 PM, Yonik Seeley wrote: > On Fri, Aug 12, 2011 at 9:53 AM, Bernd Fehling > wrote: >> It turned out that there is a sorting issue with solr 3.3. >> As fas as I could trace it down currently: >> >> 4 docs in the index and a search for *:* >> >> sorting on field dccreato

Re: Need help indexing/querying a particular type of hierarchy

2011-08-12 Thread Michael B. Klein
After a whole lot of facet-wrangling, I've come up with a practical solution that suits my situation, which is to index each triple as a series of paths. For example, if the "shelve" process of the "accessionWF" workflow is "completed," it gets indexed as: accessionWF accessionWF:shelve accessionW

Re: LockObtainFailedException

2011-08-12 Thread Naveen Gupta
HI Peter I found the issue, Actually we were getting this exception because of JVM space. I allocated 512 xms and 1024 xmx .. finally increased the time limit for write lock to 20 secs .. things are working fine ... but still it did not help ... On closely analysis of doc which we were indexing,

Re: sorting issue with solr 3.3

2011-08-12 Thread Yonik Seeley
On Fri, Aug 12, 2011 at 9:53 AM, Bernd Fehling wrote: > It turned out that there is a sorting issue with solr 3.3. > As fas as I could trace it down currently: > > 4 docs in the index and a search for *:* > > sorting on field dccreator_sort in descending order > > http://localhost:8983/solr/select

Tomcat7 with Solr closes at fixed hours, every time another hour

2011-08-12 Thread Adrian Fita
Hello. I'm having a Solr running within Tomcat7 and Tomcat is closing at fixed hours, everytime is a different hour. catalina.log doesn't show anything other than a clean tomcat shutdown (no exception or anything). I would really apreciate some advice on how to debug this. Tomcat doesn't run anyt

Exception DirectSolrSpellChecker when using spellcheck.q

2011-08-12 Thread O. Klein
Spellchecker works fine, but when using spellcheck.q it gives following exception (queryAnalyzerFieldType is defined if that would matter). Is it bug or am I doing something wrong? 2011-08-12 17:30:54,368 java.lang.NullPointerException at org.apache.solr.handler.component.SpellCheckCompon

Re: SOLR 3.3.0 multivalued field sort problem

2011-08-12 Thread Martijn v Groningen
Hi Johnny, Sorting on a multivalued field has never really worked in Solr. Solr versions <= 1.4.1 allowed it, but there was a change that an error occurred and that the sorting might not be what you expect. >From Solr 3.1 and up sorting on a multivalued isn't allowed and a http 400 is returned. D

Re: how to integrate solr with web page?

2011-08-12 Thread Nicholas Chase
On 8/12/2011 12:52 AM, nagarjuna wrote: Hi i have queried solr to retrieve information from database now i have to integrate with web page...i dont know how to implement this please help me... actually i have one jsp page which is having search field and search button now i need to get the

JEE servlet mapping, security and multiple Solr cores

2011-08-12 Thread Jaeger, Jay - DOT
This is both an FYI for the list so the issue gets documented and a suggestion for the developers. I thought about a JIRA, and would be happy to submit one, but the issue is pretty environment-specific, so I have not done so at this point. In testing Solr 3.3 under WebSphere Application Server

Re: how to integrate solr with web page?

2011-08-12 Thread Ahmet Arslan
> Hi i have queried solr to retrieve > information from database now i have to > integrate with web page...i dont know how to implement this > please help > me... > >     actually i have one jsp page which is having > search field and search > button now i need to get the results from solr in the

sorting issue with solr 3.3

2011-08-12 Thread Bernd Fehling
It turned out that there is a sorting issue with solr 3.3. As fas as I could trace it down currently: 4 docs in the index and a search for *:* sorting on field dccreator_sort in descending order http://localhost:8983/solr/select?fsv=true&sort=dccreator_sort%20desc&indent=on&version=2.2&q=*%3A*&

Re: Unbuffered entity enclosing request can not be repeated & Invalid chunk header

2011-08-12 Thread Vadim Kisselmann
Hi Markus, thanks for your answer. I'm using Solr. 4.0 and jetty now and observe the behavior and my error logs next week. tomcat can be a reason, we will see, i'll report. I'm indexing WITHOUT batches, one doc after another. But i would try out the batch indexing as well as retry indexing faulty

Nutch related issue: URL Ignore

2011-08-12 Thread Pawan Darira
hi i am using nutch 1.2. in my crawl-urlfilter.txt, i am specifying URLs to be skipped. i am giving some patterns that need to be skipped but it is not working e.g. -^http://([a-z0-9]*\.)*domain.com +^http://([a-z0-9]*\.)*domain.com/([0-9-a-z])*.html -^http://([a-z0-9]*\.)*domain.com/([a-z/])* -

Post content to be indexed to Solr

2011-08-12 Thread rahul
Hi, Currently I am indexing documents by directly adding files as 'req.addFile(fi);' or by sending the content of the file like 'req.addContentStream(stream);' using solrj. Assume, if the solrj client & Solr server are in different network (ie, Solr server is in remote location) I need to transf

Not update on duplicate key

2011-08-12 Thread Rohit
Hi All, Please correct me if I am wrong, but when I am trying to insert a document into Solr which was previously index, it overwrites the current key. Is there a way to change the behaviour, 1. I don't want Solr to override but on the other hand it should ignore the entry 2. Also, i

RE: Clustering not working when using 'text' field as snippet.

2011-08-12 Thread Pablo Queixalos
Thanks for your reply Staszek, Of course, the field has to be stored. I forgot to mention that I already updated the schema for that. I also checked that data was effectiveley stored in that field. Anyway, I tried to reproduce it on a fresh Solr install and clustering works well. ;-) Pablo

Re: SOLR 3.3.0 multivalued field sort problem

2011-08-12 Thread Péter Király
Hi, There is no direct solution, you have to create single value field(s) to create search. I am aware of two workarounds: - you can use a random or a given (e.g. the first) instance of the multiple values of the field, and that would be your sortable field. - you can create two sortable fields:

Fuzzy search with sort combination - drawback

2011-08-12 Thread johnnyisrael
Hi, I am having one problem while using the fuzzy search from query. I have two fields in my SOLR output, one field is endNgramed and other one is a normal Integer field which will have my customized score for that document. I have a handler[myhandler] which by default will sort the documents ba

SOLR 3.3.0 multivalued field sort problem

2011-08-12 Thread johnnyisrael
Hi, I am currently using SOLR 1.4.1, With this version sorting working fine even in multivalued field. Now I am planning to upgrade my SOLR version from 1.4.1 --> 3.3.0, In this latest version sorting is not working on multivauled field. So I am in unable to upgrade my SOLR due to this drawback.

Re: Timeout trying to index from nutch

2011-08-12 Thread Markus Jelsma
Firewall? Proxy? > I am new user and I have SOLR installed. I can use the admin page and > query the example data. > However, I was using nutch to load index with intranet web pages and I > got this message. > > SolrIndexer: starting at 2011-08-12 16:52:44 > org.apache.solr.client.solrj.SolrServe

Re: SEVERE: org.apache.solr.common.SolrException: Error loading class 'solr.ICUTokenizerFactory'

2011-08-12 Thread Péter Király
Hi Satish, > : > > I also added the following files to my apache-solr-3.3.0\example\lib > : > folder: I use ICU, and I copied the jar files not into example/lib as you did, but example/solr/lib. First I had to create that directory. It works for me both under 3.1, 3.2 and 3.3. In multicore setup

Re: Clustering not working when using 'text' field as snippet.

2011-08-12 Thread Stanislaw Osinski
Hi Pablo, The reason clustering doesn't work with the "text" field is that the field is not stored: For clustering to work, you'll need to keep your documents' titles and content in stored fields. Staszek On Fri, Aug 12, 2011 at 10:28, Pablo Queixalos wrote: > Hi, > > > > > > I am using s

Last successful build of Solr 4.0 and Near Realtime Search

2011-08-12 Thread Vadim Kisselmann
Hi folks, I'm writing here again (beside Jira: SOLR-2565), eventually any one can help here: I tested the nightly build #1595 with an new patch (2565), but NRT doesn't work in my case. I index 10 docs/sec, it takes 1-30sec. to see the results. same behavior when i update an existing document.

Clustering not working when using 'text' field as snippet.

2011-08-12 Thread Pablo Queixalos
Hi, I am using solr-3.3.0 and carrot² clustering which works fine out of the box with the examples doc and default solr configuration (the 'features' Field is used as snippet). I indexed my own documents using the embed ExtractingRequestHandler wich by default stores contents in the '

Re: Strip special chars like "-"

2011-08-12 Thread roySolr
Erick, you're right. It's working, my schema looks like this: Thanks for helping me!! -- View this message in cont

Re: frange not working in query

2011-08-12 Thread Amit Sawhney
Thanks Yonik. It solved the issue. On 11-Aug-2011, at 6:44 PM, Yonik Seeley wrote: > On Wed, Aug 10, 2011 at 5:57 AM, Amit Sawhney wrote: >> Hi All, >> >> I am trying to sort the results on a unix timestamp using this query. >> >> http://url.com:8983/solr/db/select/?indent=on&version=2.1&q={!f