Total Documents Failed : How to find out why

2011-05-09 Thread Rohit
Hi, I am running the solr index and post indexing I get these results, how can I know which documents failed and why? 1 5170850 0 2011-05-08 23:40:09 Indexing completed. Added/Updated: 2972300 documents. Deleted 0 documents. 2011-05-09 00:13:48 2011-05-09 00:13:48 2972300 2198550 0:33:40.945 Run

tomcat and multicore processors

2011-05-09 Thread solr_beginner
Hi,   Is that possible that solr on tomcat on windows 2008 is using only one core of processor? Do I need configure something to use more cores?    Best Regards, Solr_Beginner

Re: How to Update Value of One Field of a Document in Index?

2011-05-09 Thread Luis Cappa Banda
Hello. You should be able to get the current document that you want to update, change your notes value with the new ones to be added bye the user, and then make and update petition to Solr to delete the old document (findable by the id that you include in the POST petition) and add the new documen

Searching accross Solr-Multicore

2011-05-09 Thread Benyahya, Fahd
Hallo everyone, i'm using solr-multicore with 3 cores to index my Web-Site. For testing i'm using the solr-admin GUI to get responses. The Problem is, that i get results only from one core, but not from the others also. Each core has its own schema.xml. The Cores are like follow structured: /mul

Re: tomcat and multicore processors

2011-05-09 Thread deniz
yea you can use solr on tomcat, i am doing the same actually... but have no idea about multiple cores tho... -- View this message in context: http://lucene.472066.n3.nabble.com/tomcat-and-multicore-processors-tp2917973p2918015.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Searching accross Solr-Multicore

2011-05-09 Thread Gora Mohanty
On Mon, May 9, 2011 at 2:10 PM, Benyahya, Fahd wrote: > Hallo everyone, > > i'm using solr-multicore with 3 cores to index my Web-Site. For testing i'm > using the solr-admin GUI to get responses. The Problem is, that i get > results only from one core, but not from the others also. [...] What do

Re: uima fieldMappings and solr dynamicField

2011-05-09 Thread Tommaso Teofili
Thanks Koji for opening that, the dynamicField mapping is a commonly used feature especially for named entities mapping. Tommaso 2011/5/7 Koji Sekiguchi > I've opened https://issues.apache.org/jira/browse/SOLR-2503 . > > Koji > -- > http://www.rondhuit.com/en/ > > (11/05/06 20:15), Koji Sekiguch

Re: Searching accross Solr-Multicore

2011-05-09 Thread Benyahya, Fahd
Hi, sorry that I did not so well explained my issue. That is exactly as you described it(* Or, is it that queries are working on one core, and not on the other?) Regards, Fahd On 9 May 2011 10:58, Gora Mohanty wrote: > On Mon, May 9, 2011 at 2:10 PM, Benyahya, Fahd > wrote: > > Hallo everyo

Re: Searching accross Solr-Multicore

2011-05-09 Thread rajini maski
If the schema is different across cores , you can query across the cores only for those fields that are common. Querying across all cores for some query paramterer and gettin result set in one output xml can be achieved by shards http://localhost:8090/solr1&indent=on&q=*:*&shards=localhost:8090/so

Solr 3.1 / Java 1.5: Exception regarding analyzer implementation

2011-05-09 Thread Martin Jansen
I just attempted to set up an instance of Solr 3.1 in Tomcat 5.5 running in Java 1.5. It fails with the following exception on start-up: > java.lang.AssertionError: Analyzer implementation classes or at least their > tokenStream() and reusableTokenStream() implementations must be final at > org

Solr 1.3 highlighting problem

2011-05-09 Thread nicksnels1
Hi, I'm using the "old" 1.3 Solr version on one of my sites and I decided to add a highlighting feature. Unfortunately I can not get it to work. I'm doing some testing in the Sorl admin interface without much luck. Below is some information that describes the problem. I would like to highlight te

Re: Searching accross Solr-Multicore

2011-05-09 Thread Benyahya, Fahd
thanks for all those who have answered my questions. But i still not understanding, why i cannot sent queries for each core own and get results only form the core who has quired. At first i'm not intersting to get resultes for all cores in one xml output . to do that i need to make a distributed

Re: Solr 3.1 / Java 1.5: Exception regarding analyzer implementation

2011-05-09 Thread Martin Jansen
On 09.05.11 11:04, Martin Jansen wrote: > I just attempted to set up an instance of Solr 3.1 in Tomcat 5.5 running > in Java 1.5. It fails with the following exception on start-up: > >> java.lang.AssertionError: Analyzer implementation classes or at least their >> tokenStream() and reusableToken

Faceting with MorelikeThis

2011-05-09 Thread Isha Garg
Hi All! Can Anybody tell me how to exclude the count of similar results( obtained from morelikethis ) from total facet count. Thanks in Advance! Isha Garg

Re: Solr 1.3 highlighting problem

2011-05-09 Thread Grijesh
Whether your field text is stored or not? Highlighting works with stored fields of schema only. - Thanx: Grijesh www.gettinhahead.co.in -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-1-3-highlighting-problem-tp2918089p2918299.html Sent from the Solr - User mailing

Re: aliasing?

2011-05-09 Thread Grijesh
Can you provide more detail about your required aliasing. - Thanx: Grijesh www.gettinhahead.co.in -- View this message in context: http://lucene.472066.n3.nabble.com/aliasing-tp2917733p2918303.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Whole unfiltered content in response document field

2011-05-09 Thread solrfan
I understand now. I become the raw content of the field because is "stored". The filtered content is in the response not visible. I can only see this in the analysis view. Ok now :) I will try to move the StopFilter under the WordDelimeter. Thanks! -- View this message in context: http://lucen

Re: Total Documents Failed : How to find out why

2011-05-09 Thread Erick Erickson
First you need to find your logs. That folder should not be empty regardless of whether DIH is working correctly or not. I'm assuming here that you're just doing the "java -jar star.jar" in the example directory, if this isn't the case how are you starting Solr/Jetty? Best Erick On Mon, May 9, 2

Re: Searching accross Solr-Multicore

2011-05-09 Thread Erick Erickson
There's not much information to go on here. Please review: http://wiki.apache.org/solr/UsingMailingLists Best Erick On Mon, May 9, 2011 at 5:26 AM, Benyahya, Fahd wrote: > thanks for all those who have answered my questions. > But i still not understanding, why i cannot  sent queries for each c

RE: Total Documents Failed : How to find out why

2011-05-09 Thread Rohit
Hi Erick, Thats exactly how I am starting solr. Regards, Rohit -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: 09 May 2011 16:57 To: solr-user@lucene.apache.org Subject: Re: Total Documents Failed : How to find out why First you need to find your logs. Th

Custom filter development

2011-05-09 Thread solrfan
Hi, I would like to write my own filter. I try to use the following class: public class MyFilter extends TokenFilter { private String myField public SemanticQueryExpansionFilter(TokenStream input, myFiled) { super(input); this.myField = my

Re: Solr 1.3 highlighting problem

2011-05-09 Thread nicksnels1
Hi Grijesh, The field text is stored and yet it is not working. Kind regards, Nick -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-1-3-highlighting-problem-tp2918089p2918518.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Use Solr / Lucene to search in a Logfile

2011-05-09 Thread Matthieu Huin
Hello Robert, At my company, we are working on a generic log collector that uses Solr to provide search capabilities. What the collector does basically is this (this is greatly dumbed down !) : * collect a log line (read it from a file, receive it from the network, ... ) * parse it through a

Re: uima fieldMappings and solr dynamicField

2011-05-09 Thread Koji Sekiguchi
Thanks Tommaso! I'm glad to hear from the person with experience. I'll commit shortly. Koji (11/05/09 17:57), Tommaso Teofili wrote: Thanks Koji for opening that, the dynamicField mapping is a commonly used feature especially for named entities mapping. Tommaso 2011/5/7 Koji Sekiguchi I've o

Can ExtractingRequestHandler ignore documents metadata

2011-05-09 Thread Tod
I'm indexing content from a CMS' database of metadata. The client would prefer that Solr exclude the properties (metadata) of any documents being indexed. Is there a way to tell Tika to only index a document's text and not its properties? Thanks - Tod

Solr Range Facets

2011-05-09 Thread Rohit
Hi Chris , I did try what you suggested, but I am not getting the expected results. The code is given below, SolrQuery query = new SolrQuery(); query.set("q","apple"); query.set("facet","true"); query.set("facet.range", "create

Re: Replication Clarification Please

2011-05-09 Thread Ravi Solr
Hello Mr. Bell, Thank you very much for patiently responding to my questions. We optimize once in every 2 days. Can you kindly rephrase your answer, I could not understand - "if the amount of time if > 10 segments, I believe that might also trigger a whole index, since you cycled

Solr 3.1 Upgrade - Reindex necessary ?

2011-05-09 Thread Ravi Solr
Hello All, I am planning to upgrade from Solr 1.4.1 to Solr 3.1. I saw some deprecation warnings in the log as shown below [#|2011-05-09T12:37:18.762-0400|WARNING|sun-appserver9.1|org.apache.solr.analysis.BaseTokenStreamFactory|_ThreadID=53;_ThreadName=httpSSLWorkerThread-9001-13 ;_Re

Re: Custom filter development

2011-05-09 Thread Tom Hill
On Mon, May 9, 2011 at 5:07 AM, solrfan wrote: > Hi, I would like to write my own filter. I try to use the following class: > But this is a problem for me. The one-to-one mapping. I want to map a given > Token, for example "a" to three Tokens "a1", "a2", "a3". I want to do a > one-to-one mapping t

Synonym Filter disable at query time

2011-05-09 Thread mtraynham
I would like to be able to disable the synonym filter during runtime based on a query parameter, say 'synoynms=true' or 'synonyms=false'. Is there a way within the AnaylzerQueryNodeProcessor or QParser that I can remove the SynonymFilter from the AnalyzerAttributes? It seems that the Analyzer h

Solr security

2011-05-09 Thread Brian Lamb
Hi all, Is it possible to set up solr so that it will only execute dataimport commands if they come from localhost? Right now, my application and my solr installation are on different servers so any requests are formatted http://domain:8983 instead of http://localhost:8983. I am concerned that wh

Re: Solr security

2011-05-09 Thread Upayavira
Solr does not provide security (I believe Lucid EnterpriseWorks has something there). You should keep Solr itself secure behind a firewall, and pass all requests through some intermediary that only allows sensible stuff through to Solr itself. That way, the DataImportHandler is accessible inside y

Solr is not working for few document

2011-05-09 Thread Misra, Anil
Hi I am using solr with liferay till Friday everything was good but today I added few documents but I am unable to search some of them L. It is showing 0 result(s) are found. Waiting for your help. Thanks, anil misra 248-880-4948

Re: Solr 4.0

2011-05-09 Thread Gabriele Kahlout
REPOST as a more general question about ivy dependencies: http://stackoverflow.com/questions/5941789/do-ivy-dependency-revisions-have-anything-to-do-with-svns On Mon, May 9, 2011 at 11:31 AM, Gabriele Kahlout wrote: > I think you are talking about this dependency: > > conf="*->default" /> > > I

RE: Synonym Filter disable at query time

2011-05-09 Thread Robert Petersen
Just make another field using copyfield which the other field does not apply synonyms to the text and then search either the one with or without from the front end... that will be your selector. :) -Original Message- From: mtraynham [mailto:mtrayn...@digitalsmiths.com] Sent: Monday, May

RE: Synonym Filter disable at query time

2011-05-09 Thread mtraynham
Awesome thanks! Also, you wouldn't happen to have any insight on boosting synonyms lower than the original query after they were stemmed, would you? Say if I had synonyms turned on: The TokenStream is setup to do Synonyms -> StopFilter -> LowerCaseFilter -> SnowballPorter. Say I search for Thom

RE: Synonym Filter disable at query time

2011-05-09 Thread mtraynham
Actually now that I think about it, with copy fields I can just single out the Synonym reader and boost from an earlier processor. Thanks again though, that solved a lot of headache! -- View this message in context: http://lucene.472066.n3.nabble.com/Synonym-Filter-disable-at-query-time-tp291987

Re: Solr security

2011-05-09 Thread Jan Høydahl
Hi, You can simply configure a firewall on your Solr server to only allow access from your frontend server. Whether you use the built-in software firewall of Linux/Windows/Whatever or use some other FW utility is a choice you need to make. This is by design - you should never ever expose your b

RE: Synonym Filter disable at query time

2011-05-09 Thread Robert Petersen
I was thinking search both and boost non-synonym field perhaps? -Original Message- From: mtraynham [mailto:mtrayn...@digitalsmiths.com] Sent: Monday, May 09, 2011 1:20 PM To: solr-user@lucene.apache.org Subject: RE: Synonym Filter disable at query time Awesome thanks! Also, you wouldn't

RE: Synonym Filter disable at query time

2011-05-09 Thread Robert Petersen
Yay! :) -Original Message- From: mtraynham [mailto:mtrayn...@digitalsmiths.com] Sent: Monday, May 09, 2011 1:59 PM To: solr-user@lucene.apache.org Subject: RE: Synonym Filter disable at query time Actually now that I think about it, with copy fields I can just single out the Synonym re

Slow, CPU-bound commit

2011-05-09 Thread Santiago Bazerque
Hello, I am using the new SOLR 3.1 for a 2.6 Gb, 1MM documents index. Reading the forums and the archive I learned that SOLR and Lucene now manage commits and transactions a bit differently than in previous versions, and indeed I feel the behavior has changed. Here's the thing: committing a few 1

Re: edismax available in solr 3.1?

2011-05-09 Thread cyang2010
Is it a formal feature that solr 3.1 support? Or still as experimental feature? If it is experimental feature, i would still be hesitating to use it. -- View this message in context: http://lucene.472066.n3.nabble.com/edismax-available-in-solr-3-1-tp2910613p2920975.html Sent from the Solr - Use

Re: aliasing?

2011-05-09 Thread deniz
well... if i knew what to do about aliasing, i wouldnt post my question here Grijesh :) My idea is this: for some search queries, I need to provide some synonyms... But it is just an idea... -- View this message in context: http://lucene.472066.n3.nabble.com/aliasing-tp2917733p2921305.html Sent f

A DB dataSource and a URL Data source for Solr

2011-05-09 Thread deniz
I am trying to use two different data sources as in the title. The problem is that it fails each time i try... I tried the stuff on SolrWiki but it failed. anyone knows how to configure solr for using two different types of sources, DB and URL? -- View this message in context: http://lucene.472

Re: A DB dataSource and a URL Data source for Solr

2011-05-09 Thread deniz
well second time i have fixed the issue on my own after posting here but i dont understand why indexing time increased to 16 mins, while it was only 2 mins with only db source... confused -- View this message in context: http://lucene.472066.n3.nabble.com/A-DB-dataSource-and-a-URL-Data-source-

Solr approaches to re-indexing large document corpus

2011-05-09 Thread George P. Stathis
We are looking for some recommendations around systematically re-indexing in Solr an ever growing corpus of documents (tens of millions now, hundreds of millions in than a year) without taking the currently running index down. Re-indexing is needed on a periodic bases because: - New features ar

SolrQuery API for adding group filter

2011-05-09 Thread arian487
There doesn't seem to be API to add a group (like group.field or group=true). I'm very new to this so I'm wondering how I'd go about adding a group query much like how I use 'addFilterQuery' to add an fq. Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/SolrQuery-AP

Re: aliasing?

2011-05-09 Thread Rob Casson
a lot of this stuff is covered in the tutorial, and expanded in the wiki. still the best places to start in figuring out the fundamentals: http://lucene.apache.org/solr/tutorial.html http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#solr.SynonymFilterFactory hth, rc On Mon,

Re: A DB dataSource and a URL Data source for Solr

2011-05-09 Thread Gora Mohanty
On Tue, May 10, 2011 at 7:24 AM, deniz wrote: > well second time i have fixed the issue on my own after posting here > > but i dont understand why indexing time increased to 16 mins, while it was > only 2 mins with only db source... confused [...] Try timing just the URLDataSource. We had the sam

Re: Solr is not working for few document

2011-05-09 Thread Gora Mohanty
On Tue, May 10, 2011 at 12:38 AM, Misra, Anil wrote: [...] > I am using solr with liferay till Friday everything was good but today I > added few documents but I am unable to search some of them L. [...] We are not mind-readers, so it is hard to tell what went wrong without any details from your