Re: how to control which hosts can access Solr?

2011-02-15 Thread go canal
thank you, so firewall then I also saw Slor authentication, maybe I should add that also. thanks, canal From: Gora Mohanty To: solr-user@lucene.apache.org Sent: Wed, February 16, 2011 3:10:25 PM Subject: Re: how to control which hosts can access Solr? On

Re: how to control which hosts can access Solr?

2011-02-15 Thread Gora Mohanty
On Wed, Feb 16, 2011 at 10:52 AM, Grijesh wrote: > > You  can not do this kind of configuration by solrsonfig ,you have to > configure it with the help of your network administrator. [...] The normal way to do this on Linux is with rules for iptables that only allow access to the Solr port for ce

clustering with tomcat

2011-02-15 Thread Isha Garg
hi, i am using solr1.4 with apache tomcat. to enable the clustering feature i follow the link http://wiki.apache.org/solr/ClusteringComponent Plz help me how to add-Dsolr.clustering.enabled=true to $CATALINA_OPTS. after that which steps be will required.

Re: Solr the right thing for me?

2011-02-15 Thread Gora Mohanty
On Wed, Feb 16, 2011 at 12:18 PM, Chris wrote: [...] > - Receive an email when a site changed/was added to a web. > - Only index sites, that contain a reg exp in the content. I think that you might be confused about what Solr does. It is a search engine, and does not crawl websites. A good possib

Solr the right thing for me?

2011-02-15 Thread Chris
Hello all, I'm searching for a possibility to: - Receive an email when a site changed/was added to a web. - Only index sites, that contain a reg exp in the content. - Receive the search results in machine readable way (RSS/SOAP/..) This should be possible to organize in sets. (set A with 40 Web

Re: rollback to other versions of index

2011-02-15 Thread Tri Nguyen
Hi, Wanted to explain my situation in more detail. I have a master which never adds or deletes documents incrementally.  I just run the dataimport with autocommit. Seems like I'll need to make a custom DeletionPolicy to keep more than one index around. I'm accessing indices from Solr.  How

Re: Dismax problem

2011-02-15 Thread Grijesh
what type of query you are searching? what is the type of the field? - Thanx: Grijesh http://lucidimagination.com -- View this message in context: http://lucene.472066.n3.nabble.com/Dismax-problem-tp2501263p2507147.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Spellchecking with some misspelled words in index source

2011-02-15 Thread Grijesh
You have to correct the misspelled terms in your content to work properly because spell checker will find the term and supposed as right term. spell checker will return suggestion when word not found in its dictionary. - Thanx: Grijesh http://lucidimagination.com -- View this message in co

Re: how to control which hosts can access Solr?

2011-02-15 Thread Grijesh
You can not do this kind of configuration by solrsonfig ,you have to configure it with the help of your network administrator. - Thanx: Grijesh http://lucidimagination.com -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-control-which-hosts-can-access-Solr-tp2506

"Cloning" SolrInputDocument

2011-02-15 Thread Jeff Schmidt
In the process of handling a type of web service request, I need to create a series of documents for indexing. They differ by only a couple of field values, but share quite a few others. I would like to clone SolrInputDocument and adjust a couple of fields, index that, lather, rinse, repeat. H

Re: Passing parameters to DataImportHandler

2011-02-15 Thread Adam Estrada
Yep...Take a look at this example. Map your SQL query to the appropriate fields in your index. create a directory under called DataImportHandler and reference it in your update command using curl or whatever. example /solr/conf/dataimporthandler

how to control which hosts can access Solr?

2011-02-15 Thread go canal
Hello, Looking for advices re: how to control which hosts can access Solr. Need to configure a list of IP addresses or host names into Solr so that we can control which hosts can access Solr. I can not find the configuration in solrconfig.xml, so wondering how we can support this? thanks, cana

Reminder: Lucene Revolution 2011 Call For Papers Closing March 2

2011-02-15 Thread Michael Bohlig
Please submit your Call For Participation (CFP) proposals for Lucene Revolution 2011 by March 2. If you have a great Solr or Lucene talk, this is a fantastic opportunity to share it with the community at the largest worldwide conference dedicated to Lucene and Solr which will take place at the S

Re: solr.HTMLStripCharFilterFactory not working

2011-02-15 Thread Koji Sekiguchi
(11/02/16 8:03), Tanner Postert wrote: I am using the data import handler and using the HTMLStripTransformer doesn't seem to be working either. I've changed webtitle and webdescription to not by copied from title and description in the schema.xml file then set them both to just but duplicates of

SolrCloud - how mature it is now?

2011-02-15 Thread go canal
Hello, Recently I saw some news about Elastic Search, which claims to be the best in terms of supporting distributed search. Looking at Solandra and SolrCloud http://wiki.apache.org/solr/SolrCloud, it seems that they are not mature enough yet (http://wiki.apache.org/solr/DistributedSearch 'Dist

Spellchecking with some misspelled words in index source

2011-02-15 Thread Tanner Postert
I'm building my spellcheck index from my content and it seems to be working, but my problem is that there are a few misspelled words in my content. For example: the word Sheriff is improperly misspelled Sherrif in my content a couple dozen times (but spelled correctly a couple thousand times). The

Re: Passing parameters to DataImportHandler

2011-02-15 Thread Tanner Postert
yes it is possible via ${dataimporter.request.param} see http://wiki.apache.org/solr/DataImportHandler#Accessing_request_parameters On Tue, Feb 15, 2011 at 4:45 PM, Jason Rutherglen < jason.rutherg...@gmail.com> wrote: > It'd be nice to be able to pass HTTP parameters into DataImportHandler > t

Passing parameters to DataImportHandler

2011-02-15 Thread Jason Rutherglen
It'd be nice to be able to pass HTTP parameters into DataImportHandler that'd be passed into the SQL as parameters, is this possible?

Re: solr.HTMLStripCharFilterFactory not working

2011-02-15 Thread Tanner Postert
I am using the data import handler and using the HTMLStripTransformer doesn't seem to be working either. I've changed webtitle and webdescription to not by copied from title and description in the schema.xml file then set them both to just but duplicates of title and description in the data import

Re: solr.HTMLStripCharFilterFactory not working

2011-02-15 Thread Tanner Postert
nevermind, I think I found my answer here: http://www.mail-archive.com/solr-user@lucene.apache.org/msg34622.html I will add the HTML stripper to the data importer and see how that goes On Tue, Feb 15, 2011 at 3:43 PM, Tanner P

Re: Any way to get back search query with parsed out stop words

2011-02-15 Thread Tanner Postert
ok, I will look at using that filter factory on my content. But I was also looking at the stop filter number so I could adjust my mm parameter based on the number of non-stopwords in the search parameter so I don't run into the dismax stopword issue. any way around that other than using a very low

Re: Multicore boosting to only 1 core

2011-02-15 Thread mike anderson
Could you make an additional date field, call it date_boost, that gets populated in all of the cores EXCEPT the one with the newest articles, and then boost on this field? Then when you move articles from the 'newest' core to the rest of the cores you copy over the date to the date_boost field. (I

Re: Any way to get back search query with parsed out stop words

2011-02-15 Thread Ahmet Arslan
> I am trying to only get back the natural searched terms so > I can highlight > them in the returned search results. I know that solr has > built in > highlighting capability, but I can't use it because some of > the fields > contain HTML themselves and I need to strip it all out when > I display

Any way to get back search query with parsed out stop words

2011-02-15 Thread Tanner Postert
I am trying to see if there is a way to get back the resulting search'd query to solr excluding the stopwords. Right now when I search for: "the year in review" i can see in the debug that the parsed query contains: text:"? year ? review" but that information is mixed in with all the parsed boosti

RE: Question regarding inner entity in dataimporthandler

2011-02-15 Thread Greg Georges
OK, I think I found some information, supposedly TemplateTransformer will return an empty string if the value of a variable is null. Some people say to use the regex transformer instead, can anyone clarify this? Thanks -Original Message- From: Greg Georges [mailto:greg.geor...@biztree.co

Question regarding inner entity in dataimporthandler

2011-02-15 Thread Greg Georges
Hello all, I have searched the forums for the question I am about to ask, never found any concrete results. This is my case. I am defining the data config file with the document and entity tags. I define with success a basic entity mapped to my mysql database, and I then add some inner entities

Re: schema.xml configuration for file names?

2011-02-15 Thread alan bonnemaison
Thank you for your thorough response. Things make more sense now. Back to the drawing board. Alan. On Tue, Feb 15, 2011 at 10:23 AM, Jonathan Rochkind wrote: > You can't just send arbitrary XML to Solr for update, no. You need to send > a Solr Update Request in XML. You can write software that

Re: schema.xml configuration for file names?

2011-02-15 Thread Jonathan Rochkind
You can't just send arbitrary XML to Solr for update, no. You need to send a Solr Update Request in XML. You can write software that transforms that arbitrary XML to a Solr update request, for simple cases it could even just be XSLT. There are also a variety of other mediator pieces that come

Re: Multicore boosting to only 1 core

2011-02-15 Thread Jonathan Rochkind
No. In fact, there's no way to search over multi-cores at once in Solr at all, even before you get to your boosting question. Your different cores are entirely different Solr indexes, Solr has no built-in way to combine searches accross multiple Solr instances. [Well, sort of it can, with shar

Re: schema.xml configuration for file names?

2011-02-15 Thread alan bonnemaison
Erick, I think you put the finger on the problem. Our XML files (we get from our suppliers) do *not* look like that. That's what a typical file looks like .. Obviously, nothing like By the way, querying q=*:* retrieved "HTTP error 500 Null pointer exception", which lea

RE: Errors when implementing VelocityResponseWriter

2011-02-15 Thread McGibbney, Lewis John
To add to this (which stupidly, I have not mentioned previously) I am using Tomcat 7.0.8 as my servlet container. I have a sneaking suspicion that this is what is causing the problem, but as per below, I am unsure as to a solution. From: McGibbney, Lewis J

Re: Are there any restrictions on what kind of how many fields you can use in Pivot Query? I get ClassCastException when I use some of my string fields, and don't when I use some other sting fields

2011-02-15 Thread Erick Erickson
To get meaningful help, you have to post a minimum of: 1> the relevant schema definitions for the field that makes it blow up. include the and tags. 2> the query you used, with some indication of the field that makes it blow up. 3> What version you're using 4> any changes you've made to the stand

RE: Errors when implementing VelocityResponseWriter

2011-02-15 Thread McGibbney, Lewis John
Hi Erik thank you for the reply I have placed all velocity jar files in my /lib directory. As explained below, I have added relevant configuration to solrconfig.xml, I am just wondering if the config instructions in the wiki are missing something? Can anyone advise on this. As you mentioned, m

Re: Any contribs available for Range field type?

2011-02-15 Thread Erick Erickson
d...@lucene.apache.org Solr-dev is deprecated since Lucene and Solr converged. Can you subscribe to the above list instead? Best Erick On Tue, Feb 15, 2011 at 10:49 AM, kenf_nc wrote: > > I've tried several times to get an active account on > solr-...@lucene.apache.org and the mailing list won'

Re: Are there any restrictions on what kind of how many fields you can use in Pivot Query? I get ClassCastException when I use some of my string fields, and don't when I use some other sting fields

2011-02-15 Thread Ravish Bhagdev
Looks like its a bug? Is it not? Ravish On Tue, Feb 15, 2011 at 4:03 PM, Ravish Bhagdev wrote: > When include some of the fields in my search query: > > SEVERE: java.lang.ClassCastException: [Ljava.lang.Object; cannot be cast to > [Lorg.apache.solr.common.util.ConcurrentLRUCache$CacheEntry; >

Re: Any contribs available for Range field type?

2011-02-15 Thread kenf_nc
I've tried several times to get an active account on solr-...@lucene.apache.org and the mailing list won't send me a confirmation email, and therefore won't let me post because I'm not confirmed. Could I get someone that is a member of Solr-Dev to post either my original request in this thread, or

Re: Guidance for event-driven indexing

2011-02-15 Thread Rich Cariens
Thanks Jan, I was referring to a custom UpdateHandler, not a RequestHandler. You know, the one that the Solr wiki discourages :). Best, Rich On Tue, Feb 15, 2011 at 8:37 AM, Jan Høydahl wrote: > Hi, > > You would wire your JMSUpdateRequestHandler into solrconfig.xml as normal, > and if you wan

Re: Which version of Solr?

2011-02-15 Thread Jeff Schmidt
I guess I'll work with 3.x for now until some 4.0 feature makes me move to trunk. For the next few months, re-indexing is not a problem, but once in production one index directly under my control will be updated quarterly (maybe monthly) with new content, while other indexes will be updated by

Re: very quick question that will help me greatly... OR query syntax when using fields for solr dataset....

2011-02-15 Thread Ravish Bhagdev
Hi Erick, I've managed to fix the problem, it was to do with not encoding certain characters. Escaped with \ and it all works fine now :) . Sorry I was just being insane, look at debugQuery output helped. I know about the string field, this is kind of a uuid field that I am storing, so it it de

Re: SolrCloud - Example C not working

2011-02-15 Thread Yonik Seeley
On Mon, Feb 14, 2011 at 8:08 AM, Thorsten Scherler wrote: > Hi all, > > I followed http://wiki.apache.org/solr/SolrCloud and everything worked > fine till I tried "Example C:". Verified. I just tried and it failed for me too. -Yonik http://lucidimagination.com > I start all 4 server but all o

Re: Dismax problem

2011-02-15 Thread Tomás Fernández Löbbe
Hi Ezequiel, The standard query parser works with all the fields you are using with dismax? Did you change the schema in some way? What version of Solr are you on? Tomás On Tue, Feb 15, 2011 at 10:34 AM, Ezequiel Calderara wrote: > Hi, im having a problem while trying to do a dismax search. > For

Re: very quick question that will help me greatly... OR query syntax when using fields for solr dataset....

2011-02-15 Thread Erick Erickson
You might look at the analysis page from the admin console for the field in question, it'll show you what various parts of the analysis chain do. But I agree with Jan, having your field as a "string" type is a red flag. This field is NOT analyzed, parsed, or filtered. For instance, if a doc has a

Re: Which version of Solr?

2011-02-15 Thread Yonik Seeley
On Tue, Feb 15, 2011 at 9:18 AM, Erick Erickson wrote: > I guess it depends on how risk-averse you are. There are people using both > trunk and 3x in production. Right. It also depends on how easy it is to re-index your data. If it's hard/impossible, IMO that's the single biggest argument for g

Re: Which version of Solr?

2011-02-15 Thread Erick Erickson
Let's see if I have this right. 3x is "1.4.1 with selected features from trunk backported". Which translates as "lots of cool new stuff is in in 3x (geospatial comes to mind, eDismax, etc) but the more fluid changes are not being backported". I guess it depends on how risk-averse you are. Ther

Re: Deploying Solr CORES on OVH Cloud

2011-02-15 Thread Erick Erickson
The usual answer is "whatever you're most comfortable/experienced with". >From my perspective, there's enough to learn getting Solr running and understanding how search works without throwing new environments into the mix... So, I'd pick the one you're most familiar with and use that. If you're no

Re: schema.xml configuration for file names?

2011-02-15 Thread Erick Erickson
Can we see a small sample of an xml file you're posting? Because it should look something like R16-500 more fields here. Take a look at the Solr admin page after you've indexed data to see what's actually in your index, I suspect what's in there isn't what you expect. Try q

Re: very quick question that will help me greatly... OR query syntax when using fields for solr dataset....

2011-02-15 Thread Ravish Bhagdev
Arghhh.. I think its the regexp parser messing things up (just looked at the debugQuery ouput and its parsing incorrectly some "/" kind of letters I had. I think I can clean up the data off these characters or maybe there is a way to escape them... Ravish On Tue, Feb 15, 2011 at 1:54 PM, Ravis

Re: very quick question that will help me greatly... OR query syntax when using fields for solr dataset....

2011-02-15 Thread Jan Høydahl
The OR implies that all documents matching either one of the two terms shold be returned. Are you sure you are searching with correct uppercase/lowercase, as string fields are case sensitive? To further help you, we need copies of relevant sections of your schema and an exact copy of the query

Re: very quick question that will help me greatly... OR query syntax when using fields for solr dataset....

2011-02-15 Thread Ravish Bhagdev
Hi Jan, Thanks for reply. I have tried the first variation in your example (and again after reading your reply). It returns no results! Note: it is not a multivalued field, I think when you use example 1 below, it looks for both xyz and abc in same field for same document, what i'm trying to ge

Re: very quick question that will help me greatly... OR query syntax when using fields for solr dataset....

2011-02-15 Thread Jan Høydahl
http://wiki.apache.org/solr/SolrQuerySyntax Examples: q=myfield:(xyz OR abc) q={!lucene q.op=OR df=myfield}xyz abc q=xyz OR abc&defType=edismax&qf=myfield PS: If using type="string", you will not match individual words inside the field, only an exact case sensitive match of whole field. Use so

Re: Solr 1.4 requestHandler "update" Runtime disable/enable

2011-02-15 Thread Jan Høydahl
> Ok. > I can set it so: > enable="${solr.enable.master:true}"/> > > But how without restarting Tomcat can I change solr.enable.master from true > to false ?? That's an exercise left to the reader :) Honestly, I don't think you need to. Why would you? The handler does not do anything if never

very quick question that will help me greatly... OR query syntax when using fields for solr dataset....

2011-02-15 Thread Ravish Bhagdev
Hi Guys, I've been trying various combinations but unable to perform a "OR" query for a specific field in my solr schema. I have a string field called myfield and I want to return all documents that have this field which either matches "abc" or "xyz" So all records that have myfield=abc and all

Re: Guidance for event-driven indexing

2011-02-15 Thread Jan Høydahl
Hi, You would wire your JMSUpdateRequestHandler into solrconfig.xml as normal, and if you want to apply an UpdateChain, that would look like this: myPipeline See http://wiki.apache.org/solr/SolrRequestHandler for details -- Jan Høydahl, search solution architect Cominve

Re: rollback to other versions of index

2011-02-15 Thread Michael McCandless
Lucene is able to do this, if you make a custom DeletionPolicy (which controls when commit points are deleted). By default Lucene only saves the most recent commit (KeepOnlyLastCommitDeletionPolicy), but if your policy keeps more around, then you can open an IndexReader or IndexWriter on any Index

Re: Solr 1.4 requestHandler "update" Runtime disable/enable

2011-02-15 Thread gzyl
Ok. I can set it so: But how without restarting Tomcat can I change solr.enable.master from true to false ?? >But I don't see why you need to disable it. >You will anyway need to stop sending updates to the old master yourself. >Disabling the handler like this will cause an exception if you

Dismax problem

2011-02-15 Thread Ezequiel Calderara
Hi, im having a problem while trying to do a dismax search. For example i have the standard query url like this: It returns 1 result. But when i try to use the dismax query type i have the following error: > 15/02/2011 10:27:07 org.apache.solr.common.SolrException log > GRAVE: java.lang.ArrayIndex

Re: Guidance for event-driven indexing

2011-02-15 Thread Rich Cariens
Thanks Jan. For the JMSUpdateHandler option, how does one plugin a custom UpdateHandler? I want to make sure I'm not missing any important pieces of Solr processing pipeline. Best, Rich On Tue, Feb 15, 2011 at 4:36 AM, Jan Høydahl wrote: > Solr is multi threaded, so you are free to send as man

Re: Which version of Solr?

2011-02-15 Thread Jeff Schmidt
Hi Otis: I guess I got too obsessed trying to resolve my SolrJ/Solr interaction problem, I missed your reply... I've heard using 3.1 is the best approach, and now 4.0/trunk. Will trunk be undergoing a release in the next few months then? It seems so soon after 3.x. Fortunately, I have both

Re: Which version of Solr?

2011-02-15 Thread Jeff Schmidt
I guess hijacking my own thread is still hijacking. :) I'll avoid that in the future. It is great for SolrJ and Solr to be working as expected and to be making forward progress! Jeff On Feb 14, 2011, at 11:01 PM, David Smiley (@MITRE.org) wrote: > > Wow; I'm glad you figured it out -- sort

Re: Deploying Solr CORES on OVH Cloud

2011-02-15 Thread Rosa (Anuncios)
Thanks for your response, but it doesn't help me a whole lot! Jetty VS Tomcat? Ubuntu o Debian? What are the pro of solr using? Le 14/02/2011 23:12, William Bell a écrit : The first two questions are almost like religion. I am not sure we want to start a debate. Core setup is fairly easy. A

Re: Solr not Available with Ping when DocBuilder is running

2011-02-15 Thread Stefan Matheis
And what exactly is your error? and what is your response, for your ping-request? On Tue, Feb 15, 2011 at 12:02 PM, stockii wrote: > > Hello. > > I do every 2 Minutes a Delta and if one Core (of 7) is running a delta, solr > isnt available. when i look in the logFile the ping comes in this time,

Solr not Available with Ping when DocBuilder is running

2011-02-15 Thread stockii
Hello. I do every 2 Minutes a Delta and if one Core (of 7) is running a delta, solr isnt available. when i look in the logFile the ping comes in this time, when DocBuilder is running ... Feb 15, 2011 11:49:20 AM org.apache.solr.handler.dataimport.DocBuilder doDelta INFO: Delta Import completed

Re: carrot2 clustering component error

2011-02-15 Thread Markus Jelsma
I've seen that before on a 3.1 check out after i compiled the clustering component, copied the jars and started Solr. For some reason , recompiling didn't work and doing an ant clean in front didn't fix it either. Updating to a revision i knew did work also failed. I just removed the entire che

Re: rollback to other versions of index

2011-02-15 Thread Jan Høydahl
Yes and no. The index grows like an onion adding new segments for each commit. There is no API to remove the newly added segments, but I guess you could hack something. The other problem is that as soon as you trigger an optimize() all history is gone as the segments are merged into one. Optimize

Re: Guidance for event-driven indexing

2011-02-15 Thread Jan Høydahl
Solr is multi threaded, so you are free to send as many parallel update requests needed to utilize your HW. Each request will get its own thread. Simply configure StreamingUpdateSolrServer from your client. If there is some lengthy work to be done, it needs to be done in SOME thread, and I gues

Re: Solr 1.4 requestHandler "update" Runtime disable/enable

2011-02-15 Thread Jan Høydahl
Sure. Then set Java System Property -Dsolr.enable.master=false and restart. But I don't see why you need to disable it. You will anyway need to stop sending updates to the old master yourself. Disabling the handler like this will cause an exception if you try to call it because it will not

Re: SolrCloud - Example C not working

2011-02-15 Thread Thorsten Scherler
Hmm, nobody has an idea, for everybody the example c is working fine. salu2 On Mon, 2011-02-14 at 14:08 +0100, Thorsten Scherler wrote: > Hi all, > > I followed http://wiki.apache.org/solr/SolrCloud and everything worked > fine till I tried "Example C:". > > I start all 4 server but all of them

Re: schema.xml configuration for file names?

2011-02-15 Thread Stefan Matheis
Alan, if you want to search the filename .. it has to be part of the file-content itself. solr doesn't care about the filename itself, only the content of the given file will be indexed. HTH Stefan On Tue, Feb 15, 2011 at 1:15 AM, alan bonnemaison wrote: > Hello! > > We receive from our supplie