Re: [Solr4 beta] error 503 on commit

2012-09-12 Thread Radim Kolar
> After investigating more, here is the tomcat log herebelow. It is indeed the same problem: "exceeded limit of maxWarmingSearchers=2,". could not be solr able to close oldest warming searcher and replace it by new one?

Re: [Solr4 beta] error 503 on commit

2012-09-12 Thread Yonik Seeley
On Tue, Sep 11, 2012 at 10:52 AM, Radim Kolar wrote: >> After investigating more, here is the tomcat log herebelow. It is indeed >> the same problem: "exceeded limit of maxWarmingSearchers=2,". > > could not be solr able to close oldest warming searcher and replace it by > new one? That approach

Re: Semantic document format... standards?

2012-09-12 Thread Alexandre Rafalovitch
Otis, If you are doing Named Entity Recognition, you may want to look at the research area concerned with Named Entity Recognition. :-) In general, there is inline markup and standoff markup. You seem to be going for standoff/stand-alone markup. I am not clear though whether it is just 'discovery'

Re: suggester issues

2012-09-12 Thread aniljayanti
Hi, I m also facing same issue while using suggester (working in c#.net). Below is my configurations. suggest/?q="michael ja" --- Response : - - 0 1 - - -

Re: Partial search

2012-09-12 Thread Jack Krupansky
Add &debugQuery=true to your query request and look at the "explain" section. The scores will indicate why a document ranks as it does. When you say that your query was "Energy Field", was that a quoted phrase or just two keywords? I assume the latter. I also assume that you were using the "OR

Re: SolrCloud fail over

2012-09-12 Thread Mark Miller
Either setup a load balancer, or use the SolrCloud solrj client CloudSolrServer - it takes a comma separated list of zk servers rather than a solr url. On Tue, Sep 11, 2012 at 10:17 PM, andy wrote: > I know fail over is available in solr4.0 right now, if one server > crashes,other servers also su

Doubts in PathHierarchyTokenizer

2012-09-12 Thread mechravi25
Hi, Im Using Solr 3.6.1 version and I have a field which is having values like A|B|C B|C|D|EE A|C|B A|B|D ..etc.. So, When I search for "A|B", I should get documents starting with "A" and "A|B" To implement this, I've used PathHierarchyTokenizer for the above field as But,

Retrieval of large number of documents

2012-09-12 Thread Rohit Harchandani
Hi all, I have a solr index with 5,000,000 documents and my index size is 38GB. But when I query for about 400,000 documents based on certain criteria, solr searches it really quickly but does not return data for close to 2 minutes. The unique key field is the only field i am requesting for. Also,

Re: Retrieval of large number of documents

2012-09-12 Thread Paul Libbrecht
Isn't XSLT the bottleneck here? I have not yet met an incremental XSLT processor, although I heard XSLT 1 claimed it could be done in principle. If you start to do this kind of processing, I think you have no other choice than write your own output method. Paul Le 12 sept. 2012 à 15:47, Rohit

Solr 4.0 Beta Release

2012-09-12 Thread samarth s
Hi All, Would just like to verify if Solr 4.0 Beta has been released. Does the following url give the official beta release: http://www.apache.org/dyn/closer.cgi/lucene/solr/4.0.0-BETA -- Regards, Samarth

Re: Retrieval of large number of documents

2012-09-12 Thread Alexandre Rafalovitch
Have you tried asking for CSV as an output format? Then, you don't have any XML wrappers and you will get your IDs one per line. I tried it with returning about 40 rows and it was just fine. Regards, Alex. Personal blog: http://blog.outerthoughts.com/ LinkedIn: http://www.linkedin.com/in/al

Re: Solr unique key can't be blank

2012-09-12 Thread Ahmet Arslan
--- On Wed, 9/12/12, Dotan Cohen wrote: > From: Dotan Cohen > Subject: Solr unique key can't be blank > To: solr-user@lucene.apache.org > Date: Wednesday, September 12, 2012, 5:06 PM > Consider this simple schema: > > > >     >         name="uuid" class="solr.UUIDField" indexed="true" />

Re: Solr 4.0 Beta Release

2012-09-12 Thread Jack Krupansky
Yes, it has been released. Read the details here (including download instructions/links): http://lucene.apache.org/solr/solrnews.html -- Jack Krupansky -Original Message- From: samarth s Sent: Wednesday, September 12, 2012 9:54 AM To: solr-user@lucene.apache.org Subject: Solr 4.0 Beta

Re: Semantic document format... standards?

2012-09-12 Thread Michael Della Bitta
Actually at my company, we do a lot of NLP work and we've ended up using bespoke formats, formerly a FeatureStructure serialized to JSON, but most recently in protobufs. Possibly not the answer you were looking for, Otis, but at least it's a datapoint. Michael Della Bitta

Re: Solr unique key can't be blank

2012-09-12 Thread Dotan Cohen
On Wed, Sep 12, 2012 at 5:27 PM, Ahmet Arslan wrote: > Hi Dotan, > > Did you define the following update processor chain in solrconfig.xml ? > And did you reference it in an update handler? > > > > id > > > > Thank you Ahmet! In fact, I did not know that the updateRequestPr

Re: SolrCloud and Optimize

2012-09-12 Thread Walter Underwood
Do not run optimize. It is not necessary. Solr continually optimizes in the background. wunder On Sep 11, 2012, at 11:15 PM, Nikhil Chhaochharia wrote: > Hi, > > I am using a recent nightly of Solr 4 and have setup a simple SolrCloud > cluster of 2 shards without any replicas. If I send the

Re: Solr unique key can't be blank

2012-09-12 Thread Jack Krupansky
The UniqueKey wiki was recently updated to indicate this new Solr 4.0 requirement: http://wiki.apache.org/solr/UniqueKey "in Solr 4, this field must be populated via solr.UUIDUpdateProcessorFactory" The changes you were given are contained on that updated wiki page. -- Jack Krupansky -

Re: Solr unique key can't be blank

2012-09-12 Thread Ahmet Arslan
> Thank you Ahmet! In fact, I did not know that the > updateRequestProcessorChain needed to be defined in > solrconfig.xml and > I had tried to define it in schema.xml. I don't have access > to > solrconfig.xml (I am using Websolr) but I will contact them > about > adding it. Please not that you n

Re: [Solr4 beta] error 503 on commit

2012-09-12 Thread Radim Kolar
could not be solr able to close oldest warming searcher and replace it by new one? That approach can easily lead to starvation (i.e. you never get a new searcher usable for queries). It will not. If there is more then 1 warming searcher. Look at this schema: 1. current in use searcher 2. 1st

Authentication Not working in solrnet getting 401 error

2012-09-12 Thread Suneel Pandey
Hi, I am trying to connect with authenticated solr instance. I have added latest solrnet .dll but getting authentication issue. Please Suggest me where i did wrong. ISolrOperations oSolrOperations = null; const string core0url = "http://localhost:8080/solr/products";; const string co

Cannot parse ":", using HTTP-URL as id

2012-09-12 Thread sysrq
Hi, I defined a field "id" in my schema.xml and use it as an : id I want to store URLs with a prefix in this field to be sure that every id is unique among websites. For example: domain_http://www.domain.com/?p=12345 foo_http://foo.com bar_http://bar.com/?doc=452 I wrote a Java app, w

Re: Doubts in PathHierarchyTokenizer

2012-09-12 Thread Koji Sekiguchi
Use delimiter option instead of pattern for PathHierarchyTokenizerFactory: http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#solr.PathHierarchyTokenizerFactory koji -- http://soleami.com/blog/starting-lab-work.html (12/09/12 22:22), mechravi25 wrote: Hi, Im Using Solr 3.6.1 version

Count disctint groups in grouping distributed

2012-09-12 Thread yriveiro
Hi, Exists the possibility of do a distinct group count in a grouping done using a sharding schema? This issue https://issues.apache.org/jira/browse/SOLR-3436 make a fixe in the way to sum all groups returned in a distributed grouping operation, but not always we want the sum, in some cases is i

Re: Cannot parse ":", using HTTP-URL as id

2012-09-12 Thread Ahmet Arslan
Hello, term query parser is your friend in this case. With this you don't need to escape anything. SolrQuery query = new SolrQuery(); query.setQuery("{!term f=id}bar_http://bar.com/?doc=452";); --- On Wed, 9/12/12, sy...@web.de wrote: > From: sy...@web.de > Subject: Cannot parse ":", using

Unable to implememnt SolrNet Authentication.

2012-09-12 Thread Suneel Pandey
Hello, I am working on solr authentication with the help of solrnet dll and windsolr container getting some issue. Please suggest me and provide me some link this will be very helpful for me. - Regards, Suneel Pandey Sr. Software Developer -- View this message in context: http://lucene.47

Beginner questions

2012-09-12 Thread Ken Clarke
Hi Folks, I'm going to setup a SOLR search server for the first time. Hope you don't mind a few beginner questions. Perhaps a quick summary of how I intend to use it will help. The SOLR server will be installed on a single VPS host and bound to a internal IP (192.168.?.?). Search pa

failure notice from zju.edu.cn

2012-09-12 Thread Ahmet Arslan
Hello All, Sometimes (in a random manner) I get the following when I reply a post : "Hi. This is the deliver program at zju.edu.cn. I'm afraid I wasn't able to deliver your message to the following addresses. This is a permanent error; I've given up. Sorry it didn't work out. new...@zju.edu.cn

Re: PrecedenceQueryParser usage

2012-09-12 Thread Maciej Pestka
Thank you! It seems to me that I managed to get it work. Just for future reference short I attach source code. The jar should be placed under core/lib folder: Please let me know if you have any comments or if I got sth incorrect... public class PrecedenceQParserPlugin extends QParserPlugin {

Re: Count disctint groups in grouping distributed

2012-09-12 Thread Jason Rutherglen
Distinct in a distributed environment would require de-duplication en-masse, use Hive or MapReduce instead. On Wed, Sep 12, 2012 at 11:53 AM, yriveiro wrote: > Hi, > > Exists the possibility of do a distinct group count in a grouping done using > a sharding schema? > > This issue https://issues.a

RE: failure notice from zju.edu.cn

2012-09-12 Thread Steven A Rowe
I get the same thing, after nearly every email I send directly to the lucene/solr lists (as opposed to auto-sent JIRA posts). I don't think it delays my messages though. Steve -Original Message- From: Ahmet Arslan [mailto:iori...@yahoo.com] Sent: Wednesday, September 12, 2012 1:24 PM T

Aw: Re: Cannot parse ":", using HTTP-URL as id

2012-09-12 Thread sysrq
> term query parser is your friend in this case. With this you don't need to > escape anything. > SolrQuery query = new SolrQuery(); > query.setQuery("{!term f=id}bar_http://bar.com/?doc=452";); But how can I *store* a document with an URL as a field value ? E.g. "domain_http://www.domain.co

Aw: Re: Cannot parse ":", using HTTP-URL as id

2012-09-12 Thread sysrq
my bad, using "term query parser" works, thanks ahmet. > Gesendet: Mittwoch, 12. September 2012 um 19:40 Uhr > Von: sy...@web.de > An: solr-user@lucene.apache.org > Betreff: Aw: Re: Cannot parse ":", using HTTP-URL as id > > > term query parser is your friend in this case. With this you don't nee

3.6.1 - Suggester and spellcheker Implementation

2012-09-12 Thread Sujatha Arun
Hi , If I am looking to implement Suggester Implementation with 3.6.1 ,I beleive this creates it own index , now If I want to also use the spellcheck also ,would it be using the same index as suggester? Regards Sujatha

Re: Beginner questions

2012-09-12 Thread Ahmet Arslan
>     Should I go with Beta 4 or stable 3? I would use solr 4, since this is first time installation. >     Which servlet container would you suggest is > the most efficient for my implementation? Folks use both jetty and tomcat. >     I'm unclear if the JDK is required or I can > just install

Re: Beginner questions

2012-09-12 Thread Alexandre Rafalovitch
I would start with version 4, hands down. I started with Solr 4 alpha and has moved to beta. Final can't be too far behind. So far, it has been extremely stable for me. And unless you are going into production in a next week, it will probably be final while you are learning. Regards, Alex. Pe

Re: 3.6.1 - Suggester and spellcheker Implementation

2012-09-12 Thread Otis Gospodnetic
Hi Sujatha, No, suggester and spellchecker are separate beasts. Otis -- Search Analytics - http://sematext.com/search-analytics/index.html Performance Monitoring - http://sematext.com/spm/index.html On Wed, Sep 12, 2012 at 3:18 PM, Sujatha Arun wrote: > Hi , > > If I am looking to implement S

Hey solr-user MODERATOR (was: Re: failure notice from zju.edu.cn)

2012-09-12 Thread Otis Gospodnetic
Same here. Changed subject to attract more attention. Otis On Wed, Sep 12, 2012 at 1:34 PM, Steven A Rowe wrote: > I get the same thing, after nearly every email I send directly to the > lucene/solr lists (as opposed to auto-sent JIRA posts). > > I don't think it delays my messages though. > >

Re: TikaException: Unsupported AutoCAD drawing version

2012-09-12 Thread Ahmet Arslan
> I am indexing data with Solr Cell, > using mainly the code from here: > http://wiki.apache.org/solr/ContentStreamUpdateRequestExample > > But in my Solr server i got the TikaException followed by a > solrexception > in my solrj programm. > > Is there a way to suppress this and similar excepti

Is it possible to do an "if" statement in a Solr query?

2012-09-12 Thread Gustav
Hello everyone, I'm working on an e-commerce website and using Solr as my Search Engine, im really enjoying its funcionality and the search options/performance. But i am stucky in a kinda tricky cenario... That what happens: I Have a medicine web-store, where i indexed all necessary products in

Re: Is it possible to do an "if" statement in a Solr query?

2012-09-12 Thread Walter Underwood
You may be able to do this with grouping. Group on the medicine "family", and only show the Original if there are multiple items in the family. wunder On Sep 12, 2012, at 2:09 PM, Gustav wrote: > Hello everyone, I'm working on an e-commerce website and using Solr as my > Search Engine, im reall

Re: Is it possible to do an "if" statement in a Solr query?

2012-09-12 Thread Jack Krupansky
You could implement a custom "search component" with that logic, if you don't mind the complexity of writing Java code that runs inside the Solr environment. Otherwise, just implement that logic in your app. Or, or implement an "app server" which sits between Solr and your app. http://wiki.apa

Can solr return matched fields?

2012-09-12 Thread Dan Foley
is there a way for solr to tell me what fields the query matched, other then turning debug on? I'd like my application to take different actions based on what fields were matched. -- Dan Foley Owner - PHP Web Developer ___ Micamedia.com - PHP W

Re: Can solr return matched fields?

2012-09-12 Thread Casey Callendrello
What about using the FastVectorHighlighter? It should get you what you're looking for (fields with matches) without much of a query-time performance impact. --Casey On 9/12/12 3:01 PM, Dan Foley wrote: > is there a way for solr to tell me what fields the query matched, > other then turning debug

How to post atomic updates using xml

2012-09-12 Thread jimtronic
There's a good intro to atomic updates here: http://yonik.com/solr/atomic-updates/ but it does not describe how to structure the updates using xml. Anyone have any idea on how these would look? Thanks! Jim -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-post-atomic-

Re: How to post atomic updates using xml

2012-09-12 Thread jimtronic
Figured it out. in JSON: {"id" : "book1", "author" : {"set":"Neal Stephenson"} } in XML: book1 This seems to work. Jim -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-post-atomic-updates-using-xml-tp4007323p4007325.html Sent from the Solr - User mai

Re: Can solr return matched fields?

2012-09-12 Thread Jack Krupansky
But presumably "matched" fields relates to indexed fields, which might not have stored values. -- Jack Krupansky -Original Message- From: Casey Callendrello Sent: Wednesday, September 12, 2012 6:15 PM To: solr-user@lucene.apache.org Subject: Re: Can solr return matched fields?

Want a multi-datacenter environment with Solr?

2012-09-12 Thread Stephanie Huynh
Does anyone want me to send them a white paper on having a multi-datacenter environment with Solr? Best, Stephanie

Re: Want a multi-datacenter environment with Solr?

2012-09-12 Thread Otis Gospodnetic
Is that with plain Apache Solr or Datastax? Otis -- Performance Monitoring - http://sematext.com/spm On Sep 12, 2012 7:55 PM, "Stephanie Huynh" wrote: > Does anyone want me to send them a white paper on having a > multi-datacenter environment with Solr? > > Best, > Stephanie >

How does Solr handle overloads so well?

2012-09-12 Thread Mike Gagnon
Hi, I have been studying how server software responds to requests that cause CPU overloads (such as infinite loops). In my experiments I have observed that Solr performs unusually well when subjected to such loads. Every other piece of web software I've experimented with drops to zero service und

Re: How does Solr handle overloads so well?

2012-09-12 Thread Otis Gospodnetic
Hm, I'm not sure how to approach this. Solr is not alone here - there's container like jetty, solr inside it and lucene inside solr. Next, that index is rally small, so there is no disk IO. The request rate is also not super high and if you did this over a fast connection then there are also no

Re: Is it possible to do an "if" statement in a Solr query?

2012-09-12 Thread Amit Nithian
If the fact that it's "original" vs "generic" is a field "is_original" 0/1 can you sort by is_original? Similarly, could you put a huge boost on is_original in the dismax so that document matches on is_original score higher than those that aren't original? Or is your goal to not show generics *at a

Re: SolrCloud fail over

2012-09-12 Thread andy
Cool,Thanks Mark! Mark Miller-3 wrote > > Either setup a load balancer, or use the SolrCloud solrj client > CloudSolrServer - it takes a comma separated list of zk servers rather > than a solr url. > > On Tue, Sep 11, 2012 at 10:17 PM, andy wrote: >> I know fail over is available in so

Re: Can solr return matched fields?

2012-09-12 Thread Mikhail Khludnev
Dan, if you have "foo bar" search phrase against field: NAME, BRAND, and you have 10K docs matched and 100 first ones is displayed, what do you actually want to see as "fields the query matched" and for which docs? looking forward for additional details. On Thu, Sep 13, 2012 at 2:40 AM, Jack Kru

Re: How to know the indexversion when sending a document ?

2012-09-12 Thread Laurent Vaills
I forgot to mention that I am using Solr 3.6 . Laurent 2012/9/12 Laurent Vaills > Hi, > > When I index a document in Solr, I do not commit immediately after, I use > the autoCommit feature. > But I would like to know in which index's version the document will be > available. Is that possible to

Re: Doubts in PathHierarchyTokenizer

2012-09-12 Thread mechravi25
Thanks a lot koji. It worked. -- View this message in context: http://lucene.472066.n3.nabble.com/Doubts-in-PathHierarchyTokenizer-tp4007216p4007373.html Sent from the Solr - User mailing list archive at Nabble.com.