Re: SolrCloud: Meaning of SYNC state in ZkStateReader?

2014-10-14 Thread Martin Grotzke
Ok, thanks for your response, Mark! Cheers, Martin On Tue, Oct 14, 2014 at 1:59 AM, Mark Miller wrote: > I think it's just cruft I left in and never ended up using anywhere. You > can ignore it. > > - Mark > > > On Oct 13, 2014, at 8:42 PM, Martin Grotzke < &g

SolrCloud: Meaning of SYNC state in ZkStateReader?

2014-10-13 Thread Martin Grotzke
Hi, can anybody tell me the meaning of ZkStateReader.SYNC? All other state related constants are clear to me, I'm only not sure about the semantics of SYNC. Background: I'm working on an async solr client (https://github.com/inoio/solrs) and want to add SolrCloud support - for this I'm reusing Zk

Re: LBHttpSolrServer to query a preferred server

2012-04-04 Thread Martin Grotzke
Hi, I just submitted an issue with patch for this: https://issues.apache.org/jira/browse/SOLR-3318 Cheers, Martin On 04/04/2012 03:53 PM, Martin Grotzke wrote: > Hi, > > we want to use the LBHttpSolrServer (4.0/trunk) and specify a preferred > server. Our use case is that for one

LBHttpSolrServer to query a preferred server

2012-04-04 Thread Martin Grotzke
Hi, we want to use the LBHttpSolrServer (4.0/trunk) and specify a preferred server. Our use case is that for one user request we make several solr requests with some heavy caching (using a custom request handler with a special cache) and want to make sure that the subsequent solr requests are hitt

How to determine memory consumption per core

2012-04-02 Thread Martin Grotzke
Hi, is it possible to determine the memory consumption (heap space) per core in solr trunk (4.0-SNAPSHOT)? I just unloaded a core and saw the difference in memory usage, but it would be nice to have a smoother way of getting the information without core downtime. It would also be interesting, wh

Re: AW: How to deal with many files using solr external file field

2011-06-09 Thread Martin Grotzke
uot; but there ist none in the >> /solr/data-Folder. >> >> Question: is it possible, that those exceptions are responsible for the >> OutOfMemory-Problem or could it be due to the large(?) number of 40k terms >> for which we want to sort the result via external file field? >> >> I'm looking forward for your answers, suggestions and ideas :) >> >> >> Regards >> Sven >> >> >> [1]: >> http://lucene.apache.org/solr/api/org/apache/solr/schema/ExternalFileField.html >> -- Martin Grotzke http://twitter.com/martin_grotzke signature.asc Description: OpenPGP digital signature

Solrj retry handling - prevent "ProtocolException: Unbuffered entity enclosing request can not be repeated"

2011-04-12 Thread Martin Grotzke
ttpclient.HttpClient.executeMethod(HttpClient.java:397) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:427) -- Martin Grotzke http://twitter.com/martin_grotzke signature.asc Description: OpenPGP digital signature

Re: Use terracotta bigmemory for solr-caches

2011-01-26 Thread Martin Grotzke
memory-for-solr-caches-tp2328257p2330652.html > Sent from the Solr - User mailing list archive at Nabble.com. > -- Martin Grotzke http://www.javakaffee.de/blog/

Re: Recommendation on RAM-/Cache configuration

2011-01-25 Thread Martin Grotzke
On Tue, Jan 25, 2011 at 2:06 PM, Markus Jelsma wrote: > On Tuesday 25 January 2011 11:54:55 Martin Grotzke wrote: > > Hi, > > > > recently we're experiencing OOMEs (GC overhead limit exceeded) in our > > searches. Therefore I want to get some clarification on

Use terracotta bigmemory for solr-caches

2011-01-25 Thread Martin Grotzke
Hi, as the biggest parts of our jvm heap are used by solr caches I asked myself if it wouldn't make sense to run solr caches backed by terracotta's bigmemory (http://www.terracotta.org/bigmemory). The goal is to reduce the time needed for full / stop-the-world GC cycles, as with our 8GB heap the l

Recommendation on RAM-/Cache configuration

2011-01-25 Thread Martin Grotzke
Hi, recently we're experiencing OOMEs (GC overhead limit exceeded) in our searches. Therefore I want to get some clarification on heap and cache configuration. This is the situation: - Solr 1.4.1 running on tomcat 6, Sun JVM 1.6.0_13 64bit - JVM Heap Params: -Xmx8G -XX:MaxPermSize=256m -XX:NewSiz

Re: Rebuild Spellchecker based on cron expression

2010-12-13 Thread Martin Grotzke
ed when something > else makes it obsolete. > > Here's a place to start: http://wiki.apache.org/solr/HowToContribute > > Best > Erick > > On Mon, Dec 13, 2010 at 2:58 AM, Martin Grotzke < > martin.grot...@googlemail.com> wrote: > >> Hi, >> >>

Re: Rebuild Spellchecker based on cron expression

2010-12-13 Thread Martin Grotzke
ttps://issues.apache.org/jira/browse/SOLR-866>this is an open issue Thanx for the pointer! SOLR-866 is even better suited for us - after reading SOLR-433 again I realized that it targets scripts based replication (what we're going to leave behind us). Cheers, Martin > > Best >

Re: Rebuild Spellchecker based on cron expression

2010-12-12 Thread Martin Grotzke
eives that little interest. Anything wrong with it? Cheers, Martin On Mon, Dec 13, 2010 at 2:04 AM, Martin Grotzke wrote: > Hi, > > the spellchecker component already provides a buildOnCommit and > buildOnOptimize option. > > Since we have several spellchecker indices buil

Re: Rebuild Spellchecker based on cron expression

2010-12-12 Thread Martin Grotzke
the lifecycle, is there already some executor "framework" or >> any regularly running process in place, or would I have to pull up my >> own thread? If so, how can I stop my thread when solr/tomcat is >> shutdown (I couldn't see any shutdown or destroy method in >> SearchComponent)? >> >> Thanx for your feedback, >> cheers, >> Martin > -- Martin Grotzke http://twitter.com/martin_grotzke

Rebuild Spellchecker based on cron expression

2010-12-12 Thread Martin Grotzke
Hi, the spellchecker component already provides a buildOnCommit and buildOnOptimize option. Since we have several spellchecker indices building on each commit is not really what we want to do. Building on optimize is not possible as index optimization is done on the master and the slaves don't ev

Re: Multicore and Replication (scripts vs. java, spellchecker)

2010-12-11 Thread Martin Grotzke
should I pull up my own Timer/TimerTask etc. and create it from scratch? Cheers, Martin > > > > > > > -Hoss > -- Martin Grotzke http://www.javakaffee.de/blog/

Re: Multicore and Replication (scripts vs. java, spellchecker)

2010-12-10 Thread Martin Grotzke
Hi, that there's no feedback indicates that our plans/preferences are fine. Otherwise it's now a good opportunity to feed back :-) Cheers, Martin On Wed, Dec 8, 2010 at 2:48 PM, Martin Grotzke wrote: > Hi, > > we're just planning to move from our replicated s

Multicore and Replication (scripts vs. java, spellchecker)

2010-12-08 Thread Martin Grotzke
Hi, we're just planning to move from our replicated single index setup to a replicated setup with multiple cores. We're going to start with 2 cores, but the number of cores may change/increase over time. Our replication is still based on scripts/rsync, and I'm wondering if it's worth moving to ja

Re: ArrayIndexOutOfBoundsException for query with rows=0 and sort param

2010-12-01 Thread Martin Grotzke
On Tue, Nov 30, 2010 at 7:51 PM, Martin Grotzke wrote: > On Tue, Nov 30, 2010 at 3:09 PM, Yonik Seeley > wrote: >> On Tue, Nov 30, 2010 at 8:24 AM, Martin Grotzke >> wrote: >>> Still I'm wondering, why this issue does not occur with the plain >>> ex

Re: ArrayIndexOutOfBoundsException for query with rows=0 and sort param

2010-11-30 Thread Martin Grotzke
On Tue, Nov 30, 2010 at 3:09 PM, Yonik Seeley wrote: > On Tue, Nov 30, 2010 at 8:24 AM, Martin Grotzke > wrote: >> Still I'm wondering, why this issue does not occur with the plain >> example solr setup with 2 indexed docs. Any explanation? > > It's an old opti

Re: ArrayIndexOutOfBoundsException for query with rows=0 and sort param

2010-11-30 Thread Martin Grotzke
Is there s.th. like a timeframe when there's an agreement on the correct solution and a patch available? Thanx && cheers, Martin > > Mike > > On Mon, Nov 29, 2010 at 7:14 AM, Martin Grotzke > wrote: >> Hi, >> >> after an upgrade from solr-1.3 to

ArrayIndexOutOfBoundsException for query with rows=0 and sort param

2010-11-29 Thread Martin Grotzke
e solr side? Of course - for a quick fix - I'll change our app so that there's no sort param specified when rows=0. Thanx && cheers, Martin -- Martin Grotzke http://twitter.com/martin_grotzke

Re: How to tokenize/analyze docs for the spellchecker - at indexing and query time

2008-10-20 Thread Martin Grotzke
quot; and "Hosen" give the same results) - inconsistent/strange sorting of suggestions (as described in http://www.nabble.com/spellcheck%3A-issues-td19845539.html). Cheers, Martin On Mon, 2008-10-06 at 22:45 +0200, Martin Grotzke wrote: > On Mon, 2008-10-06 at 09:00 -0400,

Re: How to tokenize/analyze docs for the spellchecker - at indexing and query time

2008-10-06 Thread Martin Grotzke
On Mon, 2008-10-06 at 09:00 -0400, Grant Ingersoll wrote: > On Oct 6, 2008, at 3:51 AM, Martin Grotzke wrote: > > > Hi Jason, > > > > what about multi-word searches like "harry potter"? When I do a search > > in our index for "harry poter"

Re: How to tokenize/analyze docs for the spellchecker - at indexing and query time

2008-10-06 Thread Martin Grotzke
, I can help you get the spellchecker > up-and-running. Additional replies in-lined below. > > On Wed, Oct 1, 2008 at 7:11 AM, Martin Grotzke <[EMAIL PROTECTED] > > wrote: > > > Now I'm thinking about the source-field in the spellchecker ("spell"): >

How to tokenize/analyze docs for the spellchecker - at indexing and query time

2008-10-01 Thread Martin Grotzke
Hi, I'm just starting with the spellchecker component provided by solr - it is really cool! Now I'm thinking about the source-field in the spellchecker ("spell"): how should fields be analyzed during indexing, and how should the queryAnalyzerFieldType be configured. If I have brands like e.g. "A

Re: prefix-search ingnores the lowerCaseFilter

2007-10-29 Thread Martin Grotzke
On Mon, 2007-10-29 at 13:31 -0400, Yonik Seeley wrote: > On 10/29/07, Martin Grotzke <[EMAIL PROTECTED]> wrote: > > On Thu, 2007-10-25 at 10:48 -0400, Yonik Seeley wrote: > > > On 10/25/07, Max Scheffler <[EMAIL PROTECTED]> wrote: > > > > Is it possi

Re: prefix-search ingnores the lowerCaseFilter

2007-10-29 Thread Martin Grotzke
On Thu, 2007-10-25 at 10:48 -0400, Yonik Seeley wrote: > On 10/25/07, Max Scheffler <[EMAIL PROTECTED]> wrote: > > Is it possible that the prefix-processing ignores the filters? > > Yes, It's a known limitation that we haven't worked out a fix for yet. > The issue is that you can't just run the p

type ahead - suggest words with facet.prefix, but with original case (or another solution?)

2007-10-20 Thread Martin Grotzke
Hello, I'm just thinking about a solution for a type ahead functionality that shall suggest terms that the user can search for, and that displays how many docs are "behind" that search (like google suggest). When I use facet.prefix and facet.field=text, where text is my catchall field (and defaul

Re: Different search results for (german) singular/plural searches - looking for a solution

2007-10-16 Thread Martin Grotzke
at query time, but the docs in the wiki recommend to expand synonyms at index time... What are your experiences? Would you also suggest to use them when indexing? On Thu, 2007-10-11 at 17:32 +0200, Thomas Traeger wrote: > Martin Grotzke schrieb: > >> Try the SnowballPorterFilterFactory

Re: Different search results for (german) singular/plural searches - looking for a solution

2007-10-11 Thread Martin Grotzke
Hi Daniel, thanx for your suggestions, being able to export a large synonyms.txt sounds very well! Thx && cheers, Martin On Wed, 2007-10-10 at 23:38 +0200, Daniel Naber wrote: > On Wednesday 10 October 2007 12:00, Martin Grotzke wrote: > > > Basically I see two options: st

Re: Different search results for (german) singular/plural searches - looking for a solution

2007-10-11 Thread Martin Grotzke
I wouldn't expect a user to search for "keine hose" or s.th. like this :) Thanx && cheers, Martin > > Good luck, > > Tom > > > Martin Grotzke schrieb: > > Hello, > > > > with our application we have the issue, that we get different >

Different search results for (german) singular/plural searches - looking for a solution

2007-10-10 Thread Martin Grotzke
Hello, with our application we have the issue, that we get different results for singular and plural searches (german language). E.g. for "hose" we get 1.000 documents back, but for "hosen" we get 10.000 docs. The same applies to "t-shirt" or "t-shirts", of e.g. "hut" and "hüte" - lots of cases :

analysis page and search not in sync - no result for "t-shirt"?

2007-09-19 Thread Martin Grotzke
Hello, I have an issue, that "T-Shirt" is not found, even if there are documents with the title "T-Shirt". The analysis page shows that both the index-analyzer and the query-analyzer create "t" and "shirt" of this. However, when I search for "t-shirt", I don't find anything. The product title i

Re: How to extract constrained fields from query

2007-08-24 Thread Martin Grotzke
t; some cases, but the impl for ConstantScoreQuery (which is used when the > SolrQueryParser sees a range query or a prefix query) doesn't really work > at the moment.) Yep, I already had tried this, but it always failed with an UnsupportedOperationException... Thanx a lot, cheers, Martin > > -Hoss > -- Martin Grotzke http://www.javakaffee.de/blog/ signature.asc Description: This is a digitally signed message part

Re: How to extract constrained fields from query

2007-08-23 Thread Martin Grotzke
On Wed, 2007-08-22 at 23:18 -0700, Chris Hostetter wrote: > : in my custom request handler, I want to determine which fields are > : constrained by the user. > : > : E.g. the query (q) might be "ipod AND brand:apple" and there might > : be a filter query (fq) like "color:white" (or more). > : > : W

How to extract constrained fields from query

2007-08-22 Thread Martin Grotzke
Hello, in my custom request handler, I want to determine which fields are constrained by the user. E.g. the query (q) might be "ipod AND brand:apple" and there might be a filter query (fq) like "color:white" (or more). What I want to know is that "brand" and "color" are constrained. AFAICS I co

RE: How to read values of a field efficiently

2007-08-21 Thread Martin Grotzke
On Tue, 2007-08-21 at 11:52 +0200, Ard Schrijvers wrote: > > > you're missing the key piece that Ard alluded to ... the > > there is one > > > ordere list of all terms stored in the index ... a TermEnum lets you > > > iterate over this ordered list, and the > > IndexReader.terms(Term) method > >

RE: How to read values of a field efficiently

2007-08-21 Thread Martin Grotzke
On Mon, 2007-08-20 at 11:41 -0700, Chris Hostetter wrote: > : > TermEnum terms = searcher.getReader().terms(new Term(field, "")); > : > while (terms.term() != null && terms.term().field() == field){ > : > //do things > : > terms.next(); > : > } > > : while( te.next() )

RE: How to read values of a field efficiently

2007-08-20 Thread Martin Grotzke
t message i just noticed something i > > > definitely didn't spot before... > > > > > > >> Fairly long: getFieldCacheCounts for the cat field takes ~70 ms > > > >> for the second request, while reading prices takes ~600 ms. > &g

Re: How to read values of a field efficiently

2007-08-19 Thread Martin Grotzke
ctually makes a lot of sense since there are probably a lot fewer > unique values for the cat field, so there are a lot fewer discrete values > to deal with when computing counts. > > > > > -Hoss > -- Martin Grotzke http://www.javakaffee.de/blog/ signature.asc Description: This is a digitally signed message part

Re: How to read values of a field efficiently

2007-07-31 Thread Martin Grotzke
a lot of sense since there are probably a lot fewer > unique values for the cat field, so there are a lot fewer discrete values > to deal with when computing counts. > > > > > -Hoss > -- Martin Grotzke http://www.javakaffee.de/blog/ signature.asc Description: This is a digitally signed message part

Re: How to read values of a field efficiently

2007-07-24 Thread Martin Grotzke
On Mon, 2007-07-23 at 23:32 -0700, Chris Hostetter wrote: > : This part (reading field values) takes fairly long compared > : to the other fields (that use getFacetTermEnumCounts or > : getFieldCacheCounts as implemented in SimpleFacets), so that > : I asume that there is potential for optimization

How to read values of a field efficiently

2007-07-21 Thread Martin Grotzke
Hi, I have a custom Facet implementation that extends SimpleFacets and overrides getTermCounts( String field ). For the price field I calculate available ranges, for this I have to read the values for this field. Right this looks like this: public NamedList getTermCounts( final String field

Re: Same record belonging to multiple facets

2007-07-05 Thread Martin Grotzke
On Thu, 2007-07-05 at 12:39 -0700, Thiago Jackiw wrote: > Is there a way for a record to belong to multiple facets? If so, how > would one go about implementing it? > > What I'd like to accomplish would be something like: > > record A: > name="John Doe" > category_facet="Cars" > category_facet="E

Re: Indexing question - split word and comma

2007-07-05 Thread Martin Grotzke
On Thu, 2007-07-05 at 11:56 -0700, Mike Klaas wrote: > On 5-Jul-07, at 11:43 AM, Martin Grotzke wrote: > > > Hi all, > > > > I have a document with a name field like this: > > MP3-Player, Apple, »iPod nano«, silber, > > 4GB > > > > and want to

Indexing question - split word and comma

2007-07-05 Thread Martin Grotzke
Hi all, I have a document with a name field like this: MP3-Player, Apple, »iPod nano«, silber, 4GB and want to find "apple". Unfortunately, I only find "apple,"... Can anybody help me with this? The schema.xml containts the following field definition and this fieldType definition for type te

Re: Dynamically calculated range facet

2007-06-27 Thread Martin Grotzke
here's a > formula for that that works well in a single pass over a bunch of values > right? > > > > > -Hoss > -- Martin Grotzke http://www.javakaffee.de/blog/ signature.asc Description: This is a digitally signed message part

RE: Dynamically calculated range facet

2007-06-27 Thread Martin Grotzke
al > sized ranges, rounded ranges, etc. I just had a conversation with our customer and they also want to have it like this - adjusting with a new facet constraint... Cheers, Martin > > - will > -- Martin Grotzke http://www.javakaffee.de/blog/ signature.asc Description: This is a digitally signed message part

Re: Dynamically calculated range facet

2007-06-27 Thread Martin Grotzke
ers, Martin > > We are working on a solr plugin. > > -John > > On 6/26/07, Mike Klaas <[EMAIL PROTECTED]> wrote: > > > > On 26-Jun-07, at 3:01 PM, Martin Grotzke wrote: > > > AFAICS I do not have the possibility to specify range queries in my >

Re: Dynamically calculated range facet

2007-06-27 Thread Martin Grotzke
On Tue, 2007-06-26 at 16:48 -0700, Mike Klaas wrote: > On 26-Jun-07, at 3:01 PM, Martin Grotzke wrote: > > AFAICS I do not have the possibility to specify range queries in my > > application, as I do not have a clue what's the lowest and highest > > price in the search

Re: Dynamically calculated range facet

2007-06-27 Thread Martin Grotzke
those should all be easy to > compute using the ValueSource from the field type (it would be nice if > FieldType's had some way of indicating which DocValues function can best > manage the field type, but we can always assume float or have an option > for dictating it ... people might want

Dynamically calculated range facet

2007-06-26 Thread Martin Grotzke
Hi, my documents (products) have a price field, and I want to have a "dynamically" calculated range facet for that in the response. E.g. I want to have this in the response price:[* TO 20] -> 23 price:[20 TO 40] -> 42 price:[40 TO *] -> 33 if prices are between 0 and 60 but price:[* TO 100] -

Re: All facet.fields for a given facet.query?

2007-06-20 Thread Martin Grotzke
On Wed, 2007-06-20 at 12:49 -0700, Chris Hostetter wrote: > : > I solve this problem by having metadata stored in my index which tells > : > my custom request handler what fields to facet on for each category ... > : How do you define this metadata? > > this might be a good place to start, note th

Re: All facet.fields for a given facet.query?

2007-06-20 Thread Martin Grotzke
On Wed, 2007-06-20 at 12:59 +0200, Thomas Traeger wrote: > Martin Grotzke schrieb: > > On Tue, 2007-06-19 at 19:16 +0200, Thomas Traeger wrote: [...] > >> I think it would be really nice, if I don't have to know which facets > >> fields are there at query time, ins

Re: All facet.fields for a given facet.query?

2007-06-19 Thread Martin Grotzke
prop3 and prop4 if facet.query.count is 2. Just thinking about that... :) Cheers, Martin > > What do the experts think about this? > > Tom > -- Martin Grotzke http://www.javakaffee.de/blog/ signature.asc Description: This is a digitally signed message part

Re: All facet.fields for a given facet.query?

2007-06-19 Thread Martin Grotzke
ntions and say things like facet.field=facet_* > but that in general trying to do something like facet.field=* would be a > very bad idea even if it was supported. > > http://issues.apache.org/jira/browse/SOLR-247 > > > -Hoss > -- Martin Grotzke http://www.javakaffee.de/blog/ signature.asc Description: This is a digitally signed message part

Re: Solr 1.2 HTTP Client for Java

2007-06-14 Thread Martin Grotzke
r is done by another module in our application, and not with java. Cheers, Martin > > Regards, > Daniel > > > On 14/6/07 13:07, "Martin Grotzke" <[EMAIL PROTECTED]> wrote: > > > On Thu, 2007-06-14 at 11:32 +0100, Daniel Alheiros wrote: > >> H

Re: Solr 1.2 HTTP Client for Java

2007-06-14 Thread Martin Grotzke
On Thu, 2007-06-14 at 11:32 +0100, Daniel Alheiros wrote: > Hi > > I've been using one Java client I got from a colleague but I don't know > exactly its version or where to get any update for it. Base package is > org.apache.solr.client (where there are some common packages) and the client > main

Re: Interesting Practical Solr Question

2007-05-22 Thread Martin Grotzke
On Tue, 2007-05-22 at 15:10 -0400, Erik Hatcher wrote: > On May 22, 2007, at 1:36 PM, Martin Grotzke wrote: > > For sure, perhaps the schema field element could be extended by an > > attribute "isfacet" > > There is no effective difference between a "facet&qu

Re: Interesting Practical Solr Question

2007-05-22 Thread Martin Grotzke
On Tue, 2007-05-22 at 13:06 -0400, Erik Hatcher wrote: > On May 22, 2007, at 11:31 AM, Martin Grotzke wrote: > >> You need to specify the constrants (facet.query or facet.field > >> params) > > Too bad, so we would have either to know the schema in the application

Re: Interesting Practical Solr Question

2007-05-22 Thread Martin Grotzke
On Tue, 2007-05-22 at 10:44 -0400, Yonik Seeley wrote: > On 5/22/07, Martin Grotzke <[EMAIL PROTECTED]> wrote: > > On Tue, 2007-05-22 at 10:07 -0400, Will Johnson wrote: > > > Possible solutions inline: > > > > > > 1) I use facets and want to re

RE: Interesting Practical Solr Question

2007-05-22 Thread Martin Grotzke
ry but are NOT in the set of 1000 ids that they already saved. > Is this possible? > > Even more reason to save the queries and not the id's. then its > > (query1expr) NOT (query2expr) > > - will > > > > > ________ > __

Re: PriceJunkie.com using solr!

2007-05-17 Thread Martin Grotzke
but that is all for now. Join the > mailing list to see more improvements in the future. > > Also.. how do I get added to the Using Solr wiki page? > > > Thanks, > Mike Austin > -- Martin Grotzke http://www.javakaffee.de/blog/ signature.asc Description: This is a digitally signed message part