Re: Highlighting is very slow

2009-11-10 Thread Nicolas Dessaigne
7;t find all documents. I think that a pretty large copyfield (maybe 50k?) is usually enough for most documents to be highlighted, but that depends on your corpus. Good luck ;) Nicolas 2009/11/9 Andrew Clegg > > > Nicolas Dessaigne wrote: > > > > Alternatively, you could

Re: Highlighting is very slow

2009-11-09 Thread Nicolas Dessaigne
Hi Andrew, Alternatively, you could use a copyfield with a maxChars limit as your highlighting field. Works well in my case. See https://issues.apache.org/jira/browse/SOLR-538 Nicolas 2009/11/5 Andrew Clegg > > > Indeed -- it actually went slightly slower but only by a few seconds, I > suspec

RE: never desallocate RAM...during search

2008-06-20 Thread Nicolas DESSAIGNE
Hi Robert, We had actually a similar problem to your own (slow highlighting of big documents). We corrected it by extending copyField functionality : https://issues.apache.org/jira/browse/SOLR-538 We just updated the patch. It should work perfectly on trunk. Please tell us if it answers your p

RE: Slow Highlighting -> CopyField maxSize property

2008-04-15 Thread Nicolas DESSAIGNE
Koji, The patch is now available at https://issues.apache.org/jira/browse/SOLR-538 Tell me if it fits your needs. Nicolas -Message d'origine- De : Koji Sekiguchi [mailto:[EMAIL PROTECTED] Envoyé : vendredi 21 mars 2008 16:50 À : solr-user@lucene.apache.org Objet : Re: Slow Highlighting -

RE: Slow Highlighting -> CopyField maxSize property

2008-03-25 Thread nicolas . dessaigne
Hi Koji, It needs a bit of polishing first, but we'll provide a patch if you're interested. I'll keep you informed as soon as it is available. Nicolas -Message d'origine- De : Koji Sekiguchi [mailto:[EMAIL PROTECTED] Envoyé : vendredi 21 mars 2008 16:50 À : solr-user@lucene.apache.org O

RE: Language support

2008-03-20 Thread nicolas . dessaigne
You may be interested in a recent discussion that took place on a similar subject: http://www.mail-archive.com/solr-user@lucene.apache.org/msg09332.html Nicolas -Message d'origine- De : David King [mailto:[EMAIL PROTECTED] Envoyé : mercredi 19 mars 2008 20:07 À : solr-user@lucene.apache.

Slow Highlighting -> CopyField maxSize property

2008-03-19 Thread nicolas . dessaigne
Hi all, I would like to propose a new property on copy fields that limit the number of characters that are copied. The use case is the following: Among other documents, we index very big documents (several Mo of text) and want to be able to use highlighting. However, as soon as one or more

RE: Illegal xml/html character; unicode problems near solr

2008-03-07 Thread nicolas . dessaigne
I think Tomcat defaults to the operating system default, e.g. cp1252 on a classic windows. You need to add an attribute URIEncoding="UTF-8" to the Connector you use in the server.xml conf. Nicolas -Message d'origine- De : [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] De la part de Yonik Se

RE: Proposition of a new feature: Dynamic Field Types

2008-03-03 Thread nicolas . dessaigne
You're right Yonik, that's what I meant. As for an example, let us place ourselves in two situations: - Situation A: one field ("text") where the texts of all documents are indexed; - Situation B: one field per language ("text_en", "text_fr", etc.) where only the texts of documents in that languag

RE: Proposition of a new feature: Dynamic Field Types

2008-03-03 Thread nicolas . dessaigne
ges in >> the same field, while analyzing them with different analyzers. Hence >> the >> proposition of a new feature that respond to this need: Dynamic >> Field Types. >> >> The idea of this new field type is to act as a proxy to other field >> types. >> Depending of the values of some fields of the document to index, it >> chooses >> the correct f

RE: Proposition of a new feature: Dynamic Field Types

2008-02-29 Thread nicolas . dessaigne
name="french_ft"/> >name="english_ft"/> > > > > > The last condition is used as a catch-all if preceding conditions > are not > met. > > What do you think of this feature? > > Best regards, > Nicolas Dessaigne

Proposition of a new feature: Dynamic Field Types

2008-02-29 Thread nicolas . dessaigne
uot;language". It is configured with a config similar to the following: ... ... The last condition is used as a catch-all if preceding conditions are not met. What do you think of this feature? Best regards, Nicolas Dessaigne

[JOB] Full-time opportunity in Paris, France

2007-09-26 Thread nicolas . dessaigne
ning and NLP. Familiarity with C++, SOLR and Eclipse is also desired. If you are available and interested, please contact me directly at nicolas.dessaigne_at_arisem.com Nicolas Dessaigne Chief Technical Officer ARISEM