Re: Incorrect snippets using FastVectorHighlighter

2013-03-21 Thread Jochen Just
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Am 19.03.2013 02:49, schrieb Koji Sekiguchi:
>> So just to be clear: There is no possibility to highlight
>> results, if I use variable gram size. Neither the original
>> highlighter nor FVH do the job. Or am I missing something?
> 
> I don't know the latest original highlighter has such restriction
> or not today,
Just in case somebody is interested: Solr 4.2 can't highlight results
reliably using variable gram size. Neither using original Highlighter
nor using FastVectorHighlighter.
> but when FVH came in 2.9, at that time, the original highlighter
> couldn't deal with n-gram field if n > 1, because (k)-th term's end
> offset can be larger than (k+1)-th term's start offset.
> 
>> Btw does any documentation exits how the VFH works?
> 
> See package summary:
> 
> http://lucene.apache.org/core/4_2_0/highlighter/org/apache/lucene/search/vectorhighlight/package-summary.html
>
> 
> 
> koji


- -- 
Jochen Just   Fon:   (++49) 711/28 07 57-193
avono AG  Mobil: (++49) 172/73 85 387
Breite Straße 2   Mail:  jochen.j...@avono.de
70173 Stuttgart   WWW:   http://www.avono.de
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with undefined - http://www.enigmail.net/

iQIcBAEBAgAGBQJRSrwLAAoJEP1xbhgWUHmSDwEQALGZ+5boTSllItUCG0qaDMA0
5CXNBWzvf+DVV589rOIhIU8OtaNgIrNqLCBT/3hUZvUIcCQV9Y61oBXWSQ5E4oXZ
qC0p2mflNIAOcPutM21kQT+V+XWu1lG06IEIZzSNJqv75d+j6NZE0HdHMNSfdcTl
5pRPDCyrflAwR8Ryj9HjmOTLzW1lPqqfVGaRbY9WvGZE5G3USn8QRpgbODH4Hnb4
IgIdDa8C+ihW55KbzXB60xGG5F1/CFByXfBdLhsH2FDgE8p08noS5LKUH9czDO4y
PGjz2Nx8qcBq0iyj9yzibR4OOa+vvbgWQup9t8cJIbmjIDNWXXYUQdMk+XyB0cxU
ZdplyZA1KRA5D4hrYyrVYNDBgkAAcDTsdYT1MTIgnR2jVD29BU9RENAeR4DKYvp1
9l93+h0sCsfyudl+GBIr/aWvpW3SfK5DS3hDiXNr+js1V9m2jBDzGzD4AW/chLGU
uaU3UCjRWVhWmYbk/sEyxWYW0SHxDaxDRlvzDRXDvmHXR6nwphCDFPmtmY5lBAHY
e4gI3Iim7nu37Muu2tPqHzd8SuBWpwO1jMGJRk2qtBwVN2su/PmxExpc3mqypQ+q
UzMxu95Me4hzDBXR+Vj+8KF8d99ETFbNXeRECRpiq8pmrAI6XhHuirYwy9w7LThe
YX8c/oyIXGoWGSiCA56z
=CgXo
-END PGP SIGNATURE-


Incorrect snippets using FastVectorHighlighter

2013-03-18 Thread Jochen Just
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi list,

i have the following field type in my schema.xml defined in order to be able to 
do in word search.

   
  




  
  
 
 
  


Searching itself works as expected, though highlighting causes me headaches.
At first I did not use the FastVectorHighlighter, which meant highlighting did
not work at all for fields of this type. Since I'm using the 
FastVectorHighlighter
most of the time highlighting works, sometimes it doesn't.

Given I have a document containing the word 
'Superkalifragilistischexpialligetisch'
and I search for 'uperkalifragilistische', I would expect as result 
'Superkalifragilistischexpiallegetisch'
but it is 'Superkalifragilistischexpialligetisch'. So there is 'ische'
missing in the highlighted part.

Sadly, I am not able to create a simple setup to reproduce this, but it only 
happens in our in-house live system.
Though if I remove some fields from my qf attribute of the edismax parser in 
solconfig.xml, it stops behaving like that.
Some of those removed fields have the fieldType string_parts_back.

Does any one have a clue, what's going on?

Thanks in advance,
Jochen


- -- 
Jochen Just   Fon:   (++49) 711/28 07 57-193
avono AG  Mobil: (++49) 172/73 85 387
Breite Straße 2   Mail:  jochen.j...@avono.de
70173 Stuttgart   WWW:   http://www.avono.de
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with undefined - http://www.enigmail.net/

iQIcBAEBAgAGBQJRRxP5AAoJEP1xbhgWUHmSRAsP/AlLHWA6Pw6Jk5Pmr0rqiAxE
IsJ6HeL+4e56IHsKsruBY7HOGdEwRvXHSkwlKGLF+dvyzz4/lx7wbGBHJCMJJkDe
Yas9izso5z4KGKzKazMYPPKoXja67zmWmRU5PYG/exT8N1gjnA98KTzXAA47xIxA
rm9zUBImPF1eIZmEBcytI/+EMJI4Cy30OvRyWfc6XoxF7Kq5wJuMXvTWl24gM0tQ
xdPUVZ6ir8IkrGw2P7d3/IgaAtYbT+SEAuFjSE9rtS8KdJfWbXDYYupqNV59Syqh
7F5ywEOgnt/OBTODFp9FR4ElakOlSZrmRk8CgYfUZZu9vNASxyBnCWwhz+CkCbfQ
fYRzy1HyDUGIGFl6FAi+4WE4av5EdWUH6N0UEdUkE6tI5b/IqzGIdocSl36PqeMR
za7jKfU9LWqc+Xoh27wLP8Wi11t/XIRQuRCxKSFpc2Go3iweCTu+cXr1K6XTndj/
uoptQ1nJJcQTRmdvxlxA5jvrVaGvOclEEFsndQWyq6wK7CJ9k+FOHfYwc7p3L1Bp
QoTTErdEKgCZj+w39Ma0ASURBX1+jjLqRnMvleSD4CX2K78z8Z7c5a7m48192D6u
mg6uOIUyTdTPH5SLUOU+rNDjOuLLbJOuVGXdpSqYymkr2WPlwwBj+ZYGx1lap1xE
5ZgU5nHnodtUAC9jjz52
=KsNm
-END PGP SIGNATURE-


Re: Incorrect snippets using FastVectorHighlighter

2013-03-18 Thread Jochen Just
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

So just to be clear:
There is no possibility to highlight results, if I use variable gram size.
Neither the original highlighter nor FVH do the job.
Or am I missing something?
Btw does any documentation exits how the VFH works?

Jochen
Am 18.03.2013 15:00, schrieb Koji Sekiguchi:
> Hi Jochen,
> 
> There is a restriction in FVH. FVH cannot deal with variable gram size. That 
> is, minGramSize == maxGramSize in your NGramFilterFactory setting.
> 
> koji


- -- 
Jochen Just   Fon:   (++49) 711/28 07 57-193
avono AG  Mobil: (++49) 172/73 85 387
Breite Straße 2   Mail:  jochen.j...@avono.de
70173 Stuttgart   WWW:   http://www.avono.de
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with undefined - http://www.enigmail.net/

iQIcBAEBAgAGBQJRR2HSAAoJEP1xbhgWUHmS8aAP/Ao6OudBZmWt3u0IWduLb5t6
ryjJeb6jCSH5RrgDGjnbxT0wgap9NWQIvH53Bwy2Y+T89ruo27mOSywZB4aYOb+l
XEl6ZfJouBf1rTzcMacIRdz4mIj/YFHq+SS724JDaDiwbiLz7Ku8/66dppFTmmN+
+lj52pFYgzzDpP63JPtGEwCBdvJ8jgjNundY94dXlyW33ZMWvPu7sdtQZP2YVQdB
RjHcoQN0fu38+5l30t1MZrm9OpDlV2GugyEk99JpKfcnEFFmYUgS9BHI9aiPg7K3
hy5lpE1ooub78vlB1jExDSRTTEJn0V/MIEUGRvzQQDS94tdhvOidxA0/zeEiBaou
tYMJKKfw8AJQN0ag16DjbCWte/9bQwgCiTswSfrpDzaIPHnqfXw5E2ABeNM7k8Q1
E9iPwsfDG8yy/MZRR83bXWl6fhtYGcW8W6GlNLB5a1B81qKM6Ld6pu9uaGpr58Aw
JKTVrjXC02i0/kYmRx7C8KFQ14UkqKqPZXtsHOmVNVXQlYX6wh9OvmjWOsWHqgNz
Y0KyXaJfL4DQlUlvuCjj2bAplHPfbwvtbtO6gIFIisKvkbk3RziSQ9W67XLTsBEV
cyxRrNbqcrAP+JLANXdP9JC6K54Ll23dFesl9Q8idaqCXuDubc1w5shMXfAGQazt
Ba5Se0fD5QibHe90SsO/
=4Nxk
-END PGP SIGNATURE-


Sharing common config between different search handlers

2012-06-01 Thread Jochen Just
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hey there list,

my application needs two searching modes. The first modes needs to
consider synonyms the other one must not.

Currently I have two field types with basically the same configuration
except that one field type uses a SynonymFilter the other one doesn't.
Furthermore there two Searchhandlers. The first one uses only fields
that recognises synonyms the other one uses only fields that doesn't
recognise synonyms.
So far, so good.

But I would like those two Searchhandlers to share the rest of their
configuration. Because if anything needs to be changed, it need to be
done for both Searchhandlers. I think that's kind of ugly.
Additionally I would like the client (the web page the triggers a
search) not to know anything about the field names. Therefore I do not
simply specify a list of query fields in the request.

To clarify my situation, follows a sample solrconfig.xml (I left out
many of the details to save time and space, but I guess you get the idea).


  
edismax
10
id, score
description_with_synonyms

  



  
edismax
10
id, score
description_without_synonyms

  


I thought about using only SearchHandler and a filterquery to get rid
of the "synonym-results" if they are not needed. But I as far as I can
tell, that's not possible.

Thanks in advance and any idea is welcome,

Jochen
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQIcBAEBAgAGBQJPyLoZAAoJEP1xbhgWUHmS72oQAKbh5vr5SmROMO9Eupdfnr7c
2VNqQsPPslzVWSIRVsvsEZxW8RalWsXB33Dayqzqg+5Be0BSBnrwmCYGsMwetHCT
PQjXx9OvuxlGxFeRoLmrMbhDdKLudWPkHmcHK2t8ZTgZ7ZWBJOimNiYIJANHd5Wc
7C0SMqcmiyxA58RvVePtkcZP7ag7kq2CLlamd8hg7cDWs4FYR/4eRXZcgIg76Eoc
CnkgP5w0gRWxNbDI1y+KxvT4XX3lZ/w+Kwr5A7CK1WTm1Y+hrDc7cjNiUU4c/3a1
9kgnhUxTKlzLLeIPWe2qvtXqvgUcMg9l09oFnTQ+u58g+v7wBObEnCJi1IKT7gT3
+pA8kAFY8bAHauoeHg2XZO3PFtowMXXm1Er/5+euEeoRdlOAi9SPO5pCbRnlSAI8
u8QwFfXv3ZeYI4CFsQsFFUX/NVPJuVXerti0n3Ebn6sUXqs0EmxUmr5vpSnQ38Md
NQgdFRWeYeRD341Jy1tqyFh8gtzIUwWA5Otd7tKR//xidhrnq5CCA8kOr+i3AnT/
4w04ite1uGd+m5erspcBR6SkxtLVcSp3rcpzSV0CC2j5vQdxe6b8PBy25cowaxJF
wOtrtyPisvwWMM253GMuO4O6uxv+p/SgP1gdiZ4I9ZMQQwlT/Ny7+APEj93eNrKQ
3Y38BDWKUio30/yThe9G
=4mQ9
-END PGP SIGNATURE-


Re: SolrJ Response

2012-06-28 Thread Jochen Just
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi,

> I want to display response in json/xmk as it comes from solr.
Why don't you use the JSON QueryResponseWriter from Solr directly?
http://wiki.apache.org/solr/SolJSON should give you all you need to
get started.

Jochen


- -- 
Jochen Just   Fon:   (++49) 711/28 07 57-193
avono AG  Mobil: (++49) 172/73 85 387
Breite Straße 2   Mail:  jochen.j...@avono.de
70173 Stuttgart   WWW:   http://www.avono.de


-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQIcBAEBAgAGBQJP7FG7AAoJEP1xbhgWUHmSJOQP/AyKfHI1bOkmcgKL0PVAnQu9
sCdAUWhL732JWd+TT77onnQQ2g2vKWnIg+00fmU+x5B52uUzU2nKRMCLaVhGlSJK
NSb4c5DJVcdzz6G5fofkQLZKahLRSi9d3p8A5c5CMSEvkWLAYR3OPrNTn7dUiJNA
D1JyQjSbMMwyf41msjLF84oF4C4Nb+0eY2bqiF5rlMBdEzazYl4hlMkVxzu6taiQ
Yf38CB+vd91OznpvMTr89XCuTi+l9XmG0d0TKKvKq4r2sDTrQyBM8q3oyTPeNyKy
VsmUP+m6kqlPWOlSjJyxw5PQz5IlfwRskTbrMS4ZCBDH7Bam5D0UtZzuY+DJRKCM
eW49MLgbA2IPYnvfd78v+VxCj9Xyh49QZd0ea1uXve7ABp7WeRj/1L8CdHvAK6/k
5NFW02/A+PoI3+QTgcYzXaO5N+AG3maAhLELDgZ1fQW/wISRLSBeSRj7QEQRPLJE
rpekf7v3S0fBJyk2cn7YITTuqMogwktVYv/OQ6wB7+1O8cXzt6p4BYRneqmPw4Ll
6Vr/ESdGMTOu7VAzWqB9pmCMjfORtqKIFIVcGyIAGFlD5xhH3aepM2bpbCVJnaMM
GYnXoLLSB2mrexyccthBQV+sYOvZerjtcvoBY5ZIxcbT+HBag6ReFrLxM3AUWmLI
jtGvkh4y1180l2AKgSSJ
=QsJw
-END PGP SIGNATURE-


Re: Can i have more than one field as defaultSearchField in schema.xml

2012-09-13 Thread Jochen Just
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Am 14.09.2012 07:30, schrieb veena rani:
> Hi,
> 
> Can i have more than one field as defaultSearchField in
> schema.xml. This is my default search field in solr,
If you want to search in more than one filed the Edismax-Parser
(http://wiki.apache.org/solr/ExtendedDisMax) might be helpful.
> 
> ** *
> techskill.* But i need to
> add one more field to default search field.
> 


- -- 
Jochen Just   Fon:   (++49) 711/28 07 57-193
avono AG  Mobil: (++49) 172/73 85 387
Breite Straße 2   Mail:  jochen.j...@avono.de
70173 Stuttgart   WWW:   http://www.avono.de
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://www.enigmail.net/

iQIcBAEBAgAGBQJQUsvGAAoJEP1xbhgWUHmS6t0P/3SHYVQ2L5TBrGM8R7YEv3FV
qW8346kZ8r1nYbbpjNU80S6W16o4wxRn2UHEgguhk9i7IufrXlRiaATGUHMcrdKw
lxF6BM4vlyldkFXi6p5z51OefMoJM/Z10PCNgl71UymUm9wMnMbOo+d4IGeL9b4p
Q/pqpBEEw2Ej+RxAwDUv4jwGnao/TkFeduf0W1tyBWgR1zGmiPltc/8LrVGq/Gi3
TohpedfeWOETYy5yJsqonna409B2kT853odWnC1mW1ThucOfhCU5nBkNj1g4wXUg
GTMuGLG6yf2oLdtUjkbEAJFYhsn4zWwIyHW0+Qg7e7s1n9SHGBgROziiJi2U2Z+h
2MDi6DAQcYluulKR4ZwL0FRfiDzu5HwG1vGGiqBumLky1cJpfREpMcWXlIz0Vx4r
7CiSg7YqXQp5GaVO1fH0KyJ72dd9JFEHI3pl69nsA1UBTKI5i1oSwdk1q606HrYp
lG3gGIlMYnGk4qCKTvQS2BAgIb4ijKRH0a//oSSRV2KwurRgAW7F3SziQIcK8BtC
XjlmVHAvVHbpo8Z0X3zWQ4TTG43oBfrD+HuVrVI9hK27r6xp3RCMwQqR7tV8pHf7
p/ceJK0ywahoh/GflxMkefCzj8m866APwFbs8ZR/D2OfLNUhnStG2NpmC7uA7G/N
Ap6iSlj2f8689dGU7Sqz
=59ZA
-END PGP SIGNATURE-


Re: Several indexes

2012-10-17 Thread Jochen Just
You probably should try a multi core installation:
http://wiki.apache.org/solr/CoreAdmin should get you started.
Am 17.10.2012 12:21, schrieb blopez:
> Hi all,
> 
> I'm facing a problem that I think is easier to solve than I really
> think.
> 
> Overview: I have an application working on Solr which manages
> indexing and retrieval operations. Everything's working fine, I can
> index some docs (for example schema with attributes A, B and C) in
> a Solr index and then perform query operations on it.
> 
> The problem is that I want to implement another process in the
> same application to retrieve information, but with a different
> schema. For example, docs with attributes X and Y.
> 
> I tried to set two different schemas in the schema.xml file, but it
> crashes the Solr instance. Moreover, I've been thinking about a
> workaround but it's not clear for me. Another point could be
> creating a new instance of Solr, so that there are two Solr
> instances open... but I think it's not a real solution.
> 
> Regards, Borja.
> 
> 
> 
> -- View this message in context:
> http://lucene.472066.n3.nabble.com/Several-indexes-tp4014181.html 
> Sent from the Solr - User mailing list archive at Nabble.com.
> 


-- 
Jochen Just   Fon:   (++49) 711/28 07 57-193
avono AG  Mobil: (++49) 172/73 85 387
Breite Straße 2   Mail:  jochen.j...@avono.de
70173 Stuttgart   WWW:   http://www.avono.de