Why dismax isn't the default with 1.4 and why it doesn't support fuzzy search ?
Hello, Solr is a great software, but I have some interrogations like : The wiki says "As of Solr 1.3, the DisMaxRequestHandler is simply the standard request handler with the default query parser set to the DisMax Query Parser (defType=dismax).". I just made a checkout of svn and dismax doesn't seems to be the default as : - http://localhost:8983/solr/select/?q=test~0.5 and http://localhost:8983/solr/select/?q=test~0.5&qt=dismax doesn't show the same results. Note that I'm new to solr and I'm using the "example". So is dismax really the default ? Secondly, I've patched solr with http://issues.apache.org/jira/browse/SOLR-629 as I would like to have fuzzy with dismax. I built it with "ant example". Now, behavior is still the same, no fuzzy search with dismax (using the qt=dismax parameter in GET URL). In advance, thanks a lot.
Re: Why dismax isn't the default with 1.4 and why it doesn't support fuzzy search ?
On Wed, Sep 2, 2009 at 12:44 AM, Chris Hostetter wrote: > : The wiki says "As of Solr 1.3, the DisMaxRequestHandler is simply the > : standard request handler with the default query parser set to the > : DisMax Query Parser (defType=dismax).". I just made a checkout of svn > : and dismax doesn't seems to be the default as : > > that paragraph doesn't say that dismax is the "default handler" ... it > says that using qt=dismax is the same as using qt=standard with the " > query parser" set to be the DisMaxQueryParser (using defType= > > > so doing this replacement on any URL... > > qt=dismax => qt=standard&defTYpe=dismax > > ...should produce identical results. Thank you, sorry it wasn't clear for me. > > : Secondly, I've patched solr with > : http://issues.apache.org/jira/browse/SOLR-629 as I would like to have > : fuzzy with dismax. I built it with "ant example". Now, behavior is > : still the same, no fuzzy search with dismax (using the qt=dismax > : parameter in GET URL). > > questions/discussion of uncommitted patches is best done in the Jira issue > wherey ou found the patch ... that way it helps other people evaluate the > patch, and the author of the patch is more likelye to see your feedback. You're right.
Re: Why dismax isn't the default with 1.4 and why it doesn't support fuzzy search ?
Hi Gert, &qt=dismax in URL works with Solr 1.3 and 1.4 without further configuration. You are right, you should find a "dismax" query parser in solrconfig.xml by default. Erwin On Wed, Sep 9, 2009 at 7:49 AM, Villemos, Gert wrote: > On question to this; > > Do you need to explicitly configure a 'dismax' queryparser in the > solrconfig.xml to enable this, or is a queryparser named 'dismax' > available per default? > > Cheers, > Gert. > > > > > -Original Message- > From: Chris Hostetter [mailto:hossman_luc...@fucit.org] > Sent: Wednesday, September 02, 2009 2:44 AM > To: solr-user@lucene.apache.org > Subject: Re: Why dismax isn't the default with 1.4 and why it doesn't > support fuzzy search ? > > : The wiki says "As of Solr 1.3, the DisMaxRequestHandler is simply the > : standard request handler with the default query parser set to the > : DisMax Query Parser (defType=dismax).". I just made a checkout of svn > : and dismax doesn't seems to be the default as : > > that paragraph doesn't say that dismax is the "default handler" ... it > says that using qt=dismax is the same as using qt=standard with the " > query parser" set to be the DisMaxQueryParser (using defType=dismax) > > > so doing this replacement on any URL... > > qt=dismax => qt=standard&defTYpe=dismax > > ...should produce identical results. > > : Secondly, I've patched solr with > : http://issues.apache.org/jira/browse/SOLR-629 as I would like to have > : fuzzy with dismax. I built it with "ant example". Now, behavior is > : still the same, no fuzzy search with dismax (using the qt=dismax > : parameter in GET URL). > > questions/discussion of uncommitted patches is best done in the Jira > issue > wherey ou found the patch ... that way it helps other people evaluate > the > patch, and the author of the patch is more likelye to see your feedback. > > > -Hoss > > > > Please help Logica to respect the environment by not printing this email / > Pour contribuer comme Logica au respect de l'environnement, merci de ne pas > imprimer ce mail / Bitte drucken Sie diese Nachricht nicht aus und helfen > Sie so Logica dabei, die Umwelt zu schützen. / Por favor ajude a Logica a > respeitar o ambiente nao imprimindo este correio electronico. > > > > This e-mail and any attachment is for authorised use by the intended > recipient(s) only. It may contain proprietary material, confidential > information and/or be subject to legal privilege. It should not be copied, > disclosed to, retained or used by, any other party. If you are not an > intended recipient then please promptly delete this e-mail and any attachment > and all copies and inform the sender. Thank you. > > >
Highlighting priority
Hi, We are currently using Solr 4.3 and have highlighting activated on three different fields using FVH. Is it possible with Solr to prioritize highlighting for these fields ? I mean, how to configure Solr, when it's possible highlight the keywords from the first field, and highlight the rest of the keywords on the second field and so on. Is there any "Way Of Solr" for doing this ? Thank you and Best Regards Erwin
Highlighting priority
Hi, We are currently using Solr 4.3 and have highlighting activated on three different fields using FVH. Is it possible with Solr to prioritize highlighting for these fields ? I mean, how to configure Solr, when it’s possible highlight the keywords from the first field, and highlight the rest of the keywords on the second field and so on. Is there any “Way Of Solr” for doing this ? Thank you and Best Regards Erwin
Solr Highlighting Best Practices Guideline
Hi, After having done the official Solr-Tutorial (https://lucene.apache.org/solr/4_5_1/) and read the Solr-Reference-Guide (https://www.apache.org/dyn/closer.cgi/lucene/solr/ref-guide/), I would like to ask whether someone can point me to best practices and/or tutorial on how to setup the highlighting function in Solr the right way ? I have googled but cannot find any relevant results. Could someone share her/his experience in using standard highlighther, fast vector highlighter and posting highlighter ? Thanks for every hints.
RE: Solr Highlighting Best Practices Guideline
Hi Furkan, thanks for the reply. I was trying to get some guidelines on how to apply highlighter types correctly and maybe some comparison results between the three highlighter types (standard highlighter, fast vector highlighter and posting highlighter) Best Regards Erwin -Original Message- From: Furkan KAMACI [mailto:furkankam...@gmail.com] Sent: Tuesday, October 29, 2013 12:56 PM To: solr-user@lucene.apache.org Subject: Re: Solr Highlighting Best Practices Guideline This is a too broad question. If you have specific questions or want to see other users' problems about highlighting feature at Solr you can check here: http://search-lucene.com/?q=highlighting&fc_project=Solr&fc_type=mail+_hash_+user On the other hand you can read Using Additional Solr Functionalities section at Apache Solr Cookbook. 29 Ekim 2013 Salı tarihinde Erwin Gunadi adlı kullanıcı şöyle yazdı: > Hi, > > After having done the official Solr-Tutorial ( https://lucene.apache.org/solr/4_5_1/) and read the Solr-Reference-Guide ( https://www.apache.org/dyn/closer.cgi/lucene/solr/ref-guide/), I would like to ask whether someone can point me to best practices and/or tutorial on how to setup the highlighting function in Solr the right way ? > I have googled but cannot find any relevant results. > > Could someone share her/his experience in using standard highlighther, fast vector highlighter and posting highlighter ? > > Thanks for every hints. > >
RE: Solr Highlighting Best Practices Guideline
Hi Jack, thank you for the hint. Best Regards Erwin -Original Message- From: Jack Krupansky [mailto:j...@basetechnology.com] Sent: Tuesday, October 29, 2013 4:14 PM To: solr-user@lucene.apache.org Subject: Re: Solr Highlighting Best Practices Guideline There are some detailed examples in my e-book as well. -- Jack Krupansky -Original Message- From: Erwin Gunadi Sent: Tuesday, October 29, 2013 8:21 AM To: solr-user@lucene.apache.org Subject: RE: Solr Highlighting Best Practices Guideline Hi Furkan, thanks for the reply. I was trying to get some guidelines on how to apply highlighter types correctly and maybe some comparison results between the three highlighter types (standard highlighter, fast vector highlighter and posting highlighter) Best Regards Erwin -Original Message- From: Furkan KAMACI [mailto:furkankam...@gmail.com] Sent: Tuesday, October 29, 2013 12:56 PM To: solr-user@lucene.apache.org Subject: Re: Solr Highlighting Best Practices Guideline This is a too broad question. If you have specific questions or want to see other users' problems about highlighting feature at Solr you can check here: http://search-lucene.com/?q=highlighting&fc_project=Solr&fc_type=mail+_hash_+user On the other hand you can read Using Additional Solr Functionalities section at Apache Solr Cookbook. 29 Ekim 2013 Salı tarihinde Erwin Gunadi adlı kullanıcı şöyle yazdı: > Hi, > > After having done the official Solr-Tutorial ( https://lucene.apache.org/solr/4_5_1/) and read the Solr-Reference-Guide ( https://www.apache.org/dyn/closer.cgi/lucene/solr/ref-guide/), I would like to ask whether someone can point me to best practices and/or tutorial on how to setup the highlighting function in Solr the right way ? > I have googled but cannot find any relevant results. > > Could someone share her/his experience in using standard highlighther, fast vector highlighter and posting highlighter ? > > Thanks for every hints. > >
Maven archetype
Hi to everybody. Im not going to say that im new in solr, but im new in solr. I been googling a lot of things to start with solr, but i would like to know if there is a maven archetype for the 4.6 version (to deploy in tomcat). Also i would like to know (based in best practices) what the comunity recommends about solr deployment, if is better to use a solr home directory or use just a war inside tomcat instalation with all the configuration inside. Thanks and regards Erwin
Re: Maven archetype
Hi Andrea, i been looking for a archetype because i am using eclipse and the specific solr config must be easy to deploy (now we are using maven), mvn package mvn assembly or simliars, the idea is leave solr config easy to package and well stored on svn. I saw that is a very common way to use solr server create a solr home and store all xml and properties config in there , it is the common way to use solr server? regards Erwin 2013/12/6 Andrea Gazzarini > Hi, > if you want to deploy the SOLR war on tomcat you should do once so why do > you need a maven archetype? You can just get the war from the website and > deploy to your server. > > If you need to use maven because you are, for example, developing in > eclipse and you want to just launch jetty:run and have your configuration, > jetty and solr up and ready you could add the solr war dependency to your > pom.xml and appropriately configure your maven-jetty plugin > > > org.apache.solr > solr > 4.6.0 > > > My personal experience on SOLR: the servlet engine where you deploy SOLR > is not very important, assuming you are choosing one of the most popular > (Jetty, Tomcat, JBoss, WebLogic)...personally, since SOLR is a war, I would > prefer a simple servlet engine instead of an application server (e.g. > JBoss, WebSphere, Geronimo, Weblogic) because you dont need (if you don't > need) all beautiful and complex things that those monsters carry on... > > Best, > Andrea > > > On 12/06/2013 03:04 PM, Erwin Etchart wrote: > >> Hi to everybody. >> >> Im not going to say that im new in solr, but im new in solr. >> I been googling a lot of things to start with solr, but i would like to >> know if there is a maven archetype for the 4.6 version (to deploy in >> tomcat). >> Also i would like to know (based in best practices) what the comunity >> recommends about solr deployment, if is better to use a solr home >> directory >> or use just a war inside tomcat instalation with all the configuration >> inside. >> >> Thanks and regards >> >> Erwin >> >> >
How to change Field weigth via api or another way
Hi people, Anybody knows if is possible to change the weightage of a field in a dynamic way instead of xml usage? Best regards Erwin
Re: How to change Field weigth via api or another way
Thanks for all the responses, normally i have to set the field weight directly in xml creating a type of relevance. What i was wondering if is possible to change what you normally do on xml via api o command. I think that the solution provided q=superman&qf=title^2 subject can work for me. Thanks again. 2014/1/8 Aruna Kumar Pamulapati > In the link I sent before , you will see specific example as Otis replied : > q=superman&qf=title^2 subject > > > On Wed, Jan 8, 2014 at 1:56 PM, Aruna Kumar Pamulapati < > apamulap...@gmail.com> wrote: > > > Hi Erwin, > > > > Are you talking about query time boosting? > > This explains the boosting : > > http://wiki.apache.org/solr/SolrRelevancyFAQ > > > > Thanks, > > Arun > > > > > > On Wed, Jan 8, 2014 at 1:32 PM, Erwin Etchart >wrote: > > > >> Hi people, > >> > >> Anybody knows if is possible to change the weightage of a field in a > >> dynamic way instead of xml usage? > >> > >> Best regards > >> > >> Erwin > >> > > > > >
Performance problem on Solr query on stemmed values
Hi, I would like to know whether anyone have experienced this kind of phenomena. We are having performance problem regarding query on stemmed value. I've documented the symptoms which I'm currently facing: Search on field content Search on field spell Highlighting (on content field) Processing speed active active Active Slow active not active Active Fast active active not active Fast not active active Active Slow not active active not active Fast *Fast means 1000x faster than "slow". Field Content is our index field, which holds original text, and spell is the field with stemmed value. According to my measurement result, search on both fields (stemmed and not stemmed) is really fast. But when I start to take highlighting into our query it takes too long to process. Best Regards Erwin
RE: Performance problem on Solr query on stemmed values
Hi Erick, thank you for the reply. Yes, I'm using the fast vector highlighter (Solr 4.3). Every request should only deliver 10 results. Here is my schema configuration on both field: Field content contains in average around 5000 - 6000 words (only rough estimation). Best regards Erwin -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: Tuesday, February 25, 2014 3:27 PM To: solr-user@lucene.apache.org Subject: Re: Performance problem on Solr query on stemmed values Right, highlighting may have to re-analyze the input in order to return the highlighted data. This will be significantly slower than the search, especially if you have a large number of rows you're returning. You can get better performance in highlighting by using FastVectorHighlighter. See: https://cwiki.apache.org/confluence/display/solr/FastVector+Highlighter 1000x is unusual, though, unless your fields are very large or you're returning a lot of documents. Best, Erick On Tue, Feb 25, 2014 at 5:23 AM, Erwin Gunadi wrote: > Hi, > > > > I would like to know whether anyone have experienced this kind of > phenomena. > > > > We are having performance problem regarding query on stemmed value. > > I've documented the symptoms which I'm currently facing: > > > > > Search on field content > > Search on field spell > > Highlighting (on content field) > > Processing speed > > > active > > active > > Active > > Slow > > > active > > not active > > Active > > Fast > > > active > > active > > not active > > Fast > > > not active > > active > > Active > > Slow > > > not active > > active > > not active > > Fast > > > > *Fast means 1000x faster than "slow". > > > > Field Content is our index field, which holds original text, and spell > is the field with stemmed value. > > According to my measurement result, search on both fields (stemmed and > not > stemmed) is really fast. > > But when I start to take highlighting into our query it takes too long > to process. > > > > Best Regards > > Erwin > >
Where is Solr indexed file stored?
Hi All, Where is the solr indexed stored on the machine? I have checked SOLR_HOME folder as well as solr tomcat container and it is not there. When I look at the timestamp of the file located in solr_home\data\index all the files are quite old. Is there a way to copy this file across somewhere else? Thanks, Erwin Lau Analyst Programmer- Wrap Technology - BT Financial Group * 61-2-8254 2505 |* 61-2-8253 6979 |* erwin@btfinancialgroup.com National winner CSIA Australian Service Excellence Awards 2006/07 medium business category (BT Super & Wrap Solutions) This message and any attachment is confidential and may be privileged or otherwise protected from disclosure. You should immediately delete the message if you are not the intended recipient. If you have received this email by mistake please delete it from your system; you should not copy the message or disclose its content to anyone. This electronic communication may contain general financial product advice but should not be relied upon or construed as a recommendation of any financial product. The information has been prepared without taking into account your objectives, financial situation or needs. You should consider the Product Disclosure Statement relating to the financial product and consult your financial adviser before making a decision about whether to acquire, hold or dispose of a financial product. For further details on the financial product please go to http://www.bt.com.au/general/rse.asp Past performance is not a reliable indicator of future performance.
RE: Where is Solr indexed file stored?
Hi, First of all thanks for your reply Otis I start my solr jvm through tomcat and I have set registry with the following value Tomcatsolr--parameters--options: -Dsolr.solr.home=c:\solr This is my datadir set up on solrconfig.xml ${solr.data.dir:./solr/data} And I have check the C:\solr\data\index but no new file has been updated. R, Erwin -Original Message- From: Otis Gospodnetic [mailto:otis_gospodne...@yahoo.com] Sent: Friday,13 February 2009 5:18 PM To: solr-user@lucene.apache.org Subject: Re: Where is Solr indexed file stored? Hi, data/index is correct, but perhaps you pointed your Solr to some other directory via solrconfig.xml dataDir setting? Or maybe you didn't specify solr.solr.home when starting the JVM, so you ended up with a solr directory in whichever directory you started java from? Hm, do a search (ha!) on that machine and look for "solr" or "index" directories, maybe you have a couple. Once an index is built you could copy it elsewhere and search it with, say, straight Lucene or with another Solr instance that has the same schema. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch ____ From: "Lau, Erwin" To: solr-user@lucene.apache.org Sent: Friday, February 13, 2009 1:13:42 AM Subject: Where is Solr indexed file stored? Hi All, Where is the solr indexed stored on the machine? I have checked SOLR_HOME folder as well as solr tomcat container and it is not there. When I look at the timestamp of the file located in solr_home\data\index all the files are quite old. Is there a way to copy this file across somewhere else? Thanks, Erwin Lau Analyst Programmer- Wrap Technology - BT Financial Group * 61-2-8254 2505 |* 61-2-8253 6979 |* erwin@btfinancialgroup.com National winner CSIA Australian Service Excellence Awards 2006/07 medium business category (BT Super & Wrap Solutions) This message and any attachment is confidential and may be privileged or otherwise protected from disclosure. You should immediately delete the message if you are not the intended recipient. If you have received this email by mistake please delete it from your system; you should not copy the message or disclose its content to anyone. This electronic communication may contain general financial product advice but should not be relied upon or construed as a recommendation of any financial product. The information has been prepared without taking into account your objectives, financial situation or needs. You should consider the Product Disclosure Statement relating to the financial product and consult your financial adviser before making a decision about whether to acquire, hold or dispose of a financial product. For further details on the financial product please go to http://www.bt.com.au/general/rse.asp Past performance is not a reliable indicator of future performance. This message and any attachment is confidential and may be privileged or otherwise protected from disclosure. You should immediately delete the message if you are not the intended recipient. If you have received this email by mistake please delete it from your system; you should not copy the message or disclose its content to anyone. This electronic communication may contain general financial product advice but should not be relied upon or construed as a recommendation of any financial product. The information has been prepared without taking into account your objectives, financial situation or needs. You should consider the Product Disclosure Statement relating to the financial product and consult your financial adviser before making a decision about whether to acquire, hold or dispose of a financial product. For further details on the financial product please go to http://www.bt.com.au/general/rse.asp Past performance is not a reliable indicator of future performance.
RE: Where is Solr indexed file stored?
Ah I found it. For some reason my index file is written to C:\WINDOWS\system32\solr I have set the solr.solr.home value via the registry. Is there somewhere else that I need to set to get it written to c:\solr R, Erwin -Original Message- From: Shalin Shekhar Mangar [mailto:shalinman...@gmail.com] Sent: Friday,13 February 2009 5:36 PM To: solr-user@lucene.apache.org Subject: Re: Where is Solr indexed file stored? On Fri, Feb 13, 2009 at 11:59 AM, Lau, Erwin wrote: > > I start my solr jvm through tomcat and I have set registry with the > following value > > Tomcatsolr--parameters--options: > > -Dsolr.solr.home=c:\solr > > This is my datadir set up on solrconfig.xml > > ${solr.data.dir:./solr/data} > > And I have check the C:\solr\data\index but no new file has been > updated. > New files will be added only if you add some documents. Did you add/delete any documents? Also, if your data directory was empty before starting up solr, a directory named 'index' will be created inside the the 'data' directory. -- Regards, Shalin Shekhar Mangar. This message and any attachment is confidential and may be privileged or otherwise protected from disclosure. You should immediately delete the message if you are not the intended recipient. If you have received this email by mistake please delete it from your system; you should not copy the message or disclose its content to anyone. This electronic communication may contain general financial product advice but should not be relied upon or construed as a recommendation of any financial product. The information has been prepared without taking into account your objectives, financial situation or needs. You should consider the Product Disclosure Statement relating to the financial product and consult your financial adviser before making a decision about whether to acquire, hold or dispose of a financial product. For further details on the financial product please go to http://www.bt.com.au/general/rse.asp Past performance is not a reliable indicator of future performance.
RE: Where is Solr indexed file stored?
Found it. I need to remove ${solr.data.dir:./solr/data} From my solrconfig.xml Otherwise it keep pointing to C:\WINDOWS\system32\solr Instead of the folder I specified via solr.solr.home R, Erwin -Original Message- From: Lau, Erwin Sent: Friday,13 February 2009 5:45 PM To: solr-user@lucene.apache.org Subject: RE: Where is Solr indexed file stored? Ah I found it. For some reason my index file is written to C:\WINDOWS\system32\solr I have set the solr.solr.home value via the registry. Is there somewhere else that I need to set to get it written to c:\solr R, Erwin -Original Message- From: Shalin Shekhar Mangar [mailto:shalinman...@gmail.com] Sent: Friday,13 February 2009 5:36 PM To: solr-user@lucene.apache.org Subject: Re: Where is Solr indexed file stored? On Fri, Feb 13, 2009 at 11:59 AM, Lau, Erwin wrote: > > I start my solr jvm through tomcat and I have set registry with the > following value > > Tomcatsolr--parameters--options: > > -Dsolr.solr.home=c:\solr > > This is my datadir set up on solrconfig.xml > > ${solr.data.dir:./solr/data} > > And I have check the C:\solr\data\index but no new file has been > updated. > New files will be added only if you add some documents. Did you add/delete any documents? Also, if your data directory was empty before starting up solr, a directory named 'index' will be created inside the the 'data' directory. -- Regards, Shalin Shekhar Mangar. This message and any attachment is confidential and may be privileged or otherwise protected from disclosure. You should immediately delete the message if you are not the intended recipient. If you have received this email by mistake please delete it from your system; you should not copy the message or disclose its content to anyone. This electronic communication may contain general financial product advice but should not be relied upon or construed as a recommendation of any financial product. The information has been prepared without taking into account your objectives, financial situation or needs. You should consider the Product Disclosure Statement relating to the financial product and consult your financial adviser before making a decision about whether to acquire, hold or dispose of a financial product. For further details on the financial product please go to http://www.bt.com.au/general/rse.asp Past performance is not a reliable indicator of future performance. This message and any attachment is confidential and may be privileged or otherwise protected from disclosure. You should immediately delete the message if you are not the intended recipient. If you have received this email by mistake please delete it from your system; you should not copy the message or disclose its content to anyone. This electronic communication may contain general financial product advice but should not be relied upon or construed as a recommendation of any financial product. The information has been prepared without taking into account your objectives, financial situation or needs. You should consider the Product Disclosure Statement relating to the financial product and consult your financial adviser before making a decision about whether to acquire, hold or dispose of a financial product. For further details on the financial product please go to http://www.bt.com.au/general/rse.asp Past performance is not a reliable indicator of future performance.
uploading binary file or rich document through SOLRJ
Hi All, I have been uploading my rich document(pdf/doc/xls) though url and it works properly. http://localhost:8983/solr/update/rich?stream.type=doc&stream.file=SOLR_HOME/test.pdf.doc&id=101&stream.fieldname=name&commit=true Is there a way to do it through solrj as I am trying to build an application to post/upload it programatically. Thanks, Erwin _ Get the most out of your life online! Click here for the latest news and tips. http://livelife.ninemsn.com.au/