Re: field value getting null with special char
Is any help.. I am unable to figure out..
On 20-Sep-2011 2:22 PM, "Ranveer" wrote:
> Hi All,
>
> I am facing problem to get value from solr server for a particular field.
> My environment is :
> Red hat 5.3
> Solr 3.3
> Jdk 1.6.24
> Tomcat 6.2x
> Fetching value using SolrJ
>
> When using *:* on browser it show but when using solrj all value coming
> except few fields those have special char.
>
> Scoring (TEST)
> Scoring rate 3/4 (5)
>
> above value coming on browser but getting blank in solrj. I also noticed
> that all field with '(' or ')' have this kind of problem.
>
> If this is related to '(' then how to skip special char so can get value
> in solrj.
>
> regards
> Ranveer
>
>
>
Re: URL Redirect
Tucky can also help you if you are u Sing java.. On Oct 6, 2011 1:24 PM, "Finotti Simone" wrote: > Hello, > > I have been assigned the task to migrate from Endeca to Solr. > > The former engine allowed me to set keyword triggers that, when matched exactly, caused the web client to redirect to a specified URL. > > Does that feature exist in Solr? If so, where can I get some info? > > Thank you
Re: scheduling imports and heartbeats
You should use cron for that.. On 10 Nov 2010 08:47, "Tri Nguyen" wrote: Hi, Can I configure solr to schedule imports at a specified time (say once a day, once an hour, etc)? Also, does solr have some sort of heartbeat mechanism? Thanks, Tri
Re: Solr Cores
How much query per second a single core can handle in this case.. regards On Wed, Jan 25, 2012 at 9:49 AM, Sujatha Arun wrote: > Thanks Erick. > > Regards > Sujatha > > On Mon, Jan 23, 2012 at 11:16 PM, Erick Erickson >wrote: > > > You can have a large number of cores, so people have multiple > > hundreds. Having multiple cores is preferred over having > > multiple JVMs since it's more efficient at sharing system > > resources. If you're running a 32 bit JVM, you are limited in > > the amount of memory you can let the JVM use, so that's a > > consideration, but otherwise use multiple cores in one JVM > > and give that JVM say, half of the physical memory on the > > machine and tune from there. > > > > Best > > Erick > > > > On Sun, Jan 22, 2012 at 8:16 PM, Sujatha Arun > wrote: > > > Hello, > > > > > > We have in production a number of individual solr Instnaces on a single > > > JVM.As a result ,we see that the permgenSpace keeps increasing with > each > > > additional instance added. > > > > > > I would Like to know ,if we can have solr cores , instead of individual > > > instances. > > > > > > > > > - Is there any limit to the number of cores ,for a single instance? > > > - Will this decrease the permgen space as the LIB is shared.? > > > - Would there be any decrease in performance with number of cores > > added? > > > - Any thing else that I should know before moving into cores? > > > > > > > > > Any help would be appreciated? > > > > > > Regards > > > Sujatha > > >
Re: Announcement/Invitation: Melbourne Solr/Lucene Users Group
Hi, I m intrested to atained but not in aus.:-( Regards On 21-Jul-2011 9:45 AM, "Dave Hall" wrote: > Hi Tal, > > On 21/07/11 14:04, Tal Rotbart wrote: >> We have noticed that there is a blossoming of Apache Solr/Lucene usage >> & development in Melbourne in addition to a lack of an unofficial, >> relaxed gathering to allow some fruitful information and experience >> exchange. >> >> We're trying to put together a laid back meet up for developers (and >> other interested people) who are currently using Apache Solr (and/or >> Lucene) or would like to learn more about it. Aiming for it to be a >> high signal/noise ratio group, with meet ups probably once every two >> months. > > This sounds great! I'm not sure I'll be a regular, but if I'm around > town when it is on I will try to drop in. > >> The first meet up is still TBD, but please join the group if you're >> keen to join us for pizza, beer, and a discussion about Solr once we >> figure out the date of the first meeting. > Once a date is decided please update the Melbourne *UG wiki page so > others can find out about it. The wiki has meeting times for various > user groups around town, which might help you find a time which doesn't > clash with other groups. Check out at http://perl.net.au/wiki/Melbourne > > Cheers > > Dave
not equals query in solr
Hi All, How to do negative query in solr. Following are the criteria : I have state and city field where I want to filter only those state and city which is not blank. something like: state NOT "" AND city NOT "". I tried -state:"" but its not working. Or suggest me to do this in better way.. regards Ranveer
Re: not equals query in solr
Hi, is it right way to do : q=(state:[* TO *] AND city:[* TO *]) regards Ranveer On Wed, Aug 24, 2011 at 12:54 PM, Ranveer Kumar wrote: > Hi All, > > How to do negative query in solr. Following are the criteria : > I have state and city field where I want to filter only those state and > city which is not blank. something like: state NOT "" AND city NOT "". > I tried -state:"" but its not working. > > Or suggest me to do this in better way.. > > regards > Ranveer > > > >
Re: not equals query in solr
any help... On Wed, Aug 24, 2011 at 12:58 PM, Ranveer Kumar wrote: > Hi, > > is it right way to do : > q=(state:[* TO *] AND city:[* TO *]) > > regards > Ranveer > > > On Wed, Aug 24, 2011 at 12:54 PM, Ranveer Kumar wrote: > >> Hi All, >> >> How to do negative query in solr. Following are the criteria : >> I have state and city field where I want to filter only those state and >> city which is not blank. something like: state NOT "" AND city NOT "". >> I tried -state:"" but its not working. >> >> Or suggest me to do this in better way.. >> >> regards >> Ranveer >> >> >> >> >
Hindi language support in solr
Hi all, I am very new in solr. I download latest release 1.4 and install. For Indexing and Searching I am using SolrJ api. My Question is "How to enable solr to search hindi language text ?". Please Help me.. thanks with regards Ranveer K Kumar
Re: Hindi language support in solr
Hi Robert, Thanks for reply. As you write, I used "textgen" but still not able to search hindi text. Might be missing some important configuration. following is my schema.xml configuration id textgen In the summary field there are hindi keywords. Please help.. thanks with regards Ranveer K Kumar On Thu, Jan 21, 2010 at 11:25 PM, Robert Muir wrote: > hello, take a look at field type "textgen" (a general unstemmed text field) > > the whitespacetokenizer + worddelimiterfilter used by this type will > work correctly for hindi tokenization and punctuation. > > On Thu, Jan 21, 2010 at 10:55 AM, Ranveer kumar > wrote: > > Hi all, > > > > I am very new in solr. > > I download latest release 1.4 and install. For Indexing and Searching I > am > > using SolrJ api. > > My Question is "How to enable solr to search hindi language text ?". > > Please Help me.. > > > > thanks > > with regards > > Ranveer K Kumar > > > > > > -- > Robert Muir > rcm...@gmail.com >
How to disable wildcard search
Hi all, How to remove/disable wildcard search in solr. I have no requirement of wildcard. is there any configuration to disable wildcard search in solr. I am using solrj for searching.. thanks With regards Ranveer K Kumar
getting error when ":" in the query
Hi All, Facing problem when someone searching the string which carry special character " : ". For example: when querying by "ipod:touch" then throwing exception due to " : ". Jan 31, 2010 9:56:35 PM org.apache.solr.common.SolrException log SEVERE: org.apache.solr.common.SolrException: undefined field ipod my full query is : http://localhost:8080/solr/select?q=ipod:touch&hl=true&start=0&rows=10&hl.fragsize=0&hl.fl=body&hl.snippets=2&wt=xml&version=2.2 is there any configuration to allow ":" in query. please help. thanks with regards Ranveer K Kumar
Re: getting error when ":" in the query
Hi thanks for reply. Is it possible to filter the special character. If I will allow then need to put "\" before every special character, which will consume time and create performance issue. So I want to just filter those special char from user input query. However I would also like to know that, is there any short way to put "\" before special character which will not effect the performance. thanks with regards On Sun, Jan 31, 2010 at 10:09 PM, NarasimhaRaju wrote: > Hi, > you have to escape lucene special characters present in usersearch term > before handing it over to QueryParser. > for more info look at > http://lucene.apache.org/java/2_9_1/queryparsersyntax.html#Escaping%20Special%20Characters > > > > “ There are only 10 types of people in this world:- > Those who understand binary and those who don’t “ > > > Regards, > P.N.Raju, > > > > > > From: Ranveer Kumar > To: solr-user@lucene.apache.org > Sent: Sun, January 31, 2010 5:35:37 PM > Subject: getting error when ":" in the query > > Hi All, > > Facing problem when someone searching the string which carry special > character " : ". > For example: > > when querying by "ipod:touch" then throwing exception due to " : ". > > Jan 31, 2010 9:56:35 PM org.apache.solr.common.SolrException log > SEVERE: org.apache.solr.common.SolrException: undefined field ipod > > my full query is : > > http://localhost:8080/solr/select?q=ipod:touch&hl=true&start=0&rows=10&hl.fragsize=0&hl.fl=body&hl.snippets=2&wt=xml&version=2.2 > > is there any configuration to allow ":" in query. > please help. > > thanks > with regards > Ranveer K Kumar > > > > >
html tag problem while searching
Hi All, I have problem related to html tag. Basically in database some column carry html tage, for example" Hello how are you? I am indexing same as it is in index. I am filtering solr supported special character at query time. now the problem is when I am searching by "p" then result is * Hello how are you? * I dont want to search in html tag content? please help? thanks
Embedded Solr problem
Hi All,
I am still very new to solr.
Currently I am facing problem to use EmbeddedSolrServer.
following is my code:
File home = new
File("D:/ranveer/java/solr_home/solr/first");
CoreContainer coreContainer = new CoreContainer();
SolrConfig config = null;
config = new SolrConfig(home + "/core1","solrconfig.xml",null);
CoreDescriptor descriptor = new CoreDescriptor(coreContainer,"core1",home +
"/core1");
SolrCore core = new SolrCore("core1", home+"/core1/data", config, new
IndexSchema(config, "schema.xml",null), descriptor);
coreContainer.register(core.getName(), core, true);
final EmbeddedSolrServer server = new EmbeddedSolrServer(coreContainer,
"core1");
Now my problem is every time when I making request for search SolrCore is
initializing the core.
I want if the core/instance of core is already start then just use
previously started core.
Due to this problem right now searching is taking too much time.
I tried to close core after search but same thing when fresh search result
is made, solr is starting from very basic.
please help..
thanks
Re: Embedded Solr problem
Hi Sven,
thanks for reply.
yes i notice that every time when request, new instance is created of solr
server.
could you please guide me to do the same ( initialization to create an
instance of SolrServer, once during first request).
On Mon, Feb 8, 2010 at 2:11 AM, Sven Maurmann wrote:
> Hi,
>
> would it be possible that you instantiate a new instance of your SolrServer
> every time you do a query?
>
> You should use the code you quoted in your mail once during initialization
> to create an instance of SolrServer (the interface being implemented by
> EmbeddedSolrServer) and subsquently use the query method of SolrServer to
> do the query.
>
> Cheers,
>Sven
>
>
> --On Sonntag, 7. Februar 2010 21:54 +0530 Ranveer Kumar <
> ranveer.s...@gmail.com> wrote:
>
> Hi All,
>>
>> I am still very new to solr.
>> Currently I am facing problem to use EmbeddedSolrServer.
>> following is my code:
>>
>>File home = new
>> File("D:/ranveer/java/solr_home/solr/first");
>> CoreContainer coreContainer = new CoreContainer();
>> SolrConfig config = null;
>> config = new SolrConfig(home + "/core1","solrconfig.xml",null);
>> CoreDescriptor descriptor = new CoreDescriptor(coreContainer,"core1",home
>> + "/core1");
>> SolrCore core = new SolrCore("core1", home+"/core1/data", config, new
>> IndexSchema(config, "schema.xml",null), descriptor);
>> coreContainer.register(core.getName(), core, true);
>> final EmbeddedSolrServer server = new EmbeddedSolrServer(coreContainer,
>> "core1");
>>
>> Now my problem is every time when I making request for search SolrCore is
>> initializing the core.
>> I want if the core/instance of core is already start then just use
>> previously started core.
>> Due to this problem right now searching is taking too much time.
>> I tried to close core after search but same thing when fresh search result
>> is made, solr is starting from very basic.
>>
>> please help..
>> thanks
>>
>
joining two field for query
Hi all,
I need logic in solr to join two field in query;
I indexed two field : id and body(text type).
5 rows are indexed:
id=1 : text= nokia samsung
id=2 : text= sony vaio nokia samsung
id=3 : text= vaio nokia
etc..
I am searching by "q=id:1" returning result perfectly, returning "nokia
samsung".
I am searching by "nokia" and resulting (listing) 1,2,3 field with short
description.
There is link on search list(like google), by clicking on link performing
new search (opening doc from index), for this search
I want to join two fields:
id:1 + queryString ("nokia samsung") to return only id:1 record and want to
highlight the field "nokia samsung".
something like : "q=id:1 + body:nokia samsung"
basically I want to highlight the query string when clicking on link and
opening the new windows (like google cache).
please help..
thanks
Re: joining two field for query (Solved)
Hi Ahmet,
Thank you very much..
my problem solved..
with regards
On Tue, Feb 9, 2010 at 5:38 PM, Ahmet Arslan wrote:
>
> > I am searching by "nokia" and resulting (listing) 1,2,3
> > field with short
> > description.
> > There is link on search list(like google), by clicking on
> > link performing
> > new search (opening doc from index), for this search
> >
> > I want to join two fields:
> > id:1 + queryString ("nokia samsung") to return only id:1
> > record and want to
> > highlight the field "nokia samsung".
> > something like : "q=id:1 + body:nokia samsung"
> >
> > basically I want to highlight the query string when
> > clicking on link and
> > opening the new windows (like google cache).
>
> When the user clicks document (id=1), you can use these parameters:
> q=body:(nokia samsung)&fq=id:1&hl=true&hl.fl=body
>
>
>
>
>
Facet search concept problem
Hi All, My concept still not clear about facet search. I am trying to search using facet query. I am indexing data from three table, following is the detail of table: table name: news news_id news_details table name : article article_id article_details table name: blog blog_id blog_details I am indexing above tables as: id news_id news_details article_id article_details blog_id blog_details Now I want, when user search by "soccer game" and search match in all field news(5), article(4) and blog(2), then it should be list like: news(5) article(4) blog(2) currently facet listing like: soccer(5) game(6) please help me.. thanks
Re: Facet search concept problem
Hi Eric, Raju Thanks for reply.. It means I need to index separate table data (news, article and blog), currently I am joining the table and making a single rows for all three table. One other thing I want to know that, in this case (if i indexing table data separately then) some column of the table is not common. so it will go blank while indexing for other table. for example: news and article have some other column like, city which is not common and not in the other table, if I am indexing other table then this column will go blank. is this ok to leaving blank field? also in this case no. of column will increase so is there any limitation in solr regarding no. of column? thanks On Mon, Feb 15, 2010 at 2:57 PM, NarasimhaRaju wrote: > Hi, > you should have a new field in your index say 'type' which will have values > 'news','article' and 'blog' for documents news,article and blog > respectively. > when searching with facet's elabled make use of this 'type' field then you > will get what you wanted. > > Regards, > P.N.Raju, > > > > > > > From: Ranveer Kumar > To: solr-user@lucene.apache.org > Sent: Sun, February 14, 2010 5:45:54 AM > Subject: Facet search concept problem > > Hi All, > > My concept still not clear about facet search. > > I am trying to search using facet query. I am indexing data from three > table, following is the detail of table: > > table name: news > news_id > news_details > > table name : article > article_id > article_details > > table name: blog > blog_id > blog_details > > I am indexing above tables as: > id > news_id > news_details > article_id > article_details > blog_id > blog_details > > Now I want, when user search by "soccer game" and search match in all field > news(5), article(4) and blog(2), > then it should be list like: > news(5) > article(4) > blog(2) > > currently facet listing like: > soccer(5) > game(6) > > please help me.. > thanks > > > > >
how to patch solr
Hi All, I have no idea about "How to run patch?" I am using windows os and I need to patch https://issues.apache.org/jira/secure/attachment/12407047/SOLR-1139.patch Currently I download solr 1.4 and using. Should I need to download source code and compiled. or can patch jar (compiled) file directly.. please guide from basics.. thanks
Integration Solr with Interwoven TeamSite
Hi all, I am using solr for searching and working fine with independent tomcat server. I want to integrate solr with Interwoven TeamSite. But No Idea of Integration solr with teamsite.. please help.
HTMLStripCharFilterFactory configuration problem
Hi all, I am facing problem to configure HTMLStripCharFilterFactory. following is the schema : when I am checking with analysis.jsp it giving true result. But in my query result still I am getting html tage.. I am using solrj client.. please help me
Re: HTMLStripCharFilterFactory configuration problem
Hi Sven, Thanks for reply.. but how will I get the stored value instead of indexed value.. where I need to configure to get stored instead of indexed value. please help... thanks with regards On Wed, Apr 14, 2010 at 3:16 PM, Sven Maurmann wrote: > Hi, > > please note that you get the stored value of the field as a result and > not the indexed one. > > Cheers, > Sven > > > --On Wednesday, April 14, 2010 02:54:52 PM +0530 Ranveer Kumar < > ranveer.s...@gmail.com> wrote: > > Hi all, >> >> I am facing problem to configure HTMLStripCharFilterFactory. >> following is the schema : >> > positionIncrementGap="100"> >> >> >> >>>ignoreCase="true" >>words="stopwords.txt" >>enablePositionIncrements="true" >>/> >>> generateWordParts="1" generateNumberParts="1" catenateWords="1" >> catenateNumbers="1" catenateAll="0" splitOnCaseChange="1"/> >> >>> language="English" protected="protwords.txt"/> >> >> >> >> >> >>> synonyms="synonyms.txt" ignoreCase="true" expand="true"/> >>>ignoreCase="true" >>words="stopwords.txt" >>enablePositionIncrements="true" >>/> >>> generateWordParts="1" generateNumberParts="1" catenateWords="0" >> catenateNumbers="0" catenateAll="0" splitOnCaseChange="1"/> >> >>> language="English" protected="protwords.txt"/> >> >> >> >> when I am checking with analysis.jsp it giving true result. But in >> my query result still I am getting html tage.. >> I am using solrj client.. >> >> please help me >> > > > > -- > kippdata informationstechnologie GmbH > Sven Maurmann Tel: 0228 98549 -12 > Bornheimer Str. 33a Fax: 0228 98549 -50 > D-53111 Bonnsven.maurm...@kippdata.de > > HRB 8018 Amtsgericht Bonn / USt.-IdNr. DE 196 457 417 > Geschäftsführer: Dr. Thomas Höfer, Rainer Jung, Sven Maurmann >
Facet count problem
Hi,
I am facing problem to get facet result count. I must be wrong somewhere.
I am getting proper result count when searching by single word, but when
searching by string then result count become wrong.
for example : -
search keyword : Bagdad bomb blast.
I am getting 5 result count for facet country. but when clicking on the
facet browser actual value is more then 5.
When searching by "bagdad" then result count is fine.
when using url to check the response for string
http://localhost:8080/solr/core0/select?q=bagdad bomb
blast&facet=on&facet.field=type&fq=type:news
it giving the result count 8 which is right.
I am using solrj client. following is my code:-
query.setFacet(true);
// query.addFacetQuery("type:"+)
query.addFacetField("type");
query.addFacetQuery(qq);
query.setFacetSort("index");
List listFacet = rsp.getFacetFields();
Iterator itr = listFacet.iterator();
log.info(listFacet.size());
for (int i = 0; i < listFacet.size(); i++) {
FacetField facetField = itr.next();
List fList = facetField.getValues();
if (fList == null) {
break;
}
log.info(fList.size());
Iterator flistItr = fList.iterator();
for (int j = 0; j < fList.size(); j++) {
FacetField.Count ff = flistItr.next();
labelValueBean = new LabelValueBean();
labelValueBean.setLabel(ff.getName());
labelValueBean.setValue(Long.toString(ff.getCount()));
log.info(ff.getName() + ":" + ff.getCount());
listLabelValueBean.add(labelValueBean);
}
}
please help..
thanks
with regards
Re: HTMLStripCharFilterFactory configuration problem
thanks.. Actually I am using SolrJ client.. Is there anyway to do same using solrj. thanks On Sat, Apr 17, 2010 at 8:06 PM, Ahmet Arslan wrote: > > > > Thanks for reply.. > > but how will I get the stored value instead of indexed > > value.. > > where I need to configure to get stored instead of indexed > > value. > > please help... > > > > You need to remove html tags before analysis (charfilter, tokenizer, > tokenfilter) phase. For example if you are using DIH to index, you can use > HTMLStripTransformer[1]. How are you indexing your data? > > [1]http://wiki.apache.org/solr/DataImportHandler#HTMLStripTransformer > > > >
Re: Facet count problem
I am.using text for type, which is static. For example: type is a field and I am using type for categorization. For news type I am using news and for blog using blog.. type is a text field. On Apr 17, 2010 8:38 PM, "Ahmet Arslan" wrote: > I am facing problem to get facet result count. I must be > wrong somewhere. > I am getting proper ... Are you faceting on a tokenized field? What is the fieldType of your field?
Re: Facet count problem
Hi Erick, My schema configuration is following. On Mon, Apr 19, 2010 at 6:22 AM, Erick Erickson wrote: > Can we see the actual field definitions from your schema file. > Ahmet's question is vital and is best answered if you'll > copy/paste the relevant configuration entries But based > on what you *have* posted, I'd guess you're trying to > facet on tokenized fields, which is not recommended. > > You might take a look at: > http://wiki.apache.org/solr/UsingMailingLists, it'll help you > frame your questions in a manner that gets you your > answers as fast as possibld. > > Best > Erick > > On Sun, Apr 18, 2010 at 12:59 PM, Ranveer Kumar >wrote: > > > I am.using text for type, which is static. For example: type is a field > and > > I am using type for categorization. For news type I am using news and for > > blog using blog.. type is a text field. > > > > On Apr 17, 2010 8:38 PM, "Ahmet Arslan" wrote: > > > > > I am facing problem to get facet result count. I must be > wrong > > somewhere. > I am getting proper ... > > Are you faceting on a tokenized field? What is the fieldType of your > field? > > >
dismax request Handler with OR operator
Hi,
Recently I change my search handler to dismax from standard. But I am facing
problem to get result by OR operator. I am getting AND operator result only.
I think somewhere I am missing configuration.
following is my configuration :
schema.xml : ---
solrconfig.xml:---
dismax
explicit
0.01
title^5.0 text^0.5
solrj :
query.setQueryType("dismax");
query.setQuery(qq);
//query.set("qf", "title^5.0+text^0.3");
query.setParam("qf", "title^20.0 + classification_name^5.0 + text^0.3");
please help..
thanks
require synonym filter on string field
Hi, I require to configure synonym to exact match. The field I need to search is string type. I tried to configure by the text but in text, due to whitespace tokenizer exact match not found. My requirement is : suppose user search by "solr user" and exact "solr user" (or equivalant synonym) are available then only return result.. my fieldType is "string" and I want to configure synonym on string field. or Is there any other way to index without tokenize (as it is) string and configure synonym for that field? please help..
