Re: Master/Slave High CPU Usage

2010-11-21 Thread Lance Norskog
Yes, the Solr commit operations always reloads the index. And it
always throws away the Solr caches: queryresult, document, filter
query.

If you do this, please post your results.

On Sat, Nov 20, 2010 at 11:16 PM, Ofer Fort  wrote:
> OK,
> so to make sure i understand, even though the "slave" doesn't do any
> indexing, i will call commit and it will do nothing to the index itself, but
> will reload it?
> thanks
>
> On Sun, Nov 21, 2010 at 8:26 AM, Lance Norskog  wrote:
>
>> Ah! If the program doing the indexing has manual commits, the program
>> could send a commit to the slave. If the indexer uses automatic
>> commits, there is a trick: you can add a program as a postCommit event
>> in solrconfig.xml. This can just be a shell script or a curl command
>> that sends a commit to the slave Solr.
>>
>> Be sure to make all of the wait options false to this command; you
>> don't want the master to block while the slave loads up the new index.
>> Or, to control the maximum load on your server, you might actually
>> want to make the master wait while the slave loads up
>>
>> Lance
>>
>> On Sat, Nov 20, 2010 at 2:13 PM, Ofer Fort  wrote:
>> > thanks Erick,
>> > but my question was regard the configuration Lance suggested, a
>> > configuration where i have two servers, set set logical master and slave,
>> > not as a true replication. Since both are running on the same machine,
>> just
>> > have one only doing updates, and the other only queries, but both are
>> using
>> > the same index files.
>> >
>> > Ofer
>> >
>> >
>> > On Sat, Nov 20, 2010 at 8:52 PM, Erick Erickson > >wrote:
>> >
>> >> The slave polls. See: http://wiki.apache.org/solr/SolrReplication
>> >>
>> >> Best
>> >> Erick
>> >>
>> >> On Sat, Nov 20, 2010 at 1:13 PM, Ofer Fort  wrote:
>> >>
>> >> > Another question on that configuration, when the "master" commits, how
>> >> does
>> >> > the "slave" knows that the index has changed? Does it check the index
>> and
>> >> > finds out that it has a newer version?
>> >> > Thanks again for the help,
>> >> > Ofer
>> >> >
>> >> >
>> >> >
>> >> > ב-19 בנוב 2010, בשעה 05:30, Lance Norskog  כתב/ה:
>> >> >
>> >> > If they are on the same server, you do not need to replicate.
>> >> >
>> >> > If you only do queries, the query server can use the same index
>> >> > directory as the master. Works quite well. Both have to have the same
>> >> > LockPolicy in solrconfig.xml. For security reasons, I would run the
>> >> > query server as a different user who has read-only access to the
>> >> > index; that way it cannot touch the index.
>> >> >
>> >> > On Wed, Nov 17, 2010 at 11:28 PM, Ofer Fort 
>> wrote:
>> >> >
>> >> > anybody?
>> >> >
>> >> >
>> >> > On Wed, Nov 17, 2010 at 12:09 PM, Ofer Fort 
>> wrote:
>> >> >
>> >> >
>> >> > Hi, I'm working with Erez,
>> >> >
>> >> > we experienced this again, and this time the slave index folder didn't
>> >> > contain the index.XXX folder, only one index folder.
>> >> >
>> >> > if we shutdown the slave, the CPU on the master was normal, as soon as
>> we
>> >> > started the slave again, the CPU went up to 100% again.
>> >> >
>> >> > thanks for any help
>> >> >
>> >> > ofer
>> >> >
>> >> >
>> >> > On Wed, Nov 17, 2010 at 11:15 AM, Erez Zarum 
>> wrote:
>> >> >
>> >> >
>> >> > Hi all,
>> >> >
>> >> > We've been seeing this for the second time already.
>> >> >
>> >> > I have a solr (1.4.1) master and a slave. both are located on the same
>> >> > machine (16GB RAM, 4GB allocated to the slave and 3GB to the master)
>> >> >
>> >> > All our updates are going towards the master, and all the queries are
>> >> > towards the slave.
>> >> >
>> >> > Once in a while the slave gets OutOfMemoryError. This is not the big
>> >> > problem
>> >> > (i have a about 100M documents)
>> >> >
>> >> > The problem is that from that moment the CPU of the slave AND the
>> master
>> >> is
>> >> > almost 100%.
>> >> >
>> >> > If i shutdown the slave, the CPU of the master drops.
>> >> >
>> >> > If i start the slave again, the CPU is 100% again.
>> >> >
>> >> > I have the replication set on commit and startup.
>> >> >
>> >> > I see that in the data folder contains three index folders: index,
>> >> > index.XXXYYY and  index.XXXYYY.ZZZ
>> >> >
>> >> >
>> >> > The only way i was able to get pass it (worked two times already), is
>> to
>> >> > shutdown the two servers, and to copy all the index of the master to
>> the
>> >> > slave, and start them again.
>> >> >
>> >> > From that moment and on, they continue to work and replicate with a
>> very
>> >> > reasonable CPU usage.
>> >> >
>> >> >
>> >> > Our guess is that it failed to replicate due to the OOM and since then
>> >> > tries
>> >> > to do a full replication again and again?
>> >> >
>> >> > but why is the CPU of the master so high?
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> > Lance Norskog
>> >> > goks...@gmail.com
>> >> >
>> >>
>> >
>>
>>
>>
>> --
>> Lance Norskog
>> goks...@gmail.com
>>
>



-- 
Lance Norskog
goks...@gmail.com


Re: Master/Slave High CPU Usage

2010-11-21 Thread Ofer Fort
ok, i'll try that and update the group
thanks

On Sun, Nov 21, 2010 at 12:17 PM, Lance Norskog  wrote:

> Yes, the Solr commit operations always reloads the index. And it
> always throws away the Solr caches: queryresult, document, filter
> query.
>
> If you do this, please post your results.
>
> On Sat, Nov 20, 2010 at 11:16 PM, Ofer Fort  wrote:
> > OK,
> > so to make sure i understand, even though the "slave" doesn't do any
> > indexing, i will call commit and it will do nothing to the index itself,
> but
> > will reload it?
> > thanks
> >
> > On Sun, Nov 21, 2010 at 8:26 AM, Lance Norskog 
> wrote:
> >
> >> Ah! If the program doing the indexing has manual commits, the program
> >> could send a commit to the slave. If the indexer uses automatic
> >> commits, there is a trick: you can add a program as a postCommit event
> >> in solrconfig.xml. This can just be a shell script or a curl command
> >> that sends a commit to the slave Solr.
> >>
> >> Be sure to make all of the wait options false to this command; you
> >> don't want the master to block while the slave loads up the new index.
> >> Or, to control the maximum load on your server, you might actually
> >> want to make the master wait while the slave loads up
> >>
> >> Lance
> >>
> >> On Sat, Nov 20, 2010 at 2:13 PM, Ofer Fort  wrote:
> >> > thanks Erick,
> >> > but my question was regard the configuration Lance suggested, a
> >> > configuration where i have two servers, set set logical master and
> slave,
> >> > not as a true replication. Since both are running on the same machine,
> >> just
> >> > have one only doing updates, and the other only queries, but both are
> >> using
> >> > the same index files.
> >> >
> >> > Ofer
> >> >
> >> >
> >> > On Sat, Nov 20, 2010 at 8:52 PM, Erick Erickson <
> erickerick...@gmail.com
> >> >wrote:
> >> >
> >> >> The slave polls. See: http://wiki.apache.org/solr/SolrReplication
> >> >>
> >> >> Best
> >> >> Erick
> >> >>
> >> >> On Sat, Nov 20, 2010 at 1:13 PM, Ofer Fort 
> wrote:
> >> >>
> >> >> > Another question on that configuration, when the "master" commits,
> how
> >> >> does
> >> >> > the "slave" knows that the index has changed? Does it check the
> index
> >> and
> >> >> > finds out that it has a newer version?
> >> >> > Thanks again for the help,
> >> >> > Ofer
> >> >> >
> >> >> >
> >> >> >
> >> >> > ב-19 בנוב 2010, בשעה 05:30, Lance Norskog 
> כתב/ה:
> >> >> >
> >> >> > If they are on the same server, you do not need to replicate.
> >> >> >
> >> >> > If you only do queries, the query server can use the same index
> >> >> > directory as the master. Works quite well. Both have to have the
> same
> >> >> > LockPolicy in solrconfig.xml. For security reasons, I would run the
> >> >> > query server as a different user who has read-only access to the
> >> >> > index; that way it cannot touch the index.
> >> >> >
> >> >> > On Wed, Nov 17, 2010 at 11:28 PM, Ofer Fort 
> >> wrote:
> >> >> >
> >> >> > anybody?
> >> >> >
> >> >> >
> >> >> > On Wed, Nov 17, 2010 at 12:09 PM, Ofer Fort 
> >> wrote:
> >> >> >
> >> >> >
> >> >> > Hi, I'm working with Erez,
> >> >> >
> >> >> > we experienced this again, and this time the slave index folder
> didn't
> >> >> > contain the index.XXX folder, only one index folder.
> >> >> >
> >> >> > if we shutdown the slave, the CPU on the master was normal, as soon
> as
> >> we
> >> >> > started the slave again, the CPU went up to 100% again.
> >> >> >
> >> >> > thanks for any help
> >> >> >
> >> >> > ofer
> >> >> >
> >> >> >
> >> >> > On Wed, Nov 17, 2010 at 11:15 AM, Erez Zarum 
> >> wrote:
> >> >> >
> >> >> >
> >> >> > Hi all,
> >> >> >
> >> >> > We've been seeing this for the second time already.
> >> >> >
> >> >> > I have a solr (1.4.1) master and a slave. both are located on the
> same
> >> >> > machine (16GB RAM, 4GB allocated to the slave and 3GB to the
> master)
> >> >> >
> >> >> > All our updates are going towards the master, and all the queries
> are
> >> >> > towards the slave.
> >> >> >
> >> >> > Once in a while the slave gets OutOfMemoryError. This is not the
> big
> >> >> > problem
> >> >> > (i have a about 100M documents)
> >> >> >
> >> >> > The problem is that from that moment the CPU of the slave AND the
> >> master
> >> >> is
> >> >> > almost 100%.
> >> >> >
> >> >> > If i shutdown the slave, the CPU of the master drops.
> >> >> >
> >> >> > If i start the slave again, the CPU is 100% again.
> >> >> >
> >> >> > I have the replication set on commit and startup.
> >> >> >
> >> >> > I see that in the data folder contains three index folders: index,
> >> >> > index.XXXYYY and  index.XXXYYY.ZZZ
> >> >> >
> >> >> >
> >> >> > The only way i was able to get pass it (worked two times already),
> is
> >> to
> >> >> > shutdown the two servers, and to copy all the index of the master
> to
> >> the
> >> >> > slave, and start them again.
> >> >> >
> >> >> > From that moment and on, they continue to work and replicate with a
> >> very
> >> >> > reasonable CPU usage.
> >> >> >
> >> >> >

Re: Master/Slave High CPU Usage

2010-11-21 Thread Ofer Fort
do i really need a commit? or can i use the
*readercycle*script?
since i don't need to comit anything, just reopen the reader.
thanks

On Sun, Nov 21, 2010 at 12:17 PM, Lance Norskog  wrote:

> Yes, the Solr commit operations always reloads the index. And it
> always throws away the Solr caches: queryresult, document, filter
> query.
>
> If you do this, please post your results.
>
> On Sat, Nov 20, 2010 at 11:16 PM, Ofer Fort  wrote:
> > OK,
> > so to make sure i understand, even though the "slave" doesn't do any
> > indexing, i will call commit and it will do nothing to the index itself,
> but
> > will reload it?
> > thanks
> >
> > On Sun, Nov 21, 2010 at 8:26 AM, Lance Norskog 
> wrote:
> >
> >> Ah! If the program doing the indexing has manual commits, the program
> >> could send a commit to the slave. If the indexer uses automatic
> >> commits, there is a trick: you can add a program as a postCommit event
> >> in solrconfig.xml. This can just be a shell script or a curl command
> >> that sends a commit to the slave Solr.
> >>
> >> Be sure to make all of the wait options false to this command; you
> >> don't want the master to block while the slave loads up the new index.
> >> Or, to control the maximum load on your server, you might actually
> >> want to make the master wait while the slave loads up
> >>
> >> Lance
> >>
> >> On Sat, Nov 20, 2010 at 2:13 PM, Ofer Fort  wrote:
> >> > thanks Erick,
> >> > but my question was regard the configuration Lance suggested, a
> >> > configuration where i have two servers, set set logical master and
> slave,
> >> > not as a true replication. Since both are running on the same machine,
> >> just
> >> > have one only doing updates, and the other only queries, but both are
> >> using
> >> > the same index files.
> >> >
> >> > Ofer
> >> >
> >> >
> >> > On Sat, Nov 20, 2010 at 8:52 PM, Erick Erickson <
> erickerick...@gmail.com
> >> >wrote:
> >> >
> >> >> The slave polls. See: http://wiki.apache.org/solr/SolrReplication
> >> >>
> >> >> Best
> >> >> Erick
> >> >>
> >> >> On Sat, Nov 20, 2010 at 1:13 PM, Ofer Fort 
> wrote:
> >> >>
> >> >> > Another question on that configuration, when the "master" commits,
> how
> >> >> does
> >> >> > the "slave" knows that the index has changed? Does it check the
> index
> >> and
> >> >> > finds out that it has a newer version?
> >> >> > Thanks again for the help,
> >> >> > Ofer
> >> >> >
> >> >> >
> >> >> >
> >> >> > ב-19 בנוב 2010, בשעה 05:30, Lance Norskog 
> כתב/ה:
> >> >> >
> >> >> > If they are on the same server, you do not need to replicate.
> >> >> >
> >> >> > If you only do queries, the query server can use the same index
> >> >> > directory as the master. Works quite well. Both have to have the
> same
> >> >> > LockPolicy in solrconfig.xml. For security reasons, I would run the
> >> >> > query server as a different user who has read-only access to the
> >> >> > index; that way it cannot touch the index.
> >> >> >
> >> >> > On Wed, Nov 17, 2010 at 11:28 PM, Ofer Fort 
> >> wrote:
> >> >> >
> >> >> > anybody?
> >> >> >
> >> >> >
> >> >> > On Wed, Nov 17, 2010 at 12:09 PM, Ofer Fort 
> >> wrote:
> >> >> >
> >> >> >
> >> >> > Hi, I'm working with Erez,
> >> >> >
> >> >> > we experienced this again, and this time the slave index folder
> didn't
> >> >> > contain the index.XXX folder, only one index folder.
> >> >> >
> >> >> > if we shutdown the slave, the CPU on the master was normal, as soon
> as
> >> we
> >> >> > started the slave again, the CPU went up to 100% again.
> >> >> >
> >> >> > thanks for any help
> >> >> >
> >> >> > ofer
> >> >> >
> >> >> >
> >> >> > On Wed, Nov 17, 2010 at 11:15 AM, Erez Zarum 
> >> wrote:
> >> >> >
> >> >> >
> >> >> > Hi all,
> >> >> >
> >> >> > We've been seeing this for the second time already.
> >> >> >
> >> >> > I have a solr (1.4.1) master and a slave. both are located on the
> same
> >> >> > machine (16GB RAM, 4GB allocated to the slave and 3GB to the
> master)
> >> >> >
> >> >> > All our updates are going towards the master, and all the queries
> are
> >> >> > towards the slave.
> >> >> >
> >> >> > Once in a while the slave gets OutOfMemoryError. This is not the
> big
> >> >> > problem
> >> >> > (i have a about 100M documents)
> >> >> >
> >> >> > The problem is that from that moment the CPU of the slave AND the
> >> master
> >> >> is
> >> >> > almost 100%.
> >> >> >
> >> >> > If i shutdown the slave, the CPU of the master drops.
> >> >> >
> >> >> > If i start the slave again, the CPU is 100% again.
> >> >> >
> >> >> > I have the replication set on commit and startup.
> >> >> >
> >> >> > I see that in the data folder contains three index folders: index,
> >> >> > index.XXXYYY and  index.XXXYYY.ZZZ
> >> >> >
> >> >> >
> >> >> > The only way i was able to get pass it (worked two times already),
> is
> >> to
> >> >> > shutdown the two servers, and to copy all the index of the master
> to
> >> the
> >> >> > slave, and start them again.
> >> >> >
> >

Re: Spell-Check Component Functionality

2010-11-21 Thread rajini maski
If any one know articles or blog on solr spell-check component configuration
type..please let me know..solr-wiki not helping me solve maze..

On Fri, Nov 19, 2010 at 12:40 PM, rajini maski wrote:

> And If I am trying to do :
>
> http://localhost:8909/solr/select/?spellcheck.q=Curst&version=2.2&start=0&rows=10&indent=on&spellcheck=true
> &q=Curst&
>
> The XML OUTPUT IS
>
>  
> -
> 
>  
> -
> 
>0
>0
>  
> -
> 
>on
>0
>Curst
>Curst
>10
>2.2
>   
>   
>
>   
>
> No suggestion Tags also...
>
> If I am trying to do :
>
> http://localhost:8909/solr/select/?spellcheck.q=Curst&version=2.2&start=0&rows=10&indent=on&spellcheck=true
> &q=Crust&
>
> The XML OUTPUT IS
>
>  
> -
> 
>  
> -
> 
>0
>0
>  
> -
> 
>on
>0
>Crust
>Curst
>10
>2.2
>   
>   
>  
> -
> 
>  
> -
> 
>Crust
>   
>   
>   
>
> No suggestion Tags..
>
> What is the proper configuration for this? Is there any specific article
> written on spell check-solr  other then in solr-wiki page..I am not getting
> clear idea about this component in solr-wiki..
>
> Awaiting replies..
> Rajani Maski
>
>
> On Fri, Nov 19, 2010 at 11:32 AM, rajini maski wrote:
>
>> Hello Peter,
>> Thanks For reply :)I did spellcheck.q=Curst as you said ...Query
>> is like:
>>
>>
>> http://localhost:8909/solr/select/?spellcheck.q=Curst&version=2.2&start=0&rows=10&indent=on&spellcheck=true
>>
>>
>>
>> I am getting this error :(
>>
>> HTTP Status 500 - null java.lang.NullPointerException at
>> java.io.StringReader.(Unknown Source) at
>> org.apache.lucene.queryParser.QueryParser.parse(QueryParser.java:197) at
>> org.apache.solr.search.LuceneQParser.parse(LuceneQParserPlugin.java:78) at
>> org.apache.solr.search.QParser.getQuery(QParser.java:131) at
>> org.apache.solr.handler.component.QueryComponent.prepare(QueryComponent.java:89)
>> at
>> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:174)
>> at
>> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131)
>> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1316) at
>> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:338)
>> at
>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:241)
>> at
>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
>> at
>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>> at
>>
>>
>> What is the error mean ... ? what do I need to do for this.. Any mistake
>> in config?
>>
>> The config.xml and schema I have attached in the mail below FYI..Please
>> let me know if anyone know why is this error..
>>
>> Awaiting reply
>> Rajani Maski
>>
>>
>> On Thu, Nov 18, 2010 at 8:09 PM, Peter Karich  wrote:
>>
>>>  Hi Rajani,
>>>
>>> some notes:
>>>  * try spellcheck.q=curst or completely without spellcheck.q but with q
>>>  * compared to the normal q parameter spellcheck.q can have a different
>>> analyzer/tokenizer and is used if present
>>>  * do not do spellcheck.build=true for every request (creating the
>>> spellcheck index can be very expensive)
>>>  * if you got spellcheck working embed the spellcheck component into your
>>> normal query component. otherwise you need to query 2 times ...
>>>
>>> Regards,
>>> Peter.
>>>
>>>
>>> All,

 I am trying apply the Solr spell check component functionality to
 our
 data.

 The configuration set up I needed to make for it by updating config.xml
 and
 schema.xml is done as follows..
 Please let me know if any errors in it.

  I am not getting any suggestions in suggestion tags of solr output xml.

 I indexed word "Crust" to the field textSpell that is enabled for spell
 check and then I searched for
 "Curst"

 The queries i tried were :

 http://localhost:8909/solr/spell?q=Curst&spellcheck=true&spellcheck.collate=true&spellcheck.build=true&spellcheck.q=true


 http://localhost:8909/solr/spell?q=Cruste&spellcheck=true&spellcheck.collate=true&spellcheck.build=true&spellcheck.q=true&spellcheck.dictionar

Re: How to Transmit and Append Indexes

2010-11-21 Thread Renaud Delbru
 Have you looked at Apache Nutch [1]. It is a distributed web crawl and 
search system, based on Lucene/Solr and Hadoop.


[1] http://nutch.apache.org/
--
Renaud Delbru

On 19/11/10 16:52, Bing Li wrote:

Hi, all,

I am working on a distributed searching system. Now I have one server only.
It has to crawl pages from the Web, generate indexes locally and respond
users' queries. I think this is too busy for it to work smoothly.

I plan to use two servers at at least. The jobs to crawl pages and generate
indexes are done by one of them. After that, the new available indexes
should be transmitted to anther one which is responsible for responding
users' queries. From users' point of view, this system must be fast.
However, I don't know how I can get the additional indexes which I can
transmit. After transmission, how to append them to the old indexes? Does
the appending block searching?

Thanks so much for your help!

Bing Li





Amazon like search function

2010-11-21 Thread nicksnels

Hi,

I'm looking for ideas on how to implement an Amazon.com like search
function. If for example you do a search on - optimization algorithm java.
Amazon first returns results that contain all of these keywords, then
followed by a list that contains both the words "optimization algorithm",
then a list with books that contain the words "algorithm java" and finally a
list with books that contain both the words "optimization java". 

At the moment I'm using the solrQueryParser defaultOperator="OR" option, but
this returns to many results. I have tried to switch to the "AND" option but
that option returns to few results. So I would like to present the results
like Amazon does, so the user has some more options to choose from.

Kind regards,

Nick
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Amazon-like-search-function-tp1940223p1940223.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Amazon like search function

2010-11-21 Thread Erick Erickson
Take a look at DisMax, particularly the mm parameter
(minimum should match). It's kinda confusing, but I
it might help...

See: http://wiki.apache.org/solr/DisMaxQParserPlugin

I believe 3.x as well as trunk also have "Extended Dismax"
or eDismax that provides some additional capabilities.

Best
Erick

On Sun, Nov 21, 2010 at 9:08 AM, nicksnels  wrote:

>
> Hi,
>
> I'm looking for ideas on how to implement an Amazon.com like search
> function. If for example you do a search on - optimization algorithm java.
> Amazon first returns results that contain all of these keywords, then
> followed by a list that contains both the words "optimization algorithm",
> then a list with books that contain the words "algorithm java" and finally
> a
> list with books that contain both the words "optimization java".
>
> At the moment I'm using the solrQueryParser defaultOperator="OR" option,
> but
> this returns to many results. I have tried to switch to the "AND" option
> but
> that option returns to few results. So I would like to present the results
> like Amazon does, so the user has some more options to choose from.
>
> Kind regards,
>
> Nick
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Amazon-like-search-function-tp1940223p1940223.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>


Can a URL based datasource in DIH return non xml

2010-11-21 Thread lee carroll
Hi,

Can a URL based datasource in DIH return non xml. My pages being indexed are
writen by many authors and will
often be invalid xhtml. Can DIH cope with htis or will i need another
approach ?

thanks in advance Lee C


Re: sort desc and out of memory exception

2010-11-21 Thread xu cheng
thanks for replying

but when it's sort with asc, it runs pretty well
only if I sort with desc , it has the out o f memory exception

2010/11/17 Peter Karich 

>  You are applying the sort against a (tokenized) text field?
> You should better sort against a number or a string. Probably using the
> copyField directive.
>
> Regards,
> Peter.
>
>
>  hi all:
>>  I configure a solr application and there is a field of type text,and some
>> kind like this 123456, that is a string of number
>> and I wanna solr to sort the result on this field
>> however, when I use sort asc , it works perfectly ,and when I sort it with
>> desc, the application became unacceptablly slow
>> and finally , an OutOfMemoryException was throw.
>> does anyone have the same kind of problem?or any suggestions?
>>
>> thanks
>>
>>
>
> --
> http://jetwick.com twitter search prototype
>
>


Re: Issue with relevancy

2010-11-21 Thread sivaprasad

Thanks guys, I will try the mentioned options
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Issue-with-relevancy-tp1930292p1943645.html
Sent from the Solr - User mailing list archive at Nabble.com.


Phrase Search & Multiple Keywords with Double quotes

2010-11-21 Thread Pawan Darira
Hi

I want to do pharse searching with single/double quotes. Also there are
cases that those phrases include special characters like & etc.

What all i need to do while indexing such special characters & while
searching them. How to handle phrase search with quotes

Please suggest

-- 
Thanks,
Pawan Darira


RE: Phrase Search & Multiple Keywords with Double quotes

2010-11-21 Thread sivaprasad


You have to escape the special characters.Use the below method to escape
 
public static String escapeQueryChars(String s) {
   StringBuilder sb = new StringBuilder();
   for (int i = 0; i < s.length(); i++) {
 char c = s.charAt(i);
 // These characters are part of the query syntax and must be escaped
 if (c == '\\' || c == '+' || c == '-' || c == '!'  || c == '(' || c == ')' 
|| c == ':'
   || c == '^' || c == '[' || c == ']' || c == '\"' || c == '{' || c == '}' 
|| c == '~'
   || c == '*' || c == '?' || c == '|' || c == '&'  || c == ';'
   || Character.isWhitespace(c)) {
   sb.append('\\');
 }
 sb.append(c);
   }
   return sb.toString();
 }


-Original Message-
From: "pawan.darira [via Lucene]" 

Sent: Monday, November 22, 2010 12:39am
To: "sivaprasad" 
Subject: Phrase Search & Multiple Keywords with Double quotes

Hi 

I want to do pharse searching with single/double quotes. Also there are 
cases that those phrases include special characters like & etc. 

What all i need to do while indexing such special characters & while 
searching them. How to handle phrase search with quotes 

Please suggest 

-- 
Thanks, 
Pawan Darira 




View message @ 
[http://lucene.472066.n3.nabble.com/Phrase-Search-Multiple-Keywords-with-Double-quotes-tp1943780p1943780.html]
 
http://lucene.472066.n3.nabble.com/Phrase-Search-Multiple-Keywords-with-Double-quotes-tp1943780p1943780.html
To start a new topic under Solr - User, email 
ml-node+472068-1030716887-225...@n3.nabble.com 
To unsubscribe from Solr - User, 
[http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=472068&code=c2l2YXByYXNhZC5qQGVjaGlkbmFpbmMuY29tfDQ3MjA2OHwtMjAyODMzMTY4OQ==]
 click here.
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Phrase-Search-Multiple-Keywords-with-Double-quotes-tp1943780p1943793.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Spell-Check Component Functionality

2010-11-21 Thread Shanmugavel SRD

SOLR wiki page is the best place to find that.

http://stackoverflow.com/questions/3004823/solr-spellcheck-configuration
http://wiki.apache.org/solr/SpellCheckerRequestHandler
http://wiki.apache.org/solr/SpellCheckComponent
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Spell-Check-Component-Functionality-tp1923954p1944011.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Localsolr with Dismax

2010-11-21 Thread amvijaycse

Hi since u gave the priority to title .

so it always executed
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Localsolr-with-Dismax-tp1402956p1943980.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: solr dynamic core creation

2010-11-21 Thread samarth s
Hi nizan,

I have the same requirement of creating cores on the fly. Was looking
for some API provided by http solr server. Currently working around by
writing my own shell script on the server (solr server :) ). Any
better leads on the same?

Thanks,
Samarth

On Thu, Nov 11, 2010 at 9:27 PM, Robert Sandiford
 wrote:
>
> No - in reading what you just wrote, and what you originally wrote, I think
> the misunderstanding was mine, based on the architecture of my code.  In my
> code, it is our 'server' level that does the SolrJ indexing calls, but you
> meant 'server' to be the Solr instance, and what you mean by 'client' is
> what I was thinking of (without thinking) as the 'server'...
>
> Sorry about that.  Hopefully someone else can chime in on your specific
> issue...
> --
> View this message in context: 
> http://lucene.472066.n3.nabble.com/solr-dynamic-core-creation-tp1867705p1883354.html
> Sent from the Solr - User mailing list archive at Nabble.com.


Re: Problem with synonyms

2010-11-21 Thread sivaprasad

Hi,
This is looks like a bug.See the below url.

https://issues.apache.org/jira/browse/LUCENE-1622

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Problem-with-synonyms-tp1905051p1944183.html
Sent from the Solr - User mailing list archive at Nabble.com.