Solr from scratch in 3 lines

2012-09-03 Thread Michael Guymon
Hello Solrian, I put together a JRuby gem that will setup and run a Solr instance: gem install solr_sail solrsail install solrsail start There is a copy of the Solr config with the gem that gets extracted and Jar dependences are downloaded with the install step. An embedded Jetty server is u

Re: Solr4 distributed IDF

2012-09-03 Thread Toke Eskildsen
On Fri, 2012-08-31 at 02:25 +0200, Lance Norskog wrote: > The math for "confidence values" in probability theory shows that > distributed DF does not matter after not very many documents. If you > have 10s of thousands of documents in each shard, don't worry. The old advice of distributing the doc

Re: Antwort: Re: Antwort: Re: Query during a query

2012-09-03 Thread Chantal Ackermann
Hi Johannes, on production, SOLR is better a backend service to your actual web application: Client (Browser) <---> Web App <---> Solr Server Very much like a database. The processes are implemented in your Web App, and when they require results from Solr for whatever reason they simply query i

RES: Solr Not releasing memory

2012-09-03 Thread Claudio Ranieri
Are you using MMapDirectoryFactory? I had swap problem in linux to a big index when I used MMapDirectoryFactory. You can to try use solr.NIOFSDirectoryFactory. -Mensagem original- De: Lance Norskog [mailto:goks...@gmail.com] Enviada em: domingo, 2 de setembro de 2012 22:00 Para: solr-us

Re: Solr4 distributed IDF

2012-09-03 Thread veena rani
Hi, I have an issue with the # symbol, in solr, I m trying to search for string ends up with # , Eg:c#, it is throwing error Like, org.apache.lucene.queryparser.classic.ParseException: Cannot parse '(techskill:c': Encountered "" at line 1, column 12. Was expecting one of: ... ... ..

RE: Solr Not releasing memory

2012-09-03 Thread Rohit
HI Lance, Thanks for explaining this, it does push out all other programs. Regards, Rohit Mobile: +91-9901768202 -Original Message- From: Lance Norskog [mailto:goks...@gmail.com] Sent: 03 September 2012 01:00 To: solr-user@lucene.apache.org Subject: Re: Solr Not releasing memory 1) I

Re: Solr4 distributed IDF

2012-09-03 Thread Erick Erickson
When starting a new discussion on a mailing list, please do not reply to an existing message, instead start a fresh email. Even if you change the subject line of your email, other mail headers still track which thread you replied to and your question is "hidden" in that thread and gets less attent

Is there any special meaning for # symbol in solr.

2012-09-03 Thread veena rani
Hi, > > I have an issue with the # symbol, in solr, > I m trying to search for string ends up with # , Eg:c#, it is throwing > error Like, org.apache.lucene.queryparser.classic.ParseException: Cannot > parse '(techskill:c': Encountered "" at line 1, column 12. > Was expecting one of: >

Re: Antwort: Re: Antwort: Re: Query during a query

2012-09-03 Thread Erick Erickson
If you don't do what Chantal indicates, you allow your users to issue requests like: http://localhost:8983/solr/update?stream.body=*:* Followed by: http://localhost:8983/solr/update?stream.body= Presto! You have an index with zero documents. Best Erick On Mon, Sep 3, 2012 at 4:52 AM, Chant

RE: Solr Not releasing memory

2012-09-03 Thread Rohit
I am currently using StandardDirectoryFactory, would switching directory factory have any impact on the indexes? Regards, Rohit -Original Message- From: Claudio Ranieri [mailto:claudio.rani...@estadao.com] Sent: 03 September 2012 10:03 To: solr-user@lucene.apache.org Subject: RES: Sol

Re: Is there any special meaning for # symbol in solr.

2012-09-03 Thread Toke Eskildsen
On Mon, 2012-09-03 at 13:39 +0200, veena rani wrote: > > I have an issue with the # symbol, in solr, > > I m trying to search for string ends up with # , Eg:c#, it is throwing > > error Like, org.apache.lucene.queryparser.classic.ParseException: Cannot > > parse '(techskill:c': Encountered "" a

Missing Features - AndMaybe and Otherwise

2012-09-03 Thread Ramzi Alqrainy
Hi, I would like to help me for certain problem. I have encountered a problem in task I think if you implement the below functions/conditions, you will help us for many issues. *AndMaybe(a, b)* Binary query takes results from the first query. If and only if the same document also appears in the

RE: Solr Not releasing memory

2012-09-03 Thread Mikhail Khludnev
Rohit, Which collector do you use? Releasing physical ram is possible with compacting collectors like serial, parallel and maybe g1 and not possible with cms. The more important thing that releasing is really suspicious and even odd requrement. Please provide more details about your jvm and overall

Re: Faceting Facets

2012-09-03 Thread Alexey Serba
http://wiki.apache.org/solr/SimpleFacetParameters#Pivot_.28ie_Decision_Tree.29_Faceting On Mon, Sep 3, 2012 at 6:38 PM, Dotan Cohen wrote: > Is there any way to nest facet searches in Solr? Specifically, I have > a User field and a DateTime field. I need to know how many Documents > match each Us

RE: Solr Not releasing memory

2012-09-03 Thread Markus Jelsma
It would be helpful yo know which memory isn't being released. Is it virtual or physical or shared memory? Is it the heap space? -Original message- > From:Mikhail Khludnev > Sent: Mon 03-Sep-2012 16:52 > To: solr-user@lucene.apache.org > Subject: RE: Solr Not releasing memory > > Roh

Re: Faceting Facets

2012-09-03 Thread Tanguy Moal
I think it's not possible to combine pivots with facet queries, nor with facet ranges (or facet dates), please someone correct me if I'm wrong... I think only "standard" fields are "pivotable" :) That said, if you always use the same ranges for your DateTime field, you *could* have a "string" ver

Re: Faceting Facets

2012-09-03 Thread Dotan Cohen
On Mon, Sep 3, 2012 at 5:50 PM, Alexey Serba wrote: > http://wiki.apache.org/solr/SimpleFacetParameters#Pivot_.28ie_Decision_Tree.29_Faceting > Thank you, that does seem to be only available on Solr 4.0. Luckily, we're using Websolr so upgrading is rather easy! Thanks! -- Dotan Cohen http://g

Re: Faceting Facets

2012-09-03 Thread Dotan Cohen
On Mon, Sep 3, 2012 at 6:07 PM, Tanguy Moal wrote: > I think it's not possible to combine pivots with facet queries, nor with > facet ranges (or facet dates), please someone correct me if I'm wrong... > > I think only "standard" fields are "pivotable" :) > > That said, if you always use the same r

Solr New Version causes NIO Closed Channel Exception

2012-09-03 Thread Pavitar Singh
Hi, We are facing this problem repeatedly and it goes away on restarts. [#|2012-09-01T12:07:06.947+|SEVERE|glassfish3.1|org.apache.solr.core.SolrCore|_ThreadID=712;_ThreadName=Thread-2;|java.nio.channels.ClosedChannelException at sun.nio.ch.FileChannelImpl.ensureOpen(FileChannelImpl.java:

Re: Query-side Join work in distributed Solr?

2012-09-03 Thread Pavel Goncharik
That's correct, but according to the comments to the issue SOLR-2066, "counts returned when using field collapse are only accurate when the documents getting collapsed together are all on the same shard" (it's actually a quote from SOLR-2592). Which sounds like SOLR-2592 will make distributed field

Re: Solr New Version causes NIO Closed Channel Exception

2012-09-03 Thread Mikhail Khludnev
Hi Does mmap directory works for you? 03.09.2012 19:20 пользователь "Pavitar Singh" написал: > Hi, > > We are facing this problem repeatedly and it goes away on restarts. > > > [#|2012-09-01T12:07:06.947+|SEVERE|glassfish3.1|org.apache.solr.core.SolrCore|_ThreadID=712;_ThreadName=Thread-2;|ja

RE: Solr Not releasing memory

2012-09-03 Thread Rohit
I am taking of Physical memory here, we start at -Xms of 2gb but very soon it goes high as 45Gb. The memory never comes down even when a single user is not using the system. Regards, Rohit -Original Message- From: Markus Jelsma [mailto:markus.jel...@openindex.io] Sent: 03 September 20

RE: Solr Not releasing memory

2012-09-03 Thread Markus Jelsma
You've got more than 45GB of physical RAM in your machine? I assume it's actually virtual memory you're seeing, which is not a problem, even on Windows. It's not uncommon for resident memory to be higher than the allocated heap space and it's normal to have a high virtual memory address space if

RE: Solr Not releasing memory

2012-09-03 Thread Mikhail Khludnev
Rohit, Why do you think it should free it during idle time? Let us what numbers you are actually watching. Check this it can be intetesting blog.thetaphi.de/2012/07/use-lucenes-mmapdirectory-on-64bit.html 04.09.2012 0:45 пользователь "Markus Jelsma" написал: > You've got more than 45GB of physic

Re: Missing Features - AndMaybe and Otherwise

2012-09-03 Thread Lance Norskog
> AndMaybe(a, b)* Lucene does not really have booleans. Instead, it has plus, minus, and neither. Plus means "this term has to be in", minus means "this term cannot be in" and neither means "maybe". This means "A has to be in the document, and the document scores higher if B is in it": "+A B".

Re: Is there any special meaning for # symbol in solr.

2012-09-03 Thread veena rani
if i use this link ,http://localhost:8080/solr/select?&q=(techskill%3Ac%23) , solr is going to display techskill:c result. But i want to display only techskill:c# result. On Mon, Sep 3, 2012 at 7:23 PM, Toke Eskildsen wrote: > On Mon, 2012-09-03 at 13:39 +0200, veena rani wrote: > > > I have a

Searching of Chinese characters and English

2012-09-03 Thread waynelam
Hi all, I tried to modified the schema.xml and solrconfig.xml come with Drupal "search_api_solr" modules. I tried to modified it so that it is suitable for an CJK environment. I can see Chinese words cut up each 2 words in "Field Analysis". If i use the following query my_ip_address:8080/sol

Re: AW: AW: auto completion search with solr using NGrams in SOLR

2012-09-03 Thread aniljayanti
Hi, thanks, Im not able to attach asked xml files here. Can u give me ur Email id, so that i can send schema and solrconfig.xmls. Regards, AnilJayanti -- View this message in context: http://lucene.472066.n3.nabble.com/auto-completion-search-with-solr-using-NGrams-in-SOLR-tp3998559p4005141.h

BaseTokenFilterFactory is missing in Solr 4.0?

2012-09-03 Thread deniz
well as the title says... I couldnt find it in any jars while I was following the tutorial here: http://solr.pl/en/2012/05/14/developing-your-own-solr-filter/ i thought something was wrong with my env so i was trying to find which jar includes that class but search on grepcode only shows 3.6.0 h

Re: BaseTokenFilterFactory is missing in Solr 4.0?

2012-09-03 Thread deniz
seems like it became this : org.apache.lucene.analysis.util.TokenFilterFactory can anyone confirm if i am correct? still not totally sure - Zeki ama calismiyor... Calissa yapar... -- View this message in context: http://lucene.472066.n3.nabble.com/BaseTokenFilterFactory-is-missing-in-Solr-

Re: BaseTokenFilterFactory is missing in Solr 4.0?

2012-09-03 Thread Ahmet Arslan
> seems like it became this : > org.apache.lucene.analysis.util.TokenFilterFactory > > can anyone confirm if i am correct? still not totally sure Yes it is.

Re: Is there any special meaning for # symbol in solr.

2012-09-03 Thread Ahmet Arslan
> if i use this link ,http://localhost:8080/solr/select?&q=(techskill%3Ac%23) > , solr is going to display techskill:c result. > But i want to display only techskill:c#  result. Can you paste field type definition (used for techskill)? By the way you don't need parenthesis, you q should be url en