Re: Proximity(tilde) combined with wildcard, AutomatonQuery ?

2012-09-27 Thread Vadim Kisselmann
Hi Ahmet, thanks for your reply:) I see that it does not come with the 4.0 release, because the given patches do not work with this version. Right? Best regards Vadim 2012/9/26 Ahmet Arslan : > >> we assume i have a simple query like this with wildcard and >> tilde: >> >> "japa* fukushima"~10 >>

Re: Items disappearing from Solr index

2012-09-27 Thread Kissue Kissue
#What is the field type for that field - string or text? It is a string type. Thanks. On Wed, Sep 26, 2012 at 8:14 PM, Jack Krupansky wrote: > What is the field type for that field - string or text? > > > -- Jack Krupansky > > -Original Message- From: Kissue Kissue > Sent: Wednesday, Se

Re: How can I create about 100000 independent indexes in Solr?

2012-09-27 Thread Tanguy Moal
Hello Monton, I wanted to make sure that you understood me well : I really don't how well does solr scale if the number of fields increases... What I mean here is that the more distinct fields you index, the more memory you will need. So if in your schema, you have something like 15 fields decla

ExtractingRequestHandler causes Out of Memory Error

2012-09-27 Thread Shigeki Kobayashi
Hi guys, I use Manifold CF to crawl files in Windows file server and index them to Solr using Extracting Request Handler. Most of the documents are succesfully indexed but some are failed and Out of Memory Error occurs in Solr, so I need some advice. Those failed files are not so big and they ar

Re: How to retrive value from float field in custom request handler?

2012-09-27 Thread ravicv
Thanks guys.. I was able to retrieve all values now.. But why Solr Field is not having a method to retrieve values for all data types? something similar to Object obj = doc.getField("Field1"); Why only stringvalue is exposed in this Field class? doc.getField("Field1").stringValue() Thanks, r

Problem with Special Characters in SOLR Query

2012-09-27 Thread aniljayanti
Hi , Im using "text_general" fieldType for searching in SOLR. while searching keywords along with special characters not getting proper results and getting errors. used special characters like below. 1) - 2) & 3) + QUERY :: *solr?q=Healing - Live* *solr?q=Healing & Live* *solr?q=Healing ? Live

Re: Problem with Special Characters in SOLR Query

2012-09-27 Thread irshad siddiqui
Hi, Just escape all solr special char example: solr?q=Healing \& Live Regards, Irshad On Thu, Sep 27, 2012 at 3:55 PM, aniljayanti wrote: > Hi , > > Im using "text_general" fieldType for searching in SOLR. while searching > keywords along with special characters not getting proper results and

Re: Solr Replication and Autocommit

2012-09-27 Thread Erick Erickson
I'll echo Otis, nothing comes to mind... Unless you were indexing stuff to the _slaves_, which you should never do, now or in the past Erick On Thu, Sep 27, 2012 at 12:00 AM, Aleksey Vorona wrote: > Hi, > > I remember having some issues with replication and autocommit previously. > But now

Re: How can I create about 100000 independent indexes in Solr?

2012-09-27 Thread 韦震宇
Hi, Tanguy Oh, I understand now. I don't have the issue as you. Though there are so many customers in our site, but the fields they owned are same. so few field fields are ok in my scene. Best Regards! Monton - Original Message - From: "Tanguy Moal" To: Sent: Thursday, September 27,

httpSolrServer and exyternal load balancer

2012-09-27 Thread Lee Carroll
Hi We have the following solr http server The issue we face is the f5 balancer is returning a cookie which the client is hanging onto. resulting in the same slave being hit for all requests. one obvious solution is to config the load balancer to be non sticky however politically a "non-

Re: Items disappearing from Solr index

2012-09-27 Thread Erick Erickson
Wild shot in the dark What happens if you switch from StreamingUpdateSolrServer to HttpSolrServer? What I'm wondering is if somehow you're getting a queueing problem. If you have multiple threads defined for SUSS, it might be possible (and I'm guessing) that the delete bit is getting sent aft

Re: Problem with Special Characters in SOLR Query

2012-09-27 Thread aniljayanti
Hi, thanks, I tried with below query getting result. q=Cheat \- Album Version But getting error with below. q=Oot \& Aboot Error message : -- message org.apache.lucene.queryParser.ParseException: Cannot parse 'Oot \': Lexical error at line 1, column 6. Encountered: after : "" de

Re: httpSolrServer and exyternal load balancer

2012-09-27 Thread Erick Erickson
What client state? Solr servers are stateless, they don't keep any information specific to particular clients so this doesn't seem to be a problem. What Solr _does_ do is cache things like fq clauses, but these are not user-specific. Which actually argues for going to the same slave on the theory

Re: Problem with Special Characters in SOLR Query

2012-09-27 Thread Toke Eskildsen
On Thu, 2012-09-27 at 13:49 +0200, aniljayanti wrote: > But getting error with below. > > q=Oot \& Aboot > > Error message : > -- > message org.apache.lucene.queryParser.ParseException: Cannot parse 'Oot \': > Lexical error at line 1, column 6. Encountered: after : "" It seems like

Re: Problem with Special Characters in SOLR Query

2012-09-27 Thread Erick Erickson
Right, you're conflating two separate issues 1> URL escaping. the & is a special character in the URL, entirely separate from Solr. Try using %26 rather than \& 2> Query parsing. Once the string gets through the URL and servlet container, it's in query parsing land, where the escaping of

Re: httpSolrServer and exyternal load balancer

2012-09-27 Thread Lee Carroll
Hi Erick, the load balancer in front of the solr servers is dropping the cookie not the solr server themselves. are you saying the clients http connection manager builds will ignore this state ? it looks like they do not. It looks like the client is passing the cookie back to the load balancer I

Re: httpSolrServer and exyternal load balancer

2012-09-27 Thread Erick Erickson
But again, why do you want to do this? I really think you don't. I'm assuming that when you say this: "...resulting in the same slave being hit for all requests." you mean "all requests _from the same client_". If that's not what's happening, then disregard my maundering because when it comes to

Re: Items disappearing from Solr index

2012-09-27 Thread Kissue Kissue
Actually this problem occurs even when i am doing just deletes. I tested by sending only one delete query for a single catalogue and had the same problem. I always optimize once. I changed to the syntax you suggested ( {!term f=catalogueId}Emory Labs) and works like a charm. Thanks for the pointer

Query filtering

2012-09-27 Thread Finotti Simone
Hello, I'm doing this query to return top 10 facets within a given "context", specified via the fq parameter. http://solr/core/select?fq=(...)&q=*:*&rows=0&facet.field=interesting_facet&facet.limit=10 Now, I should search for a term inside the context AND the previously identified top 10 facet

Regarding delta-import and full-import

2012-09-27 Thread darshan
Hi All, Can anyone refer me few number blogs that explains both imports in little bit more detail and with examples. Thanks, Darshan

Re: Regarding delta-import and full-import

2012-09-27 Thread Koji Sekiguchi
(12/09/27 22:45), darshan wrote: Hi All, Can anyone refer me few number blogs that explains both imports in little bit more detail and with examples. Thanks, Darshan Asking Google, I got: http://www.arunchinnachamy.com/apache-solr-mysql-data-import/ http://www.andornot.

Re: httpSolrServer and exyternal load balancer

2012-09-27 Thread Lee Carroll
Hi Erick Our application has one CommonsHttpSolrServer for each solr core used by our web app. Whilst we have many web app clients solr only has 1 client, our application. Does that make sense. This is why sticky load balancing is an issue for us. I cannot see any where the state is being handle

Re: Query filtering

2012-09-27 Thread Amit Nithian
I think one way to do this is issue another query and set a bunch of filter queries to restrict "interesting_facet" to just those ten values returned in the first query. fq=interesting_facet:1 OR interesting_facet:2 etc&q=context: Does that help? Amit On Thu, Sep 27, 2012 at 6:33 AM, Finotti Sim

Re: Solr Replication and Autocommit

2012-09-27 Thread Aleksey Vorona
Thank both of you for the responses! -- Aleksey On 12-09-27 03:51 AM, Erick Erickson wrote: I'll echo Otis, nothing comes to mind... Unless you were indexing stuff to the _slaves_, which you should never do, now or in the past Erick On Thu, Sep 27, 2012 at 12:00 AM, Aleksey Vorona wrote

RE: SolrJ - IOException

2012-09-27 Thread balaji.gandhi
Thanks for your reply. SOLR Server is not stalled. Just the add fails with this exception. Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.

RE: SolrJ - IOException

2012-09-27 Thread balaji.gandhi
Here is the stack trace:- org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server: org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182) at org

How to run Solr Cloud using Tomcat?

2012-09-27 Thread Benjamin, Roy
I've gone through the guide on running Solr Cloud using Jetty but it's not practical to use JAVA_OPTS etc on real cloud deployments. I don't see how to extend these instructions to running on Tomcat. Has anyone run Solr Cloud under Tomcat successfully? Did they document how? Thanks Roy

RE: How to run Solr Cloud using Tomcat?

2012-09-27 Thread Markus Jelsma
Hi - on Debian systems there's a /etc/default/tomcat properties file you can use to set your flags. -Original message- > From:Benjamin, Roy > Sent: Thu 27-Sep-2012 19:57 > To: solr-user@lucene.apache.org > Subject: How to run Solr Cloud using Tomcat? > > I've gone through the guide on

Re: How to run Solr Cloud using Tomcat?

2012-09-27 Thread Vadim Kisselmann
Hi Roy, jepp, it works with Tomcat 6 and an external Zookeeper. I will publish a blogpost about it tomorrow on sentric.ch My blogpost is ready, but i had no time to publish it in the last couple of days:) Best regards Vadim 2012/9/27 Markus Jelsma : > Hi - on Debian systems there's a /etc/defaul

Re: httpSolrServer and exyternal load balancer

2012-09-27 Thread Erick Erickson
Ahh, I finally think I get it. I was missing the connection being the CommonsHttpSolrServer. That's the thing that's locking on to a particular slave I'm afraid I'm not up enough on the internals here to be much help, so I'll have to defer Erick. On Thu, Sep 27, 2012 at 10:20 AM, Lee Car

Re: Change config to use port 8080 instead of port 8983

2012-09-27 Thread Sami Siren
i just tried this with tomcat and the props work for me. Did you wipe out your zoo_data before starting with the additional system properties? here's how i ran it: JAVA_OPTS="-DzkRun -DnumShards=1 -Djetty.port=8080 -Dbootstrap_conf=true -Dhost=127.0.0.1" bin/catalina.sh run -- Sami Siren On

Re: 4.0.snapshot to 4.0.beta index migration

2012-09-27 Thread vybe3142
Thanks, that's what we decided to do too. -- View this message in context: http://lucene.472066.n3.nabble.com/4-0-snapshot-to-4-0-beta-index-migration-tp4009247p4010828.html Sent from the Solr - User mailing list archive at Nabble.com.

Can SOLR Index UTF-16 Text

2012-09-27 Thread vybe3142
Our SOLR setup (4.0.BETA on Tomcat 6) works as expected when indexing UTF-8 files. Recently, however, we noticed that it has issues with indexing certain text files eg. UTF-16 files. See attachment for an example (tarred+zipped) tesla-utf16.txt

Re: ExtractingRequestHandler causes Out of Memory Error

2012-09-27 Thread Lance Norskog
These are very large files and this is not enough memory. Do you upload these as files? If the CSV file is one document per line, you can split it up. Unix has a 'split' command which does this very nicely. - Original Message - | From: "Shigeki Kobayashi" | To: solr-user@lucene.apach

Re: ExtractingRequestHandler causes Out of Memory Error

2012-09-27 Thread Jan Høydahl
Please try to increase -Xmx and see how much RAM you need for it to succeed. I believe it is simply a case where this particular file needs double memory (480Mb) to parse and you have only allocated 1Gb (which is not particularly much). Perhaps the code could be optimized to avoid the Arrays.cop

Filter query not null or in list

2012-09-27 Thread Kiran J
Hi everyone, I have a group field which restricts the permission for each user. A user can belong to multiple groups. A document can belong to only Group (ie) non multi valued. There are some documents which are unrestricted, hence group id is null. How can I use the filter for a given user so tha

Re: Filter query not null or in list

2012-09-27 Thread Jack Krupansky
Add a "*:*" before the negative query. (*:* -Group:[* TO *]) OR Group:(X OR Y OR Z) -- Jack Krupansky -Original Message- From: Kiran J Sent: Thursday, September 27, 2012 8:07 PM To: solr-user@lucene.apache.org Subject: Filter query not null or in list Hi everyone, I have a group

RE: File content indexing

2012-09-27 Thread Zhang, Lisheng
Hi Erik, I really meant to send this message earlier, I read code and tested, your suggestion solved my problem, really appreciate! Thanks very much for helps, Lisheng -Original Message- From: Erik Hatcher [mailto:erik.hatc...@gmail.com] Sent: Tuesday, September 18, 2012 5:04 PM To: solr

Re: ExtractingRequestHandler causes Out of Memory Error

2012-09-27 Thread Shigeki Kobayashi
Hi Jan. Thank you very much for your advice. So I understand Solr needs more memory to parse the files. To parse a file of size x, it needs double memory (2x). Then how much memory allocation should be taken to heap size? 8x? 16x? Regards, Shigeki 2012/9/28 Jan Høydahl > Please try to incr

Re: Getting the distribution information of scores from query

2012-09-27 Thread Amit Nithian
Thanks! That did the trick! Although it required some more work in the component level of generating the same query key as the index searcher else when you go to try and fetch scores for a cached query result, I got a lot of NPE since the stats are computed in the collector level which for me isn't

Regarding delta-import and full-import

2012-09-27 Thread darshan
Hi All, Can anyone refer me few number blogs that explains both imports in little bit more detail and with examples. Thanks, Darshan

Merge Policy Recommendation for 3.6.1

2012-09-27 Thread Sujatha Arun
Hello, In the case where there are over 200+ cores on a single node , is it recommended to go with Tiered MP with segment size of 4 ? Our Index size vary from a few MB to 4 GB . Will there be any issue with "Too many open files " and the number of indexes with respect to MP ? At the moment we ar