Re: Java heap space:out of memory

You were right the changes made in JAVA_OPTs didn't show increase in the heap size, I made changes in the UI of tomcat Initial pool memory : 512 MB Maximum pool memory : 1024 MB Now the heap size has increased. Thanks you all for your suggestions,it really saved my time. -- View this message i

Re: Getting Solr Document Attributes from a Custom Function

Hi Kydryavtsev Thanks a lot it works, but how do i pass a multivalued field values to a function query? Can it be passed as a String array? Thanks & Regards Mukund On Tue, Dec 10, 2013 at 12:05 PM, Kydryavtsev Andrey wrote: > You can implement it in this way: > Index number of cities as new

Re: Java heap space:out of memory

On 12/10/2013 11:47 PM, sweety wrote: > yes,i did put the space,as in the image Chances are good that wherever it was that you put the JAVA_OPTS is not being used by the servlet container that's running, or perhaps you never stopped and restarted the correct process. Thanks, Shawn

Re: Java heap space:out of memory

yes,i did put the space,as in the image -- View this message in context: http://lucene.472066.n3.nabble.com/Java-heap-space-out-of-memory-tp4105903p4106077.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Java heap space:out of memory

Hi,  Did you put a space between flags? -Xms1g -Xmx1g On Wednesday, December 11, 2013 7:09 AM, sweety wrote: I have set : JAVA_OPTS as  value: -Xms1024M-Xmx1024M But the dashboard still shows 64M,but now the usage is only 18% How could that be? yesterday it was 87%. -- View this message in

Re: Java heap space:out of memory

On 12/10/2013 10:09 PM, sweety wrote: > I have set : JAVA_OPTS as value: -Xms1024M-Xmx1024M > But the dashboard still shows 64M,but now the usage is only 18% > How could that be? yesterday it was 87%. Due to Java's garbage collection memory model, memory usage will vary. If "-Xms1024M-Xmx1024M"

Re: Java heap space:out of memory

I have set : JAVA_OPTS as value: -Xms1024M-Xmx1024M But the dashboard still shows 64M,but now the usage is only 18% How could that be? yesterday it was 87%. -- View this message in context: http://lucene.472066.n3.nabble.com/Java-heap-space-out-of-memory-tp4105903p4106069.html Sent from the S

Re: Solr with tomcat installation fails to respond on low load

Hi we are using solr 4.2 and tomcat version 6.0.36 And Now the server gives time outs daily in night One Addition is the server has 4 cpu and one cpu has a 100% utilization with memory to spare regards Rajat -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-with-tom

Re: Replacing Deprecated CachedSqlEntityProcessor with SqlEntityProcessor with a cacheImpl parameter

Hi; I suggest you to read this Jira issue: https://issues.apache.org/jira/browse/SOLR-2382 it makes clear why it is deprecated. Here is one thing about the issue: *Provide a means to temporarily cache a child Entity's data without needing to create a special cached implementation of the Entity Pr

Re: Call to Solr via TCP

Which is a precise description of what HTTP does. --wunder On Dec 10, 2013, at 4:00 PM, Bill Bell wrote: > Yeah open socket to port and send correct Get syntax and Solr will respond > with results... > > > > Bill Bell > Sent from mobile > > >> On Dec 10, 2013, at 2:50 PM, Doug Turnbull >

Re: Edismax and prefixlen for fuzzy queries

Hi; I've debugged edismax of Solr 4.5.1 and I see that line: *case FUZZY: return super.getFuzzyQuery(field, val, flt);* it calls that one: * // called from parser* * protected Query getFuzzyQuery(String field, String termStr, float minSimilarity) throws SyntaxError {* *termStr = analyzeIfM

Re: Call to Solr via TCP

Yeah open socket to port and send correct Get syntax and Solr will respond with results... Bill Bell Sent from mobile > On Dec 10, 2013, at 2:50 PM, Doug Turnbull > wrote: > > Zwer, is there a reason you need to do this? Its probably very hard to > get solr to speak TCP. But if you're havi

Re: Please help me to understand debugQuery output

Hi Amit; First of all, I suggest that you should read here: http://lucene.apache.org/core/4_6_0/core/org/apache/lucene/search/similarities/TFIDFSimilarity.html to understand the basics of score calculation of documents. Thanks; Furkan KAMACI 2013/11/26 GaneshSe > You might want to look at the

Re: SolrCloud unstable

Hi Martin; You can change your Java version from 1.6 to 1.7 u25 and test it again to see that whether it is related to version of Java. Thanks; Furkan KAMACI 2013/11/24 Lance Norskog > Yes, you should use a recent Java 7. Java 6 is end-of-life and no longer > supported by Oracle. Also, read u

Re: Is there any limit how many documents can be indexed by apache solr

Hi Kamal; You said that: "Recently I observed, after indexing around 11,000 documents, further documents are not getting indexed." How do you think that documents are not indexed? There may occur an error and indexing process may be break. Do you see any error at your log file? On the other hand h

Re: Query results in "no servers hosting shard: " with single sharded SolrCloud (with embedded ZK)

Hi Daniel; That's good to hear that I could help to solve your problem. Thanks; Furkan KAMACI 2013/12/11 Daniel Bryant > Ah! That's solved it - there were multiple missing (inactive) shards shown > in the Cloud panel. This is bizarre (as I'm specifying numShards=1 on the > JVM options), but d

Re: an "array" liked string is treated as multivalued when adding doc to solr

Hi Liu; Yes. it is an expected behavior. If you send data within square brackets Solr will behave it as a multivalued field. You can test it with this way: if you use Solrj and use a List for a field it will be considered as multivalued too because when you call toString() method of your List you

Re: Change Velocity Template Directory in Solr 4.6

Hi Olson, Even if you set -Dsolr.allow.unsafe.resourceloading=true, do you still get IOException("For security reasons, SolrResourceLoader cannot load..")? On Wednesday, December 11, 2013 12:17 AM, O. Olson wrote: Hi, Does anyone have a clue regarding this? Or would this question be more ap

Replacing Deprecated CachedSqlEntityProcessor with SqlEntityProcessor with a cacheImpl parameter

Hi,       I am looking to replace the Deprecated CachedSqlEntityProcessor with SqlEntityProcessor with a cacheImpl parameter but I cannot find documentation.    The Deprecated note at the top of http://lucene.apache.org/solr/3_6_0/org/apache/solr/handler/dataimport/CachedSqlEntityProcess

Re: Query results in "no servers hosting shard: " with single sharded SolrCloud (with embedded ZK)

Ah! That's solved it - there were multiple missing (inactive) shards shown in the Cloud panel. This is bizarre (as I'm specifying numShards=1 on the JVM options), but deleting my zoo_data folder under the solr directory, and then restarting SolrCloud resulted in queries returning correct values

Re: pool-1-thread-4" java.lang.NoSuchMethodError: org.apache.solr.util.SimplePostTool

Hi; Are you sure that post.jar is at classpath and everytink is OK? By the way how do you post your documents into Solr, are you using SimplePostTool class within another java class of your project? Thanks; Furkan KAMACI 2013/12/6 Vineet Mishra > pool-1-thread-4" java.lang.NoSuchMethodError:

Re: Solr with tomcat installation fails to respond on low load

Which version of Solr you are using? 2013/12/9 shinkanze > Hi All, > > I am having a problem with one of my *Slave solr* servers . > My solr server fails to respond to *queries every alternate night* > although > it is able to answer 3-4 times queries in day . Queries takes very large > time

Re: Change Velocity Template Directory in Solr 4.6

Hi, Does anyone have a clue regarding this? Or would this question be more appropriate on the Solr-Dev? After posting this I realized that the template directory needs to be named "velocity" even if you place it under /core/conf/. This seems to be too restrictive. O. O. -- View this message

Re: highlight feature is not working on "string" field type- Apache Solr

Hi; When you examine Solr example folder you can see that highlighting feature works for String field. Here is the definition for cat field that is a type of String: if you run that from your browser: http://localhost:8983/solr/collection1/select?q=cat:*%20AND%20name:samsung&hl=true&hl.fl=* Y

Edismax and prefixlen for fuzzy queries

Does edismax query parser support prefixlen (length of common (non-fuzzy) prefix)? Thanks

Re: Use of Deprecated Classes: SortableIntField SortableFloatField SortableDoubleField

Thank you kydryavtsev andrey. Wow this reference guide at https://cwiki.apache.org/confluence/display/solr/Apache+Solr+Reference+Guid is a lot more detailed than the official Solr Wiki at http://wiki.apache.org/solr/. May be those responsible for Solr should link to it. Thank you for confirming

Re: Rebalancing a SolrCloud index after adding new nodes

Interesting, thanks for the response. Let's saying I wanted to use SPLITSHARD to balance my index. Once I call it, the original shard has been split into 2 subshards that are both then on the same machine. Can I then somehow move one of the shards to my new server? This would allow me to balanc

RE: Call to Solr via TCP

Zwer, is there a reason you need to do this? Its probably very hard to get solr to speak TCP. But if you're having a performance or infrastructure problem, the group might be able to help you with a far simpler solution. Sent from my Windows Phone From: Zwer Sent: 12/10/2013 12:15 PM To: solr-user

Re: Call to Solr via TCP

Zwer, I think it may be a bit dangerous as jetty may start to do some connection management and expect the client to do so. However, if you look into http/1.0 you have a little chance that doing simple http calls is as simple as socket connections. What could be the reason not to use a decent h

Re: Query results in "no servers hosting shard: " with single sharded SolrCloud (with embedded ZK)

Hi Daniel; Could you open the Solr admin page and check it? If there is no error message click on the Cloud link at left panel check the status of your node? Thanks; Furkan KAMACI 10 Aralık 2013 Salı tarihinde Daniel Bryant adlı kullanıcı şöyle yazdı: > Hi, > > I'm getting the error 'msg: "no s

Re: Call to Solr via TCP

I think it is not possible since Jetty is a HTTP server except jetty is extensible to support other protocol, that is not a derivation of HTTP (it supports SPDY, WebSocket). However, what we do, is putting another layer on top of Solr. Our client does not directly connect to our Solr, but through

Re: Configurable collectors for custom ranking

Quick question: In the context of a custom collector, how does one get the values of a field of type 'ExternalFileField'? Thanks, Peter On Tue, Dec 10, 2013 at 1:18 PM, Peter Keegan wrote: > Hi Joel, > > This is related to another thread on function query matching ( > http://lucene.472066.n3.na

Re: Newbie to SOLR with ridiculously simple questions

Alex, Yeah im getting too complicated... I have a VMWARE instance with SOLR running I have an Amazon instance with SOLR running I have a Rails Installer with SOLR and Blacklight running on windows (localhost:8983) I have a Binami Windows SOLR installed (localhost:8984) i just downloaded the windo

Query results in "no servers hosting shard: " with single sharded SolrCloud (with embedded ZK)

Hi, I'm getting the error 'msg: "no servers hosting shard: " ' when trying to search on a freshly created SolrCloud instance with an embedded ZooKeeper and a single shard? My solr.xml is as follows: shard="1"/> And all the directories referenced i

Re: Rebalancing a SolrCloud index after adding new nodes

On 12/10/2013 12:02 PM, cwhi wrote: > I'm wondering if there is an automated way to rebalance a solr collection > once a new node is added, so the maximum size of a single shard is > decreased. I was pointed to this document > which

Re: Searching for document by id in a sharded environment

Thanks for your replies Ahmet and Joel! We have now determined that the exclamation point wasn't the issues, and our query actually had too many boolean expressions in (more than the default 1024). Apologies for any confusion this may have caused - the issue went around my team like the chil

Re: Java heap space:out of memory

On 12/10/2013 11:26 AM, sweety wrote: > okay thanks, > here it is: > max heap size : 63.56MB(it is howing 37.2% usage though) > How to increase that size?? 64MB is an extremely small heap size. Chances are good that because you are running on Windows 7, Java is in client mode, especially if the J

Re: Java heap space:out of memory

On 10 December 2013 23:39, Shawn Heisey wrote: > On 12/10/2013 11:05 AM, sweety wrote: >> sorry but i dont know how to check that? > > On the Solr admin UI dashboard, one of the numbers is JVM-Memory. There > are three numbers below that. This is great advice, and something that I had forgotten.

Rebalancing a SolrCloud index after adding new nodes

I'm wondering if there is an automated way to rebalance a solr collection once a new node is added, so the maximum size of a single shard is decreased. I was pointed to this document which seems to imply such functionality exists, b

Re: Java heap space:out of memory

okay thanks, here it is: max heap size : 63.56MB(it is howing 37.2% usage though) How to increase that size?? -- View this message in context: http://lucene.472066.n3.nabble.com/Java-heap-space-out-of-memory-tp4105903p4105952.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Configurable collectors for custom ranking

Hi Joel, This is related to another thread on function query matching ( http://lucene.472066.n3.nabble.com/Function-query-matching-td4099807.html#a4105513). The patch in SOLR-4465 will allow me to extend TopDocsCollector and perform the 'scale' function on only the documents matching the main dism

Re: Java heap space:out of memory

On 12/10/2013 11:05 AM, sweety wrote: > sorry but i dont know how to check that? On the Solr admin UI dashboard, one of the numbers is JVM-Memory. There are three numbers below that. Those numbers are (from left to right and top to bottom) currently used heap, current heap size, and max heap siz

Re: Java heap space:out of memory

sorry but i dont know how to check that? -- View this message in context: http://lucene.472066.n3.nabble.com/Java-heap-space-out-of-memory-tp4105903p4105947.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Global query parameters to facet query

: when disabling the facet, the query works perfectly. I understand that : either defType parameter or q.myalias.qf parameters, do not affect the : facet query (which always runs with lucene parser??) a top level defType param only applies to the "q" param. This is by design. "defType" is sp

Re: Solr hardware memory question

Shawn's right that if you're going to scale this big you'd be very well served to spend time getting the index as small as possible. In my experience if your searches require real-time random access reads (that is, the entire index needs to be fast), you don't want to wait for HDD disk reads. Get

RE: Solr hardware memory question

Thanks Shawn. You're absolutely right about the performance balance, though it's good to hear it from an experienced source (if you don't mind me calling you that!) Fortunately we don't have a top performance requirement, and we have a small audience so a low query volume. On similar systems we're

Re: Solr hardware memory question

On 12/10/2013 9:51 AM, Hoggarth, Gil wrote: > We're probably going to be building a Solr service to handle a dataset > of ~60TB, which for our data and schema typically gives a Solr index > size of 1/10th - i.e., 6TB. Given there's a general rule about the > amount of hardware memory required shoul

Re: Call to Solr via TCP

Maybe I asked incorrectly. Solr is Web Application, hosted by some servlet container and is reachable via HTTP. HTTP is an extension of TCP and I would like to know whether exists some lower way to communicate with application (i.e. Solr) hosted by Jetty? -- View this message in context: htt

Re: Java heap space:out of memory

On 10 December 2013 22:25, sweety wrote: > > 4gb ram. > I m running on Windows 7,with Tomcat as webserver. As Michael asked, how much of this memory is made available to Solr? Regards, Gora

HDS - free tomcat based solr distro

We've created a Solr distribution called HDS (Heliosearch Distribution for Solr) as the basis for our support + bug-backport subscriptions (but you can use it without one). Since it's both open source and free to use, I figured it would be of general interest here, especially for Tomcat fans. Some

Re: Call to Solr via TCP

: I am hosting Solr in Jetty servlet container and just would like to know : whether exists some way to communicate with Solr through TCP protocol, not : HTTP? HTTP ites on top of TCP, so your question doens't really make much sense to me. Please elaborate on your specific goal/problem, because

Call to Solr via TCP

Hi Guys, I am hosting Solr in Jetty servlet container and just would like to know whether exists some way to communicate with Solr through TCP protocol, not HTTP? Thanks for the responses. -- View this message in context: http://lucene.472066.n3.nabble.com/Call-to-Solr-via-TCP-tp4105932.html

Re: Java heap space:out of memory

4gb ram. I m running on Windows 7,with Tomcat as webserver. -- View this message in context: http://lucene.472066.n3.nabble.com/Java-heap-space-out-of-memory-tp4105903p4105929.html Sent from the Solr - User mailing list archive at Nabble.com.

Solr hardware memory question

We're probably going to be building a Solr service to handle a dataset of ~60TB, which for our data and schema typically gives a Solr index size of 1/10th - i.e., 6TB. Given there's a general rule about the amount of hardware memory required should exceed the size of the Solr index (exceed to also

Re: Java heap space:out of memory

I'm not sure how you're running Solr, but generally if you're using the Java command line to launch Jetty, you do something like this: java -Xmx512m -jar start.jar That would give you a half-gigabyte heap. Are you running this on a machine with low overall RAM, or low available RAM? Michael Del

Java heap space:out of memory

I just indexed 10 doc of total 15mb.For some queries it works fine but, for some queries i get this error: java.lang.OutOfMemoryError: Java heap space java.lang.RuntimeException: java.lang.OutOfMemoryError: Java heap space at org.apache.solr.servlet.SolrDispatchFilter.sendError(SolrDispatchFilt

DIH doucments not indexed because of loss in xsl transformation.

Hello I'm indexing xml files with xpathEntityProcessor, and for some hundreads documents on 12 millions are not processed. When I tried to index only one of the KO documents it doesn't either index. So it's not a matter of big number of documents. We tried to do the xslt transformation external

Re: SOLR 4 - Query Issue in Common Grams with Surround Query Parser

Hi Salman, I personally do not perform stopword removal. So are you saying CommonGramsFilter is not useful without CommonGramsFilterQueryFilter? If yes, do you want to add a comment to confluence explaining this? https://cwiki.apache.org/confluence/display/solr/Filter+Descriptions#FilterDescri

Re: SOLR 4 - Query Issue in Common Grams with Surround Query Parser

Thanks!! Using CommonGramsQueryFilter resolved the issue. This was not there in 1.4.1 and also for some reason was not there in SOLR 4 Release Notes that we studied before upgrading. On Tue, Dec 10, 2013 at 9:55 AM, Ahmet Arslan wrote: > Hi Salman, > > I never used commons gram filer but I rem

Filter suggester with fq=...

Hi, I'm searching for a way to filter results from the suggester component. I found this http://wiki.apache.org/solr/SpellCheckComponent#spellcheck.collate where it says, you can filter your results with the fq parameter. Unfortunately, this doesn't work. If i turn on collations, apply some fq par

Re: Indexing on plain text and binary data in a single HTTP POST request

I would index all attachments separately, but with some sort of reference back to the mail message. That way, I could use the update handler for the text and metadata of the mail message, and the the update/extract handler for the binary attachment(s) and a restricted set of metadata (file name, co