uniquekey generation in solr
hi all, We are generating unique key(signaturefield) for solr based six unique fields from DB. The generated uniquekey is different in solr , when run through dataimport handler and updaterequesthandler for the same document though we are calling the same update.chain for both. So can any one please explain this behaviour. Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/uniquekey-generation-in-solr-tp4106766.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: uniquekey generation in solr
one of the field used in unique key generation is in date format and other are in string format. So when we remove this date field ,it is working fine. -- View this message in context: http://lucene.472066.n3.nabble.com/uniquekey-generation-in-solr-tp4106766p4106919.html Sent from the Solr - User mailing list archive at Nabble.com.
Invalid version (expected 2, but 60) or the data in not in 'javabin' format exception while deleting 30k records
Hi, We are getting the below error message while trying to delete 30k records from solr. Error occured while invoking endpoint on Solr: org.apache.solr.client.solrj.SolrServerException: Error executing query at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:98) at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:36) at com.ntrs.wpf.search.batch.BatchProcessorImpl.run(BatchProcessorImpl.java:57) at com.ntrs.wpf.search.batch.SolrIndexingController.purgePositions(SolrIndexingController.java:235) at com.ntrs.wpf.search.batch.SolrIndexingController.execute(SolrIndexingController.java:106) at com.ntrs.wpf.search.batch.BatchFrameworkManager.main(BatchFrameworkManager.java:63) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.eclipse.jdt.internal.jarinjarloader.JarRsrcLoader.main(JarRsrcLoader.java:56) Caused by: java.lang.RuntimeException: Invalid version (expected 2, but 60) or the data in not in 'javabin' format at org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:109) at org.apache.solr.client.solrj.impl.BinaryResponseParser.processResponse(BinaryResponseParser.java:41) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:387) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181) at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90) ... 10 more we are forming the delete query as below. (Account:123+AND+DATE:["2013-11-29T00:00:00Z"+TO+"2013-11-29T23:59:59Z"])+OR+ (Account:345+AND+DATE:["2013-11-29T00:00:00Z"+TO+"2013-11-29T23:59:59Z"])+OR+ (Account:569+AND+DATE:["2013-11-29T00:00:00Z"+TO+"2013-11-29T23:59:59Z"])+OR+ (Account:789+AND+DATE:["2013-11-29T00:00:00Z"+TO+"2013-11-29T23:59:59Z"])+OR+..+OR+30k th record) But we are able to delete small number of records without any issues. Can anyone please help us on this. -- View this message in context: http://lucene.472066.n3.nabble.com/Invalid-version-expected-2-but-60-or-the-data-in-not-in-javabin-format-exception-while-deleting-30k-s-tp4109259.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Invalid version (expected 2, but 60) or the data in not in 'javabin' format exception while deleting 30k records
Thanks all for the reply. we are working on that to reduce the delete query size. But after that we faced one more issue.The issue is our batch process is able to delete 16k records but we got an OOM exception in one server.(out of 4 server in solrcloud).We are using solr 4.2 and zookeeper 3.4.5. and we are using sunjdk. we increased the heap size from 12 to 16 GB but no luck.we have 250GB ram dedicated only for solr and we have 100 million records. we have We are getting the following error during the deletion process. org.apache.solr.common.SolrException; Error opening realtime searcher for deleteByQuery:java.lang.OutOfMemoryError: Java heap space org.apache.solr.common.SolrException; Error while trying to recover. core=pe_shard1_replica1:java.lang.IllegalStateException: this writ er hit an OutOfMemoryError; cannot commit org.apache.solr.common.SolrException; auto commit error...:java.lang.IllegalStateException: this writer hit an OutOfMemoryError; cannot commit ERROR - org.apache.solr.common.SolrException; org.apache.solr.common.SolrException: Cannot talk to ZooKeeper - Updates are disabled. Note:Initially we got the same error when we index more than one million record at a time.So to fix that we divided data into two chunks and it is working fine now. Please advise .. Thanks... -- View this message in context: http://lucene.472066.n3.nabble.com/Invalid-version-expected-2-but-60-or-the-data-in-not-in-javabin-format-exception-while-deleting-30k-s-tp4109259p4109993.html Sent from the Solr - User mailing list archive at Nabble.com.
jetty version 8.1.8.v20121106 stable?
Hi all, 8.1.8.v20121106 is the stable version of jetty??? Please let me know your thoughts. Thanks.. -- View this message in context: http://lucene.472066.n3.nabble.com/jetty-version-8-1-8-v20121106-stable-tp4110005.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Invalid version (expected 2, but 60) or the data in not in 'javabin' format exception while deleting 30k records
Thanks. We will try with more heap. And we noticed that zookeeper(open jdk) and Solr(sun jdk) is using different jvm. Will this really cause this OOM issue ?. -- View this message in context: http://lucene.472066.n3.nabble.com/Invalid-version-expected-2-but-60-or-the-data-in-not-in-javabin-format-exception-while-deleting-30k-s-tp4109259p4110538.html Sent from the Solr - User mailing list archive at Nabble.com.
Solr restart is taking more than 1 hour
Hi , We have 2 cores & one shard with Solr 4.1. After some configuration changes when try to reload the core/restart the solr instance it is taking more than one hour.In log it says opening a searcher.(maxwarmingsearcher is 2). Can any one help us on this to resolve?? Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-restart-is-taking-more-than-1-hour-tp4054165.html Sent from the Solr - User mailing list archive at Nabble.com.
Solr admin url hit is not taking to the correct page
Hi, When we try to access Solr(3.6) admin page some times it is not taking us to the right page instead it is showing the below message. Directory: /solr/admin/ Parent Directory Replication 4096 bytes Mar 25 2013 9:34:06 AM When we click on parent Directory it displays the below one and clicking on META-INF, WEB-INF says not found. META-INF/ WEB-INF/ admin/ How to resolve this? Could any one please suggest?. Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-admin-url-hit-is-not-taking-to-the-correct-page-tp4055091.html Sent from the Solr - User mailing list archive at Nabble.com.
Configure compositekey
Hi, i want to explore the hash document routing available in Solr 4.1. So please share the configuration for generating composite key. Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/Configure-compositekey-tp4055645.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: how to migrate solr 1.4 index to solr 4.2 index
Hi , have you re-indexed again or moved 1.4 index to 4.2?? Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-migrate-solr-1-4-index-to-solr-4-2-index-tp4055531p4055686.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr restart is taking more than 1 hour
Thanks for detailed explanation. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-restart-is-taking-more-than-1-hour-tp4054165p4056355.html Sent from the Solr - User mailing list archive at Nabble.com.
how to get & display Jessionid with solr results
Hi, We are using jetty as a container for solr 3.6. We have two slave servers to serve queries for the user request and queries distributed to any one slave through load balancer. When one user send a first search request say its going to slave1 and when that user queries again we want to send the query to the same server with the help of Jsessionid. how to achieve this? How to get that Jsessionid with solr search results? Please provide your suggestions. Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-get-display-Jessionid-with-solr-results-tp4058751.html Sent from the Solr - User mailing list archive at Nabble.com.
Exception with Replication in solr 3.6
Hi, We have one master and 2 slaves with solr3.6. The below messages are logged in solr log . ERROR: Master at: http://server:port/solr/pe/replication is not available. Index fetch failed. Exception: Connection reset ERROR: Master at: http://server:port/solr/pe/replication is not available. Index fetch failed. Exception: Read timed out What does it mean? We are not getting these messages frequently. Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/Exception-with-Replication-in-solr-3-6-tp4060514.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Exception with Replication in solr 3.6
Thanks Otis & Shawn. They are in same data center but in different clusters. Slaves are in load-balanced cluster and master is in non-load balanced cluster. So we can say both are in same LAN. Let me diagnose NIC and IPv6 things. Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/Exception-with-Replication-in-solr-3-6-tp4060514p4060559.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How to force a document to be indexed in a given shard at SolrCloud?
Hi, Yes shard.keys should work for this case.Please check this link. http://docs.lucidworks.com/display/solr/Shards+and+Indexing+Data+in+SolrCloud Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-force-a-document-to-be-indexed-in-a-given-shard-at-SolrCloud-tp4063017p4063052.html Sent from the Solr - User mailing list archive at Nabble.com.
protect solr pages
Hi, i want implement security through jetty realm in solr4. So i configured related stuffs in realm.properties ,jetty.xml, webdefault.xml under /solrhome/example/etc. But still it is not working. Please advise. Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/protect-solr-pages-tp4064274.html Sent from the Solr - User mailing list archive at Nabble.com.
Tool to read Solr4.2 index
Hi All, We can use lukeall4.0 for reading Solr3.x index . Like that do we have anything to read solr 4.x index. Please help. Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/Tool-to-read-Solr4-2-index-tp4065448.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Tool to read Solr4.2 index
Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/Tool-to-read-Solr4-2-index-tp4065448p4065453.html Sent from the Solr - User mailing list archive at Nabble.com.
fq & facet on double and non-indexed field
Hi i am trying to apply filtering on non-indexed double field .But its not returning any results. So cant we do fq on non-indexed field? can not use FieldCache on a field which is neither indexed nor has doc values: EXCH_RT_AMT 400 We are using Solr4.2. Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/fq-facet-on-double-and-non-indexed-field-tp4065457.html Sent from the Solr - User mailing list archive at Nabble.com.
Capturing document processing in solr4.2
Hi , We are creating a unique id using 4-5 fields using SingnatureUpdateProcessorFactory. And we are getting count mismatch b/w data source and solr though we dont have any duplicate records in data source. So we want to capture the id in the log file during its generation to track the mismatch. Is there any configuration available to do this? Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/Capturing-document-processing-in-solr4-2-tp4065531.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: fq & facet on double and non-indexed field
Thanks Erick.. i hope we cant do q also on non-indexed field. Whats is the difference between q and fq other than cache . Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/fq-facet-on-double-and-non-indexed-field-tp4065457p4065604.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Query syntax error: Cannot parse ....
Hi, Try to pass URL encode value(%23) for # . Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/Query-syntax-error-Cannot-parse-tp4066560p4066566.html Sent from the Solr - User mailing list archive at Nabble.com.
