Re: zookeeper config

2013-01-23 Thread Per Steffensen
This is supported. You just need to ajust your ZK connection-string: ":/solr,:/solr,...,:/solr" Regards, Per Steffensen On 1/24/13 7:57 AM, J Mohamed Zahoor wrote: Hi I am using Solr 4.0. I see the Solr data in zookeeper is placed on the root znode itself. This becomes a p

Re: Submit schema definition using curl via SOLR

2013-01-24 Thread Per Steffensen
va -DzkHost= -Dcollection.configName=edr_sms_conf -Dbootstrap_confdir= -jar start.jar I prefer 1) for several reasons. Regards, Per Steffensen On 1/24/13 4:02 PM, Fadi Mohsen wrote: Hi, We would like to use Solr to index statistics from any Java module in our production environment. Applica

Re: Submit schema definition using curl via SOLR

2013-01-24 Thread Per Steffensen
On 1/24/13 4:51 PM, Per Steffensen wrote: 2) or You can have an Solr node (server) load a "Solr config" into ZK during startup by adding collection.configName and bootstrap_confdir VM params - something like this java -DzkHost= -Dcollection.configName= -Dbootstrap_confdir= -jar

Re: Starting instances with multiple collections

2013-01-24 Thread Per Steffensen
startup is only for "playing". You ought to load configs into ZK as a separate operation from starting Solrs (and creating collections for that matter). Also see recent mail-list dialog "Submit schema definition using curl via SOLR" Regards, Per Steffensen On 1/23/13 11:12

Re: Submit schema definition using curl via SOLR

2013-01-25 Thread Per Steffensen
On 1/24/13 11:22 PM, Fadi Mohsen wrote: Thanks Per, would the first approach involve restarting Solr? Of course ZK need to run in order to load the config into ZK. Solr nodes do not need to run. If they do I couldnt imagine that they need to be restarted in order to take advantage of new conf

Re: How to migrate SolrCloud shards to different servers?

2013-01-26 Thread Per Steffensen
! Regards, Per Steffensen On 1/26/13 6:56 AM, Mingfeng Yang wrote: Hi Mark, When I did testing with SolrCloud, I found the following. 1. I started 4 shards on the same host on port 8983, 8973, 8963, and 8953. 2. Index some data. 3. Shutdown all 4 shards. 4. Started 4 shards again, all pointing to

Known memory leaks in 4.0?

2013-03-15 Thread Per Steffensen
Hi We have a problem that seems to be due to memory leaks during search on Solr 4.0. Havnt dived into it yet, so I am certainly not sure, but just wanted to ask upfront, if 4.0 contains any known memory leaks? And if they have been fixed? Regards, Per Steffensen

Re: Known memory leaks in 4.0?

2013-03-15 Thread Per Steffensen
down if you stop all searching. We have just decided to dive into it for a few days in order to understand what actually happens. Regards Bernd Regards, Per Steffensen

Parallel indexing in Solr

2012-02-03 Thread Per Steffensen
- e.g. tomcat? What is the recommended web-container for high performance production systems? Thanks! Regards, Per Steffensen

Re: Parallel indexing in Solr

2012-02-06 Thread Per Steffensen
able setup so that we can get to this kind of numbers at all. Right now I am focusing on getting most out of one Solr instance potentially with several cores, though. Best Erick On Fri, Feb 3, 2012 at 3:55 AM, Per Steffensen wrote: Hi This topic has probably been covered before, but I havnt

Is Solr waiting for data to arrive

2012-02-06 Thread Per Steffensen
nfirmed my suspiction, but if it is 2) I probably have. Can anyone help med with the interpretation. Thanks! Regards, Per Steffensen

Re: Parallel indexing in Solr

2012-02-06 Thread Per Steffensen
So SolrJ with CommonsHttpSolrServer will not support handling several requests concurrently? Nope. Use StreamingUpdateSolrServer, it should be just a drop-in with a different constructor. I will try to do that. It is a little bit difficult for me, as we are actually not dealing with

Re: Parallel indexing in Solr

2012-02-06 Thread Per Steffensen
Sami Siren skrev: On Mon, Feb 6, 2012 at 2:53 PM, Per Steffensen wrote: Actually right now, I am trying to find our what my bottleneck is. The setup is more complex, than I would bother you with, but basically I have servers with 80-90% IO-wait and only 5-10% "real CPU usage"

Re: Parallel indexing in Solr

2012-02-07 Thread Per Steffensen
You could try to isolate the bottleneck by testing the indexing speed from the local machine hosting Solr. Also tools like iostat or sar might give you more details about the disk side. Yes, I am doing different stuff to isolate bottleneck. Im also profiling JVM. And I am using iostat, top a

Unique key constraint and optimistic locking (versioning)

2012-02-21 Thread Per Steffensen
olr/lucene - e.g. in the client using solr. Regards, Per Steffensen

Re: Unique key constraint and optimistic locking (versioning)

2012-02-22 Thread Per Steffensen
t;separate area" to work on the code (making a Git fork), and suggest the contribution back to core lucene/solr (doing a Git "pull request")? Thanks! Per Steffensen Em skrev: Hi Per, Solr provides the so called "UniqueKey"-field. Refer to the Wiki to learn mor

Re: Unique key constraint and optimistic locking (versioning)

2012-02-22 Thread Per Steffensen
Per Steffensen skrev: Thanks a lot. We will use the UniqueKey feature and build versioning ourselves. Do you think it would be a good idea if we built a versioning feature into Solr/Lucene instead of doing it outside, so that others can benefit from the feature as well? Guess contributions

Re: Unique key constraint and optimistic locking (versioning)

2012-02-23 Thread Per Steffensen
n mind concurrent updates). Kind regards, Em Am 21.02.2012 13:50, schrieb Per Steffensen: Hi Does solr/lucene provide any mechanism for "unique key constraint" and "optimistic locking (versioning)"? Unique key constraint: That a client will not succeed creating a new documen

Re: Unique key constraint and optimistic locking (versioning)

2012-02-23 Thread Per Steffensen
ent already in the index/core/shard. The existing document will always be updated (implemented as "old deleted and new added"). Correct? Kind regards, Em Regards, Per Steffensen

Re: Unique key constraint and optimistic locking (versioning)

2012-02-24 Thread Per Steffensen
Em skrev: Hi Per, I want an error to occur if a document with the same id already exists, when my intent is to INSERT a new document. When my intent is to UPDATE a document in solr/lucene I want the old document already in solr/lucene deleted and the new version of this document added (exact

Re: Unique key constraint and optimistic locking (versioning)

2012-02-24 Thread Per Steffensen
Sami Siren skrev: Given that you've set a uniqueKey-field and there already exists a document with that uniqueKey, it will delete the old one and insert the new one. There is really no difference between the semantics - updates do not exist. To create a UNIQUE-constraint as you know it from a dat

Re: Unique key constraint and optimistic locking (versioning)

2012-02-24 Thread Per Steffensen
ommit has happened. You can have many threads working on indexing datarecords into Solr but not deleting/acknowledging the source for those datarecords before next hard-commit has happend after index. But I believe it is another issue - one we also have plans about dealing with. Thanks everyb

Re: Unique key constraint and optimistic locking (versioning)

2012-02-24 Thread Per Steffensen
Yonik Seeley skrev: On Fri, Feb 24, 2012 at 6:55 AM, Em wrote: However, regarding a versioning-system, one always has to keep in mind that an uncommited document is not guaranteed to be persisted in the index. We now have durability via an update log. With a recent nightly trunk build

Re: Unique key constraint and optimistic locking (versioning)

2012-02-24 Thread Per Steffensen
Yonik Seeley skrev: On Fri, Feb 24, 2012 at 9:04 AM, Per Steffensen wrote: Cool. We have a test doing exactly that - indexing 2000 documents into Solr, kill-9'ing Solr in the middle of the process, starting Solr again and checking that 2000 documents will eventually be searchable. It l

Re: Unique key constraint and optimistic locking (versioning)

2012-02-24 Thread Per Steffensen
Per Steffensen skrev: Em skrev: This is a really cool feature! Thanks for pointing us in that direction! A feature where you can flag your "index" operation to provide "create sematics" would be cool. When setting the "create-semantics" flag, an "index

Re: Unique key constraint and optimistic locking (versioning)

2012-02-28 Thread Per Steffensen
n on this behaviour of having "database" (RDBMS) semantics, and when you do you get both. Tomorrrow will create another Jira issue on the "versioning/optimistic locking" part. Per Steffensen skrev: Hi Does solr/lucene provide any mechanism for "unique key constraint&qu

Re: Unique key constraint and optimistic locking (versioning)

2012-02-29 Thread Per Steffensen
ou to turn on this behaviour of having "database" (RDBMS) semantics, and when you do you get both. Tomorrrow will create another Jira issue on the "versioning/optimistic locking" part. Per Steffensen skrev: Hi Does solr/lucene provide any mechanism for "unique key c

MISSING LICENSE

2012-03-12 Thread Per Steffensen
-COMPOUND.txt [licenses] => .../solr/exampleB/work/Jetty_0_0_0_0_8900_solr.war__solr__dsbrc0/webapp/WEB-INF/lib/zookeeper-LICENSE-FAKE.txt $ ant -version Apache Ant(TM) version 1.8.2 compiled on October 14 2011 What might be wrong? Regards, Per Steffensen

Re: MISSING LICENSE

2012-03-12 Thread Per Steffensen
Shawn Heisey skrev: On 3/12/2012 1:24 AM, Per Steffensen wrote: $ ant -version Apache Ant(TM) version 1.8.2 compiled on October 14 2011 What might be wrong? If you check lucene/BUILD.txt in your source, it says to use ant 1.7.1 or later, but not 1.8.x. This is from a recent trunk checkout

Re: MISSING LICENSE

2012-03-12 Thread Per Steffensen
Thank you both for your kind help. Regards, Steff Erick Erickson skrev: Per: You've been working with SolrCloud, haven't you? Yonik's right on, removing exampleB is what I had to do with the exact same problem. Erick On Mon, Mar 12, 2012 at 2:33 PM, Yonik Seeley wrote: Over-aggressive l

Adding config to SolrCloud without creating any shards/slices

2012-05-16 Thread Per Steffensen
only way we know to create a Solr config in ZK is to spin up a Solr with system properties zkHost, bootstrap_confdir and collection.configName. Is there another, more API-ish, way of creating a Solr config in ZK? Regards, Per Steffensen

Re: Adding config to SolrCloud without creating any shards/slices

2012-05-18 Thread Per Steffensen
First of all, sorry about the subject of this discussion. It should have been something like "Adding config to SolrCloud without starting a Solr server" Mark Miller skrev: k On May 16, 2012, at 5:35 AM, Per Steffensen wrote: Hi We want to create a Solr config in ZK during in

Searching and sorting over multiple collections

2012-08-27 Thread Per Steffensen
Hi Due to what we have seen in recent tests I got in doubt how Solr search is actually supposed to behave * Searching with "distrib=true&q=*:*&rows=10&collection=x,y,z&sort=timestamp asc" ** Is Solr supposed to return the 10 documents with the lowest timestamp across all documents in all sli

Re: Searching and sorting over multiple collections

2012-08-28 Thread Per Steffensen
Per Steffensen skrev: Hi Due to what we have seen in recent tests I got in doubt how Solr search is actually supposed to behave * Searching with "distrib=true&q=*:*&rows=10&collection=x,y,z&sort=timestamp asc" ** Is Solr supposed to return the 10 documents with th

Re: SolrZKClient changed interface

2012-11-09 Thread Per Steffensen
use on the RuntimeExceptions. Or maybe it is just an accident that the checked excpetions was removed from the method signature, and then of course you can add them again at make sure the actual exceptions are propagated correctly. Regards, Per Steffensen Trym R. Møller skrev: Hi The constructor of So

<    1   2