Solr cloud date based paritioning

Hi guys! I have simple use case to implement but I have problem with date based partitioning... Here are some rules: 1. At the beginning I have to create huge index (10GB) based on one db table. 2. Every day I have to update this index. 3. 99,999% are queries based on date field (*data from last

Re: Solr cloud date based paritioning

Thanks! I have very limited response time (max 100ms) therefore sharding is a must. Data also have trend to grow up to tens of gigs. Is there any way how to create new logical shard in runtime? I want to logically partition my data by date. I'm still wondering how is implemented example from docum

Re: Solr cloud date based paritioning

Sure, I'ill measure results and come back if results will be unsatisfactory. Thanks very much for advice. Out of curiosity: is there any way to partition shards (logical and physical) by specified value of specified field? Kowish -- View this message in context: http://lucene.472066.n3.nabble

Re: Solr cloud date based paritioning

Otis, Is it implemented? I can find only unresolved JIRA issues. Kowish -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-cloud-date-based-paritioning-tp4074729p4074993.html Sent from the Solr - User mailing list archive at Nabble.com.

Sorting

Hi, What should be faster: sorting by field of type string (solr.StrField) or long (solr.TrieLongField). In both cases values are numbers so I can decide what type of field to use. Is it possible to speed up sorting by unique field? With sorting my queries are 10-100 times slower and I can't meet

Re: Sorting

Jack, Do you think DocValues with unique field make sense? From what I read, it will only double index size for that field. It will give just a different numbers of field. I have really big problem with sorting by unique field. Without sorting, event in 40-50 GB index, almost every query is quite

SolrCloud leader

Hi guys, Is it possible to determine (by the server node itself) in SolrCloud if the node is the leader? One possible solution is to use CloudSolrServer and fetch leader address but how can I check address of the current node (I can see it in configuration but how to get configuration programmatic

Re: SolrCloud leader

Ya :-) I need it for different reason. I have 8 server nodes and one of them has to invoke scheduled data import (by invoking CloudSolrServer)... And that's why I need to identify exclusive server (it doesn't have to be leader but I think it is the simplest solution). I don't want to invoke schedu

Re: SolrCloud leader

The problem is that I don't want to invoke data import on 8 server nodes but to choose only one for scheduling. Of course if this server will shut down then another one needs to take the scheduler role. I can see that there is task for sheduling https://issues.apache.org/jira/browse/SOLR-2305 . I h

SolrCloud Zookeeper SaslClient

Hi, Is there any documentation of how to configure SolrCloud Zookeeper using SASL (on JBOSS 5). When I start SolrCloud on Jboss 5 I see WARN: /"2013-07-16 21:38:17,425 INFO [org.apache.solr.common.cloud.ConnectionManager:157] (main) Waiting for client to connect to ZooKeeper 2013-07-16 21:38:17,

Solr Cloud dataimport freezes

Hi guys, I have a problem with data import (based on database sql) in Solr Cloud. I'm trying to import ~500 000 000 of documents and I've created 30 logical shards on 2 physical machines. Documents are distributed by composite id. After some time (5-10 minutes; about 400 000 documents) Solr Cloud

Re: Solr Cloud dataimport freezes

Update: - it works for 8 shards. I'm going to test it on 16 shards. Any ideas what is going on? :-) -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Cloud-dataimport-freezes-tp4090812p4090832.html Sent from the Solr - User mailing list archive at Nabble.com.