Having an issue with pivot faceting

I'm having an issue getting pivot faceting working as expected. I'm trying to filter by a specific criteria, and then first facet by one of my document attributes called item_generator, then facet those results into 2 sets each: the first set is the count of documents satisfying that facet with nu

Re: SolrException Error when indexing new documents at scale in SolrCloud -

Hi Shawn, Thanks for the helpful and thorough response. While I understand all of the factors that you've outlined for memory requirements (in fact, I'd previously read your page on Solr performance problems), it is baffling to me why two identical SolrCloud instances, each sharded across 3 machi

Re: SolrException Error when indexing new documents at scale in SolrCloud -

Hi Shawn, Thanks for the quick reply. I did notice the exception you pointed out and had some thoughts about it maybe being the client library I'm using to connect to Solr (C# SolrNet) disconnecting too early, but that doesn't explain it eventually running out of memory altogether. A large index

SolrException Error when indexing new documents at scale in SolrCloud -

I have a SolrCloud installation with about 2 million documents indexed in it. It's been buzzing along without issue for the past 8 days, but today started throwing errors on document adds that eventually resulted in out of memory exceptions. There is nothing funny going on. There are a few infre

solr-user@lucene.apache.org

I agree, but that's the only information that was returned from the interface. I had a look through the logs and there isn't a deeper stack trace, but I noticed these errors directly before that exception that might be helpful: ERROR - 2014-01-06 16:23:12.426; org.apache.solr.common.SolrException

solr-user@lucene.apache.org

I'm adding dozens of documents every few minutes to a SolrCloud instance with 3 machines and ~ 25 million documents. I'm starting to see issues where adds are throwing these ugly errors that seem to indicate there might be some issues with the nodes communicating to one another. My posts are of t

Re: Shards stuck in "down" state after splitting shard - How can we recover from a failed SPLITSHARD?

Thanks again for your replies. I'm using Solr 4.6. I just tried splitting another shard so I could grab the exceptions from the logs, and here is the log output. I noticed a few obvious exceptions that might have caused this to fail, such as this: ERROR - 20

Re: Shards stuck in "down" state after splitting shard - How can we recover from a failed SPLITSHARD?

My apologies, I forgot to paste the output of clusterstate.json to my last post. Here it is: [zk: localhost:2181(CONNECTED) 1] get /clusterstate.json {"collection1":{ "shards":{ "shard1":{ "range":"8000-d554", "state":"active", "replicas":{"10.0.0.229:844

Re: Shards stuck in "down" state after splitting shard - How can we recover from a failed SPLITSHARD?

Thanks for your reply Anshum. I took a look at clusterstate.json, and it seems they are stuck in "construction" while the others are still active. I'm able to query my index again (that seems to have been an unrelated issue), but I'd still like to remove these stuck shards and recreate them (or f

Shards stuck in "down" state after splitting shard - How can we recover from a failed SPLITSHARD?

I called SPLITSHARD on a shard in an existing SolrCloud instance, where the shard had ~1 million documents in it. It's been about 3 hours since that splitting has completed, and the subshards are still stuck in a "Down" state. They are reported as down in localhost/solr/#/~cloud, and I'm unable t

How can you move a shard from one SolrCloud node to another?

Let's say I want to rebalance a SolrCloud collection. I call SPLITSHARD to split an existing shard, and then I'd like to move one of the subshards to a new machine so the index is more balanced. Can this be done? If not, how do you rebalance an existing SolrCloud collection? -- View this mess

Re: Rebalancing a SolrCloud index after adding new nodes

Interesting, thanks for the response. Let's saying I wanted to use SPLITSHARD to balance my index. Once I call it, the original shard has been split into 2 subshards that are both then on the same machine. Can I then somehow move one of the shards to my new server? This would allow me to balanc

Rebalancing a SolrCloud index after adding new nodes

I'm wondering if there is an automated way to rebalance a solr collection once a new node is added, so the maximum size of a single shard is decreased. I was pointed to this document which seems to imply such functionality exists, b

Replicating from the correct collections in SolrCloud on solr start

I have a Solr configuration that I am trying to replicate on several machines as part of a package installation. I have a cluster of machines that will run the SolrCloud, with 3 machines in the cluster running a zookeeper ensemble. As part of the installation of each machine, Solr is started with