Re: Need help to configure automated deletion of shard in solr

2020-12-08 Thread Pushkar Mishra
Hi Erick, COLSTATUS does not work with Implicit router type collection . Is there any way to get the replica detail ? Regards On Mon, Nov 30, 2020 at 8:48 PM Erick Erickson wrote: > Are you using the implicit router? Otherwise you cannot delete a shard. > And you won’t have any shards that ha

Re: Need help to configure automated deletion of shard in solr

2020-12-02 Thread Erick Erickson
You can certainly use the TTL logic. Note the TimeRoutedAlias, but the DocExpirationUpdateFactory. DocExpirationUpdateFactory operates on each document individually so you can mix-n-match if you want. As for knowing when a shard is empty, I suggested a method for that in one of the earlier e-mails

Re: Need help to configure automated deletion of shard in solr

2020-12-01 Thread Pushkar Mishra
Hi Erick, It is implicit. TTL thing I have explored but due to some complications we can't use. that . Let me explain the actual use case . We have limited space ,we can't keep storing the document for infinite time . So based on the customer's retention policy ,I need to delete the documents. An

Re: Need help to configure automated deletion of shard in solr

2020-12-01 Thread Erick Erickson
This is still confusing. You haven’t told us what router you are using, compositeId or implicit? If you’re using compositeId (the default), you will never have empty shards because docs get assigned to shards via a hashing algorithm that distributes them very evenly across all available shards. Y

Re: Need help to configure automated deletion of shard in solr

2020-12-01 Thread Pushkar Mishra
Hi Team, As I explained the use case , can someone help me out to find out the configuration way to delete the shard here ? A quick response will be greatly appreciated. Regards Pushkar On Mon, Nov 30, 2020 at 11:32 PM Pushkar Mishra wrote: > > > On Mon, Nov 30, 2020, 9:15 PM Pushkar Mishra

Re: Need help to configure automated deletion of shard in solr

2020-11-30 Thread Pushkar Mishra
On Mon, Nov 30, 2020, 9:15 PM Pushkar Mishra wrote: > Hi Erick, > First of all thanks for your response . I will check the possibility . > Let me explain my problem in detail : > > 1. We have other use cases where we are making use of listener on > postCommit to delete/shift/split the shards .

Re: Need help to configure automated deletion of shard in solr

2020-11-30 Thread Pushkar Mishra
Hi Erick, First of all thanks for your response . I will check the possibility . Let me explain my problem in detail : 1. We have other use cases where we are making use of listener on postCommit to delete/shift/split the shards . So we have capability to delete the shards . 2. The current use c

Re: Need help to configure automated deletion of shard in solr

2020-11-30 Thread Erick Erickson
Are you using the implicit router? Otherwise you cannot delete a shard. And you won’t have any shards that have zero documents anyway. It’d be a little convoluted, but you could use the collections COLSTATUS Api to find the names of all your replicas. Then query _one_ replica of each shard with so

Need help to configure automated deletion of shard in solr

2020-11-30 Thread Pushkar Mishra
Hi Solr team, I am using solr cloud.(version 8.5.x). I have a need to find out a configuration where I can delete a shard , when number of documents reaches to zero in the shard , can some one help me out to achieve that ? It is urgent , so a quick response will be highly appreciated . Thanks P