Hi, I'm working on an application that index CDR ( Call Detail Record ) in SolrCloud with 1 collection and 3 shards.
Every day the application index 30 millions of CDR. I have a purge application that delete records older than 10 days, and call OPTIMIZE, so the collection will keep only 300 millions of CDR. Do you know if there is a limit on max number of documents per shard , included deleted documents ? I read in some blogs that there is a limit of 2 Billions per shard included deleted documents, that is I can have an empty collection, but if I already indexed 6 Billions of CDR ( 2 per 3 shards ) in that collection, I'll get an error. Is it true ? Have I recreate the collection ? I see that when I call delete records, apache solr free space on disk. Thanks. Agostino