Is there any particular reason why ExternalFileField is read from data directory

[apoorvqwerty]

Hi,
As per the documentation for ExternalFileField we need to put external_field
with the map in parallel with the data directory on all the shards.
Is it possible to read the file from a central location or zookeeper?



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Is-there-any-particular-reason-why-ExternalFileField-is-read-from-data-directory-tp4343374.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Is there any particular reason why ExternalFileField is read from data directory

[apoorvqwerty]

Thanks a lot,
for now I've written a listener to read from redis instead.
But might not scale well since the map is kept in memory.



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Is-there-any-particular-reason-why-ExternalFileField-is-read-from-data-directory-tp4343374p4344151.html
Sent from the Solr - User mailing list archive at Nabble.com.

Overseer session expires on multiple collection creation

[apoorvqwerty]

Hi, 
I am trying to create multiple collections with 2 shards and 2 replications
each.
After 5-6 successful 
overseer status response for 5 creations shows 40k requests for
collection_operations=>am_i_leader which is a bit odd. 
and I get 
Am I not supposed to create 8-10 collections one after the other or is there
some configuration that I'm missing.
On creation of 8th collection I get following overseer session expired
exception 

nExpiredException: KeeperErrorCode = Session expired for
/overseer/collection-queue-work/qnr-24
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at
org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:322)
at
org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:319)
at
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at 
org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:319)
at
org.apache.solr.cloud.OverseerTaskQueue.remove(OverseerTaskQueue.java:93)
at
org.apache.solr.cloud.OverseerTaskProcessor$Runner.markTaskComplete(OverseerTaskProcessor.java:525)
at
org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:483)
at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)






--
View this message in context: 
http://lucene.472066.n3.nabble.com/Overseer-session-expires-on-multiple-collection-creation-tp4331265.html
Sent from the Solr - User mailing list archive at Nabble.com.

RE: Overseer session expires on multiple collection creation

[apoorvqwerty]

So i figured out the issue i was facing
https://issues.apache.org/jira/browse/SOLR-9803



  ${solr.ulog.dir:}
  ${solr.ulog.numVersionBuckets:8388608}



i had a huge value set fir numVersioinBuckets which was causing memory leak
as stated in issue 9803

Changing to default value solved my problem



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Overseer-session-expires-on-multiple-collection-creation-tp4331265p4333692.html
Sent from the Solr - User mailing list archive at Nabble.com.