Error importing data - java.util.concurrent.RejectedExecutionException
I will preface this with the fact that I am still pretty new to both Solr and
Tomcat, so hopefully this is something obvious to somebody out there. I have
two 4.3.10 Solr servers set up in separate contexts, running on a Tomcat 7
application server on Windows 2012. When I attempt to import data from a SQL
server into a collection on one of the Solr instances, no documents are created
and the log files when run at full debug level show the following .
--
DEBUG - 2015-12-30 13:24:53.469;
org.apache.solr.update.processor.LogUpdateProcessor; PRE_UPDATE add{,id=216885}
{{params(optimize=true&indent=true&clean=true&commit=true&verbose=false&command=full-import&debug=false&wt=json),defaults(config=db-data-config.xml)}}
WARN - 2015-12-30 13:24:53.469; org.apache.solr.handler.dataimport.SolrWriter;
Error creating document : SolrInputDocument(fields: [memberId=**,
location=**,**, longitude=**, lastName=**, status=**,
latitude=**, id=**, firstName=**, _version_=1522019276914950145])
org.apache.solr.common.SolrException: Exception writing document id ** to
the index; possible analysis error.
at
org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:168)
at
org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69)
at
org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
at
org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:926)
at
org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1080)
at
org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:692)
at
org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:100)
at org.apache.solr.handler.dataimport.SolrWriter.upload(SolrWriter.java:71)
at
org.apache.solr.handler.dataimport.DataImportHandler$1.upload(DataImportHandler.java:265)
at
org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:511)
at
org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:415)
at
org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:330)
at
org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:232)
at
org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:416)
at
org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:480)
at
org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:461)
Caused by: java.util.concurrent.RejectedExecutionException: Task
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@15afacfe
rejected from
java.util.concurrent.ScheduledThreadPoolExecutor@132e86ed[Terminated, pool size
= 0, active threads = 0, queued tasks = 0, completed tasks = 1]
at
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(Unknown
Source)
at java.util.concurrent.ThreadPoolExecutor.reject(Unknown Source)
at java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(Unknown
Source)
at java.util.concurrent.ScheduledThreadPoolExecutor.schedule(Unknown
Source)
at
org.apache.solr.update.CommitTracker._scheduleCommitWithin(CommitTracker.java:150)
at
org.apache.solr.update.CommitTracker._scheduleCommitWithinIfNeeded(CommitTracker.java:118)
at
org.apache.solr.update.CommitTracker.addedDocument(CommitTracker.java:169)
at
org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:275)
at
org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:164)
... 15 more
--
I am not sure where to even start looking here, but the server appears to be
running fine with ample CPU and memory room. I have doubled the RAM available
to the Tomcat server (1024 on start, 4096 for the max).
On the Solr side, I have checked the data shown against the schema for the
collection and everything appears to line up.
I am at a loss here ... can anybody offer a pointer?
Thanks,
-- Jeff
DIH with Nested Documents - Configuration Issue
I am working on a project where the specification requires a parent - child
relationship within the Solr data collection ... i.e. a user and the collection
of languages they speak (each of which is made up of multiple data fields). My
production system is a 4.10 Solr implementation but I have a 5.5 implementation
as my disposal as well. Thus far, I am not getting this to work on either one
and I have yet to find a complete documentation source on how to implement this.
The goal is to get a resulting document from Solr that looks like this:
{
"id": 123,
"firstName": "John",
"lastName": "Doe",
"languagesSpoken": [
{
"id": 243,
"abbreviation": "en",
"name": "English"
},
{
"id": 442,
"abbreviation": "fr",
"name": "French"
}
]
}
In my schema.xml, I have flatted out all of the fields as follows:
The latest rendition of my db-data-config.xml looks like this:
...
On the 4.10 server, when the data comes out of Solr, I get one flat document
record with the fields for one language inline with the firstName and lastname
like this:
{
"id": 123,
"firstName": "John",
"lastName": "Doe",
"languagesSpoken_id": 243,
"languagesSpoken_abbreviation ": "en",
"languagesSpoken_name": "English"
}
On the 5.5 server, when the data comes out, I get separate documents for the
root client document and the child language documents with no relationship
between them like this:
{
"id": 123,
"firstName": "John",
"lastName": "Doe"
},
{
"languagesSpoken_id": 243,
"languagesSpoken_abbreviation": "en",
"languagesSpoken_name": "English"
},
{
"languagesSpoken_id": 442,
"languagesSpoken_abbreviation": "fr",
"languagesSpoken_name": "French"
}
I have spent several days now trying to figure out what is going on here to no
avail. Can anybody provide me with a pointer as to what I am missing here?
Thanks,
-- Jeff
