Hello,

I have Solr version 4.3.0.

I have encountered a problem where document is not returning from queries
after delta import although the delta import does not report that a
document has been deleted.

i have a document that is composed of several fields , the delta import
looks for a field
called "update_date" and checks whether the date is after the last time
delta import was ran.

so something like

select d.ID as UNIQUE_ID
       from document d
       where d.UPDATE_DATE >= '${dataimporter.last_index_time}' and
d.OWNER_ID IS NOT NULL and d.DELETE_DATE IS NULL


deletePKQuery looks like

select d.ID as UNIQUE_ID from document d
      where d.DELETE_DATE >= '${dataimporter.last_index_time}'

doing full import will successfully fetch the documents

then changing the update_date on a document will remove it from the index
(but this is not reported in the log)

"07 Aug 2016 18:29:24,278 [Thread-53] INFO  DocBuilder - Completed
DeletedRowKey for Entity: permission_set rows obtained : 0"

07 Aug 2016 18:29:24,438 [Thread-53] INFO  MetadataOnImportEndEventListener
- metadata import process end: {deletedDocCount=0, docCount=1,
queryCount=6, rowCount=6, skipDocCount=0}


merge policy is :

<mergePolicy class="org.apache.lucene.index.TieredMergePolicy">
  <int name="maxMergeAtOnce">10</int>
  <int name="segmentsPerTier">10</int>
</mergePolicy>


<deletionPolicy class="solr.SolrDeletionPolicy">
<!-- The number of commit points to be kept -->
 <str name="maxCommitsToKeep">1</str>
<!-- The number of optimized commit points to be kept -->
 <str name="maxOptimizedCommitsToKeep">1</str></deletionPolicy>


only hard commit is configured, soft commit is commented out:

<autoCommit>
  <maxDocs>1000</maxDocs>
  <maxTime>30000</maxTime>
  <openSearcher>false</openSearcher>
</autoCommit>


will greatly appreciate your help

Thanks,
Or Gerson

Reply via email to