Let me answer in line, to get more info : 2015-06-10 10:59 GMT+01:00 Midas A <test.mi...@gmail.com>:
> Hi Alessandro, > > Please find the answers inline and help me out to figure out this problem. > > 1) Solr version : *4.2.1* > 2) Solr architecture :* Master -slave/ Replication with requestHandler* > > Where happened the issue ? Have you read this : The SQL Entity Processor The SqlEntityProcessor is the default processor. The associated data source <https://cwiki.apache.org/confluence/display/solr/Uploading+Structured+Data+Store+Data+with+the+Data+Import+Handler#UploadingStructuredDataStoreDatawiththeDataImportHandler-JdbcDataSource> should be a JDBC URL. The entity attributes specific to this processor are shown in the table below. Attribute Use query Required. The SQL query used to select rows. deltaQuery SQL query used if the operation is delta-import. This query selects the primary keys of the rows which will be parts of the delta-update. The pks will be available to the deltaImportQuery through the variable ${dataimporter.delta.<column-name>}. parentDeltaQuery SQL query used if the operation is delta-import. deletedPkQuery SQL query used if the operation is delta-import. deltaImportQuery SQL query used if the operation is delta-import. If this is not present, DIH tries to construct the import query by(after identifying the delta) modifying the 'query' (this is error prone). There is a namespace ${dataimporter.delta.<column-name>} which can be used in this query. For example, select * from tbl where id=${dataimporter.delta.id}. It is from Solr official wiki. You should be sure you adhere to the proper configurations. > 3) Kind of data source indexed : *Mysql * > what about your delta query ? that one is the responsible for the delta indexing > 4) What happened to the datasource ? any change in there ? : *No change * > Nothing relevant happened there ? any deletion or weird update to the database ? > 5) Was the index actually deleted ? All docs deleted ? Index file segments > deleted ? Index corrupted ? : *all docs deleted , segment files are there. > index file is also there .* > So a deletion + commit happened, but still no merge purging the index deleted content ? > 6) What about system resources ? > * JVM: 30 GB* > * RAM: 48 GB* > > *CPU : 8 core* > eheheh not interested in your current resources, I have no indication of the size of your data, My question was more related to check if the system was healthy from the system resource point of view. Cheers > > On Wed, Jun 10, 2015 at 2:13 PM, Alessandro Benedetti < > benedetti.ale...@gmail.com> wrote: > > > Let me try to help you, first of all I would like to encourage people to > > post more information about their scenario than "This is my log, index > > deleted, help me" :) > > > > This kind of Info can be really useful : > > > > 1) Solr version > > 2) Solr architecture ( Solr Cloud ? Solr Cloud configuration ? Manual > > Sharding ? Manual Replication ? where the problem happened ? ) > > 3) Kind of data source indexed > > 4) What happened to the datasource ? any change in there ? > > 5) Was the index actually deleted ? All docs deleted ? Index file > segments > > deleted ? Index corrupted ? > > 6) What about system resources ? > > > > These questions are only few example one that everyone should always post > > along their mysterious problem ! > > > > Hope this helps, > > > > Cheers > > > > > > 2015-06-10 9:15 GMT+01:00 Midas A <test.mi...@gmail.com>: > > > > > > > > We are running full import and delta import crons . > > > > > > Fulll index once a day > > > > > > delta index : every 10 mins > > > > > > > > > last night my index automatically deleted(numdocs=0). > > > > > > attaching logs for review . > > > > > > please suggest to resolve the issue. > > > > > > > > > > > > -- > > -------------------------- > > > > Benedetti Alessandro > > Visiting card : http://about.me/alessandro_benedetti > > > > "Tyger, tyger burning bright > > In the forests of the night, > > What immortal hand or eye > > Could frame thy fearful symmetry?" > > > > William Blake - Songs of Experience -1794 England > > > -- -------------------------- Benedetti Alessandro Visiting card : http://about.me/alessandro_benedetti "Tyger, tyger burning bright In the forests of the night, What immortal hand or eye Could frame thy fearful symmetry?" William Blake - Songs of Experience -1794 England
