Just taking a look to the code :
"
if (requestParams.containsKey("clean")) {
clean = StrUtils.parseBool( (String) requestParams.get("clean"), true);
} else if (DataImporter.DELTA_IMPORT_CMD.equals(command) ||
DataImporter.IMPORT_CMD.equals(command)) {
clean = false;
} else {
clean = debug ? false : true;
} "
Which make sense, as I would be surprised to see a delta import with a
default cleaning.
The guys was using delta import anyway, so maybe the problem is
different and not related to the clean.
But he needs definitely to give us more information .
Cheers
2015-06-10 12:11 GMT+01:00 Upayavira <u...@odoko.co.uk>:
> I was only speaking about full import regarding the default of
> clean=true. However, looking at the source code, it doesn't seem to
> differentiate especially between a full and a delta in relation to the
> default of clean=true, which would be pretty crappy. However, I'd need
> to try it.
>
> Upayavira
>
> On Wed, Jun 10, 2015, at 11:57 AM, Alessandro Benedetti wrote:
> > Wow, Upaya, I didn't know that clean was default=true in the delta import
> > as well!
> > I did know it was default in the full import, but I agree with you that
> > having a default to true for delta import is very dangerous !
> >
> > But assuming the user was using the delta import so far, if cleaning
> > every
> > time, how was possible to have a coherent index ?
> >
> > Using a delta import with clean=true should produce a non consistent
> > index
> > with only a subset ( the latest modified) of the entire data set !
> >
> > Cheers
> >
> > 2015-06-10 11:46 GMT+01:00 Upayavira <u...@odoko.co.uk>:
> >
> > > Note the clean= parameter to the DIH. It defaults to true. It will wipe
> > > your index before it runs. Perhaps it succeeded at wiping, but failed
> to
> > > connect to your database. Hence an empty DB?
> > >
> > > clean=true is, IMO, a very dangerous default option.
> > >
> > > Upayavira
> > >
> > > On Wed, Jun 10, 2015, at 10:59 AM, Midas A wrote:
> > > > Hi Alessandro,
> > > >
> > > > Please find the answers inline and help me out to figure out this
> > > > problem.
> > > >
> > > > 1) Solr version : *4.2.1*
> > > > 2) Solr architecture :* Master -slave/ Replication with
> requestHandler*
> > > >
> > > > 3) Kind of data source indexed : *Mysql *
> > > > 4) What happened to the datasource ? any change in there ? : *No
> change *
> > > > 5) Was the index actually deleted ? All docs deleted ? Index file
> > > > segments
> > > > deleted ? Index corrupted ? : *all docs deleted , segment files are
> > > > there.
> > > > index file is also there .*
> > > > 6) What about system resources ?
> > > > * JVM: 30 GB*
> > > > * RAM: 48 GB*
> > > >
> > > > *CPU : 8 core*
> > > >
> > > >
> > > > On Wed, Jun 10, 2015 at 2:13 PM, Alessandro Benedetti <
> > > > benedetti.ale...@gmail.com> wrote:
> > > >
> > > > > Let me try to help you, first of all I would like to encourage
> people
> > > to
> > > > > post more information about their scenario than "This is my log,
> index
> > > > > deleted, help me" :)
> > > > >
> > > > > This kind of Info can be really useful :
> > > > >
> > > > > 1) Solr version
> > > > > 2) Solr architecture ( Solr Cloud ? Solr Cloud configuration ?
> Manual
> > > > > Sharding ? Manual Replication ? where the problem happened ? )
> > > > > 3) Kind of data source indexed
> > > > > 4) What happened to the datasource ? any change in there ?
> > > > > 5) Was the index actually deleted ? All docs deleted ? Index file
> > > segments
> > > > > deleted ? Index corrupted ?
> > > > > 6) What about system resources ?
> > > > >
> > > > > These questions are only few example one that everyone should
> always
> > > post
> > > > > along their mysterious problem !
> > > > >
> > > > > Hope this helps,
> > > > >
> > > > > Cheers
> > > > >
> > > > >
> > > > > 2015-06-10 9:15 GMT+01:00 Midas A <test.mi...@gmail.com>:
> > > > >
> > > > > >
> > > > > > We are running full import and delta import crons .
> > > > > >
> > > > > > Fulll index once a day
> > > > > >
> > > > > > delta index : every 10 mins
> > > > > >
> > > > > >
> > > > > > last night my index automatically deleted(numdocs=0).
> > > > > >
> > > > > > attaching logs for review .
> > > > > >
> > > > > > please suggest to resolve the issue.
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > --------------------------
> > > > >
> > > > > Benedetti Alessandro
> > > > > Visiting card : http://about.me/alessandro_benedetti
> > > > >
> > > > > "Tyger, tyger burning bright
> > > > > In the forests of the night,
> > > > > What immortal hand or eye
> > > > > Could frame thy fearful symmetry?"
> > > > >
> > > > > William Blake - Songs of Experience -1794 England
> > > > >
> > >
> >
> >
> >
> > --
> > --------------------------
> >
> > Benedetti Alessandro
> > Visiting card : http://about.me/alessandro_benedetti
> >
> > "Tyger, tyger burning bright
> > In the forests of the night,
> > What immortal hand or eye
> > Could frame thy fearful symmetry?"
> >
> > William Blake - Songs of Experience -1794 England
>
--
--------------------------
Benedetti Alessandro
Visiting card : http://about.me/alessandro_benedetti
"Tyger, tyger burning bright
In the forests of the night,
What immortal hand or eye
Could frame thy fearful symmetry?"
William Blake - Songs of Experience -1794 England
