this is my log file : [EMAIL PROTECTED]:/home# tail -f /var/log/tomcat5.5/catalina.$(date +%Y-%m-%d).log Sep 18, 2008 5:25:02 PM org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a connection for entity books with URL: jdbc:mysql://master-spare.vip.books.com/books Sep 18, 2008 5:25:02 PM org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken for getConnection(): 50 Sep 18, 2008 5:25:53 PM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed ModifiedRowKey for Entity: books rows obtained : 1608415 Sep 18, 2008 5:25:53 PM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Running DeletedRowKey() for Entity: books Sep 18, 2008 5:25:53 PM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed DeletedRowKey for Entity: books rows obtained : 0
I just updated browser /dataimport, looks like another one has been started so maybe the cron started it : <str name="status">busy</str> <str name="importResponse">A command is still running...</str> − <lst name="statusMessages"> <str name="Time Elapsed">0:0:44.993</str> <str name="Total Requests made to DataSource">1</str> <str name="Total Rows Fetched">1503980</str> <str name="Total Documents Processed">0</str> <str name="Total Documents Skipped">0</str> <str name="Delta Dump started">2008-09-18 17:30:01</str> <str name="Identifying Delta">2008-09-18 17:30:01</str> </lst> Shalin Shekhar Mangar wrote: > > On Thu, Sep 18, 2008 at 8:45 PM, sunnyfr <[EMAIL PROTECTED]> wrote: > >> >> I agree about that but the last time 4hours later the number wasn't >> different >> : > > > Do you mean that the number doesn't change at all on refreshing the page? > Can you check the solr log file for exceptions? > > I suspect that you may be running out of memory. > > >> >> and if I check now, nothing changed : does it have to go across all the >> data >> like full import, I thought it would bring back just ids which need to be >> modify ...? >> > > No, it will bring back only those id if the deltaQuery is correct. Are you > sure you modified less number of rows in the DB? > > >> >> <lst name="statusMessages"> >> <str name="Time Elapsed">0:39:36.943</str> >> <str name="Total Requests made to DataSource">3447914</str> >> <str name="Total Rows Fetched">9054602</str> >> <str name="Total Documents Processed">492558</str> >> <str name="Total Documents Skipped">0</str> >> <str name="Delta Dump started">2008-09-18 16:29:38</str> >> <str name="Identifying Delta">2008-09-18 16:29:38</str> >> <str name="Deltas Obtained">2008-09-18 16:30:26</str> >> <str name="Building documents">2008-09-18 16:30:26</str> >> <str name="Total Changed Documents">1603970</str> >> </lst> >> >> look it was this morning : I just stopped it beacause it was too long ... >> It doesn't look logic: >> >> <lst name="statusMessages"> >> <str name="Time Elapsed">6:9:0.256</str> >> <str name="Total Requests made to DataSource">3451431</str> >> <str name="Total Rows Fetched">9165885</str> >> <str name="Total Documents Processed">493061</str> >> <str name="Total Documents Skipped">0</str> >> <str name="Delta Dump started">2008-09-18 10:01:01</str> >> <str name="Identifying Delta">2008-09-18 10:01:01</str> >> <str name="Deltas Obtained">2008-09-18 10:01:43</str> >> <str name="Building documents">2008-09-18 10:01:43</str> >> <str name="Total Changed Documents">1587889</str> >> </lst> >> >> And do you think my cron job can't work ? >> >> > Your wget command looks fine to me. > > >> >> >> -- >> View this message in context: >> http://www.nabble.com/delta-import-looks-stuck------how-can-I-check-if-it%27s-done-or-not---tp19551728p19555223.html >> Sent from the Solr - User mailing list archive at Nabble.com. >> >> > > > -- > Regards, > Shalin Shekhar Mangar. > > -- View this message in context: http://www.nabble.com/delta-import-looks-stuck------how-can-I-check-if-it%27s-done-or-not---tp19551728p19555548.html Sent from the Solr - User mailing list archive at Nabble.com.
