may be you can do a thread dump of solr . It may throw some light on wht it is upto.
kill -3 pid in *nix --Noble On Mon, Oct 6, 2008 at 6:25 PM, sunnyfr <[EMAIL PROTECTED]> wrote: > > Hi, > > A command is still running... How can I know exactly what does it do ? > Cuz really , it looks like it does something, but I've cron job for > delta-import every five minutes and nothing change .. > last 20 minutes I would say, nothing changed at all, row fetched or request > made .. > And I checked log files, no exception there. > It's the first time this delta import has been started after a tomcat > restart, so maybe it's normal. > How can I check what does it really do right now ? > > [EMAIL PROTECTED]:/data/solr/books/data# ps aux | grep solr > tomcat55 18780 0.0 0.0 9452 1512 ? S 10:45 0:00 /bin/bash > /data/solr/video/bin/snapshooter > root 18786 0.0 0.0 23112 1216 ? S 10:45 0:00 sudo -u > root /data/solr/video/bin/snapshooter > root 18851 0.0 0.0 3944 620 pts/1 S+ 11:17 0:00 grep solr > > Thanks a lot guys for all your help, > > </lst> > <str name="status">busy</str> > <str name="importResponse">A command is still running...</str> > − > <lst name="statusMessages"> > <str name="Time Elapsed">0:28:38.8</str> > <str name="Total Requests made to DataSource">393</str> > <str name="Total Rows Fetched">9184</str> > <str name="Total Documents Processed">55</str> > <str name="Total Documents Skipped">0</str> > <str name="Delta Dump started">2008-10-06 10:45:01</str> > <str name="Identifying Delta">2008-10-06 10:45:01</str> > <str name="Deltas Obtained">2008-10-06 10:45:44</str> > <str name="Building documents">2008-10-06 10:45:44</str> > <str name="Total Changed Documents">8863</str> > </lst> > − > > Still the same, 3hours later : > > <str name="status">busy</str> > <str name="importResponse">A command is still running...</str> > − > <lst name="statusMessages"> > <str name="Time Elapsed">4:1:51.416</str> > <str name="Total Requests made to DataSource">393</str> > <str name="Total Rows Fetched">9184</str> > <str name="Total Documents Processed">55</str> > <str name="Total Documents Skipped">0</str> > <str name="Delta Dump started">2008-10-06 10:45:01</str> > <str name="Identifying Delta">2008-10-06 10:45:01</str> > <str name="Deltas Obtained">2008-10-06 10:45:44</str> > <str name="Building documents">2008-10-06 10:45:44</str> > <str name="Total Changed Documents">8863</str> > </lst> > > And my logs : > > Oct 6 10:45:01 solr-test /USR/SBIN/CRON[18775]: (root) CMD (/usr/bin/wget > -q --output-document=/home/tot.txt > http://solr-test.adm.video.com:8180/solr/video/dataimport?command=delta-import&entity=b) > Oct 6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM > org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr > path=/dataimport params={command=delta-import} status=0 QTime=0 Oct 6, 2008 > 10:45:01 AM org.apache.solr.handler.dataimport.DataImporter doDeltaImport > INFO: Starting Delta Import > Oct 6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM > org.apache.solr.handler.dataimport.SolrWriter readIndexerProperties INFO: > Read dataimport.properties > Oct 6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM > org.apache.solr.handler.dataimport.DocBuilder doDelta INFO: Starting delta > collection. > Oct 6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM > org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Running > ModifiedRowKey() for Entity: rel_group_ids > Oct 6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM > org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed > ModifiedRowKey for Entity: rel_group_ids rows obtained : 0 > Oct 6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM > org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Running > DeletedRowKey() for Entity: rel_group_ids > Oct 6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM > org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed > DeletedRowKey for Entity: rel_group_ids rows obtained : 0 > Oct 6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM > org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed > parentDeltaQuery for Entity: rel_group_ids Oct 6, 2008 10:45:01 AM > org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Running > ModifiedRowKey() for Entity: rel_playlist_ids Oct 6, 2008 10:45:01 AM > org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed > ModifiedRowKey for Entity: rel_playlist_ids rows obtained : 0 Oct 6, 2008 > 10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: > Running DeletedRowKey() for Entity: rel_playlist_ids Oct 6, 2008 10:45:01 AM > org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed > DeletedRowKey for Entity: rel_playlist_ids rows obtained : 0 Oct 6, 2008 > 10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: > Completed parentDeltaQuery for Entity: rel_playlist_ids Oct 6, 2008 10:45:01 > AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Ru > Oct 6 10:45:01 solr-test jsvc.exec[18716]: fan_ids Oct 6, 2008 10:45:01 AM > org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed > ModifiedRowKey for Entity: rel_fan_ids rows obtained : 0 Oct 6, 2008 > 10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: > Running DeletedRowKey() for Entity: rel_fan_ids Oct 6, 2008 10:45:01 AM > org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed > DeletedRowKey for Entity: rel_fan_ids rows obtained : 0 Oct 6, 2008 10:45:01 > AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: > Completed parentDeltaQuery for Entity: rel_fan_ids Oct 6, 2008 10:45:01 AM > org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Running > ModifiedRowKey() for Entity: rel_featured_home_country Oct 6, 2008 10:45:01 > AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: > Completed ModifiedRowKey for Entity: rel_featured_home_country rows obtained > : 0 Oct 6, 2008 10:45:01 AM org.apache.solr.handler.dataimport.DocBuil > Oct 6 10:45:01 solr-test jsvc.exec[18716]: owKey() for Entity: > rel_featured_home_country Oct 6, 2008 10:45:01 AM > org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed > DeletedRowKey for Entity: rel_featured_home_country rows obtained : 0 Oct 6, > 2008 10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta > INFO: Completed parentDeltaQuery for Entity: rel_featured_home_country Oct > 6, 2008 10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder > collectDelta INFO: Running ModifiedRowKey() for Entity: > rel_featured_user_ids Oct 6, 2008 10:45:01 AM > org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed > ModifiedRowKey for Entity: rel_featured_user_ids rows obtained : 0 Oct 6, > 2008 10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta > INFO: Running DeletedRowKey() for Entity: rel_featured_user_ids Oct 6, 2008 > 10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: > Completed DeletedRowKey for Entity: rel_featured_user_ids rows ob > Oct 6 10:45:01 solr-test jsvc.exec[18716]: > apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed > parentDeltaQuery for Entity: rel_featured_user_ids Oct 6, 2008 10:45:01 AM > org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Running > ModifiedRowKey() for Entity: rel_featured_group_ids Oct 6, 2008 10:45:01 AM > org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed > ModifiedRowKey for Entity: rel_featured_group_ids rows obtained : 0 Oct 6, > 2008 10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta > INFO: Running DeletedRowKey() for Entity: rel_featured_group_ids Oct 6, 2008 > 10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: > Completed DeletedRowKey for Entity: rel_featured_group_ids rows obtained : 0 > Oct 6, 2008 10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder > collectDelta INFO: Completed parentDeltaQuery for Entity: > rel_featured_group_ids Oct 6, 2008 10:45:01 AM > org.apache.solr.handler.dataimport.DocBuilder collectDelt > Oct 6 10:45:01 solr-test jsvc.exec[18716]: tity: video Oct 6, 2008 10:45:01 > AM org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a > connection for entity video with URL: > jdbc:mysql://master-spare.vip.videos.com/videos Oct 6, 2008 10:45:01 AM > org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken > for getConnection(): 0 > > > Oct 6 10:45:42 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:42 AM > org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr > path=/dataimport params={} status=0 QTime=0 > Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM > org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed > ModifiedRowKey for Entity: video rows obtained : 8863 > Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM > org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Running > DeletedRowKey() for Entity: video > Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM > org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed > DeletedRowKey for Entity: video rows obtained : 0 > Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM > org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed > parentDeltaQuery for Entity: video > Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM > org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a > connection for entity video with URL: > jdbc:mysql://master-spare.vip.videos.com/videos > Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM > org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken > for getConnection(): 0 > Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM > org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a > connection for entity rel_group_ids with URL: > jdbc:mysql://master-spare.vip.videos.com/videos > Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM > org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken > for getConnection(): 0 > Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM > org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a > connection for entity rel_playlist_ids with URL: > jdbc:mysql://master-spare.vip.videos.com/videos > Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM > org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken > for getConnection(): 0 > Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM > org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a > connection for entity rel_fan_ids with URL: > jdbc:mysql://master-spare.vip.videos.com/videos > Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM > org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken > for getConnection(): 0 > Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM > org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a > connection for entity rel_featured_home_country with URL: > jdbc:mysql://master-spare.vip.videos.com/videos > Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM > org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken > for getConnection(): 0 > Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM > org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a > connection for entity rel_featured_user_ids with URL: > jdbc:mysql://master-spare.vip.videos.com/videos > Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM > org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken > for getConnection(): 0 > Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM > org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a > connection for entity rel_featured_group_ids with URL: > jdbc:mysql://master-spare.vip.videos.com/videos > Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM > org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken > for getConnection(): 0 > Oct 6 10:45:45 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:45 AM > org.apache.solr.update.DirectUpdateHandler2 commit INFO: start > commit(optimize=false,waitFlush=true,waitSearcher=true) > Oct 6 10:47:22 solr-test jsvc.exec[18716]: Oct 6, 2008 10:47:22 AM > org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr > path=/dataimport params={} status=0 QTime=0 > Oct 6 10:48:02 solr-test jsvc.exec[18716]: Oct 6, 2008 10:48:02 AM > org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr > path=/dataimport params={} status=0 QTime=0 > Oct 6 10:50:01 solr-test /USR/SBIN/CRON[18788]: (root) CMD (/root/memmon.sh >>> /root/memmon.txt) > Oct 6 10:50:01 solr-test /USR/SBIN/CRON[18791]: (root) CMD (/usr/bin/wget > -q --output-document=/home/tot.txt > http://solr-test.adm.videos.com:8180/solr/videos/dataimport?command=delta-import&entity=b) > Oct 6 10:50:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:50:01 AM > org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr > path=/dataimport params={command=delta-import} status=0 QTime=0 > > ..... > Oct 6 11:17:01 solr-test /USR/SBIN/CRON[18844]: (root) CMD ( cd / && > run-parts --report /etc/cron.hourly) > Oct 6 11:17:02 solr-test ntpdate[18849]: adjust time server 195.8.215.137 > offset -0.036227 sec > Oct 6 11:20:01 solr-test /USR/SBIN/CRON[18853]: (root) CMD (/root/memmon.sh >>> /root/memmon.txt) > Oct 6 11:20:01 solr-test /USR/SBIN/CRON[18856]: (root) CMD (/usr/bin/wget > -q --output-document=/home/tot.txt > http://solr-test.adm.videos.com:8180/solr/videos/dataimport?command=delta-import&entity=b) > Oct 6 11:20:01 solr-test jsvc.exec[18716]: Oct 6, 2008 11:20:01 AM > org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr > path=/dataimport params={command=delta-import} status=0 QTime=0 > Oct 6 11:24:08 solr-test jsvc.exec[18716]: Oct 6, 2008 11:24:08 AM > org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr > path=/dataimport params={} status=0 QTime=0 > Oct 6 11:24:16 solr-test jsvc.exec[18716]: Oct 6, 2008 11:24:16 AM > org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr > path=/dataimport params={} status=0 QTime=0 > Oct 6 11:24:19 solr-test jsvc.exec[18716]: Oct 6, 2008 11:24:19 AM > org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr > path=/dataimport params={} status=0 QTime=0 > Oct 6 11:25:01 solr-test /USR/SBIN/CRON[18864]: (root) CMD ([ -x > /usr/lib/sysstat/sa1 ] && { [ -r "$DEFAULT" ] && . "$DEFAULT" ; [ "$ENABLED" > = "true" ] && exec /usr/lib/sysstat/sa1 $SA1_OPTIONS 1 1 ; }) > Oct 6 11:25:01 solr-test /USR/SBIN/CRON[18866]: (root) CMD (/usr/bin/wget > -q --output-document=/home/tot.txt > http://solr-test.adm.videos.com:8180/solr/videos/dataimport?command=delta-import&entity=b) > Oct 6 11:25:01 solr-test jsvc.exec[18716]: Oct 6, 2008 11:25:01 AM > org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr > path=/dataimport params={command=delta-import} status=0 QTime=0 > Oct 6 11:30:01 solr-test /USR/SBIN/CRON[18870]: (root) CMD (/root/memmon.sh >>> /root/memmon.txt) > Oct 6 11:30:01 solr-test /USR/SBIN/CRON[18872]: (root) CMD (/usr/bin/wget > -q --output-document=/home/tot.txt > http://solr-test.adm.videos.com:8180/solr/videos/dataimport?command=delta-import&entity=b) > Oct 6 11:30:01 solr-test jsvc.exec[18716]: Oct 6, 2008 11:30:01 AM > org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr > path=/dataimport params={command=delta-import} status=0 QTime=0 > Oct 6 11:33:29 solr-test jsvc.exec[18716]: Oct 6, 2008 11:33:29 AM > org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr > path=/dataimport params={} status=0 QTime=0 > Oct 6 11:33:30 solr-test jsvc.exec[18716]: Oct 6, 2008 11:33:30 AM > org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr > path=/dataimport params={} status=0 QTime=0 > Oct 6 11:33:30 solr-test jsvc.exec[18716]: Oct 6, 2008 11:33:30 AM > org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr > path=/dataimport params={} status=0 QTime=0 > Oct 6 11:35:01 solr-test /USR/SBIN/CRON[18880]: (root) CMD ([ -x > /usr/lib/sysstat/sa1 ] && { [ -r "$DEFAULT" ] && . "$DEFAULT" ; [ "$ENABLED" > = "true" ] && exec /usr/lib/sysstat/sa1 $SA1_OPTIONS 1 1 ; }) > Oct 6 11:35:01 solr-test /USR/SBIN/CRON[18882]: (root) CMD (/usr/bin/wget > -q --output-document=/home/tot.txt > http://solr-test.adm.videos.com:8180/solr/videos/dataimport?command=delta-import&entity=b) > Oct 6 11:35:01 solr-test jsvc.exec[18716]: Oct 6, 2008 11:35:01 AM > org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr > path=/dataimport params={command=delta-import} status=0 QTime=0 > Oct 6 11:36:26 solr-test jsvc.exec[18716]: Oct 6, 2008 11:36:26 AM > org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr > path=/dataimport params={} status=0 QTime=0 > Oct 6 11:36:36 solr-test jsvc.exec[18716]: Oct 6, 2008 11:36:36 AM > org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr > path=/dataimport params={} status=0 QTime=0 > Oct 6 11:36:37 solr-test jsvc.exec[18716]: Oct 6, 2008 11:36:37 AM > org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr > path=/dataimport params={} status=0 QTime=0 > Oct 6 11:40:01 solr-test /USR/SBIN/CRON[18885]: (root) CMD (/root/memmon.sh >>> /root/memmon.txt) > Oct 6 11:40:01 solr-test /USR/SBIN/CRON[18888]: (root) CMD (/usr/bin/wget > -q --output-document=/home/tot.txt > http://solr-test.adm.videos.com:8180/solr/videos/dataimport?command=delta-import&entity=b) > Oct 6 11:40:01 solr-test jsvc.exec[18716]: Oct 6, 2008 11:40:01 AM > org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr > path=/dataimport params={command=delta-import} status=0 QTime=0 > Oct 6 11:45:01 solr-test /USR/SBIN/CRON[18896]: (root) CMD ([ -x > /usr/lib/sysstat/sa1 ] && { [ -r "$DEFAULT" ] && . "$DEFAULT" ; [ "$ENABLED" > = "true" ] && exec /usr/lib/sysstat/sa1 $SA1_OPTIONS 1 1 ; }) > Oct 6 11:45:01 solr-test /USR/SBIN/CRON[18898]: (root) CMD (/usr/bin/wget > -q --output-document=/home/tot.txt > http://solr-test.adm.videos.com:8180/solr/videos/dataimport?command=delta-import&entity=b) > Oct 6 11:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 11:45:01 AM > org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr > path=/dataimport params={command=delta-import} status=0 QTime=0 > > > -- > View this message in context: > http://www.nabble.com/command-is-still-running---delta-import--tp19837392p19837392.html > Sent from the Solr - User mailing list archive at Nabble.com. > > -- --Noble Paul
