You're right, the OS is asking the server to shut down. In the default example under Jetty, this is a result of issuing a crtl-c. Is it possible that something is asking your server to quit? What servlet container are you running under? Does the Solr server run for more than this period if you're NOT indexing? And are you sure you have enough resources, especially disk space?
On another note, I'm surprised that it's taking 2 days to index 5m documents. That's less than 30 docs/second and Solr should handle a considerably greater load than that. For whatever that's worth... And what version of Solr are you using? You may want to consider writing something in SolrJ to do your indexing, it'll provide you more flexible control over indexing than DIH.. Best Erick On Mon, Nov 29, 2010 at 1:20 PM, Phong Dais <phong.gd...@gmail.com> wrote: > Hi, > > I am in the process of trying to index about 50 mil documents using the > data > import handler. > For some reason, about 2 days into the import, I see this message "shutdown > hook executing" in the log and the solr web server instance exits > "gracefully". > I do not see any errors in the entire log. This has happened twice now, > usually 5 mil or so documents into the import process. > > Does anyone out there knows what this message mean? It's an INFO log > message so I don't think it is caused by any error. > Does this problem occur because the os is asking the server to shut down > (for whatever reason) or is there something wrong with the server causing > it > to shutdown? > > Thanks for any help, > Phong >
