HI, I have a simple MySQLtable with 12 million rows (7 columns), I have been trying to use the DIH to index all the rows, I tired using the batchSize = "25000", but DIH is failing after a while. but if I split the query with limit and offset (limit 1000000 offset 0), it is indexing the records properly.
The batchSize is not really fetching 25000 records from the DB, it is still try to get all the 12 million rows. I am using MySQL server version 5.0.77. Another question, when I run the DIH ( http://localhost:8080/my_solr/dataimport?command=full-import), is there a way to commit the index without restarting the tomcat? the records appear only after I run the dataimport and restart the tomcat. Thanks!
