Re: Indexing large Mysql table using DIH

2010-02-02 Thread Lukas Kahwe Smith
On 02.02.2010, at 22:45, Giri wrote: > HI, > > I have a simple MySQLtable with 12 million rows (7 columns), I have been > trying to use the DIH to index all the rows, I tired using the batchSize = > "25000", but DIH is failing after a while. but if I split the query with > limit and offset (limi

Indexing large Mysql table using DIH

2010-02-02 Thread Giri
HI, I have a simple MySQLtable with 12 million rows (7 columns), I have been trying to use the DIH to index all the rows, I tired using the batchSize = "25000", but DIH is failing after a while. but if I split the query with limit and offset (limit 100 offset 0), it is indexing the records pro