On Sat, Jan 28, 2012 at 10:35 AM, mathieu lacage <mathieu.lac...@alcmeon.com > wrote:
> > (I have tried two different sqlite jdbc drivers so, I doubt it could > be a problem there, but, who knows). > I eventually screamed really loud when I read the source code of the sqlite jdbc drivers: they interpret the jdbcDataSource attribute batchSize as a hard limit on the number of results to return. The default is 500. QED. I am not very familiar with the details of the expected semantcs if jdbc drivers so, I do not know whether or not this is a bug in there or in JdbcDataSource. What I know, though, is that if you want to use sqlite with JdbcDataSource, you better set batchSize=0 as such: <dataSource type="JdbcDataSource" driver="org.sqlite.JDBC" url="jdbc:sqlite:/home/mathieu/data/final.db" batchSize="0"/> This deserves an entry in http://wiki.apache.org/solr/DataImportHandlerFaqwhich I would have updated but it is immutable. *hint to those who have edit powers there* This is a sucky weekend. Mathieu -- Mathieu Lacage <mathieu.lac...@alcmeon.com>
