These are orthogonal. Confusing I know... In my blog, "batch size" refers to the number of documents sent to _Solr_ when you're indexing, in this case from a SolrJ program but the results generally hold for HTTP requests.
The "batch size" you're seeing in DIH is the batch size for getting records from the SQL database. Completely different things....... And assuming you're using a Java program, you really have to look at your individual JDBC APIs. The batchsize of -1 for DIH is particular to MySQL, other DBs perform fine with a fixed size batch. I'd recommend the forums for your particular JDBC to figure out what you want to do with this setting. Best, Erick On Tue, Apr 26, 2016 at 5:36 AM, Bastien Latard - MDPI AG <lat...@mdpi.com.invalid> wrote: > Hi Eric (Erickson) & others, > > I read your post 'batching when indexing is good > <https://lucidworks.com/blog/2015/10/05/really-batch-updates-solr-2/>'. > But I also read this one > <https://datafireball.com/2016/02/29/solr-dih-batchsize/>, which recommend > to use batchSize="-1". > > So I have now some questions: > - when you speak about 'Packet Size', are you speaking about batchSize? > - where can I define the Integer.MIN_VALUE used by the setFetchSize() from > JDBC con. ? (I use mysql jdbc) > > Kind regards, > Bastien
