Re: Recommended MySQL JDBC driver

2010-06-26 Thread Marc Sturlese
I supose you use BatchSize=-1 to index that amount of data. Up from 5.1.7 connector there's this param: netTimeoutForStreamingResults The default value is 600. Increasing that maybe can help (2400 for example?) -- View this message in context: http://lucene.472066.n3.nabble.com/Recommended-MySQL

Re: Recommended MySQL JDBC driver

2010-06-25 Thread Lukas Kahwe Smith
On 18.05.2010, at 17:22, Shawn Heisey wrote: > On 5/14/2010 12:40 PM, Shawn Heisey wrote: >> I downgraded to 5.0.8 for testing. Initially, I thought it was going to be >> faster, but it slows down as it gets further into the index. It now looks >> like it's probably going to take the same amou

Re: Recommended MySQL JDBC driver

2010-05-18 Thread Shawn Heisey
On 5/14/2010 12:40 PM, Shawn Heisey wrote: I downgraded to 5.0.8 for testing. Initially, I thought it was going to be faster, but it slows down as it gets further into the index. It now looks like it's probably going to take the same amount of time. On the server timeout thing - that's a sett

Re: Recommended MySQL JDBC driver

2010-05-14 Thread Shawn Heisey
Lucas.. was there a reason you went with 5.1.10 or was it just the latest when you started your Solr project? just what was recent when i set things up. Also, how many items are in your index and how big is your index size? index size is 4.6GB with about 16M entities. I

Re: Recommended MySQL JDBC driver

2010-05-14 Thread Lukas Kahwe Smith
On 14.05.2010, at 19:16, Blargy wrote: > > Lucas.. was there a reason you went with 5.1.10 or was it just the latest > when you started your Solr project? just what was recent when i set things up. > Also, how many items are in your index and how big is your index size? index size is 4.6GB w

Re: Recommended MySQL JDBC driver

2010-05-14 Thread Blargy
Lucas.. was there a reason you went with 5.1.10 or was it just the latest when you started your Solr project? Also, how many items are in your index and how big is your index size? Thanks -- View this message in context: http://lucene.472066.n3.nabble.com/Recommended-MySQL-JDBC-driver-tp817458p

Re: Recommended MySQL JDBC driver

2010-05-14 Thread Lukas Kahwe Smith
Hi, just FYI I am using mysql-connector-java-5.1.10-bin.jar and I my full import takes about 3 hours and I am not experiencing crashes. regards, Lukas

Re: Recommended MySQL JDBC driver

2010-05-14 Thread Blargy
Shawn, first off thanks for the reply and links! "As far as the error in the 5.0.8 version, does the import work, or does it fail when the exception is thrown?" - The import "works" for about 5-10 minutes then it fails and everything is rolled-back one the above exception is thrown. " You might

Re: Recommended MySQL JDBC driver

2010-05-14 Thread Shawn Heisey
I would like to know the same thing. I'm using 5.1.12 myself. A full reindex of one of my shards takes 4-6 hours for 7 million rows, depending on whether I run them one at a time or all at once. If I run the same query on the same machine with the commandline client and write the results to