For future reference, I had this problem, and it was the debug statements in
commons HTTP that were printing out all the binary data to the log, but my
console appender was set to INFO so I wasn't seeing them. Setting http
commons to INFO level fixed my speed issue (two orders of magnitude faster).
sometorment later
I found the reason ofsolr replication'slow speed. It's not solr's problem.It's
jetty's. I used to embed jetty7 in my app. But when I found solr's demo use
jetty6 , I tried to use jetty6 in my app and I was so happy to get the fast
speed.
actually, I tried to change solr's d
This is the time to replicate and open the new index, right? Opening a
new index can take a lot of time. How many autowarmers and queries are
there in the caches? Opening a new index re-runs all of the queries in
all of the caches.
2010/11/1 kafka0102 :
> I suspected my app has some sleeping op ev
I suspected my app has some sleeping op every 1s, so
I changed ReplicationHandler.PACKET_SZ to 1024 * 1024*10; // 10MB
and log result is like thus :
[2010-11-01
17:49:29][INFO][pool-6-thread-1][SnapPuller.java(1038)]readFully10485760 cost
3184
[2010-11-01
17:49:32][INFO][pool-6-thread-1][SnapPu
I hacked SnapPuller to log the cost, and the log is like thus:
[2010-11-01
17:21:19][INFO][pool-6-thread-1][SnapPuller.java(1037)]readFully1048576 cost 979
[2010-11-01
17:21:19][INFO][pool-6-thread-1][SnapPuller.java(1037)]readFully1048576 cost 4
[2010-11-01
17:21:19][INFO][pool-6-thread-1][Snap
If you are copying from an indexer while you are indexing new content,
this would cause contention for the disk head. Does indexing slow down
during this period?
Lance
2010/10/31 Peter Karich :
> we have an identical-sized index and it takes ~5minutes
>
>
>> It takes about one hour to replacate
we have an identical-sized index and it takes ~5minutes
It takes about one hour to replacate 6G index for solr in my env. But
my network can transfer file about 10-20M/s using scp. So solr's http
replcation is too slow, it's normal or I do something wrong?
It takes about one hour to replacate 6G index for solr in my env. But my
network can transfer file about 10-20M/s using scp. So solr's http replcation
is too slow, it's normal or I do something wrong?
