Salman, To my knowledge, there's not a great way of doing this.
Perhaps if your dataset were based on a time series, you could shard by date, and then only a smaller segment of your data would be updated and therefore need to be sent each week? Michael Della Bitta Applications Developer o: +1 646 532 3062 appinions inc. “The Science of Influence Marketing” 18 East 41st Street New York, NY 10017 t: @appinions <https://twitter.com/Appinions> | g+: plus.google.com/appinions<https://plus.google.com/u/0/b/112002776285509593336/112002776285509593336/posts> w: appinions.com <http://www.appinions.com/> On Wed, Jan 22, 2014 at 4:48 AM, Salman Akram < salman.ak...@northbaysolutions.net> wrote: > We do. We have a lot of updates/deletes every day and a weekly optimization > definitely gives a considerable improvement so don't see a downside to it > except the complete replication part which is not an issue on local > network. >