On Mon, 12 Jul 2010 09:20:05 +0200
"Willem Van Riet" wrote:
> Hi Gora
>
> Also indexing 4mil + records from a MS-SQL database - index size
> is about 25Gb.
Thanks for some great pointers. More detailed responses below.
> I managed to solve both the performance and recovery issue by
> "segmenti
On Sun, 11 Jul 2010 07:22:51 -0700 (PDT)
osocurious2 wrote:
>
> Gora,
> Our environment, currently under development, is very nearly the
> exact same thing as yours. My DB is currently only about 10GB,
> but likely to grow.
[...]
Thanks for your response. It is good to hear from people dealing
Hi Gora
Also indexing 4mil + records from a MS-SQL database - index size is
about 25Gb.
I managed to solve both the performance and recovery issue by
"segmenting" the indexing process along with the
CachedSqlEntityProcessor.
Basically I populate a temp table with a subset of primary keys (I use
Gora,
Our environment, currently under development, is very nearly the exact same
thing as yours. My DB is currently only about 10GB, but likely to grow. We
also use Solr as primary repository (store all fields there), but use the DB
as a back up when Full Import is needed. Delta imports aren't th
