Hello..
We have about 4 Million Products in our our Database and the Import takes
about 1,5 hours. In this Time is the Performance of the Database very bad
and our Server crashed sometimes. It's seems that DIH send only ONE select
to the db ?!?! is that right ?
all other processes cannot connect to the db =(...
thats very bad !!!! what is the best solution to make a full-import better,
so that we dont have such problems !?!?!?!? an import with PHP takes tooooo
long for us !
thats the query:
query="select *
FROM items_de.shop_items as i, shops as s
WHERE s.id=i.shop_id AND s.is_active=1 AND s.is_testmode=0 AND
parent_id IS
NULL" >
AND the Mappings for the categories:
<entity name="item_category" pk="id, shop_item_id" dataSource="items"
query="select shop_category_id, order_index FROM
shop_item_category_mappings WHERE shop_item_id='${item.id}'" >
<field column="shop_category_id" name="shop_category_id" />
<field column="order_index" name="popularity"/>
<entity name="categoryName" pk="id" dataSource="items"
query="select name, path from shop_categories where id =
'${item_category.shop_category_id}'" >
<field column="name" name="category" />
</entity>
what do you thing make it better ? can the dih use other options ? make it
sense to use anoter batchSize = "-1" ????
--
View this message in context:
http://lucene.472066.n3.nabble.com/DIH-Full-Import-DB-and-Performance-tp861068p861068.html
Sent from the Solr - User mailing list archive at Nabble.com.
