Ok thanks a lot, so I can remove all this part <field name="title" type="text" indexed="true" stored="false" /> <field name="description" type="text" indexed="true" stored="false" />
<field name="tag1" type="string" indexed="true" stored="false" omitNorms="true" /> <field name="tag2" type="string" indexed="true" stored="false" omitNorms="true" /> <field name="tag3" type="string" indexed="true" stored="false" omitNorms="true" /> <field name="tag4" type="string" indexed="true" stored="false" omitNorms="true" /> <field name="tags" type="string" indexed="true" stored="false" omitNorms="true" multiValued="true" termVectors="true" /> and just keep ... : <copyField source="title" dest="text"/> <copyField source="title_en" dest="text"/> ..title_es ... <copyField source="description" dest="text"/> <copyField source="description_en" dest="text"/> ..title_en ... <copyField source="tag1" dest="text"/> <copyField source="tag2" dest="text"/> <copyField source="tag3" dest="text"/> <copyField source="tag4" dest="text"/> Just to be sure ... I index, title and description if for exemple i need to boost them sepearetly... bf. title^2 description^1.5 Languages one ... need to be index to apply analyzer/stemmer, and boost them differently according to the country.. but I copy them to be searchable. thanks so much for your time .. again and again... Yonik Seeley wrote: > > remove this entry from the example schema unless you need the > timestamp when it was indexed: > > <field name="timestamp" type="date" indexed="true" stored="true" > default="NOW" multiValued="false"/> > > Also, only index fields you really need to search separately. > For example, if the "description" field is also indexed into the > "text" field via copyField, and you only search it via the "text" > field, then don't store or index the description field. > > Retrieving only ids is something that could be optimized in Solr, but > hasn't been done yet. > > -Yonik > > On Thu, Dec 4, 2008 at 11:10 AM, sunnyfr <[EMAIL PROTECTED]> wrote: >> >> Hi Yonik, >> >> I will index my data again .... Can you advice me to optimize a lot my >> data >> and tell me if you see something very wrong or bad for the memory, >> according >> to the fact that I just need to show back the ID, that's it. >> But I need to boost some field ... like description .. >> description_country >> according to the country ... >> >> Thanks a lot, I would appreciate it, >> >> >> <fields> >> <field name="id" type="sint" indexed="true" >> stored="true" omitNorms="true" /> >> >> >> <field name="status_private" type="boolean" indexed="true" >> stored="false" omitNorms="true" /> >> <field name="status_... 6 more like that> >> >> <field name="duration" type="sint" indexed="true" >> stored="false" omitNorms="true" /> >> <field name="created" type="date" indexed="true" >> stored="false" omitNorms="true" /> >> <field name="modified" type="date" indexed="true" >> stored="false" omitNorms="true" /> >> <field name="rating_binrate" type="sint" indexed="true" >> stored="false" omitNorms="true" /> >> <field name="user_id" type="sint" indexed="true" >> stored="false" omitNorms="true" /> >> <field name="country" type="string" indexed="true" >> stored="false" omitNorms="true" /> >> <field name="language" type="string" indexed="true" >> stored="false" omitNorms="true" /> >> <field name="creative_type" type="string" indexed="true" >> stored="false" omitNorms="true" /> >> >> >> <field name="rel_group_ids" type="sint" indexed="true" >> stored="false" omitNorms="true" multiValued="true" /> >> ... 3more like that >> >> >> >> <field name="rel_featured_user_ids" type="sint" indexed="true" >> stored="false" omitNorms="true" multiValued="true" /> >> <field name="rel_featured_group_ids" type="sint" indexed="true" >> stored="false" omitNorms="true" multiValued="true" /> >> >> <field name="stat_views" type="sint" indexed="true" >> stored="false" omitNorms="true" /> >> ...6more like that ... >> >> <field name="title" type="text" >> indexed="true" >> stored="false" /> >> <field name="title_fr" type="text_fr" >> indexed="true" >> stored="false" /> >> <field name="title_en" type="text_en" >> indexed="true" >> stored="false" /> >> <field name="title_de" type="text_de" >> indexed="true" >> stored="false" /> >> <field name="title_es" type="text_es" >> indexed="true" >> stored="false" /> >> <field name="title_ru" type="text_ru" >> indexed="true" >> stored="false" /> >> <field name="title_pt" type="text_pt" >> indexed="true" >> stored="false" /> >> <field name="title_nl" type="text_nl" >> indexed="true" >> stored="false" /> >> <field name="title_el" type="text_el" >> indexed="true" >> stored="false" /> >> <field name="title_ja" type="text_ja" >> indexed="true" >> stored="false" /> >> <field name="title_it" type="text_it" >> indexed="true" >> stored="false" /> >> >> <field name="description" type="text" indexed="true" >> stored="false" /> >> <field name="description_fr" type="text_fr" >> indexed="true" >> stored="false" /> >> <field name="description_en" type="text_en" >> indexed="true" >> stored="false" /> >> <field name="description_de" type="text_de" >> indexed="true" >> stored="false" /> >> <field name="description_es" type="text_es" >> indexed="true" >> stored="false" /> >> <field name="description_ru" type="text_ru" >> indexed="true" >> stored="false" /> >> <field name="description_pt" type="text_pt" >> indexed="true" >> stored="false" /> >> <field name="description_nl" type="text_nl" >> indexed="true" >> stored="false" /> >> <field name="description_el" type="text_el" >> indexed="true" >> stored="false" /> >> <field name="description_ja" type="text_ja" >> indexed="true" >> stored="false" /> >> <field name="description_it" type="text_it" >> indexed="true" >> stored="false" /> >> >> <field name="tag1" type="string" indexed="true" >> stored="false" omitNorms="true" /> >> <field name="tag2" type="string" indexed="true" >> stored="false" omitNorms="true" /> >> <field name="tag3" type="string" indexed="true" >> stored="false" omitNorms="true" /> >> <field name="tag4" type="string" indexed="true" >> stored="false" omitNorms="true" /> >> <field name="tags" type="string" indexed="true" >> stored="false" omitNorms="true" multiValued="true" termVectors="true" /> >> <field name="owner_login" type="string" indexed="true" >> stored="false" omitNorms="true" /> >> >> <field name="text" type="text" indexed="true" stored="false" >> multiValued="false"/> >> <field name="timestamp" type="date" indexed="true" stored="true" >> default="NOW" multiValued="false"/> >> <field name="spell" type="textSpell" indexed="true" stored="false" >> multiValued="true"/> >> <dynamicField name="random*" type="random" /> >> >> </fields> >> >> >> >> >> Yonik Seeley wrote: >>> >>> On Thu, Dec 4, 2008 at 8:13 AM, sunnyfr <[EMAIL PROTECTED]> wrote: >>>> >>>> Hi Yonik, >>>> >>>> I've tried everything but it's doesn't change anything, I tried as well >>>> the >>>> last trunk version but nothing changed. >>>> There is nothings that I can do about the indexation ...maybe I can >>>> optimize >>>> something before searching ??? >>> >>> Did you optimize the index (send in the optimize command) after >>> indexing but before searching? >>> >>> curl http://localhost:8983/solr/update?optimize=true >>> >>>> I'm using linux system, apache 5.5, last solr version updated. >>>> Memory : 8G Intel >>>> >>>> Do you think its a lot for the index size 7.6G for 8.5M of document? >>> >>> So it could be due to the index being slightly to big - subtract out >>> memory for Solr and other stuff, and there's not enough left for >>> everything to fully be cached by the OS. >>> >>> You can make it bigger or smaller depending on how you have the schema >>> configured. >>> The example schema isn't necessarily optimized for speed or size - it >>> serves as an example of many field types and operations. >>> >>> Make sure you only index fields you need to search, sort, or facet on. >>> Make sure you only store fields (marked as stored in the schema) that >>> you really need returned in results. >>> The example schema as copyFields and default values that you don't >>> need - hopefully you've removed them. >>> >>> What's your schema, and do you have more examples of URLs you are >>> sending to Solr (all the parameters)? >>> >>> -Yonik >>> >>> >> >> -- >> View this message in context: >> http://www.nabble.com/Solr-1.3---response-time-very-long-tp20795134p20836635.html >> Sent from the Solr - User mailing list archive at Nabble.com. >> >> > > -- View this message in context: http://www.nabble.com/Solr-1.3---response-time-very-long-tp20795134p20837252.html Sent from the Solr - User mailing list archive at Nabble.com.