Hi,
I'm currently setting up a schema in solr, which is being imported using
the data-import plugin.
The initial config contains the following key information:
...
<fieldType name="standardTextType"
class="solr.TextField" positionIncrementGap="100" stored="false"
multiValued="false">
<analyzer type="index">
<tokenizer
class="solr.KeywordTokenizerFactory"/>
<filter class="solr.StopFilterFactory"
ignoreCase="true" words="stopwords.txt"/>
<filter
class="solr.LowerCaseFilterFactory"/>
<filter
class="solr.RemoveDuplicatesTokenFilterFactory"/>
</analyzer>
<analyzer type="query">
<tokenizer
class="solr.KeywordTokenizerFactory"/>
<filter
class="solr.LowerCaseFilterFactory"/>
<filter
class="solr.RemoveDuplicatesTokenFilterFactory"/>
</analyzer>
</fieldType>
<fieldType name="ingredientSuggestionType"
class="solr.TextField" positionIncrementGap="100" stored="false"
multiValued="true">
<analyzer type="index">
<tokenizer
class="solr.WhitespaceTokenizerFactory"/>
<filter class="solr.StopFilterFactory"
ignoreCase="true" words="stopwords.txt"/>
<filter
class="solr.LowerCaseFilterFactory"/>
<filter
class="solr.RemoveDuplicatesTokenFilterFactory"/>
</analyzer>
<analyzer type="query">
<tokenizer
class="solr.WhitespaceTokenizerFactory"/>
<filter
class="solr.LowerCaseFilterFactory"/>
<filter
class="solr.RemoveDuplicatesTokenFilterFactory"/>
</analyzer>
</fieldType>
<fieldType name="chefSuggestionType"
class="solr.TextField" positionIncrementGap="100" stored="false"
multiValued="false">
<analyzer type="index">
<tokenizer
class="solr.WhitespaceTokenizerFactory"/>
<filter class="solr.StopFilterFactory"
ignoreCase="true" words="stopwords.txt"/>
<filter
class="solr.LowerCaseFilterFactory"/>
<filter
class="solr.RemoveDuplicatesTokenFilterFactory"/>
<filter
class="solr.EdgeNGramFilterFactory" minGramSize="3" maxGramSize="15"
side="front"/>
</analyzer>
<analyzer type="query">
<tokenizer
class="solr.WhitespaceTokenizerFactory"/>
<filter
class="solr.LowerCaseFilterFactory"/>
<filter
class="solr.RemoveDuplicatesTokenFilterFactory"/>
</analyzer>
</fieldType>
<fieldType name="programmeSuggestionType"
class="solr.TextField" positionIncrementGap="100" stored="false"
multiValued="false">
<analyzer type="index">
<tokenizer
class="solr.WhitespaceTokenizerFactory"/>
<filter class="solr.StopFilterFactory"
ignoreCase="true" words="stopwords.txt"/>
<filter
class="solr.LowerCaseFilterFactory"/>
<filter
class="solr.RemoveDuplicatesTokenFilterFactory"/>
<filter
class="solr.EdgeNGramFilterFactory" minGramSize="3" maxGramSize="15"
side="front"/>
</analyzer>
<analyzer type="query">
<tokenizer
class="solr.WhitespaceTokenizerFactory"/>
<filter
class="solr.LowerCaseFilterFactory"/>
<filter
class="solr.RemoveDuplicatesTokenFilterFactory"/>
</analyzer>
</fieldType>
...
with the following fields:
...
<fields>
<field name="recipeId" type="standardTextType"
indexed="true" stored="true" required="true"/>
<field name="programmeName" type="standardTextType"
indexed="true" stored="true" required="true"/>
<field name="programmeSuggestion"
type="programmeSuggestionType" stored="true"/>
<field name="chefName" type="standardTextType"
indexed="true" stored="true" required="true"/>
<field name="chefSuggestion" type="chefSuggestionType"
stored="true"/>
<field name="ingredientText" type="standardTextType"
indexed="true" stored="true" required="true"/>
<field name="ingredientSuggestion"
type="ingredientSuggestionType" stored="true"/>
and
...
<copyField source="programmeName" dest="programmeSuggestion"/>
<copyField source="chefName" dest="chefSuggestion"/>
<copyField source="ingredientText" dest="ingredientSuggestion"/>
<uniqueKey>recipeId</uniqueKey>
<defaultSearchField>ingredientText</defaultSearchField>
<solrQueryParser defaultOperator="OR"/>
When I query solr with the query ?q=ingredientSuggestion=banana I get
160 results.
Ok, all fine.
When I add a new field such as
<field name="courseName" type="text" indexed="true"
stored="true" required="true"/>
to my index it reduces the number of results from my query to 131, even
though the query
has'nt changed and does not (at least explicitly) filter the result set.
Obviously I'm missing something fundemental , but I'm not sure what it
is. Has anyone else experienced a similar
problem? Am I doing something wrong in the way I am indexing my
database?
Mark
http://www.bbc.co.uk/
This e-mail (and any attachments) is confidential and may contain personal
views which are not the views of the BBC unless specifically stated.
If you have received it in error, please delete it from your system.
Do not use, copy or disclose the information in any way nor act in reliance on
it and notify the sender immediately.
Please note that the BBC monitors e-mails sent or received.
Further communication will signify your consent to this.
