Hi Jack,
Thanks.
Even though I have mentioned compound Index to true in the Indexconfig
section of schema for 3.6 version ,it still seems to create normal Index
files.
Attached is the solrconfig.xml
Please let me know if anything wrong
Regards
Sujatha
On Sat, Sep 15, 2012 at 9:43 PM, Jack Krupansky <j...@basetechnology.com>wrote:
> Correcting myself, for #4, Solr doesn't "analyze" string fields such as
> the unique key field, but... a transformer or other logic, say in DIH, that
> constructs the document key values might behave differently between Solr
> 1.3 and 3.6. Maybe there was a bug in 1.3 that caused distinct keys to map
> to the same value (causing documents to be discarded), but now in 3.6 the
> mapping is correct and distinct (and more documents are correctly indexed.
>
> -- Jack Krupansky
>
> -----Original Message----- From: Jack Krupansky
> Sent: Saturday, September 15, 2012 10:34 AM
>
> To: solr-user@lucene.apache.org
> Subject: Re: 1.3 to 3.6 migration
>
> Try some queries in both the old and the new and identify some documents
> that appear in one and not the other. Then examine a couple of those docs
> in
> detail one field at a time and see if anything is suspicious. Take each
> field value and enter it into the Solr Admin Analysis page to see how Solr
> 3.6 analyzes the field value compared to 1.3.
>
> Four likely scenarios:
> 1. The additional docs were not present when you indexed with 1.3.
> 2. Your indexing tool (DIH, or whatever) may have discarded the docs in
> 1.3
> due to some issue that has now been resolved.
> 3. Solr 1.3 got an error those documents but your indexing process
> continued
> despite the error, while Solr 3.6 may not have hit those errors, possibly
> because it is more flexible and has more features now.
> 4. Your key values analyze differently in Solr 3.6 so that the keys of the
> extra documents mapped to other existing keys in Solr 1.3, causing the
> "extra" documents to overwrite existing documents in Solr 1.3.
>
> -- Jack Krupansky
>
> -----Original Message----- From: Sujatha Arun
> Sent: Saturday, September 15, 2012 2:39 AM
> To: solr-user@lucene.apache.org
> Subject: Re: 1.3 to 3.6 migration
>
> Can you please elaborate?
>
> Regards
> Sujatha
>
> On Sat, Sep 15, 2012 at 1:34 AM, Otis Gospodnetic <
> otis.gospodne...@gmail.com> wrote:
>
> Hi,
>>
>> Maybe your indexer is different/modified/buggy?
>>
>> Otis
>> --
>> Search Analytics -
>> http://sematext.com/search-**analytics/index.html<http://sematext.com/search-analytics/index.html>
>> Performance Monitoring -
>> http://sematext.com/spm/index.**html<http://sematext.com/spm/index.html>
>>
>>
>> On Fri, Sep 14, 2012 at 3:23 PM, Sujatha Arun <suja.a...@gmail.com>
>> wrote:
>> > Hi,
>> >
>> > Just migrated to 3.6.1 from 1.3 version with the following observation
>> >
>> > Indexed content using the same source
>> >
>> > 1.3
>> > 3.6.1
>> > Number of documents indexed 11505 13937
>> > Index Time - Full Index 170ms
>> 171ms
>> > Index size 23 MB
>> > 31MB
>> > Query Time [first time] for *:* 44 ms
>> 187
>> >
>> > and *:* query is not cached in 3.6.1 in query result cache ,is this
>> > expected?
>> >
>> > some points:
>> >
>> > Even though I used the same data source ,the number of documents indexed
>> > seem to be more in 3.6.1 [ not sure why?]
>> > All the other params including index size and query time seem to be more
>> > instnead of less in 3.6.1 and queries are not getting cached in 3.6.1
>> >
>> > Attached the schema's - any pointers?
>> >
>> > Regards
>> > Sujatha
>> >
>>
>>
<?xml version="1.0" encoding="UTF-8" ?>
<!--
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to You under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
<config>
<abortOnConfigurationError>${solr.abortOnConfigurationError:true}</abortOnConfigurationError>
<luceneMatchVersion>LUCENE_36</luceneMatchVersion>
<!-- The DirectoryFactory to use for indexes.
solr.StandardDirectoryFactory, the default, is filesystem based.
solr.RAMDirectoryFactory is memory based, not persistent, and doesn't work with replication. -->
<directoryFactory name="DirectoryFactory" class="${solr.directoryFactory:solr.StandardDirectoryFactory}"/>
<indexConfig>
<!-- Values here affect all index writers and act as a default unless overridden. -->
<useCompoundFile>true</useCompoundFile>
<mergeFactor>4</mergeFactor>
<ramBufferSizeMB>32</ramBufferSizeMB>
<maxMergeDocs>2147483647</maxMergeDocs>
<maxFieldLength>10000</maxFieldLength>
<writeLockTimeout>1000</writeLockTimeout>
<commitLockTimeout>10000</commitLockTimeout>
<lockType>single</lockType>
</indexConfig>
<jmx />
<updateHandler class="solr.DirectUpdateHandler2" />
<query>
<maxBooleanClauses>100000</maxBooleanClauses>
<filterCache class="solr.FastLRUCache"
size="16384"
initialSize="4096"
autowarmCount="4096"/>
<queryResultCache
class="solr.LRUCache"
size="16384"
initialSize="4096"
autowarmCount="1024"/>
<documentCache
class="solr.LRUCache"
size="16384"
initialSize="4096"
autowarmCount="0"/>
<enableLazyFieldLoading>true</enableLazyFieldLoading>
<useFilterForSortedQuery>true</useFilterForSortedQuery>
<queryResultWindowSize>50</queryResultWindowSize>
<queryResultMaxDocsCached>200</queryResultMaxDocsCached>
<HashDocSet maxSize="3000" loadFactor="0.75"/>
<!-- <listener event="newSearcher" class="solr.QuerySenderListener">
<arr name="queries">-->
<!--
<lst><str name="q">solr</str><str name="sort">price asc</str></lst>
<lst><str name="q">rocks</str><str name="sort">weight asc</str></lst>
-->
<!-- </arr>
</listener> -->
<!-- <listener event="firstSearcher" class="solr.QuerySenderListener">
<arr name="queries">
<lst> -->
<!-- <str name="q">static firstSearcher warming in solrconfig.xml</str> -->
<!-- </lst>
</arr>
</listener>-->
<useColdSearcher>false</useColdSearcher>
<maxWarmingSearchers>2</maxWarmingSearchers>
</query>
<requestDispatcher handleSelect="true" >
<requestParsers enableRemoteStreaming="false" multipartUploadLimitInKB="2048" />
<httpCaching lastModifiedFrom="openTime"
etagSeed="Solr">
</httpCaching>
</requestDispatcher>
<requestHandler name="standard" class="solr.SearchHandler" default="true">
<!-- default values for query parameters -->
<lst name="defaults">
<str name="echoParams">explicit</str>
<!--
<int name="rows">10</int>
<str name="fl">*</str>
<str name="version">2.1</str>
-->
</lst>
</requestHandler>
<requestHandler name="/update" class="solr.XmlUpdateRequestHandler" />
<requestHandler name="/analysis" class="solr.AnalysisRequestHandler" />
<requestHandler name="/admin/" class="org.apache.solr.handler.admin.AdminHandlers" />
<requestHandler name="/admin/ping" class="PingRequestHandler">
<lst name="defaults">
<str name="qt">standard</str>
<str name="q">solrpingquery</str>
<str name="echoParams">all</str>
</lst>
</requestHandler>
<!-- Echo the request contents back to the client -->
<requestHandler name="/debug/dump" class="solr.DumpRequestHandler" >
<lst name="defaults">
<str name="echoParams">explicit</str> <!-- for all params (including the default etc) use: 'all' -->
<str name="echoHandler">true</str>
</lst>
</requestHandler>
<queryResponseWriter name="php" class="org.apache.solr.request.PHPResponseWriter"/>
<queryResponseWriter name="phps" class="org.apache.solr.request.PHPSerializedResponseWriter"/>
<queryResponseWriter name="xslt" class="org.apache.solr.request.XSLTResponseWriter">
<int name="xsltCacheLifetimeSeconds">5</int>
</queryResponseWriter>
<!-- config for the admin interface -->
<admin>
<defaultQuery>solr</defaultQuery>
</admin>
</config>
