facet order

2010-05-29 Thread search
Hi, how can i configuratively order facets according to total count of facet fields? for example - facets with the highest count be on top. facet1 [0] abc (20) def (18) ghi (16) facet2 [1] jkl (10) mno (9) pqr (2) thanks dev.

Re: facet order

2010-05-29 Thread search
oh yes thats correct, but that orders the items inside a facet. i am using multiple facet fields. so i want to have the field with the most items first. thanks. > use: facet.sort=true > > > http://wiki.apache.org/solr/SimpleFacetParameters#facet.sort > > > On Sat, May 29, 2010 at 3:53 PM, wrote

memory leak during undeploying

2011-03-02 Thread Search Learn
Hello, We currently deploy and undeploy solr web application potentially hundred's of times during a typical day. when the solr is undeployed, its classes are not getting unloaded and eventually we are running into permgen error. There are couple of JIRA's related to this: https://issues.apache.org

Re: memory leak during undeploying

2011-03-02 Thread Search Learn
Thanks for the suggestions. Tomcat does release permgen memory with appropriate jvm options and configuration settings ( clearReferencesStopTimerThreads, clearReferencesThreadLocals). When I did heap analysis, the culprit always seems to be TimeLimitedCollector thread. Because of this, considerable

custom reranking

2009-02-26 Thread CIF Search
We have a distributed index consisting of several shards. There could be some documents repeated across shards. We want to remove the duplicate records from the documents returned from the shards, and re-order the results by grouping them on the basis of a clustering algorithm and reranking the doc

Re: custom reranking

2009-02-26 Thread CIF Search
, 2009, at 6:04 AM, CIF Search wrote: > > We have a distributed index consisting of several shards. There could be >> some documents repeated across shards. We want to remove the duplicate >> records from the documents returned from the shards, and re-order the >> results by g

input XSLT

2009-03-09 Thread CIF Search
Just as you have an xslt response writer to convert Solr xml response to make it compatible with any application, on the input side do you have an xslt module that will parse xml documents to solr format before posting them to solr indexer. I have gone through dataimporthandler, but it works in dat

Re: input XSLT

2009-03-12 Thread CIF Search
will also facilitate plugging in solr seamlessly with all kinds of applications. Regards, CI On Wed, Mar 11, 2009 at 11:52 PM, Noble Paul നോബിള്‍ नोब्ळ् < noble.p...@gmail.com> wrote: > On Tue, Mar 10, 2009 at 12:17 PM, CIF Search wrote: > > Just as you have an xslt response w

Re: input XSLT

2009-03-12 Thread CIF Search
man...@gmail.com> wrote: > On Fri, Mar 13, 2009 at 11:36 AM, CIF Search wrote: > > > There is a fundamental problem with using 'pull' approach using DIH. > > Normally people want a delta imports which are done using a timestamp > > field. > > Now it may not

response time

2009-04-06 Thread CIF Search
Hi, I have around 10 solr servers running indexes of around 80-85 GB each and and with 16,000,000 docs each. When i use distrib for querying, I am not getting a satisfactory response time. My response time is around 4-5 seconds. Any suggestions to improve the response time for queries (to bring it

Re: custom reranking

2009-04-07 Thread CIF Search
Would it not be a good idea to provide Ranking as solr plugin, in which users can write their custom ranking algorithms and reorder the results returned by Solr in whichever way they need. It may also help Solr users to incorporate learning (from search user feedback - such as click logs), and

Re: response time

2009-04-07 Thread CIF Search
yes, non cached. If I repeat a query the response is fast since the results are cached. 2009/4/7 Noble Paul നോബിള്‍ नोब्ळ् > are these the numbers for non-cached requests? > > On Tue, Apr 7, 2009 at 11:46 AM, CIF Search wrote: > > Hi, > > > > I have around 10 solr

truncating indexed docs

2009-04-15 Thread CIF Search
Is it possible to truncate large documents once they are indexed? (Can this be done without re-indexing) Regards, CI

How to stop backup once initiated

2014-03-21 Thread search engn dev
My index size 20 GB and I have issues solr backup command , now this backup is going on its taking too much time , so how can i stop backup command? -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-stop-backup-once-initiated-tp4126020.html Sent from the Solr - User mai

Need of hadoop

2014-07-07 Thread search engn dev
Currently i am exploring hadoop with solr, Somewhere it is written as "This does not use Hadoop Map-Reduce to process Solr data, rather it only uses the HDFS filesystem for index and transaction log file storage. " , then what is the advantage of using using hadoop over local file system? will use

Re: Need of hadoop

2014-07-07 Thread search engn dev
It is written here -- View this message in context: http://lucene.472066.n3.nabble.com/Need-of-hadoop-tp4145846p4146033.html Sent from the Solr - User mailing list archive at Nabble.com.

Understanding query behaviour in LBHttpSolrServer

2014-07-17 Thread search engn dev
I just want to understand query flow and how load balancing works in case of LBHttpSolrServer. We have setup SolrCloud with one collection, and that collection has 4 shards and each shard has two nodes i.e one master and one replica. I have configured LBHttpSolrServer as below. SolrServer lbHttpS

SolrCloud performance issues regarding hardware configuration

2014-07-17 Thread search engn dev
I need help regarding hardware configuration of my SolrCloud setup. most of the queries to our SolrCloud are boolean queries involving 6-7 fields and spatial and facet queries. currently for facet queries solr throws OOM errors. below are my solrcloud stats, solr version 4.6.1 1 collection : 4 sha

Re: Understanding query behaviour in LBHttpSolrServer

2014-07-17 Thread search engn dev
Thanks Shawn, I am also not sure about query flow , >From my understanding solr and solrj works as below, 1. LBHttpSolrServer keeps pinging above list of servers and maintains list of live servers. 2. Every time query arives it picks one server from the list (round-robin fashion) 3. Sends que

RE: SolrCloud performance issues regarding hardware configuration

2014-07-18 Thread search engn dev
out of 700 million documents 95-97% values are unique approx. My facet query is : http://localhost:8983/solr/select?q=*:*&rows=0&facet=true&facet.limit=1&facet.field=user_digest Above query throws OOM exception as soon as fire it to solr. -- View this message in context: http://lucene.

Re: SolrCloud performance issues regarding hardware configuration

2014-07-20 Thread search engn dev
Thanks Erick, /"So your choices are either to increase memory (a lot) or not do this. It's a valid question whether this is useful information to present to a user (or are you doing some kind of analytics here?). "/ Yes, You are right my facet queries are for text analytic purpose. Users will

how many shards required to search data

2014-02-20 Thread search engn dev
will I need to search data? -- View this message in context: http://lucene.472066.n3.nabble.com/how-many-shards-required-to-search-data-tp4118715.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: how many shards required to search data

2014-02-20 Thread search engn dev
Shard1 config : Config: 32GB RAM, 4 core Shard2 config : Config: 32GB RAM, 4 core -- View this message in context: http://lucene.472066.n3.nabble.com/how-many-shards-required-to-search-data-tp4118715p4118717.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: how many shards required to search data

2014-02-21 Thread search engn dev
As you suggestedI have indexed 12million sample records in solr on hardware of 8gb ram. Size of index is 3gb. can i extrapolate this to predict actual size of index.? -- View this message in context: http://lucene.472066.n3.nabble.com/how-many-shards-required-to-search-data-tp4118715p4118753

Knowing shard value of result

2014-02-26 Thread search engn dev
I have setup solr cloud of two shards and two replicas. I am using solrj for communicating with solr. We are using CloudSolrServer for searching in solr cloud. below is my code String zkHost = "host1:2181,host1:2182,host1:2183,host1:2184,host1:2185"; CloudSolrSe

Re: Knowing shard value of result

2014-02-26 Thread search engn dev
Thanks iorixxx, SolrQuery parameters = new SolrQuery(); parameters.set("q","*:*"); parameters.set("fl","Id,STATE_NAME,[shard]"); parameters.set("distrib","true"); QueryResponse response = server.query(parameters); It's working fine now. -- View this message in context: http://lucene.472066.n3

Solrmeter with solr 4.6.1

2014-02-27 Thread search engn dev
Has anybody used latest solrmeter with solr 4.6.1? because I am getting following error whenever i try to connect to solr. [Thread-384]|ERROR|[com.plugtree.solrmeter.model.statistic.CacheHistoryStatistic]|15:02:52,509 | Could not update statistic com.plugtree.solrmeter.model.exception.StatisticCo

Re: Solrmeter with solr 4.6.1

2014-02-27 Thread search engn dev
Thanks Shawn, thanks for the pointer. I will try to checkout latest trunk from solrmeter and will see if i can patch it myself. -- View this message in context: http://lucene.472066.n3.nabble.com/Solrmeter-with-solr-4-6-1-tp4120082p4120092.html Sent from the Solr - User mailing list archive

Re: Solr is NoSQL database or not?

2014-03-01 Thread search engn dev
Thank you all for such nice thoughts. Got some more information from here -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-is-NoSQL-database-or-n

What is mean by Index Searcher?

2014-03-06 Thread search engn dev
I am reading apache solr reference guide and it has lines as below ". Solr caches are associated with a specific instance of an Index Searcher, a specific view of an index that doesn't change during the lifetime of that searcher. As long as that Index Searcher is being used, any items in its c

Re: What is mean by Index Searcher?

2014-03-07 Thread search engn dev
Thanks Alex, But what is mean by "...lifetime of that searcher." Is is lifetime of any particular query or what.? Sorry but i am not able to understand this. :( -- View this message in context: http://lucene.472066.n3.nabble.com/What-is-mean-by-Index-Searcher-tp4121898p4121912.html Sent from

How to retrive all terms with their frequency in that website.

2013-02-21 Thread search engn dev
I have indexed data of 10 websites in solr. Now i want to dump data of each website with following format : [Terms,Frequency of terms in that website ,IDF] Can i do this with solr admin, or i need to write any script for that? -- View this message in context: http://lucene.472066.n3.nabble.co

Re: Difference between two solr indexes

2012-04-17 Thread search engn dev
Thanks Pawel Rog for much needed reply, i'll give try and let u know. -- View this message in context: http://lucene.472066.n3.nabble.com/Difference-between-two-solr-indexes-tp3916328p3918996.html Sent from the Solr - User mailing list archive at Nabble.com.

Hunspell stemmer solr 3.4

2012-05-14 Thread search engn dev
I am currently using solr 3.4 in my application, Currently i cant upgrade solr to 3.5 due to some problem. I want to use hunspell stemmer in solr 3.4 , for doing this which all changes i need to make. -- View this message in context: http://lucene.472066.n3.nabble.com/Hunspell-stemmer-solr-3-4-tp

Recommend a Enterprise search to your, it is a friendly interaction to improve the program Solr

2010-05-08 Thread Rivulet Enterprise Search
In Google, I see your masterpiece, I developed a system based on Solr Enterprise search Rivulet ES, I would like to improve him, so better use, more powerful, hope to receive your responses Rivulet ES is an open source enterprise search server based on the Lucene And Solr, Like to use Solr can

Re: Help indexing PDF files

2010-05-09 Thread Rivulet Enterprise Search
user Rivulet Enterprise Search http://sourceforge.net/projects/rivu/ http://sourceforge.net/projects/rivu/ it's very easy . -- View this message in context: http://lucene.472066.n3.nabble.com/Help-indexing-PDF-files-tp783677p786781.html Sent from the Solr - User mailing list archi

Re: CommonsHttpSolrServer vs EmbeddedSolrServer

2010-05-09 Thread Rivulet Enterprise Search
use Rivulet Enterprise Search , http://sourceforge.net/projects/rivu/ http://sourceforge.net/projects/rivu/ , it's very easy to use -- View this message in context: http://lucene.472066.n3.nabble.com/CommonsHttpSolrServer-vs-EmbeddedSolrServer-tp784201p786785.html Sent from the Solr -

Re: How to load Core Properties after Core creation?

2010-05-09 Thread Rivulet Enterprise Search
You shoud edit Solr Source Code , define a Single static SolrCore , after reload solr.xml , change this single static SolrCore -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-load-Core-Properties-after-Core-creation-tp782389p786792.html Sent from the Solr - User maili

Re: Please Help, how to Xinclude in schema.xml

2010-05-09 Thread Rivulet Enterprise Search
try copy to /opt/tomcat/bin -- View this message in context: http://lucene.472066.n3.nabble.com/Please-Help-how-to-Xinclude-in-schema-xml-tp779769p786808.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr work at Drupal

2010-05-09 Thread Rivulet Enterprise Search
try Rivulet Enterprise Search , http://sourceforge.net/projects/rivu/ http://sourceforge.net/projects/rivu/ -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-work-at-Drupal-tp786638p786810.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Custom DIH variables

2010-05-09 Thread Rivulet Enterprise Search
Rivulet Enterprise Search Provides a web interface, DIH, you might try http://sourceforge.net/projects/rivu/ http://sourceforge.net/projects/rivu/ -- View this message in context: http://lucene.472066.n3.nabble.com/Custom-DIH-variables-tp777696p786836.html Sent from the Solr - User mailing

large number of fields

2016-02-05 Thread Jan Verweij - Experts in search
results). Don't think this is the way to go so I'm looking for suggestions how to solve this. One other option would be to: 1. create one multivaluefield 'company_hitrate' 2. store for each company their [companyID]_[hitrate] During search use boostfields [companyID]_50 …. [