Re: Solr Replication is not Possible on RAMDirectory?

2012-11-05 Thread Erik Hatcher
There's an open issue (with a patch!) that enables this, it seems: Erik On Nov 5, 2012, at 07:41 , deniz wrote: > Michael Della Bitta-2 wrote >> No, RAMDirectory doesn't work for replication. Use MMapDirectory... it >> ends up storing th

RE: trunk is unable to replicate between nodes ( Unable to download ... completely)

2012-11-05 Thread Markus Jelsma
https://issues.apache.org/jira/browse/SOLR-4032 -Original message- > From:Mark Miller > Sent: Sat 03-Nov-2012 14:25 > To: solr-user@lucene.apache.org > Subject: Re: trunk is unable to replicate between nodes ( Unable to download > ... completely) > > Likely some of the trunk work ar

RE: No lockType configured for NRTCachingDirectory

2012-11-05 Thread Markus Jelsma
https://issues.apache.org/jira/browse/SOLR-4033 -Original message- > From:Mark Miller > Sent: Sat 03-Nov-2012 14:26 > To: solr-user@lucene.apache.org > Subject: Re: No lockType configured for NRTCachingDirectory > > I think I've seen it on 4.X as well yesterday. Let's file a JIRA to tr

RE: trouble instantiating CloudSolrServer

2012-11-05 Thread Markus Jelsma
Something was wrong on my machine, removing Nutch' build dir and cleanly rebuilding everything fixed the issue. Thanks -Original message- > From:Mark Miller > Sent: Sat 03-Nov-2012 02:57 > To: solr-user@lucene.apache.org > Subject: Re: trouble instantiating CloudSolrServer > > I think

Running solr on apache tomcat

2012-11-05 Thread Leena Jawale
Hi, I have installed lucidwork enterprise 2.1.1 and apache tomcat 6. I want to run solr on tomcat server. For that I need to deploy solr.war file on Tomcat Web Application Manager. But where can I find .war in lucidwork enterprise installation. Or I need to make a .war file? How to make it ? Do

RE: Running solr on apache tomcat

2012-11-05 Thread Leena Jawale
I need both lucidwork admin and solr to run on apache tomcat. Thanks & Regards, Leena Jawale Software Engineer Trainee BFS BU Phone No. - 9762658130 Email - leena.jaw...@lntinfotech.com From: Leena Jawale Sent: Monday, November 05, 2012 5:37 PM To: 'solr-user@

Re: Running solr on apache tomcat

2012-11-05 Thread Jack Krupansky
You need to contact LucidWorks for support and documentation for their products. This mailing list is for Apache Solr only. -- Jack Krupansky -Original Message- From: Leena Jawale Sent: Monday, November 05, 2012 7:07 AM To: solr-user@lucene.apache.org Subject: Running solr on apache t

Re: Add new shard will be treated as replicas in Solr4.0?

2012-11-05 Thread Erick Erickson
Not at present. What you're interested in is "shard splitting" which is certainly on the roadmap but not implemented yet. To expand the number of shards you'll have to reconfigure, then re-index. Best Erick On Mon, Nov 5, 2012 at 4:09 AM, Zeng Lames wrote: > Dear All, > > we have an existing s

How to request multiple snippet lengths

2012-11-05 Thread Dave Twaddell
Hi, I am trying to find a way to request multiple snippets of different lengths for a single field. I know that this could be accomplished by issuing two separate queries or duplicating the field, but I want to avoid doubling the query load or index size. I'd also rather not resort to writing a cu

Re: Where to get more documents or references about sold cloud?

2012-11-05 Thread Jack Krupansky
Is most of the Web blocked in your location? When I Google "SolrCloud", Google says that there are "About 61,400 results" with LOTS of informative links, including blogs, videos, slideshares, etc. just on the first two pages pf search results alone. If you have specific questions, please ask t

Re: Grouping for categories / performance

2012-11-05 Thread Jack Krupansky
Maybe you simply don't have enough heap memory space available to the Java JVM for Solr to do large groups. -- Jack Krupansky -Original Message- From: ilay Sent: Monday, November 05, 2012 2:20 AM To: solr-user@lucene.apache.org Subject: Grouping for categories / performance Hello all

RE: Does SolrCloud supports MoreLikeThis?

2012-11-05 Thread Darren Govoni
There is a ticket for that with some recent activity (sorry I don't have it handy right now), but I'm not sure if that work made it into the trunk, so probably solrcloud does not support MLT...yet. Would love an update from the dev team though! --- Original Message --- On 11/5/2012 10

Re: Does SolrCloud supports MoreLikeThis?

2012-11-05 Thread Luis Cappa Banda
Thanks for the answer, Darren! I still have the hope that MLT is supported in the current version. An important feature of the product that I´m developing depends on that, and even if I can emulate MLT with a Dismax or E-dismax component, the thing is that MLT fits and works perfectly... Regards,

Re: Solr question

2012-11-05 Thread mkaran
It seems this is exactly what i need. From this tutorial http://www.solrtutorial.com/custom-solr-functionquery.html it would seem the main thing that i have to do is implement a DocValues class which gets (Map context, IndexReader reader) and provides methods which return a score for the document

Re: lukeall.jar for Solr4r?

2012-11-05 Thread Carrie Coy
I checked out luke-src-4.0.0-ALPHA.tgz, the most recent I could find, and compiled, but I still get the error "Format version not supported (resource MMapIndexInput(path="/var/lib/tomcat6/solr/apache-solr-4.0.0-/core1/data/index/_7.tvx")): 1 needs to be between 0 and 0" Can anyone post a luke

More Like this without a document?

2012-11-05 Thread Raimon Bosch
Hi, I'm designing a K-nearest neighbors classifier for Solr. So I am taking information IMDB and creating a set of documents with the description of each movie and the categories selected for each document. To validate if the classification is correct I'm using cross-validation. So I do not inclu

ANNOUNCE: Stump The Chump @ ApacheCon EU

2012-11-05 Thread Chris Hostetter
Hey folks, In 2 days, I'll be doing a "Stump The Chump" session at ApacheCon EU in Sinsheim, Germany http://www.apachecon.eu/schedule/presentation/170/ If you aren't familiar with "Stump The Chump" it is a Q&A style session where I (the Chump) get put on the hot seat to answer tough / inter

Re: large text blobs in string field

2012-11-05 Thread geeky2
Gora, currently our core does use mult-valued fields. however the exsiting multi-valued fields in the schema are will only result in 3 - 10 values. we are thinking of using the text blob approach primarily because of the large number of possible values in this field. if we were to use a multi

Re: large text blobs in string field

2012-11-05 Thread Gora Mohanty
On 5 November 2012 22:26, geeky2 wrote: > Gora, > > currently our core does use mult-valued fields. however the exsiting > multi-valued fields in the schema are will only result in 3 - 10 values. > > we are thinking of using the text blob approach primarily because of the > large number of possib

Re: More Like this without a document?

2012-11-05 Thread Walter Underwood
I wrote something like this for Ultraseek. After the document was parsed and analyzed, I took the top terms (by tf.idf) and did a search, then added fields with the categories. You might be able to use the document analysis request handler for this. Analyze it, then choose terms, do the search,

RE: DataImport Handler : Transformer Function Eval Failed Error

2012-11-05 Thread Mishra, Shikhar
Looks like it will be helpful. I'm going to give it a shot. Thanks, Otis. Shikhar From: Otis Gospodnetic [otis.gospodne...@gmail.com] Sent: Friday, November 02, 2012 4:36 PM To: solr-user@lucene.apache.org Subject: Re: DataImport Handler : Transformer Funct

Re: large text blobs in string field

2012-11-05 Thread Erick Erickson
The only thing "special" about a multiValued field is that it can have non-consecutive positions due to the incrementGap. So, if you set the incrementGap=1, adding 10,000,000 words in one go is the same as adding 1 word at a time 10,000,000 times to a mutliValued field. I think the only practical

Re: large text blobs in string field

2012-11-05 Thread geeky2
Erick, thanks for the insight. FWIW and to add to the context of this discussion, if we do decide to add the previously mentioned content as a multivalued field, we would likely use a DIH hooked to our database schema (this is currently how we add ALL content to our core) and within the DIH, us

Re: Solr 4.0 simultaneous query problem

2012-11-05 Thread Rohit Harchandani
Hi, So it seems that when I query multiple shards with the sort criteria for 5000 documents, it queries all shards and gets a list of document ids and then adds the document ids to the original query and queries all the shards again. This process of doing the join of query results with the unique i

Re: Solr 4.0 simultaneous query problem

2012-11-05 Thread Walter Underwood
Don't query for 5000 documents. That is going to be slow no matter how it is implemented. wunder On Nov 5, 2012, at 1:00 PM, Rohit Harchandani wrote: > Hi, > So it seems that when I query multiple shards with the sort criteria for > 5000 documents, it queries all shards and gets a list of docum

load balance with SolrCloud

2012-11-05 Thread Jie Sun
we are using solr 3.5 in production and we deal with customers data of terabytes. we are using shards for large customers and write our own replica management in our software. Now with the rapid growth of data, we are looking into solrcloud for its robustness of sharding and replications. I unde

Re: lukeall.jar for Solr4r?

2012-11-05 Thread Shawn Heisey
On 11/5/2012 9:19 AM, Carrie Coy wrote: I checked out luke-src-4.0.0-ALPHA.tgz, the most recent I could find, and compiled, but I still get the error "Format version not supported (resource MMapIndexInput(path="/var/lib/tomcat6/solr/apache-solr-4.0.0-/core1/data/index/_7.tvx")): 1 needs to be

Re: lukeall.jar for Solr4r?

2012-11-05 Thread Shawn Heisey
On 11/5/2012 2:52 PM, Shawn Heisey wrote: No idea whether I did it right, or even whether it works. All my indexes are either 3.5 or 4.1-SNAPSHOT, so I can't actually test it. You can get to the resulting jar and my patch against the luke-4.0.0-ALPHA source: https://dl.dropbox.com/u/9777050

Re: Add new shard will be treated as replicas in Solr4.0?

2012-11-05 Thread Zeng Lames
hi Erick, thanks for your kindly response. hv got the information from the SolrCloud wiki. think we may need to defined the shard numbers when we really rollout it. thanks again On Mon, Nov 5, 2012 at 8:40 PM, Erick Erickson wrote: > Not at present. What you're interested in is "shard splitting

Re: Add new shard will be treated as replicas in Solr4.0?

2012-11-05 Thread Zeng Lames
btw, where can i find all the items in the road map? thanks! On Tue, Nov 6, 2012 at 8:55 AM, Zeng Lames wrote: > hi Erick, thanks for your kindly response. hv got the information from the > SolrCloud wiki. > think we may need to defined the shard numbers when we really rollout it. > > thanks ag

Re: Solr Replication is not Possible on RAMDirectory?

2012-11-05 Thread deniz
Erik Hatcher-4 wrote > There's an open issue (with a patch!) that enables this, it seems: > ; i will check it for sure, thank you Erik :) Shawn Heisey-4 wrote > ... transparently mapping the files on disk to a virtual memory space and > using ex

Re: need help on solr search

2012-11-05 Thread jchen2000
Used mm parameter and it works! Right now preparing perf test. Please share if anybody has method to optimize dismax queries Thanks! Jeremy Otis Gospodnetic-5 wrote > Hi, > > Have a look at your solrconfig.xml and look for your default operator. > Also > look at the docs for the mm parameter

Re: Solr Replication is not Possible on RAMDirectory?

2012-11-05 Thread Shawn Heisey
> Shawn Heisey-4 wrote >> ... transparently mapping the files on disk to a virtual memory space >> and >> using excess RAM to cache that data and make it fast. If you have >> enough extra memory (disk cache) to fit the entire index, the OS will >> never have to read any part of the index from dis

Re: Solr Replication is not Possible on RAMDirectory?

2012-11-05 Thread Michael Della Bitta
Here's some reading: http://en.wikipedia.org/wiki/Page_cache Michael Della Bitta Appinions 18 East 41st Street, 2nd Floor New York, NY 10017-6271 www.appinions.com Where Influence Isn’t a Game On Mon, Nov 5, 2012 at 8:02 PM, deniz wrote: > Er

Reply:Re: Where to get more documents or references about sold cloud?

2012-11-05 Thread SuoNayi
Thanks jack and thanks for the great country. All big famous websites such as google, slideshares and blogspot etc are blocked. What I want to know about is more details about solrcloud, here is my questions: 1.Can we control the relocation of shard / replica dynamically? 2.Can we move shard betw

Re: How to change the boost of fields in edismx at runtime

2012-11-05 Thread roz dev
Thanks Hoss. Yes, that approach would work as I can change the query. Is there a way to extend the Edismax Handler to read a config file at startup and then use some events like commit to instruct edismax handler to re-read the config file. That way, I can ensure that my boost params are just on

Re: Splitting index created from a csv using solr

2012-11-05 Thread mitra
Thanks for the reply Gora i just wanted to know if solr could do it by itself now from your answer i could see its not possible So what do you think is the best way to split it I mean should i use Luke to split the index or should I split the csv and index it @Walter Thankyou sir , i dont have

Re: Splitting index created from a csv using solr

2012-11-05 Thread Gora Mohanty
On 6 November 2012 10:52, mitra wrote: > > Thanks for the reply Gora > > i just wanted to know if solr could do it by itself now from your answer i > could see its not possible Yes, this is not a common use case. > So what do you think is the best way to split it I mean should i use Luke to > s

SolrCloud - configuration management in ZooKeeper

2012-11-05 Thread AlexeyK
Zookeeper manages not only the cluster state, but also the common configuration files. My question is, what are the exact rules of precedence? That is, when SOLR node will decide to download new configuration files? Will configuration files be updated from ZooKeeper every time the core is refreshe

Problem with ping handler, SolrJ 4.1-SNAPSHOT, Solr 3.5.0

2012-11-05 Thread Shawn Heisey
If I send a ping request to Solr 4.1 from SolrJ 4.1, it works. I don't have an exact revision number from branch_4x, I don't know how to get it from SolrJ. The 4.1 server is running solr-impl 4.1-SNAPSHOT 1401798M with the patch from SOLR-1972 applied, and it's somewhat newer than SolrJ. Ja