RE: SolrCloud FunctionQuery inconsistency

2013-12-03 Thread Raju Shikha
Hi All, Sorry to ask, is it possible to create multiple collections in solr standalone mode.I mean only one solr instance.I am able to create multiple collections in solr cloud environment. But when creating in solr standalone, it is saying, solr is not in cloud mode.Any suggestions great help.

Re: SolrCloud FunctionQuery inconsistency

2013-12-03 Thread sling
Thanks, Chirs: The schema is: There is no default value for ptime. It is generated by users. There are 4 shards in this solrcloud, and 2 nodes in each shard. I was trying query with a function query({!boost b=dateDeboost(ptime)} channelid:0082 && title:abc), which leads differents results fro

Re: Deleting and committing inside a SearchComponent

2013-12-03 Thread Peyman Faratin
On Dec 3, 2013, at 8:41 PM, Upayavira wrote: > > > On Tue, Dec 3, 2013, at 03:22 PM, Peyman Faratin wrote: >> Hi >> >> Is it possible to delete and commit updates to an index inside a custom >> SearchComponent? I know I can do it with solrj but due to several >> business logic requirements I

Re: json update moves doc to end

2013-12-03 Thread Upayavira
By default it sorts by score. If the score is a consistent one, it will order docs as they appear in the index, which effectively means an undefined order. For example a *:* query doesn't have terms that can be used to score, so every doc will get a score if 1. Upayavira On Tue, Dec 3, 2013, at

Re: Deleting and committing inside a SearchComponent

2013-12-03 Thread Upayavira
On Tue, Dec 3, 2013, at 03:22 PM, Peyman Faratin wrote: > Hi > > Is it possible to delete and commit updates to an index inside a custom > SearchComponent? I know I can do it with solrj but due to several > business logic requirements I need to build the logic inside the search > component. I a

Re: a core for every user, lots of users... are there issues

2013-12-03 Thread Erick Erickson
bq: Do you have any sense of what a good upper limit might be, or how we might figure that out? As always, "it depends" (tm). And the biggest thing it depends upon is the number of simultaneous users you have and the size of their indexes. And we've arrived at the black box of estimating size agai

Re: SolrCloud FunctionQuery inconsistency

2013-12-03 Thread Chris Hostetter
: Yes, I am populating "ptime" using a default of "NOW". : : I only store the id, so I can't get ptime values. But from the perspective : of business logic, ptime should not change. if you are populating it using a *schema* default then the warning text i pasted into my last message would defini

Re: post filtering for boolean filter queries

2013-12-03 Thread Michael Sokolov
On 12/03/2013 01:55 AM, Dmitry Kan wrote: Hello! We have been experimenting with post filtering lately. Our setup is a filter having long boolean query; drawing the example from the Dublin's Stump the Chump: fq=UserId:(user1 OR user2 OR...OR user1000) The underlining issue impacting performanc

Re: a core for every user, lots of users... are there issues

2013-12-03 Thread hank williams
Sorry, I see that we are up to solr 4.6. I missed that. On Tue, Dec 3, 2013 at 3:53 PM, hank williams wrote: > Also, I see that the "lotsofcores" stuff is for solr 4.4 and above. What > is the state of the 4.4 codebase? Could we start using it now? Is it safe? > > > On Tue, Dec 3, 2013 at 3:33

Re: a core for every user, lots of users... are there issues

2013-12-03 Thread hank williams
Also, I see that the "lotsofcores" stuff is for solr 4.4 and above. What is the state of the 4.4 codebase? Could we start using it now? Is it safe? On Tue, Dec 3, 2013 at 3:33 PM, hank williams wrote: > > > > On Tue, Dec 3, 2013 at 3:20 PM, Erick Erickson wrote: > >> You probably want to look a

Re: How to Empty Content of a Field via Solrj?

2013-12-03 Thread Furkan KAMACI
I know that I can use Atomic Updates for such cases but I want to atomically update a field by a search result (I want to use that functionality as like nested queries). Any other ideas are welcome. 2013/12/3 Furkan KAMACI > How can I empty content of a field at Solr (I use Solr 4.5.1 as SolrCl

How to Empty Content of a Field via Solrj?

2013-12-03 Thread Furkan KAMACI
How can I empty content of a field at Solr (I use Solr 4.5.1 as SolrCloud) via Solrj? I mean if I have that document at my index: field1: "abc" field2: "def" field3: "ghi" and if I want to empty the content of field2. I want to have: field1: "abc" field2: "" field3: "ghi"

Re: a core for every user, lots of users... are there issues

2013-12-03 Thread hank williams
On Tue, Dec 3, 2013 at 3:20 PM, Erick Erickson wrote: > You probably want to look at "transient cores", see: > http://wiki.apache.org/solr/LotsOfCores > > But millions will be "interesting" for a single node, you must have some > kind of partitioning in mind? > > Wow. Thanks for that great link. Y

Re: Using Payloads as a Coefficient For Score At a Custom QParser That extends ExtendedDismaxQParser

2013-12-03 Thread Furkan KAMACI
I've implemented what I want. I can add payload score into the document score. I've modified ExtendedDismaxQParser and I can use all the abilities of edismax at my case. I will explain what I did at my blog. Thanks; Furkan KAMACI 2013/12/1 Furkan KAMACI > Hi; > > I use Solr 4.5.1 I have a case

Re: a core for every user, lots of users... are there issues

2013-12-03 Thread Erick Erickson
You probably want to look at "transient cores", see: http://wiki.apache.org/solr/LotsOfCores But millions will be "interesting" for a single node, you must have some kind of partitioning in mind? Best, Erick On Tue, Dec 3, 2013 at 2:38 PM, hank williams wrote: > We are building a system wher

Re: post filtering for boolean filter queries

2013-12-03 Thread Yonik Seeley
On Tue, Dec 3, 2013 at 4:45 AM, Dmitry Kan wrote: > ok, we were able to confirm the behavior regarding not caching the filter > query. It works as expected. It does not cache with {!cache=false}. > > We are still looking into clarifying the cost assignment: i.e. whether it > works as expected for

a core for every user, lots of users... are there issues

2013-12-03 Thread hank williams
We are building a system where there is a core for every user. There will be many tens or perhaps ultimately hundreds of thousands or millions of users. We do not need each of those users to have “warm” data in memory. In fact doing so would consume lots of memory unnecessarily, for users that mig

Re: json update moves doc to end

2013-12-03 Thread Erick Erickson
Try adding &debug=all and you'll see exactly how docs are scored. Also, it'll show you exactly how your query is parsed. Paste that if it's confused, it'll help figure out what's going wrong. On Tue, Dec 3, 2013 at 1:37 PM, Andreas Owen wrote: > So isn't it sorted automaticly by relevance (boos

Re: Automatically build spellcheck dictionary on replicas

2013-12-03 Thread Kydryavtsev Andrey
Yep, sorry, it doesn't work for file-based dictionaries: > In particular, you still need to index the dictionary file once by issuing a > search with &spellcheck.build=true on the end of the URL; if you system > doesn't update that dictionary file, then this only needs to be done once. > This m

RE: json update moves doc to end

2013-12-03 Thread Andreas Owen
So isn't it sorted automaticly by relevance (boost value)? If not do should i set it in solrconfig? -Original Message- From: Jonathan Rochkind [mailto:rochk...@jhu.edu] Sent: Dienstag, 3. Dezember 2013 19:07 To: solr-user@lucene.apache.org Subject: Re: json update moves doc to end What o

Re: json update moves doc to end

2013-12-03 Thread Andrea Gazzarini
AFAIK If you don't supply or configure a sort parameter, SOLR is sorting by "score desc". In that case, you may want to understand (at least view) how each document score is calculated: you can run the query with queryDebug set and see the whole explain This great tool helped me a lot: _http:/

Re: json update moves doc to end

2013-12-03 Thread Jonathan Rochkind
What order, the order if you supply no explicit sort at all? Solr does not make any guarantees about what order documents will come back in if you do not ask for a sort. In general in Solr/lucene, the only way to update a document is to re-add it as a new document, so that's probably what's g

json update moves doc to end

2013-12-03 Thread Andreas Owen
When I search for “agenda” I get a lot of hits. Now if I update the 2. Result by json-update the doc is moved to the end of the index when I search for it again. The field I change is “editorschoice” and it never contains the search term “agenda” so I don’t see why it changes the order. Why does it

Re: Automatically build spellcheck dictionary on replicas

2013-12-03 Thread Mirko
Yes, I have that, but it doesn't help. It seems Solr still needs the query with the "spellcheck.build" parameter to build the spellchecker index. 2013/12/3 Kydryavtsev Andrey > Did you try to add > true > parameter to your slave's spellcheck configuration? > > 03.12.2013, 12:04, "Mirko" : >

Re: Automatically build spellcheck dictionary on replicas

2013-12-03 Thread Kydryavtsev Andrey
Did you try to add true parameter to your slave's spellcheck configuration? 03.12.2013, 12:04, "Mirko" : > Hi all, > We use a Solr SpellcheckComponent with a file-based dictionary. We run a > master and some replica slave servers. To update the dictionary, we copy > the dictionary txt file to t

Re: Constantly increasing time of full data import

2013-12-03 Thread michallos
This occurs only on production environment so I can't profile it :-) Any clues? DirectUpdateHandler2 config: 15000 false ${solr.ulog.dir:} -- View this message in context: http://lucene.472066.n3.nabble.com/Constantly-increasing-time-of-full-data-import-tp4103873p4104722.htm

Deleting and committing inside a SearchComponent

2013-12-03 Thread Peyman Faratin
Hi Is it possible to delete and commit updates to an index inside a custom SearchComponent? I know I can do it with solrj but due to several business logic requirements I need to build the logic inside the search component. I am using SOLR 4.5.0. thank you

Re: SolrCloud keeps repeating exception 'SolrCoreState already closed'

2013-12-03 Thread Shalin Shekhar Mangar
No, I am running on the example jetty. I am re-running the import and haven't hit the problem yet. Still running. On Tue, Dec 3, 2013 at 5:45 PM, Eric Bus wrote: > Are you currently running SOLR under Tomcat or standalone with Jetty? I > switched from Tomcat to Jetty and the problems went away.

Re: Using the flexible query parser in Solr instead of classic

2013-12-03 Thread Jack Krupansky
I don't recall hearing any discussion of such a switch. In fact, Solr now has its own copy of the classic Lucene query parser since Solr needed some features that the Lucene guys did not find acceptable. That said, if you have a proposal to dramatically upgrade the base Solr query parser, as w

RE: SolrCloud keeps repeating exception 'SolrCoreState already closed'

2013-12-03 Thread Eric Bus
Are you currently running SOLR under Tomcat or standalone with Jetty? I switched from Tomcat to Jetty and the problems went away. - Eric -Oorspronkelijk bericht- Van: Shalin Shekhar Mangar [mailto:shalinman...@gmail.com] Verzonden: dinsdag 3 december 2013 12:44 Aan: solr-user@lucene.ap

Re: SolrCloud keeps repeating exception 'SolrCoreState already closed'

2013-12-03 Thread Shalin Shekhar Mangar
I just ran into this issue on solr 4.6 on an EC2 machine while indexing wikipedia dump with DIH. I'm trying to isolate exceptions before the SolrCoreState already closed exception. On Sun, Nov 10, 2013 at 11:58 PM, Mark Miller wrote: > Can you isolate any exceptions that happened just before that

Re: post filtering for boolean filter queries

2013-12-03 Thread Dmitry Kan
ok, we were able to confirm the behavior regarding not caching the filter query. It works as expected. It does not cache with {!cache=false}. We are still looking into clarifying the cost assignment: i.e. whether it works as expected for long boolean filter queries. On Tue, Dec 3, 2013 at 8:55 A

Re: Indexing Multiple Languages with solr (Arabic & English)

2013-12-03 Thread Alexandre Rafalovitch
It's just a text type. So, just declare another field and instead of text_general or text_en, use text_ar. Then use copyField from source text field to it. Go through the tutorial, if you haven't yet. It explains some of the things. Regards, Alex. Personal website: http://www.outerthoughts.co

Re: Indexing Multiple Languages with solr (Arabic & English)

2013-12-03 Thread aniljayanti
Hi, Thanks for ur post, I donot know how to use "text_ar" fieldtype for Arabic language. What are the configurations need to add in schema.xml file ? Please guide me. AnilJayanti -- View this message in context: http://lucene.472066.n3.nabble.com/Indexing-Multiple-Languages-with-solr-Arabic

Automatically build spellcheck dictionary on replicas

2013-12-03 Thread Mirko
Hi all, We use a Solr SpellcheckComponent with a file-based dictionary. We run a master and some replica slave servers. To update the dictionary, we copy the dictionary txt file to the master, from where it is automatically replicated to all slaves. However, it seems we need to run the "spellcheck.