Re: DIH timezone offset

2014-05-19 Thread rulinma
good. -- View this message in context: http://lucene.472066.n3.nabble.com/DIH-timezone-offset-tp504958p4137077.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Question on 3-level composite-id routing

2014-05-19 Thread shamik
Awesome, thanks a lot Anshum, makes total sense now. Appreciate your help. -- View this message in context: http://lucene.472066.n3.nabble.com/Question-on-3-level-composite-id-routing-tp4137044p4137071.html Sent from the Solr - User mailing list archive at Nabble.com.

ReversedWildcardFilter to TestRandomChains

2014-05-19 Thread Ahmet Arslan
Hi, How can we add ReversedWildcardFilterFactory to TestRandomChains? I believe there is an offset bug in RWF : SOLR-3193 SOLR-3901 SOLR-5426 If a filter (like RWF) does not set offset attribute, how it is calculated? How to debug/prevent offset bugs? Thanks, Ahmet

Re: How to delete docs only in a spec shard within a collection

2014-05-19 Thread YouPeng Yang
Hi It seems that ther _route_ parameter make work as [1]. In my last posts,It said that the shards should be same with the _route_ and shard.keys during update process to make sure consistent. I will should file a JIRA to improve that. [1]:http://10.1.22.1:8082/solr/tv_201402/update?stre

Re: Question on 3-level composite-id routing

2014-05-19 Thread Anshum Gupta
Hi Shamik, Your assumptions on that are correct. As far as explicit '/8' at query time is concerned, that's the only way the router would get to know that it's a 3-level id and not a 2-level one i.e. e.g. shard.keys='myapp!' Hash range to be fetched: to Intended Hash Range: <8 bits fro

Re: Is there a way to change transientCacheSize dynamically without restarting Solr

2014-05-19 Thread Erick Erickson
Nope. I never thought of the need when we put together transient cores Best, Erick On Mon, May 19, 2014 at 1:13 AM, Elran Dvir wrote: > Thank you, Shalin. > -Original Message- > From: Shalin Shekhar Mangar [mailto:shalinman...@gmail.com] > Sent: Monday, May 19, 2014 10:18 AM > To: so

Re: date range queries efficiency

2014-05-19 Thread Erick Erickson
This might be useful: http://searchhub.org/2012/02/23/date-math-now-and-filter-queries/ Best, Erick On Mon, May 19, 2014 at 12:09 AM, Dmitry Kan wrote: > Thanks, Jack, Alex and Shawn. > > This makes proper sense. One win of rounding down on indexing side is > saving index space, according to hos

Re: Replica as a "leader"

2014-05-19 Thread Erick Erickson
bq: Is there a way that solr can recover without losing docs in this scenario? Not that I know of currently. SolrCloud is designed to _not_ lose documents as long as all leaders are present. And when a leader goes down, assuming there's a replica handy docs shouldn't be lost either. But taking dow

Re: Solr Commiter

2014-05-19 Thread Erick Erickson
The short form is "join the community". Shawn did so as he explained. A _great_ place to contribute is to write unit tests. That's also a bit "safe" in that it doesn't change Solr but does improve it! Poke around the build site and look at the coverage reports, pick a part of Solr that isn't test

Re: core.properties setup help

2014-05-19 Thread Erick Erickson
You can actually just remove those entries from solr.xml (and all the stuff). Then create a core.properties with name=cat and name=mcat respectively. Actually, you don't even need to put that in. Just put an empty core.properties file in the respective dirs. The name of the core defaults to the

Re: Cloudera Manager install

2014-05-19 Thread Erick Erickson
Michael: You really have to ask Cloudera that. The Solr project has nothing to say about what versions of Solr work with Cloudera Manager and what ones don't. Best, Erick On Thu, May 15, 2014 at 8:17 AM, Michael Della Bitta wrote: > Hi everyone, > > I'm investigating migrating over to an HDFS-b

Question on 3-level composite-id routing

2014-05-19 Thread Shamik Bandopadhyay
Hi, Need some clarification on multilevel composite-id routing in SolrCloud .I'm currently composite id routing using the following pattern *topic!url* . This is aimed at run-time de-duplication based on topic field. As I'm adding support for language search, I felt the need to include language

Re: Error when creating collection

2014-05-19 Thread Mark Olsen
Looking on the logs of the other server, I see this: SEVERE: org.apache.solr.common.SolrException: I was asked to wait on state recovering for 192.168.1.155:8983_solr but I still do not see the requested state. I see state: active live:true at org.apache.solr.handler.admin.CoreAdminHandler.h

Re: Error when creating collection

2014-05-19 Thread Mark Olsen
Shawn, I set a shard ID however am still getting the same issue. The logs on the solr server are reporting the following: The request is being performed on 192.168.1.155 and it is timing out when contacting another server in the zookeeper group (192.168.1.152). There are no firewall rules in p

Re: Index / Query IP Address as number.

2014-05-19 Thread Jack Krupansky
Consider an update processor - either raw Java or a snippet of JavaScript with the stateless script update processor. The update processor could be hard-coded or take parameters as to which source value to examine and what field to output. It could use a simple regex to extract only IP addresses

Re: Issue paging when sorting on a Date field

2014-05-19 Thread Chris Hostetter
: Using Solr 4.6.1 and in my schema I have a date field storing the time a : document was added to Solr. what *exactly* does your schema look like? are you using "solr.DateField" or "solr.TrieDateField" ? what field options do you have specified? : I have a utility program which: : - queries f

Issue paging when sorting on a Date field

2014-05-19 Thread Bryan Bende
Using Solr 4.6.1 and in my schema I have a date field storing the time a document was added to Solr. I have a utility program which: - queries for all of the documents in the previous day sorted by create date - pages through the results keeping track of the unique document ids - compare the total

Re: Index / Query IP Address as number.

2014-05-19 Thread SolrUser1543
I have a text field containing a large piece of mixed text , like : test test 12/12/2001 12345 192.168.1.1 1234324 I need to create a copy field which will capture only all IPs from the text ( may be more than one IP ) . What will be the best way to do ? I dont see any option to make WordD

Re: Index / Query IP Address as number.

2014-05-19 Thread SolrUser1543
I dont have autogeneratephrasequeries set to true . I tried both false / true for it , but nothing changed Capture.JPG the same chain defined for both query / index : " />

Re: trigger delete on nested documents

2014-05-19 Thread Mikhail Khludnev
Thomas, Vanilla way to override a blocks is to send it with the same unique-key (I guess it's "id" for your case, btw don't you have unique-key defined in the schema?), but it must have at least one child. It seems like analysis issue to me https://issues.apache.org/jira/browse/SOLR-5211 While bl

Re: Slow file-import

2014-05-19 Thread Ahmet Arslan
Hi, Try http://wiki.apache.org/solr/UpdateCSV , it should be faster.  See 'Tab-delimited importing' at the end of the wiki page. Cheers, Ahmet On Monday, May 19, 2014 1:31 PM, Hal Arres wrote: Hallo there, I am working on an import-configuration for my solr-index and I got some issues with

Re: Custom filter not working with solr 4.7.1

2014-05-19 Thread Shawn Heisey
On 5/19/2014 1:10 AM, Kamal Kishore Aggarwal wrote: > I have created a custom filter factory for solr 4.2. It is working good. > But when I am trying to upgarde solr-4.2 to 4.7 version, it is reporting > errors. > > Caused by: org.apache.solr.common.SolrException: Plugin init failure for > [schema.

Re: Custom filter not working with solr 4.7.1

2014-05-19 Thread Kamal Kishore Aggarwal
I am new to solr. I am not getting your answer. Can you please explain in more detail. On Mon, May 19, 2014 at 12:40 PM, Kamal Kishore Aggarwal < kkroyal@gmail.com> wrote: > Dear Team, > > I have created a custom filter factory for solr 4.2. It is working good. > But when I am trying to upga

Re: Custom filter not working with solr 4.7.1

2014-05-19 Thread Kamal Kishore Aggarwal
I am new to solr. I am not getting your answer. Can you please explain in more detail. On Mon, May 19, 2014 at 4:02 PM, Kamal Kishore Aggarwal < kkroyal@gmail.com> wrote: > I am new to solr. I am not getting your answer. Can you please explain in > more detail. > > > On Mon, May 19, 2014 at

Re: score retrieval performance

2014-05-19 Thread Gora Mohanty
On 19 May 2014 19:52, Michael Ryan wrote: > Is there any significant difference in query speed when retrieving the score > pseudo-field? E.g., does... > > q=foo&sort=date+desc&fl=*,score > > ...take longer to run than... > > q=foo&sort=date+desc&fl=* > > I know there's different code paths in Sol

score retrieval performance

2014-05-19 Thread Michael Ryan
Is there any significant difference in query speed when retrieving the score pseudo-field? E.g., does... q=foo&sort=date+desc&fl=*,score ...take longer to run than... q=foo&sort=date+desc&fl=* I know there's different code paths in Solr depending on whether the score is needed or not, but not

Re: Solr 4.7.2 Core Creation Issue on SC - ZK

2014-05-19 Thread Shawn Heisey
On 5/19/2014 2:31 AM, deniz wrote: > I am using SC with version 4.7.2. There is already one collection/core > running on the cloud, and I am trying to add a new core according to > https://wiki.apache.org/solr/CoreAdmin#CREATE > > When I add the core, I can see that it is added to collections in

Re: Subscribe for Solr Mails

2014-05-19 Thread Jack Krupansky
Read this web page for information about subscribing: https://lucene.apache.org/solr/discussion.html -- Jack Krupansky -Original Message- From: Kamal Kishore Aggarwal Sent: Monday, May 19, 2014 6:12 AM To: solr-user@lucene.apache.org Subject: Subscribe for Solr Mails Dear Team,

How does query on AND work

2014-05-19 Thread Per Steffensen
Hi Lets say I have a Solr collection (running across several servers) containing 5 billion documents. A.o. each document have a value for field "no_dlng_doc_ind_sto" (a long) and field "timestamp_dlng_doc_ind_sto" (also a long). Both "no_dlng_doc_ind_sto" and "timestamp_dlng_doc_ind_sto" are

Re: How to delete docs only in a spec shard within a collection

2014-05-19 Thread Jack Krupansky
Normally a delete-by-query needs to be distributed to all shards since it is not known which document keys it will affect. It sounds like SolrCloud does not support the feature you would really like: support for distrb=false. You can file a Jira request for a feature "improvement." -- Jack K

Slow file-import

2014-05-19 Thread Hal Arres
Hallo there, I am working on an import-configuration for my solr-index and I got some issues with that. In the first step I configured an import-handler to import data from a database into the solr-index and it worked just fine, but it is very slow (7K documents per second). So I wanted to change

Subscribe for Solr Mails

2014-05-19 Thread Kamal Kishore Aggarwal
Dear Team, I am new to solr. Please subscribe me for solr mails. With Regards & Thanks Kamal Kishore

Re: How to delete docs only in a spec shard within a collection

2014-05-19 Thread YouPeng Yang
Hi I have checked the src in DistributedUpdateProcessor.doDeleteByQuery(DeleteUpdateCommand cmd) as[1] According to the source code,it seems that ShardParams._ROUTE_ (_route_) and the ShardParams.SHARD_KEYS(shard.keys) would be used to find the right shard. Compared to my last two posts,the

Solr 4.7.2 Core Creation Issue on SC - ZK

2014-05-19 Thread deniz
Hello, I am using SC with version 4.7.2. There is already one collection/core running on the cloud, and I am trying to add a new core according to https://wiki.apache.org/solr/CoreAdmin#CREATE When I add the core, I can see that it is added to collections in Cloud/file menu, but the config part

RE: Is there a way to change transientCacheSize dynamically without restarting Solr

2014-05-19 Thread Elran Dvir
Thank you, Shalin. -Original Message- From: Shalin Shekhar Mangar [mailto:shalinman...@gmail.com] Sent: Monday, May 19, 2014 10:18 AM To: solr-user@lucene.apache.org Subject: Re: Is there a way to change transientCacheSize dynamically without restarting Solr Hi Elran, No, I don't think

RE: Reloading core with param vs unloading and creating with params

2014-05-19 Thread Elran Dvir
Hi, Did anyone have a chance to take a look at this issue? Thanks. From: Elran Dvir Sent: Thursday, May 15, 2014 12:22 PM To: solr-user@lucene.apache.org Subject: Reloading core with param vs unloading and creating with params Hi all, I created a new patch https://issues.apache.org/jira/browse

Re: How to delete docs only in a spec shard within a collection

2014-05-19 Thread YouPeng Yang
Hi Anyone gives some suggestions. Regards 2014-05-19 11:31 GMT+08:00 YouPeng Yang : > Hi > I have a colloection with 3 shards. > I want to delete some docs in one shard with the command: > > > http://10.1.22.1:8082/solr/tv_201402/update?&stream.body=BEGINTIME:["2014-03-01 > 00:00:00"

Re: deep paging without sorting / keep IRs open

2014-05-19 Thread Tommaso Teofili
thanks Yonik, that looks promising, I'll have a look at it. Tommaso 2014-05-17 17:57 GMT+02:00 Yonik Seeley : > On Sat, May 17, 2014 at 10:30 AM, Yonik Seeley > wrote: > > I think searcher leases would fit the bill here? > > https://issues.apache.org/jira/browse/SOLR-2809 > > > > Not yet imple

Re: Replica active during warming

2014-05-19 Thread lboutros
Hi Erick, I do not pass the LBHttpSolrServer to the c'tor of CloudSolrServer. thx, Ludovic. - Jouve France. -- View this message in context: http://lucene.472066.n3.nabble.com/Replica-active-during-warming-tp4135274p4136828.html Sent from the Solr - User mailing list archive at Nabble.co

Re: Custom filter not working with solr 4.7.1

2014-05-19 Thread Alexandre Rafalovitch
I think the init method signatures changed. Just compare the same factory across two Solr versions and you will see. Regards, Alex. Personal website: http://www.outerthoughts.com/ Current project: http://www.solr-start.com/ - Accelerating your Solr proficiency On Mon, May 19, 2014 at 2:10 PM,

Re: Is there a way to change transientCacheSize dynamically without restarting Solr

2014-05-19 Thread Shalin Shekhar Mangar
Hi Elran, No, I don't think there is way to do that right now. On Mon, May 19, 2014 at 12:18 PM, Elran Dvir wrote: > Does anyone have an answer for this? > Thanks. > > From: Elran Dvir > Sent: Thursday, May 15, 2014 12:32 PM > To: solr-user@lucene.apache.org > Subject: Is there a way to change

Custom filter not working with solr 4.7.1

2014-05-19 Thread Kamal Kishore Aggarwal
Dear Team, I have created a custom filter factory for solr 4.2. It is working good. But when I am trying to upgarde solr-4.2 to 4.7 version, it is reporting errors. Caused by: org.apache.solr.common.SolrException: Plugin init failure for [schema.xml] analyzer/filter: Error instantiating class: 'o

Re: date range queries efficiency

2014-05-19 Thread Dmitry Kan
Thanks, Jack, Alex and Shawn. This makes proper sense. One win of rounding down on indexing side is saving index space, according to hoss (reply over IRC): "with the TrieDateFields, rounding dates at indexing time won't have any effect on the cachability of the rounded queries, and even for non c