Data import handler and no status in web-ui

Hi, I use DIH in solr-cloud mode (implicit route) in solr6.5.1. When I start the import it works fine and I see the progress in the logfile. However, when I click the "Refresh Status" button in the web-ui while the import is running I only see "No information available (idle)". So I have to look

Re: Adding a Basic Authentication user fails with 404

Please chk if it is not due to 6.5 which is fixed in 6.6 http://issues.apache.org/jira/browse/SOLR-10718 On Tue, Jun 6, 2017 at 8:05 PM, David Parker wrote: > Hello, > > I am running a stand-alone instance of Solr 6.5 (without ZooKeeper). I am > attempting to implement Basic Authentication per

Re: Why do Solr nodes go into Recovery status

Thanks Erick for the reply. When the leader asks the follower to go into recovery status, does it stop sending future updates to this replica until it becomes fully in sync with the leader? Regards Suresh On Mon, Jun 5, 2017 at 8:32 PM, Erick Erickson wrote: > bq: This means that technically

Re: Why do Solr nodes go into Recovery status

GW, Did you mean a separate transaction log on Solr or on Zookeeper? -suresh On Tue, Jun 6, 2017 at 5:23 AM, GW wrote: > I've heard of systems tanking like this on Windows during OS updates. > Because of this, I run all my updates in attendance even though I'm Linux. > My Nodes run as VM's, I s

Adding a Basic Authentication user fails with 404

Hello, I am running a stand-alone instance of Solr 6.5 (without ZooKeeper). I am attempting to implement Basic Authentication per the documentation, but when I try to use the API to add a user, I get a 404 error. It seems the /admin/authentication API entry point isn't there: $ curl --user solr

RE: Got a 404 trying to update a solr. 6.5.1 server. /solr/update not found.

Duh! Thanks for that. -Original Message- From: tflo...@apple.com [mailto:tflo...@apple.com] Sent: Tuesday, 6 June 2017 4:25 p.m. To: solr-user@lucene.apache.org Subject: Re: Got a 404 trying to update a solr. 6.5.1 server. /solr/update not found. I think you are missing the collection na

Re: dynamic fields during segment merge

Merging has nothing to do with tlogs. Tlogs are simply the last N (configurable) raw documents to be used for certain index recovery operations. Dynamic fields are no different from static fields. In either case the first time a document is encountered with a field that matches, the same mechanism

Re: Anonymous Read?

Thanks! The null role value did the trick. I tried this with the predefined permissions and it worked as well. Thanks again! On Tue, Jun 6, 2017 at 2:08 PM, Oakley, Craig (NIH/NLM/NCBI) [C] < craig.oak...@nih.gov> wrote: > We usually end security.json with the permissions > >{ >

Re: How to do CDCR with basic auth?

looks like this ticket was fixed in 6.6 SOLR-10718 On Fri, May 19, 2017 at 3:19 PM Shawn Feldman wrote: > i added a ticket > > https://issues.apache.org/jira/browse/SOLR-10718 > > we'll see what happens > > On Fri, May 19, 2017 at 3:03 PM Shawn F

dynamic fields during segment merge

When solr is merging segments of the tlog what impact do dynamic fields have? If i have 1k dynamic fields do i pay the cost on every merge or only if the documents have those fields? -shawn

RE: Anonymous Read?

We usually end security.json with the permissions { "name":"open_select", "path":"/select/*", "role":null}, { "name":"all-admin", "collection":null, "path":"/*",

Anonymous Read?

Is it possible to setup Solr security to allow anonymous query (/select etc.) but restricted access to other permissions as described in https://lucidworks.com/2015/08/17/securing-solr-basic-auth-permission-rules/ ?

Re: Different DateTime format in dataimport and index

I don't use DB. I do dataimport from one collection of SOLR to another collection with the same configuration. -- View this message in context: http://lucene.472066.n3.nabble.com/Different-DateTime-format-in-dataimport-and-index-tp4339230p4339244.html Sent from the Solr - User mailing list arc

Re: Solr installdir deleted after set up solr cloud

Ouch! Thanks for letting us know, I can sleep easier now ;) On Tue, Jun 6, 2017 at 9:12 AM, tstusr wrote: > Hi, there > > We've got a silly but terrible mistake. > > We replace on solrconfig.xml ${solr.data.dir:} for ${solr.install.dir}. > > So, when solr cloud config works it replaces on install

Re: Solr installdir deleted after set up solr cloud

Hi, there We've got a silly but terrible mistake. We replace on solrconfig.xml ${solr.data.dir:} for ${solr.install.dir}. So, when solr cloud config works it replaces on install dir, erasing all solr instance. Thanks for your help. -- View this message in context: http://lucene.472066

Re: Different DateTime format in dataimport and index

My guess would be that your DIH query is interacting weirdly with your db and doing time one transforms before Solr gets it. On Jun 6, 2017 8:38 AM, "SOLR4189" wrote: > Let's say I have SolrDoc: > *{id: test1, price: 100, name: pizza, pickupTime: 2017-06-06T19:00:00}*, > where type of id is int,

Different DateTime format in dataimport and index

Let's say I have SolrDoc: *{id: test1, price: 100, name: pizza, pickupTime: 2017-06-06T19:00:00}*, where type of id is int, type of price is float, type of name is string and type of pickupTime is tdate/date. And let's say I have my update processor that writes to log indexed item. So, my questi

Re: Invalid shift value (64) in prefixCoded bytes (is encoded value really an INT?)

Does this happen on a fresh Solr 6.3 ( as mentioned on SOLR-10806 ) or was the index existing with some other version and then upgraded to 6.3 ? Is the problem reproducible for you? On Tue, Jun 6, 2017 at 7:26 AM, S G wrote: > Hi, > > We are seeing some very bad performance on our performance

Re: Facets delayed several seconds after commit

Most like this is autowarming. New searchers are not available until the autowarming period is complete. The sequence is: > commit > new searcher is opened and autowarming starts on it. > new requests are served by the old searcher > autowarming completes > new requests are served by the new search

Facets delayed several seconds after commit

We've observed that, following a commit, it may take several seconds before the indexed documents are reflected in facets on subsequent queries. I have been able to reproduce this using enum and fc as facet.method Is this related to the filterCache perhaps? My next step is to test with filterCache

Invalid shift value (64) in prefixCoded bytes (is encoded value really an INT?)

Hi, We are seeing some very bad performance on our performance test that tries to load a 2 shard, 3 replica system with about 2000 writes/sec and 2000 reads/sec The exception stack trace seems to point to a specific line of code and a similar stack trace is reported by users on Elastic-Search for

Re: Slow inserting with SolrCloud when increasing replicas

There is some indexing performance penalty is by adding a replica but then onwards adding more replica(s) shouldn't have much difference. So something very wrong. Can you watch your logs when indexing happening and see what's going when gets replicated etc. Thanks, Susheel On Tue, Jun 6, 2017 a

Re: Slow inserting with SolrCloud when increasing replicas

Hi Sisheel! We are using Solr 6.5. We've already looked at Issue 7333, but none of the params seem to change the behaviour. Also, I'm not sure having more parallelism will improve performance since the problem seems to be related to replication. It looks like the writes need to get to all the re

Re: Slow inserting with SolrCloud when increasing replicas

Which version of Solr are you using. See https://lucidworks.com/2015/06/10/indexing-performance-solr-5-2-now-twice-fast/ https://issues.apache.org/jira/browse/SOLR-7333 Also would suggest to index using SolrJ with parallelism (multiple threads and/or machines) to increase indexing thru-put furt

Re: Why do Solr nodes go into Recovery status

I've heard of systems tanking like this on Windows during OS updates. Because of this, I run all my updates in attendance even though I'm Linux. My Nodes run as VM's, I shut down Solr gracefully, snap shot a backup of the VM, update and run. If things go screwy I can always roll back. To me it soun

Re: I want "john smi" to find "john smith" in my custom "fullname_s" field

Erik, Thank you for correcting. Things I miss out on daily bases: _text_ :) Amrit Sarkar Search Engineer Lucidworks, Inc. 415-589-9269 www.lucidworks.com Twitter http://twitter.com/lucidworks LinkedIn: https://www.linkedin.com/in/sarkaramrit2 On Tue, Jun 6, 2017 at 5:12 PM, Nick Way wrote: > F

Re: I want "john smi" to find "john smith" in my custom "fullname_s" field

Fantastic thank you so much; I now have 'fullname_s:#string.spacesescaped#* or email_s:#string.spacesescaped#*' which is working like a dream - thank you so much - really appreciate your help. Thank you also Amrit. Nick On 6 June 2017 at 10:40, Erik Hatcher wrote: > Nick - try escaping the spa

Re: Velocity UI with Analyzing Infix Suggester?

> typeahead solutions using a separate collection Erik, Do you use a separate collection so it can be smaller and thereby faster? Or so you can keep good performance on the the main collection server? In my mind, the performance of the as-you-type is more important than the regular search. Chee

Re: I want "john smi" to find "john smith" in my custom "fullname_s" field

Nick - try escaping the space, so that your query is q=fullname_s:john\ smi* However, whitespace and escaping is problematic. There is a handy prefix query parser, so this would work on a string field with spaces: q={!prefix f=fullname_s}john smi note no trailing asterisk on that one. E

Re: Velocity UI with Analyzing Infix Suggester?

Walter - I’ve done several one-off demos that have incorporated as-you-type Ajax actions into /browse. The first one I did was “instant search” (not suggest) and left that sitting over at my “instant_search” branch - of svn(!). See the top two commits listed here: https://github.com/erikhat

Re: Number of requests spike up, when i do the delta Import.

I found this article helpful. https://wiki.apache.org/solr/DataImportHandlerDeltaQueryViaFullImport -- View this message in context: http://lucene.472066.n3.nabble.com/Number-of-requests-spike-up-when-i-do-the-delta-Import-tp4338162p4339168.html Sent from the Solr - User mailing list archive a

Re: I want "john smi" to find "john smith" in my custom "fullname_s" field

Nick, "string" is a primitive data-type and the entire value of a field is indexed as single token. The regex matching happens against the tokens for text fields and against the full content for string fields. So once a piece of text is tokenized, there is no way to perform a regex query across wo

Slow inserting with SolrCloud when increasing replicas

Hello, We are using SolrCloud with 5 nodes, 2 collections, 2 shards each. The problem we are seeing is a huge drop on writes when the number of replicas increase. When we index (using DIH and batches) a collection with no replicas, we are able to index at 1800 inserts/sec. That number decreases t

I want "john smi" to find "john smith" in my custom "fullname_s" field

Hi - I have a Solr collection with a custom field "fullname_s" (a string). I want "john smi" to find "john smith" (I lower-cased the names upon indexing them) I have tried fullname_s:"john smi*" fullname_s:john smi* fullname_s:"john smi?" fullname_s:john smi? but nothing gives the expected res