Re: solr crashes

Am 04.12.18 um 16:47 schrieb Danilo Tomasoni: Hello Bernd, Thanks for the suggestion, the problem is that we don't have 75 GB of RAM. Are you aware of any way to reduce solr memory usage? Yes, remove all Faceting, especially those for Fields with high cardinality. Don't use huge Synonym

Re: ERROR When uploading configset

https://zookeeper.apache.org/doc/r3.4.6/zookeeperAdmin.html See the jute.maxbuffer sysvar. That said, having 6M of synonym file is suspect. Remember that each and every core will have to download this file on startup. Solr intentionally limited the defalut value here so that you have to override

ERROR When uploading configset

Hi all, i'm experiencing a probklem when uploading a new configset on a Solr ionstance running in cloud mode. The problem seems to be related to the synonyms.txt file size: if > 1,5 M Solr returns an error: adding: synonyms.txt (deflated 76%) { "responseHeader":{ "status":500, "QTime

Re: Error when loading configset

It’s also documented in the Solr Ref Guide: https://lucene.apache.org/solr/guide/7_5/setting-up-an-external-zookeeper-ensemble.html#increasing-the-file-size-limit Even if you

Re: Basic Auth Permission

I run on Solr cloud 7.2.1 Sent from my mobile. Please excuse any typos. > On Dec 4, 2018, at 2:57 PM, Terry Steichen wrote: > > I think there's been some confusion on which standalone versions support > authentication. I'm using 6.6 in cloud mode (purely so the > authentication will work). So

Re: Error when loading configset

By the default, ZooKeeper's znode maximum size limit is 1MB. If you try to send more than this then an error occurs. You can increase this size limit but it has to be done both on server (ZK) and client (Solr) side. See this discussion for more details: http://lucene.472066.n3.nabble.com/How-to-s

Re: SolrCloud required ports

STOP_PORT is only useful from localhost anyway, so no use in opening it up. JMX port only useful if you need to monitor the cluster using JMX and not metrics API -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 3. des. 2018 kl. 18:43 skrev Erick Erickson : > > Others

Error when loading configset

Hi all, i'm experiencing a problem when uploading a new configset on a Solr 7.5 instance running in cloud mode. The problem seems to be related to the synonyms.txt file size: if > 1,5 M Solr returns an error: adding: synonyms.txt (deflated 76%) { "responseHeader":{ "status":500, "QTi

Re: Basic Auth Permission

I think there's been some confusion on which standalone versions support authentication.  I'm using 6.6 in cloud mode (purely so the authentication will work).  Some of the documentation seems to say that only cloud implementations support it, but others (like the experts on this forum) say that la

Re: Basic Auth Permission

I am using standalone Solr 7.4.0. Are you using cloud or standalone? Not sure if that cause the problem or not. -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Basic Auth Permission

What Solr version are you using? On 12/4/18 2:47 PM, yydpkm wrote: > Thank you for your replay. I use your format and failed. User2 can still > visit collection "name" > Could that because I am using standalone Solr not Solrcloud? > > > > -- > Sent from: http://lucene.472066.n3.nabble.com/Solr-Us

Re: Basic Auth Permission

I tried to replace "/select" with "/*" but user B can still access collection A. "permissions":[ { "name":"security-edit", "role":"admin", "index":1}, { "name":"PermA", "collection":CollectionA"", "path":"/*", "role":["ReadColl

Re: Basic Auth Permission

Thank you for your replay. I use your format and failed. User2 can still visit collection "name" Could that because I am using standalone Solr not Solrcloud? -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Collection specific permission not working

Yes, I tried only /select. Doesn't work as well. -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Collection specific permission not working

Just curious. Did you try by not making path variable as a list? On Tue, Dec 4, 2018 at 11:15 AM yydpkm wrote: > Hi, > I am using standalone Solr 7.4. Right now I have 2 collections A and B. > Users a and b. I want to let only a can read and query A, b can read and > query B. But it doesn't work

Collection specific permission not working

Hi, I am using standalone Solr 7.4. Right now I have 2 collections A and B. Users a and b. I want to let only a can read and query A, b can read and query B. But it doesn't work. I have tried similar in https://lucidworks.com/2017/04/14/securing-solr-tips-tricks-and-other-things-you-really-need-to-

Re: Basic Auth Permission

Hi Rick, This is how I was able to restrict permissions to user-role ( user1 ) to its own collection. Hopefully it helps. "permissions": [ {"name": "*", "path": "/dataimport", "params": {"command": ["status"]}, "role": "*"}, {"collection": "name", "path": "/admin/file", "role": ["us

Re: Basic Auth Permission

In setting his permission, Antony said he set "path": "/admin/file".  I use "path":"/*" - that may be too restrictive for you, but it works fine (for me). On 12/4/18 9:55 AM, yydpkm wrote: > Hi Antony, > > Have you solved this? I am facing the same thing. Other users can still do > /select after

Re: Can I use configsets with custom stopwords per collection?

Substitution variables are whatever you want. The file looks like: ${my.var.here:default_if_not_spcified} then set it when you start Solr by java . -Dmy.var.here=whatever .. Best, Erick On Tue, Dec 4, 2018 at 2:43 AM O. Klein wrote: > > Yeah, I'm not copying files. I want all collecti

Re: solr crashes

you can set the -Xms value lower on startup but your still going to run into this issue. Really you just need to go buy more ram, hardware is cheap so you may as well max out the number of sockets for memory and get a couple TB sized SSD's. On Tue, Dec 4, 2018 at 10:47 AM Danilo Tomasoni wrote:

Re: solr crashes

Hello Bernd, Thanks for the suggestion, the problem is that we don't have 75 GB of RAM. Are you aware of any way to reduce solr memory usage? Thanks Danilo On 04/12/18 15:06, Bernd Fehling wrote: Hi Danilo, Full GC points out that you need more heap which also implies that you need more R

Re: Basic Auth Permission

Hi Antony, Have you solved this? I am facing the same thing. Other users can still do /select after I set the permission path and collection. Best, Rick -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: solrj - Batching and Optimistic Concurrency

Hi Erick, Looks like TolerantUpdateProcessor is exactly what I need. Thanks! Kyle. P.S. I can find the doc for TolerantUpdateProcessorFactory here: http://lucene.apache.org/solr/7_5_0/solr-core/org/apache/solr/update/processor/TolerantUpdateProcessor.html , but it seems to be missing from the gu

Re: solr crashes

Hi Danilo, Full GC points out that you need more heap which also implies that you need more RAM. Raise your heap to 24GB and your physical RAM to about 75GB or better 96GB. RAM should be about 3 to 4 times heap size. Regards, Bernd Am 04.12.18 um 13:37 schrieb Danilo Tomasoni: Hello Bernd,

Re: solr crashes

Hello Bernd, Here I list the extra info you requested: - actually the virtual machine has 22GB of RAM and 16GB of heap - my 40 million raw data takes about 1364GB on filesystem (in xml format) - my index optimized (1 segment, 0 deleted docs) takes about 555GB - solr 7.3, openjdk 1.8.0_181 -

Re: Can I use configsets with custom stopwords per collection?

Yeah, I'm not copying files. I want all collections to use 1 schema. So I wonder, do managed stopwords work with configsets and store stopwords per collection? Also, what would be the substitution variable for collection name? Is there a list somewhere? Thanks! -- Sent from: http://lucene.472

Re: solr instance keep increasing thread count

update about 3000 docs per minute ,but other solr instance is running normally -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Block Join Update

Absolutely, but it's deadly hard when like two threads nuke the same block altogether and then insert the new ones concurrently, it's gonna be deadend. You'd rather handle it upstream on ETL level. On Tue, Dec 4, 2018 at 6:35 AM Lucky Sharma wrote: > Sure Mikhail, > One question on this, If we

Re: solr instance keep increasing thread count

I bet it's caused by unreasonable rate of commits. Stop streaming commits so much. On Tue, Dec 4, 2018 at 11:08 AM andy wrote: > we use solrcloud with version 5.2.1,openjdk 1.8,we have multiple solr > machines, one of them keep increasing thread count ,I saw from > http://xx:xxx/solr/#/~thre

solr instance keep increasing thread count

we use solrcloud with version 5.2.1,openjdk 1.8,we have multiple solr machines, one of them keep increasing thread count ,I saw from http://xx:xxx/solr/#/~threads page, I found that a lot of [java.util.concurrent.locks.ReentrantReadWriteLock$FairSync@x] threads, the detail info like this: