Re: Connecting Solr to Nutch

2018-10-05 Thread Jan Høydahl
ial#Setup_Solr_for_search> -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 5. okt. 2018 kl. 03:53 skrev Timeka Cobb : > > Hello out there! I'm trying to create a small search engine and have > installed Nutch 1.15 and Solr 7.5.0..issue now is connecting the 2 > p

Re: Apache SOLR upgrade from 5.2.1 to 7.x

2018-10-06 Thread Jan Høydahl
index <https://github.com/cominvent/solr-tools/tree/master/upgradeindex> a spin in your test environtment and then just test whether 7.5 works on that index :) -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 5. okt. 2018 kl. 16:49 skrev Shawn Heisey : > > On

Status of the Zeppelin Solr Interpreter

2018-10-17 Thread Jan Høydahl
Hi What is the status of this project? Looks pretty dead on GitHub: https://github.com/lucidworks/zeppelin-solr Would love to be able to use this in a project. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com

Re: Dealing with null values in streaming rollup

2018-10-18 Thread Jan Høydahl
Have you tried with Solr 7.5? I think it may have been fixed in that version? At least for the timeseries() expression... -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 18. okt. 2018 kl. 05:35 skrev RAUNAK AGRAWAL : > > Hi, > > I am trying to use s

Re: Solr Cell Input Parameter tika.config

2018-11-07 Thread Jan Høydahl
/contrib/extraction/src/java/org/apache/solr/handler/extraction/ExtractingRequestHandler.java#L65-L77) uses "new File(tikaConfigLoc)" for resolving the tika config file, while it should probably load it through SolrResourceLoader to play nice with Zookeeper -- Jan Høydahl, search solution

Re: SolrCloud Using Solrconfig.xml Instead of Configoverlay.json for RequestHandler QF

2018-11-07 Thread Jan Høydahl
clean solr. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 5. nov. 2018 kl. 21:00 skrev Corey Ellsworth : > > Hello, > > I'm using Solr Cloud 6.6. I have a situation where I have a RequestHandler > configuration that exists in both the

Re: Disabling jvm properties from ui

2018-11-08 Thread Jan Høydahl
metrics and you need to add the same exclusion in solr.xml, see https://lucene.apache.org/solr/guide/7_5/metrics-reporting.html#the-metrics-hiddensysprops-element -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 7. nov. 2018 kl. 20:51 skrev Naveen M : > > Hi

Re: Disabling jvm properties from ui

2018-11-09 Thread Jan Høydahl
to add a new /solr/admin/info/system/secrets/ handler which could return those hidden props. But there may not be a need to retrieve these on API level at all. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 8. nov. 2018 kl. 19:54 skrev Gus Heck : > > That&

Re: Solr cloud change collection index directory

2018-11-13 Thread Jan Høydahl
move data to the new location and then startup Solr again. Try it in your test environment first :) -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 13. nov. 2018 kl. 17:31 skrev Erick Erickson : > > Look at all the explanations in your solr.in.cmd since

Re: ExtractRequestHandler and Tika. Get only plain text

2018-11-14 Thread Jan Høydahl
Have you tried to specify &extractFormat=text -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 14. nov. 2018 kl. 12:09 skrev marotosg : > > Hi all, > > Currently I am trying to do index documents from different kinds with Solr > and tika. It&#

Re: How to use multiple data drives?

2018-11-15 Thread Jan Høydahl
You can create a new collection that you explicitly place on drive E and split your data in that way. Otherwise we normally advise to buy bigger drives or to use an OS tool to create a logical drive spanning several physical ones so that Solr sees it as one. -- Jan Høydahl, search solution

Re: indexing multiple levels of data

2018-11-16 Thread Jan Høydahl
recommend to do in such an indexer application instead of relying on Solr's built-in Tika. This gives you all the control you need, and the burden of building and running a separate app will probably be worth it. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com

Streaming Expressions GET vs POST

2018-11-23 Thread Jan Høydahl
.io.IOException: --> https://127.0.0.1:61613/solr/mycoll:org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:61613/solr/mycoll: Expected mime type application/octet-stream but got text/html. Bad Message 414reason: URI Too Long -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com

Re: Streaming Expressions GET vs POST

2018-11-24 Thread Jan Høydahl
Filed SOLR-13014 <https://issues.apache.org/jira/browse/SOLR-13014> -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 23. nov. 2018 kl. 16:03 skrev Jan Høydahl : > > Hi, > > A customer will use Streaming with VERY LARGE epxressions since the

Re: solr is using TLS1.0

2018-11-30 Thread Jan Høydahl
Hmm, perhaps our bin/solr start scripts could set the com.ibm.jsse2.overrideDefaultTLS property automatically in case of IBM JVM? Or alternatively document this in the SSL section of the reference Guide? Anchal, feel free to open a JIRA and submit a patch. -- Jan Høydahl, search solution

Re: Dataimport UI - shows green even when import fails

2018-11-30 Thread Jan Høydahl
I have seen the same if the JDBC jar is not found, you cannot tell from the UI, you have to go to Solr logs. We should fix this! -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 30. nov. 2018 kl. 00:46 skrev Shawn Heisey : > > I'm looking into a pro

Re: Issue with SolrQuery( Adding +) -- Need help urgent

2018-12-02 Thread Jan Høydahl
urlendoced version as-is. The fact that the log removes the plus you put in front of some of your terms suggests that you are already using q.op=AND so that the plus is implicit? -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 2. des. 2018 kl. 04:24 skrev Surender Re

Re: SolrCloud required ports

2018-12-03 Thread Jan Høydahl
need to be open outside the cluster. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 3. des. 2018 kl. 09:22 skrev Moshe Recanati | KMS : > > Hi, > We're currently running SolrCloud with 3 servers: 3 ZK and 3 Search Engines. > Each one on each mach

Re: SolrCloud required ports

2018-12-04 Thread Jan Høydahl
STOP_PORT is only useful from localhost anyway, so no use in opening it up. JMX port only useful if you need to monitor the cluster using JMX and not metrics API -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 3. des. 2018 kl. 18:43 skrev Erick Erick

Re: Post/Get API call for Solr results differ from web query

2018-12-13 Thread Jan Høydahl
ld be exactly the same whether you POST or GET your query. My guess is that you have some mismatch in encoding, escaping or similar in the Python Solr client you are using. So that is why I encourage you to reproduce the issue with cURL or in the browser. -- Jan Høydahl, search solution arch

Re: Solr Index Data will be delete if state.json did not exists

2018-12-14 Thread Jan Høydahl
er and start again -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 14. des. 2018 kl. 07:46 skrev Lei Wang : > > Hi guys, > > Currently I am running a 2 nodes cloud of Solr 7.5, I already have a > collection named A and it worked fine with 20GB ind

Re: ZooKeeper for Solr 7.6

2018-12-18 Thread Jan Høydahl
That is no problem, doing it myself. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 18. des. 2018 kl. 04:34 skrev Yasufumi Mizoguchi : > > Hi > > I am trying Solr 7.6 in SolrCloud mode. > But I found that ZooKeeper 3.4.11 has a critical issue abo

Re: Questions about the IndexUpgrader tool.

2018-12-19 Thread Jan Høydahl
imple and you do due diligence when preparing and understand all changes, it MAY work for your use case, but it may also fail in mysterious ways :) -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 18. des. 2018 kl. 18:40 skrev Erick Erickson : > > You are f

Re: Questions about the IndexUpgrader tool.

2018-12-19 Thread Jan Høydahl
source data readily available and re-indexing from it is fairly quick. Sometimes you have the source repo but indexing takes two weeks, then a Solr-Solr reindex may be much faster! -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 19. des. 2018 kl. 09:56 skrev Char

Re: Zookeeper timeout issue -

2018-12-19 Thread Jan Høydahl
Which version of Solr? Why do you mention Weblogic? How is Solr deployed, what kind of servers, how much RAM, heap, how many documents in collection, shards etc. Do you run other software on the same server? Have you noticed any hickups or GC activity? -- Jan Høydahl, search solution architect

Re: HttpParser URI is too large

2019-01-03 Thread Jan Høydahl
Upgrade to v7.6 https://issues.apache.org/jira/browse/SOLR-12814 <https://issues.apache.org/jira/browse/SOLR-12814> -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 21. des. 2018 kl. 21:00 skrev Tannen, Lev (USAEO) [Contractor] > : > > Hello Solr

Re: Solr Size Limitation upto 32 KB files

2019-01-03 Thread Jan Høydahl
6_6/requestdispatcher-in-solrconfig.html#RequestDispatcherinSolrConfig-requestParsersElement> -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 2. jan. 2019 kl. 10:23 skrev Kranthi Kumar K > : > > Hi, > > We are currently using Solr 4.2.1 ve

Re: Identifying product name and other details from search string

2019-01-03 Thread Jan Høydahl
Check out http://solr.cool <http://solr.cool/> for some candidate query parsers -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 30. des. 2018 kl. 17:33 skrev UsesRN : > > Is there any way to identify product name and other details from search >

Re: How to have the same SOLR cores for both 8983 and 8984 ports

2019-01-07 Thread Jan Høydahl
installed and started Solr, where your SOLR_HOME is located etc -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 7. jan. 2019 kl. 05:54 skrev Muniraj M : > > Hi, > > I am using Apache SOLR 6.6.5 as my search engine running on port 8983. I > just wa

Re: Web Server HTTP Header Internal IP Disclosure SOLR port

2019-01-07 Thread Jan Høydahl
?? Remember that Solr is not any random Web server and must be firewalled and not exposed to the internet. Your security scan tool may have other assumptions? -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 7. jan. 2019 kl. 05:55 skrev Muniraj M : > > Hi, >

Re: Tool to format the solr query for easier reading?

2019-01-08 Thread Jan Høydahl
html <https://lucene.apache.org/solr/guide/7_6/json-query-dsl.html> in the first place :) -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com <http://www.cominvent.com/> > 8. jan. 2019 kl. 05:33 skrev Hullegård, Jimi > <mailto:jimi.hulleg...@svensktnarin

Re: Web Server HTTP Header Internal IP Disclosure SOLR port

2019-01-10 Thread Jan Høydahl
e and also in UI, which is more human friendly than IPs. But the reporter will have to elaborate further on this. Exposing the hostname or IP of a Solr node that you as a client (or Admin UI) needs to talk to, is definitely necessary and by design. -- Jan Høydahl, search solution architect Cominve

Re: Single query to get the count for all individual collections

2019-01-10 Thread Jan Høydahl
Just to a series of cheap http://localhost:8983/solr/mycoll/select?q=*:*&rows=0 requests :) -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 10. jan. 2019 kl. 04:40 skrev Zheng Lin Edwin Yeo : > > Hi, > > I would like to find out, is there any wa

Re: Starting optimize... Reading and rewriting the entire index! Use with care

2019-01-16 Thread Jan Høydahl
Should we consider to default optimize to false in the DIH UI? -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 16. jan. 2019 kl. 14:23 skrev Jeremy Smith : > > How are you calling the dataimport? As I understand it, optimize defaults to > true, s

Re: How to have the same SOLR cores for both 8983 and 8984 ports

2019-01-21 Thread Jan Høydahl
don't even know if this is standalone Solr or SolrCloud. Please give details on how solr is installed, what your solr.in.sh file looks like, how you start Solr (bin/solr or through service daemon) etc. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 19. jan. 20

Re: Single query to get the count for all individual collections

2019-01-22 Thread Jan Høydahl
+1 for the most elegant solution so far :) -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 22. jan. 2019 kl. 03:15 skrev Joel Bernstein : > > Streaming Expressions can do this: > > plist(stats(collection1, q="*:*", count(*)), >

Re: Solr dependencies with security issues (CVEs)

2019-01-24 Thread Jan Høydahl
really exploitable in Solr, then please attempt to describe why you believe Solr is vulnerable, and send a report to secur...@apache.org <mailto:secur...@apache.org> and/or file a private JIRA issue. Do not explain a new vulnerability on open mailing lists. -- Jan Høydahl, search solution archite

Re: Indexing in one collection affect index in another collection

2019-01-24 Thread Jan Høydahl
ol to get a full view of the system. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 24. jan. 2019 kl. 13:42 skrev Zheng Lin Edwin Yeo : > > Hi Shawn, > > Unfortunately your reply of memory may not be valid. Please refer to my > explanation below of

Re: Indexing in one collection affect index in another collection

2019-01-24 Thread Jan Høydahl
if you get back your speed. Also, I see fl=* in your config, which is really asking for all fields. Are you sure you want that, that may also be slow. Try to ask for just the fields you will be using. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 24. jan. 2019

Re: Indexing in one collection affect index in another collection

2019-01-25 Thread Jan Høydahl
Which java version? 32 or 64 bit? You start Solr with default 512Mb heap size? Other software running on the machine? -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 25. jan. 2019 kl. 13:05 skrev Zheng Lin Edwin Yeo : > > Hi Jan and Shawn, > > For

Re: Indexing in one collection affect index in another collection

2019-01-25 Thread Jan Høydahl
How do you start Solr, cause the solr.in.cmd you sent does not contain the memory settings. What other parameters do you start Solr with? -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 25. jan. 2019 kl. 15:28 skrev Zheng Lin Edwin Yeo : > > Hi Jan, &g

Re: solr 6.6.3 is not working on azure web app, it throws an error "The server committed a protocol violation. Section=ResponseStatusLine"

2019-01-27 Thread Jan Høydahl
stem? What specification? Settings? -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 25. jan. 2019 kl. 14:34 skrev Jignesh Savaliya : > > Hello, > > > We have deployed solr 6.6.3 on azure as a web app and it works fine over > there, but when we try

Re: SPLITSHARD not working as expected

2019-01-28 Thread Jan Høydahl
This is normal. Please read https://lucene.apache.org/solr/guide/7_6/collections-api.html#splitshard PS: Images won't make it to the list, but don't think you need a screenshot here, what you describe is the default behaviour. -- Jan Høydahl, search solution architect Co

Re: by: java.util.zip.DataFormatException: invalid distance too far back reported by Solr API

2019-01-31 Thread Jan Høydahl
n infinite loop. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 30. jan. 2019 kl. 20:49 skrev Monique Monteiro : > > Hi all, > > I'm writing a Python routine to upload thousands of PDF files to Solr, and > after trying to upload some files, So

Re: Why solr sends a request for a metrics every minute?

2019-02-04 Thread Jan Høydahl
Yes, it is the Metrics History Handler that does this to collect some key metrics in a central place. Read more here https://lucene.apache.org/solr/guide/7_6/metrics-history.html -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 4. feb. 2019 kl. 18:45 skrev levtan

Re: Get recent documents from solr

2019-02-08 Thread Jan Høydahl
DB views into the same collection in Solr, yes? -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 8. feb. 2019 kl. 14:38 skrev shruti suri : > > Hi, > > I want to get latest updated documents from Solr. I am indexing data from > multiple view and e

Re: Solr Size Limitation upto 32 kb limitation

2019-02-10 Thread Jan Høydahl
our application or with Update Processor or TokenFilter in Solr. Jan Høydahl > 11. feb. 2019 kl. 06:27 skrev Kranthi Kumar K > : > > Hi Team, > > We didn’t get any suggested solutions. Could you help us by providing better > approach or a solution to fix the issue? > W

Re: Migrate from sol 5.3.1 to 7.5.0

2019-02-13 Thread Jan Høydahl
You need to list all zk hosts in zkHost, that’s part of the design for ZK, clients will open connections to all nodes and be able to fail over if trouble. Where did you get the CNAME advice? Jan Høydahl > 13. feb. 2019 kl. 05:56 skrev ramyogi : > > We are migrating SOLR version, We

Re: Migrate from sol 5.3.1 to 7.5.0

2019-02-14 Thread Jan Høydahl
You may of course ignore the warning in the UI, it is just a warning intended to help you avoid mis-configurations. But there may be side effects of placing a load balancer in between client and zk cluster, see https://stackoverflow.com/questions/30905007/load-balancer-with-zookeeper -- Jan

Re: Getting repeated Error - RunExecutableListener java.io.IOException

2019-02-14 Thread Jan Høydahl
would help if you told us things like Solr version, whether this has worked before, or what change that caused it to stop working, also a copy of the relevant solrconfig.xml section. What are you expecting the listener to do for you? -- Jan Høydahl, search solution architect Cominvent AS

Re: Solr 7.7 UpdateRequestProcessor broken

2019-02-15 Thread Jan Høydahl
.min(((CharSequence) content).length(), maxFieldValueChars); } } -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 14. feb. 2019 kl. 16:02 skrev Andreas Hubold : > > Hi, > > while trying to update from Solr 7.6 to 7.7 I run in

Re: edismax: sorting on numeric fields

2019-02-17 Thread Jan Høydahl
q=kind:animal&wantedweight=50&sort=abs(sub(weight,wantedweight)) asc Jan Høydahl > 16. feb. 2019 kl. 17:08 skrev Dave : > > Sounds like you need to use code and post process your results as it sounds > too specific to your use case. Just my opinion, unless you want to

Re: Createsnapshot null pointer exception

2019-02-18 Thread Jan Høydahl
r data from the data collection "datacoll" http://some.solr.server:8983/solr/gatewaycoll?q=my query&collection=datacoll Have not tested it but it should give the desired effect. You can hardcode the "collection" param in solrconfig.xml of gatewaycoll's /select handler if you

Re: Solr 7.7 UpdateRequestProcessor broken

2019-02-18 Thread Jan Høydahl
Thanks for chiming in Markus. Yea, same with the langid tests, they just work locally with manually constructed SolrInputDocument objects. This bug breaking change sounds really scary and we should add an UPGRADE NOTE somewhere. -- Jan Høydahl, search solution architect Cominvent AS

Re: Upload Synonym to Solr Cloud

2019-02-21 Thread Jan Høydahl
Or use managed resource https://lucene.apache.org/solr/guide/6_6/managed-resources.html#ManagedResources-Synonyms Jan Høydahl > 21. feb. 2019 kl. 01:50 skrev Erick Erickson : > > bin/solr zk -help > particularly > bin/solr zk cp > >> On Feb 20, 2019, at 4:0

Re: RequestHandlerBase java.lang.NullPointerException Error

2019-03-13 Thread Jan Høydahl
What Solr version? What configuration? What is the document you are indexing and how do you send it to Solr? Think this may be a known bug that is already fixed.. Jan Høydahl > 13. mar. 2019 kl. 17:21 skrev Rathor, Piyush (US - Philadelphia) > : > > Facing following error sudde

Re: Solr 7.6 Shard name - possible issue?

2019-03-18 Thread Jan Høydahl
It's just a name, so as long as Solr agrees with itself and ZK that this is the core name you're fine. I have no idea why the numbering seems to jump in that way though. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 18. mar. 2019 kl. 02:15 skre

BM25F in Solr

2019-03-20 Thread Jan Høydahl
you can do that in Similarity? -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com

Re: solr 7.7+ admin ui inaccessible with BasicAuthPlugin+RuleBasedAuthorizationPlugin

2019-03-23 Thread Jan Høydahl
Hi Can you take a screenshot of the 401 error page you see (without login form)? Also, perhaps you could do a curl -I (show headers) request to your Solr and show what headers that Solr returns instead of the www-authenticate header? Jan > 23. mar. 2019 kl. 15:34 skrev a...@sigil.red: >

Re: solr 7.7+ admin ui inaccessible with BasicAuthPlugin+RuleBasedAuthorizationPlugin

2019-03-24 Thread Jan Høydahl
pw then it should be possible to enter it. Or we could disallow empty pw in the API :) Jan Høydahl > 23. mar. 2019 kl. 18:37 skrev a...@sigil.red: > > Hi > > Here is the curl: >> $ curl -I http://localhost:8080/solr/ >> HTTP/1.1 401 Unauthorized request, Response code:

Re: Problem with white space or special characters in function queries

2019-03-28 Thread Jan Høydahl
Functions can never contain spaces. Try to substitute the term with a variable, i.e. a request parameter, e.g. bf=if(termfreq(ADSKFeature,$myTerm),log(CaseCount),sqrt(CaseCount))&myTerm=CUI+(Command) -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 28. mar.

Re: security.json "all" predefined permission

2019-03-28 Thread Jan Høydahl
change anything here. One thing to try could be to start with an empty RuleBasedAuth and then use the REST API to add all the permissions and roles, in that way you are sure that they are syntactically correct, and hopefully you get some errors if you do something wrong? -- Jan Høydahl, sear

Re: How to implement security for solr admin page

2019-03-29 Thread Jan Høydahl
You are probably looking for authentication and authorization. The documentation has you covered: https://lucene.apache.org/solr/guide/7_7/securing-solr.html <https://lucene.apache.org/solr/guide/7_7/securing-solr.html> -- Jan Høydahl, search solution architect Cominvent AS - www.cominve

Re: Upgrade Solr 8.0.0 issue

2019-03-29 Thread Jan Høydahl
o not bother with core.properties, zoo_data or any old cruft -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 29. mar. 2019 kl. 09:32 skrev vishal patel : > > > If I delete the product_shard1_replica_n1 folder then what about data folder? > because its

Re: Documentation for Apache Solr 8.0.0?

2019-04-02 Thread Jan Høydahl
while waiting for the 8,0 guide, as they are almost identical still. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 1. apr. 2019 kl. 16:11 skrev Jason Gerlowski : > > The Solr Reference Guide (of which the online documentation is a part) > gets built and r

Re: Solr 6.6 and OpenJDK11

2019-04-05 Thread Jan Høydahl
Solr7 is the first Solr version that has been proved to work with JDK9+ So you better stick with Java8. Solr 7/8 will work with JDK11, and Solr 9 will likely require it. Much more details to be found here: https://wiki.apache.org/solr/SolrJavaVersions -- Jan Høydahl, search solution architect

Re: Windows SSL.Keystore and Windows TrustStore requires an empty PKCS#12 Key Store

2019-04-05 Thread Jan Høydahl
Hi, Thanks for your proposal. I think it warrants a new JIRA issue as a feature request. Patches to both code and documentation are highly welcome! -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 5. apr. 2019 kl. 10:53 skrev Herbert Hackelsberger : > > H

Re: Document IDs instead of count for facets?

2019-04-05 Thread Jan Moszczynski
This is old. Still worth replying, as sometimes somebody might stumble across the same problem. Well I achieved this rather simply by using facet.pivot. If you define your facet.pivot as “n_cellered_diseaseExact,id” you will get in return the data structure containing pivot list of all disease

Re: Solr 6.6 and OpenJDK11

2019-04-05 Thread Jan Høydahl
The page below is just a draft for some wording that will go in the Reference Guide in next version. You can stick with Java8 for Solr 7.x and 8.x as well, but in most cases Java11 will work just fine. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 5. apr. 2019

Re: I it possible to configure solr to show time stamps without the 'Z'- character in the end

2019-04-10 Thread Jan Høydahl
tml> https://lucene.apache.org/solr/guide/7_7/update-request-processors.html <https://lucene.apache.org/solr/guide/7_7/update-request-processors.html> -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 8. apr. 2019 kl. 12:38 skrev Miettinen Jaana (STAT) : >

Re: Solr web crawler with recursive option

2019-04-12 Thread Jan Høydahl
I think there may actually be a bug. I was not able to crawl some other web site either. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 11. apr. 2019 kl. 18:55 skrev Erick Erickson : > > You are sending malformed XML to Solr. This can be something as

Re: Set Basic Auth to CloudSolrStream

2019-04-15 Thread Jan Høydahl
It may not be well supported Check out https://issues.apache.org/jira/browse/SOLR-9779 <https://issues.apache.org/jira/browse/SOLR-9779> for some hints. Contributions welcome for improving how SolrJ can pass different auth credentials both for Streaming and search. -- Jan Høydahl,

Mixing simple and nested docs in same update?

2018-01-10 Thread Jan Høydahl
"type":["child"], "_version_":1589249812802306048, "type_str":["child"]}]}] }} As you can see, the “friend” got included as a child of “mother”. If you index the exact same request, putting “friend” after “mot

Re: Mixing simple and nested docs in same update?

2018-01-15 Thread Jan Høydahl
Radio silence… Here is a GIST for easy reproduction. Is this by design? -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 11. jan. 2018 kl. 00:42 skrev Jan Høydahl : > > Hi, > > We index several large nested documents. We found that querying the

Re: Mixing simple and nested docs in same update?

2018-01-30 Thread Jan Høydahl
Pasting the GIST link :-) https://gist.github.com/45640fe3bad696d53ef8a0930a35d163 <https://gist.github.com/45640fe3bad696d53ef8a0930a35d163> Anyone knows if this is expected behavior? -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 15. jan. 2018 kl. 14

Distributed search cross cluster

2018-01-30 Thread Jan Høydahl
t isolation, that extra merge code seems fairly complex. So far I opt for the custom SearchComponent and &shards= param approach. Any useful input from someone who tried a similar approach would be priceless! -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com

Re: Mixing simple and nested docs in same update?

2018-01-31 Thread Jan Høydahl
not exist for the BlockJoin QParsers. Still not sure whether it is a bug or not... -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 31. jan. 2018 kl. 00:30 skrev Tomas Fernandez Lobbe : > > I believe the problem is that: > * BlockJoin queries do not kno

Re: Distributed search cross cluster

2018-01-31 Thread Jan Høydahl
est to sub shards in a generic way, without writing all the merge and two-phase stuff over again, then that would be ideal. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 31. jan. 2018 kl. 10:41 skrev Bernd Fehling : > > Many years ago, in a different unive

Re: Distributed search cross cluster

2018-01-31 Thread Jan Høydahl
that cross cluster traffic is allowed in everywhere. PKI auth is not really intended for accepting requests from a foreign node that is not in its ZK etc. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 31. jan. 2018 kl. 10:06 skrev Charlie Hull : > > On

Re: Mixing simple and nested docs in same update?

2018-02-06 Thread Jan Høydahl
TSHARD, is the SPLIT API aware of blocks so that it will never split in the middle of a block? I hope to perhaps update the RefGuide documentation to clarify all of these constraints and pitfalls. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 5. feb. 2018

Re: [nesting] Any way to return the whole hierarchical structure when doing Block Join queries?

2018-03-14 Thread Jan Høydahl
is returned by the {!parent} query? I cannot see how to use [subquery] to do this? Jan On 2016/03/24 20:52:51, Mikhail Khludnev wrote: > I think you cal already kick tires and contribute a test case into > https://issues.apache.org/jira/browse/SOLR-8208 that's already reachabl

Re: [nesting] Any way to return the whole hierarchical structure when doing Block Join queries?

2018-03-14 Thread Jan Høydahl
ucted? Any thoughts on this approach? In what phase would we need to add the _parent_ field? -- Jan Høydahl > 14. mar. 2018 kl. 13:56 skrev Jan Høydahl : > > I understand that the [subquery] transformer can help build a nested response > when you know the structure in advance, but

Re: [nesting] Any way to return the whole hierarchical structure when doing Block Join queries?

2018-03-15 Thread Jan Høydahl
> 14. mar. 2018 kl. 15:45 skrev Anshum Gupta : > > Hi Jan, > > The way I remember it was done (or at least we did it) is by storing the > depth information as a field in the document using an update request > processor and using a custom transformer to reconstruct the o

Re: Using multi valued field in solr cloud Graph Traversal Query

2018-03-16 Thread Jan Høydahl
> Adding multi-value field support is a fairly high priority so I would > expect this to be coming in a future release. I got this question from a client of mine as well. Trying to find a JIRA issue for multi value support, is there one? -- Jan Høydahl, search solution architect Cominv

Solr streaming - get single value from tuple

2018-05-24 Thread Jan Høydahl
describe() returns a tuple. I’d like to assign the value of “mean” from that tuple to a separate variable for use in later computations. How to achieve?? Jan

Re: Solr streaming - get single value from tuple

2018-05-25 Thread Jan Høydahl
Thanks. https://issues.apache.org/jira/browse/SOLR-12401 -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 24. mai 2018 kl. 16:11 skrev Joel Bernstein : > > I've been meaning to add this, so let's create a ticket. Until it's > released you

Re: Solr Cloud 6.6.4 in Docker containers: collection creation fails

2018-06-04 Thread Jan Høydahl
Hi Probably some networking issues. I would log in to each node at a time and verify connectivity to all others. Make sure that e.g. "node1" resolves correctly on all RHEL hosts as well as inside docker containers. -- Jan Høydahl, search solution architect Cominvent AS - www.cominven

Autoscaling and inactive shards

2018-06-11 Thread Jan Høydahl
one could argue that it should not be counted in core/replica rules? 2. Why is there no suggestion to move a shard due to the "minimize cores" reference itself? -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com

Re: Autoscaling and inactive shards

2018-06-13 Thread Jan Høydahl
cores on all three (unless that would violate disk space or load limits)? -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 12. jun. 2018 kl. 08:10 skrev Shalin Shekhar Mangar : > > Hi Jan, > > Comments inline: > > On Tue, Jun 12, 2018 a

Re: A good KV store/plugins to go with Solr

2018-06-14 Thread Jan Høydahl
a fetchKV() function which per result document fetches data from external JDBC (or other) source and enriches on the fly. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 5. jun. 2018 kl. 05:38 skrev Erick Erickson : > > Well, you can always throw more re

Re: Can replace the IP with the hostname or some unique identifier for each node in Solr

2018-06-14 Thread Jan Høydahl
See this FAQ https://github.com/docker-solr/docker-solr/blob/master/Docker-FAQ.md#can-i-run-zookeeper-and-solr-clusters-under-docker -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 8. jun. 2018 kl. 14:52 skrev akshat : > > Hi, > > I have deployed

Re: Hardware-Aware Solr Coud Sharding?

2018-06-14 Thread Jan Høydahl
. If you "overshard" your system, i.e. if you have three nodes, you create a collection with 9 shards, then there will be three shards per node, and Solr can suggest moving one of them off to anther server. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com >

Re: Cost of enabling doc values

2018-06-14 Thread Jan Høydahl
n lets you do atomic updates to your docs, to re-index from an existing index (not from source) and to use streaming expressions on all fields. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 14. jun. 2018 kl. 04:13 skrev Erick Erickson : > > I pretty much

Re: Solr basic auth

2018-06-15 Thread Jan Høydahl
When authentication is enabled ALL requests must carry valid credentials. Are you asking for a feature where a request is authenticated based on IP address of the client, not username/password? Jan Sendt fra min iPhone > 14. jun. 2018 kl. 22:24 skrev Dinesh Sundaram : > > Hi, &g

Re: Solr basic auth

2018-06-17 Thread Jan Høydahl
Of course, but Dinesh explicitly set blockUnknown=true below, so in this case ALL requests must have credentials. There is currently no feature that lets Solr accept any request by other rules, all requests are forwarded to the chosen authentication plugin. -- Jan Høydahl, search solution

Re: Autoscaling and inactive shards

2018-06-18 Thread Jan Høydahl
Is there still a valid reason to keep the inactive shards around? If shard splitting is robust, could not the split operation delete the inactive shard once the new shards are successfully loaded, just like what happens during an automated merge of segments? -- Jan Høydahl, search solution

Re: Solr basic auth

2018-06-21 Thread Jan Høydahl
at if a request originates from a particular frontend server's IP address then it should be whitelisted? You could also suggest in a new JIRA issue to extend Solr's auth feature to allow a chain of AuthPlugins, and if the request passes any of them it is let through. -- Jan Høydahl,

Re: SOLR migration

2018-06-27 Thread Jan Høydahl
Solr nodes Copy SOLR_HOME (where your data is) to exact same path on F drive, e.g. com E:\solr\data to F:\solr\data Unmount both drives and re-mount with drive letters swapped (new small disk becomes E while old disk becomes F) Start Solr on all nodes The length of your down-time depends on the amoun

Re: Solr unable to start up after setting up SSL in Solr 7.4.0

2018-08-10 Thread Jan Høydahl
Hi, Did you solve your issue? SSL should work ootb in 7.4, the class that your error says is not found exists, so there must be some setup issues. How did you install Solr, how do you start it, what is the content of your solr.in <http://solr.in/>.sh etc -- Jan Høydahl, search so

Re: Spell check with data from database and not from english dictionary

2020-01-28 Thread Jan Høydahl
to add to the dictionary. No need for SQL complexity for this inside Solr. Jan > 27. jan. 2020 kl. 10:49 skrev seeteshh : > > Hello Alessandra > > Thanks for your post. > > Thats what I am concerned about generating a file or reindexing as the data > in the databa

<    2   3   4   5   6   7   8   9   10   11   >