Streaming Expressions (/stream) NPE

2015-12-22 Thread Jason Gerlowski
I'll preface this email by saying that I wasn't sure which mailing list it belonged on. It might fit on the dev list (since it involves a potential Solr bug), but maybe the solr-users list is a better choice (since I'm probably just misusing Solr). I settled on the solr-users list. Sorry if I ch

Re: Streaming Expressions (/stream) NPE

2015-12-23 Thread Jason Gerlowski
stream" was recently changed to "expr" in SOLR-8443. > > Joel Bernstein > http://joelsolr.blogspot.com/ > > On Tue, Dec 22, 2015 at 8:45 PM, Jason Gerlowski > wrote: > > > I'll preface this email by saying that I wasn't sure which mailing list &g

Request for SOLR-wiki edit permissions

2016-02-08 Thread Jason Gerlowski
Hi all, Can someone please give me edit permissions for the Solr wiki. Is there anything I should or need to do to get these permissions? My wiki username is "Jason.Gerlowski", and my wiki email is "gerlowsk...@gmail.com". I spotted a few things that could use some clarification on the HowToCon

Re: Request for SOLR-wiki edit permissions

2016-02-08 Thread Jason Gerlowski
Thanks Anshum! On Mon, Feb 8, 2016 at 1:01 PM, Anshum Gupta wrote: > Done. > > On Mon, Feb 8, 2016 at 9:55 AM, Jason Gerlowski > wrote: > >> Hi all, >> >> Can someone please give me edit permissions for the Solr wiki. Is >> there anything I should or n

Re: ConcurrentUpdateSolrClient example?

2017-08-13 Thread Jason Gerlowski
Hi Paul, I'll try reproducing this with the snippet provided, but I don't see anything inherently wrong with the Builder usage you mentioned, assuming the Solr base URL you provided is correct. It would be easier to troubleshoot your issue though if you included some more information about the NP

Re: ConcurrentUpdateSolrClient example?

2017-08-14 Thread Jason Gerlowski
to the fact the the queue size > is not specified. > 2) works as expected. > > Cheers, > P. > >> On 13 Aug 2017, at 22:58, Jason Gerlowski wrote: >> >> Hi Paul, >> >> I'll try reproducing this with the snippet provided, but I don't

Re: Issue found with install_solr_service.sh

2017-08-17 Thread Jason Gerlowski
Hi Eddie, thanks for reporting. This is a common issue with "xargs". When xargs doesn't receive any input through the pipe (i.e. if "find" doesn't find anything), it isn't smart enough to exit-early and still tries to run the "chmod" command without a filename. The "-r" flag is present in most v

Re: Issue found with install_solr_service.sh

2017-08-17 Thread Jason Gerlowski
Also, can you confirm whether there are files in your install/extract directory? On Thu, Aug 17, 2017 at 2:22 PM, Jason Gerlowski wrote: > Hi Eddie, thanks for reporting. > > This is a common issue with "xargs". When xargs doesn't receive any > input through the p

Re: ConcurrentUpdateSolrClient example?

2017-08-17 Thread Jason Gerlowski
Created SOLR-11256 for giving "queueSize" a default. There's a patch attached on that JIRA with 10 as the chosen default. Whether that particular value sticks or not, at least there's a fix in the works! On Mon, Aug 14, 2017 at 9:36 AM, Jason Gerlowski wrote: > Ah,

Re: Solr returning same object in different page

2017-09-12 Thread Jason Gerlowski
Is it possible that your indexed data contains duplicated or nearly-duplicated documents. (See: https://cwiki.apache.org/confluence/display/solr/De-Duplication) Also, I'm curious whether you see the same duplicates when making a single, larger query. Can you run a single query that returns the n

Re: CloudSolrServer set http request timeout

2017-09-21 Thread Jason Gerlowski
Hi Vincenzo, Have you tried setting the read/socket timeout on your client? CloudSolrServer uses a LBHttpSolrServer under the hood, which you can get with the getLBServer method (https://lucene.apache.org/solr/4_1_0/solr-solrj/org/apache/solr/client/solrj/impl/CloudSolrServer.html#getLbServer()).

Re: Expected mime type application/octet-stream but got text/html

2017-10-17 Thread Jason Gerlowski
At a glance, I'd guess that your SolrClient object isn't setup correctly, probably because it has the wrong "baseURL" specified. Solr has a "/solr//update" URL, but the error above makes it look like your application is reaching out to "/solr/update" which isn't a valid endpoint. If your SolrClie

Re: authentication

2017-11-18 Thread Jason Gerlowski
Hey Arkadi, Your "nagios" user is under "role_monitoring", which has "config-read" permissions. The default config-read gets you access to the Config API and Request Parameters API, but not the /admin/mbeans API (afaik). See https://lucene.apache.org/solr/guide/6_6/rule-based-authorization-plug

Re: Performance warning: Overlapping onDeskSearchers=2 solr

2017-05-17 Thread Jason Gerlowski
Hey Shawn, others. This is a pitfall that Solr users seem to run into with some frequency. (Anecdotally, I've bookmarked the Lucidworks article you referenced because I end up referring people to it often enough.) The immediate first advice when someone encounters these onDeckSearcher error mess

Re: Want to start contributing.

2018-08-22 Thread Jason Gerlowski
Hi Rohan, Welcome! To add just a bit to the good advice from Erick and Alex: If you want a smaller issue to familiarize yourself with our development workflow, the "newdev" label is a good place to start (as the wiki page referenced above points out). But I would also suggest taking a look at i

Re: Non-Essential Components

2018-09-20 Thread Jason Gerlowski
Hi Seamus, Have you looked at the "contrib" module? The "contrib" module is a collection of commonly used packages that aren't strictly required for Solr's "core". What's more, "contrib" is pretty large: it takes up ~82mb of a ~185mb Solr distribution. If you don't plan on using any contrib mod

Querying with ConcurrentUpdateSolrClient

2018-09-25 Thread Jason Gerlowski
Hi all, The Javadocs for ConcurrentUpdateSolrClient steer users away from using it for query requests: "Although any SolrClient request can be made with this implementation, it is only recommended to use ConcurrentUpdateSolrClient with /update requests. The class HttpSolrClient is better suited f

Re: Making Solr Indexing Errors Visible

2018-09-30 Thread Jason Gerlowski
Hi Also worth mentioning that bin/post only handles certain file extensions, and AFAIR it doesn't mention specifically when it skips over a file because of the extension. You mentioned you're trying to index Word docs and pdf's. Are there any other formats in the directory that might be messing u

Re: Metrics API via Solrj

2018-10-03 Thread Jason Gerlowski
Hi Deniz, I don't think there are any classes that simplify accessing the metrics API like there are for other APIs (e.g. CollectionAdminRequest, CoreAdminRequest, ..). But sending metrics requests in SolrJ is still possible; it's just a little bit more complicated. Anytime you want to make an A

Re: How to do rollback from solrclient using python

2018-10-03 Thread Jason Gerlowski
Hi Chetra, The syntax that you're looking for is "/solr/someCoreName/update?rollback=true". But I'm afraid Rollback might not be quite what you think it is. You mentioned: "but it doesn't work, whenever there is a commit the request still updates on the server". Yes, that is the expected behavi

Re: Is there a tool to directly index hdfs files to solr?

2018-10-21 Thread Jason Gerlowski
Not familiar with the contrib you mentioned, or the rationale behind its removal. But as to your first question, you might be interested in looking at: https://github.com/lucidworks/hadoop-solr Disclaimer: I help maintain the "hadoop-solr" project mentioned. On Thu, Oct 18, 2018 at 8:17 AM shreck

Re: Does ConcurrentUpdateSolrClient apply for SolrCloud ?

2018-10-25 Thread Jason Gerlowski
One comment to complicate Erick's already-good advice. > If a doc that needs to go to shard2 is received by a replica on shard1, it > must be forwarded to the leader of shard1, introducing an extra hop. Definitely true, but I don't think that's the only factor in the relative performance of CUSC

JSON Query DSL Param Dropping/Overwriting

2018-10-28 Thread Jason Gerlowski
Hi all, Had a question about how parameters are combined/overlaid in the JSON Query DSL. Ran into some behavior that struck me as odd/maybe-buggy. The query DSL allows params to be provided a few different ways: 1. As query-params in the URI (e.g. "/select?fq=inStock:true") 2. In the JSON reques

Re: CloudSolrClient produces tons of CLUSTERSTATUS commands against single server in Cloud

2018-11-06 Thread Jason Gerlowski
My understanding was that we always tried to use the cached version of this information until either (a) Solr responds in a way that indicates our cache is out of date, or (b) the TTL on the cache entry expires. Though there might very well be a code path that behaves differently as Erick suggests

Re: CloudSolrClient produces tons of CLUSTERSTATUS commands against single server in Cloud

2018-11-08 Thread Jason Gerlowski
Hey Shawn, A few answers, where I can give them. 1. It's easy to miss in the thread, but the user mentioned that they're creating their CloudSolrClient via solr URLs. 2. When you create a CloudSolrClient with a Solr URL, it's not just used to fetch the ZK connString so that it can use ZK from the

Re: Query regarding SolrJ

2018-11-12 Thread Jason Gerlowski
Hi, SolrJ is a client library that helps your application talk to Solr. It's not a full application that can be run on its own. So the error message you got is correct. It's not a standalone application. For more information on using SolrJ, see the documentation here: https://lucene.apache.org

Re: Upgrade 6.2.1 to 7.5.0 - "Connection evictor" Threads not closed

2018-11-26 Thread Jason Gerlowski
Hey Sebastian, As for how Solr/SolrJ compatibility is handled, the story for SolrJ looks a lot like the story for Solr itself - major version changes can introduce breaking changes, so it is best to avoid using SolrJ 6.x with Solr 7.x. In practice I think changes that break Solr/SolrJ compatibili

Re: Time-Routed Alias Not Distributing Wrongly Placed Docs

2018-11-28 Thread Jason Gerlowski
Hi John, I'm not an expert on TRA, but I don't think so. The TRA functionality I'm familiar with involves creating and deleting underlying collections and then routing documents based on that information. As far as I know that happens at the UpdateRequestProcessor level - once your data is index

Re: Documentation on SolrJ

2018-11-30 Thread Jason Gerlowski
Hi Thomas, I recently added a first pass at JSON faceting support to SolrJ. The main classes are "JsonQueryRequest" and "DirectJsonQueryRequest" and live in the package "org.apache.solr.client.solrj.request.json" (https://github.com/apache/lucene-solr/tree/master/solr/solrj/src/java/org/apache/so

Re: Documentation on SolrJ

2018-12-01 Thread Jason Gerlowski
over more complex query > > capabilities would probably do the trick. I don’t think you need 600 pages > > like the Solr Ref Guide document. This will make more sense to do when we > > get to the 8.0 release (or the next release including JSON API support). I > > reti

Re: Last Modified Timestamp

2019-01-02 Thread Jason Gerlowski
Hi Antony, I don't know a ton about DIH, so I can't answer your question myself. But you might have better luck getting an answer from others if you include more information about the behavior you're curious about. Where do you see this Last Modified timestamp (in the Solr admin UI? on your filesy

Re: The parent shard will never be delete/clean?

2019-01-22 Thread Jason Gerlowski
Hi, You might want to check out the documentation, which goes over split-shard in a bit more detail: https://lucene.apache.org/solr/guide/7_6/collections-api.html#CollectionsAPI-splitshard To answer your question directly though, no. Split-shard creates two new subshards, but it doesn't do anyth

Re: Asynchronous Calls to Backup/Restore Collections ignoring errors

2019-02-04 Thread Jason Gerlowski
Hi Steffen, There are a few "known issues" in this area. Probably most relevant is SOLR-6595, which covers a few error-reporting issues for "collection-admin" operations. I don't think we've gotten any reports yet of success/failure determination being broken for asynchronous operations, but tha

Re: CloudSolrClient getDocCollection

2019-02-08 Thread Jason Gerlowski
Hi Henrik, I'll try to answer, and let others correct me if I stray. I wasn't around when CloudSolrClient was written, so take this with a grain of salt: "Why does the client need that timeout?Wouldn't it make sense to use a watch?" You could probably write a CloudSolrClient that uses watch

Re: Java object binding not working

2019-02-08 Thread Jason Gerlowski
Hi Swapnil, Ray did suggest a potential cause. Your Java object has "name" as a String, but Solr returns the "name" value as an ArrayList. Usually Solr returns ArrayLists when the field in question is multivalued, so it's a safe bet that Solr is treating your "name" field as multivalued. You can

Re: Load balance writes

2019-02-11 Thread Jason Gerlowski
> On the other hand, the CloudSolrClient ignores errors from Solr, which makes > it unacceptable for production use. Did you mean "ConcurrentUpdateSolrClient"? I don't think CloudSolrClient does this, though I've been surprised before and possible I just missed something. Just wondering. Jason

Re: Get details about server-side errors

2019-02-13 Thread Jason Gerlowski
Hey Chris, Unfortunately I think you covered the main/only options above. HTTP status code isn't the most useful, but it's worth pointing out that there are a few things you can do with it. Some status codes are easy to identify and come up with a good message to display to your end user e.g. 40

Re: Getting repeated Error - RunExecutableListener java.io.IOException

2019-02-18 Thread Jason Gerlowski
Hi Hermant, configoverlay.json is not a file with content provided by Solr out of the box. Instead, it's used to hold any changes you make to Solr's default configuration using the config API (/config). More details at the top of the article here: https://lucene.apache.org/solr/guide/6_6/config-

Re: Solr 7.7 UpdateRequestProcessor broken

2019-02-18 Thread Jason Gerlowski
Hey all, I have a proposed update which adds a 7.7 section to our "Upgrade Notes" ref-guide page. I put a mention of this in there, but don't have a ton of context on the issue. Would appreciate a review from anyone more familiar. Check out SOLR-13256 if you get a few minutes. Best, Jason On

Re: Suppress stack trace in error response

2019-02-22 Thread Jason Gerlowski
Hi Jeremy, Unfortunately Solr doesn't offer anything like what you're looking for, at least that I know of. There's no sort of global "quiet" or "suppressStack" option that you can pass on a request to _not_ get the stacktrace information back. There might be individual APIs which offer somethin

Re: Spring Boot Solr+ Kerberos+ Ambari

2019-03-01 Thread Jason Gerlowski
Hi Rushikesh, Solr's Kerberos authentication is completely independent of Ranger. You can set it up to use Ranger, as is common with Hortonworks HDP, but it's also possible to setup Kerberos+Solr without Ranger in the picture at all. I haven't come across a concise explanation of _how_ to do this

Re: %solr_logs_dir% does not like spaces

2019-03-01 Thread Jason Gerlowski
+1 to submitting a JIRA, even if you cannot find an edit to solr.cmd to fix the issue. And +1 to the issue likely just being a lack of double-quotes around the reference to SOLR_LOG_DIR. Best, Jason Gerlowski On Tue, Feb 26, 2019 at 11:56 AM Erick Erickson wrote: > > If you can mun

Re: Giving SolrJ credentials for Zookeeper

2019-03-01 Thread Jason Gerlowski
Hi Ryan, I haven't tried this myself, but wanted to offer a sanity check based on how I understand those instructions. Are you setting the "zkCredentialsProvider", "zkDigestUsername", and "zkDigestPassword" system-properties on your client app/process as well as on your Solr/ZK servers? Or are y

Re: Python Client for Solr Cloud - Leader aware

2019-03-01 Thread Jason Gerlowski
Hi Ganesh, I'm not an expert on pysolr, but from a quick scan of their update code, it does look like pysolr attempts to send update requests to _a_ leader node for a particular collection. But that's all it does. It doesn't check which shard the document(s) will belong to and try to pick the _c

Re: Solr Reference Guide for version 7.7

2019-03-01 Thread Jason Gerlowski
Hi Edwin, I volunteered to release the 7.7 ref-guide last week but decided to wait until 7.7.1 came out to work on it. (You probably know that 7.7.0 contained some serious bugs. These would've required non-trivial documentation effort in the ref-guide, and 7.7.1 already had a release-manager and

Re: Hide BasicAuth JVM param on SOLR admin UI

2019-03-07 Thread Jason Gerlowski
Solr has a configuration option that allows redacting particular properties that appear in the Admin UI. I _think_ this is the functionality you're looking for. For more information, Kevin Risden has a great little writeup of it here: https://risdenk.github.io/2018/11/27/apache-solr-hide-redact-s

Re: Solrj, Json Facets, (Date) stats facets

2019-03-11 Thread Jason Gerlowski
Hi Andrea, It looks like you've stumbled on a bug in NestableJsonFacet. I clearly wasn't thinking about Date stats when I first wrote it; it looks like it doesn't detect/parse them correctly in the current iteration. I'll try to fix this in a subsequent release. But in the meantime, unfortunate

Apache Solr Reference Guide 7.7 Released

2019-03-11 Thread Jason Gerlowski
The Lucene PMC is pleased to announce that the Solr Reference Guide for 7.7 is now available. This 1,431-page PDF is the definitive guide to using Apache Solr, the search server built on Lucene. The PDF Guide can be downloaded from: https://www.apache.org/dyn/closer.cgi/lucene/solr/ref-guide/apac

Re: ClassCastException in SolrJ 7.6+

2019-03-11 Thread Jason Gerlowski
Hi Gerald, That looks like it might be a bug in SolrJ's JSON faceting support. Do you have a small code snippet that reproduces the problem? That'll help us confirm it's a bug, and get us started on fixing it. Best, Jason On Mon, Mar 11, 2019 at 10:29 AM Gerald Bonfiglio wrote: > > I'm seeing

Re: Solr collection indexed to pdf in hdfs throws error during solr restart

2019-03-14 Thread Jason Gerlowski
> When I restart Solr How exactly are you restarting Solr? Are you running a "bin/solr restart"? Or is Solr already shut down and you're just starting it back up with a "bin/solr start "? Depending on how Solr was shut down, you might be running into a bit of a known-issue with Solr's HDFS supp

Re: Upgrading solarj from 6.5.1 to 8.0.0

2019-03-21 Thread Jason Gerlowski
You should be able to set credentials on individual requests with the SolrRequest.setBasicAuthCredentials() method. That's the method suggested by the latest Solr ref guide at least: https://lucene.apache.org/solr/guide/7_7/basic-authentication-plugin.html#using-basic-auth-with-solrj There might

Re: Upgrading solarj from 6.5.1 to 8.0.0

2019-03-25 Thread Jason Gerlowski
or the response. I saw the method of setting credentials based on > > individual request. > > But I need to set the credentials at solrclient level. If you remember the > > way to do it please let me know. > > > > Thanks > > > > On Thu, Mar 21, 2019 at 8

security.json "all" predefined permission

2019-03-28 Thread Jason Gerlowski
Hi all, Diving into the RuleBasedAuthorizationPlugin for the first time in awhile, and found that the predefined permission "all" isn't behaving the way I'd expect it to. I'm trying to figure out whether it doesn't work the way I think, whether I'm just making a dumb mistake, or whether it's curr

Re: security.json "all" predefined permission

2019-03-29 Thread Jason Gerlowski
o try could be to start with an empty RuleBasedAuth and then use > the REST API to add all the permissions and roles, > in that way you are sure that they are syntactically correct, and hopefully > you get some errors if you do something wrong? > > -- > Jan Høydahl, search sol

Re: Documentation for Apache Solr 8.0.0?

2019-04-01 Thread Jason Gerlowski
The Solr Reference Guide (of which the online documentation is a part) gets built and released separately from the Solr distribution itself. The Solr community tries to keep the code and documentation releases as close together as we can, but the releases require work and are done on a volunteer ba

Re: bin/post command not working when run from crontab

2019-04-14 Thread Jason Gerlowski
Hi Carsten, I think this is probably worth a jira. I'm not familiar enough with bin/post to say definitively whether the behavior you mention is a bug, or whether it's "expected" in some odd sense. But there's enough uncertainty that I think it's worth recording there. Best, Jason On Fri, Apr

Re: Documentation Slop (DisMax parser)

2018-01-18 Thread Jason Gerlowski
Hi James, 1. Good catch, and thanks for reporting it. 2. The improved wording you proposed above matches my (limited) understanding. Others might see something wrong that I missed, but I think it's definitely an improvement over the current wording. 3. If you'd like, you can start the change your

Re: Long GC Pauses

2018-01-31 Thread Jason Gerlowski
Hi Maulin, To clarify, when you said "...allocated 40 GB RAM to each shard." above, I'm going to assume you meant "to each node" instead. If you actually did mean "to each shard" above, please correct me and anyone who chimes in afterward. Firstly, it's really hard to even take guesses about pot

Re: solr read timeout

2018-02-15 Thread Jason Gerlowski
Hi Prateek, Depending on the SolrServer/SolrClient implementation your application is using, you can make use of the "setSoTimeout" method, which controls the socket (read) timeout in milliseconds. e.g. http://lucene.apache.org/solr/4_8_1/solr-solrj/org/apache/solr/client/solrj/impl/HttpSolrServe

Re: Solrj : ConcurrentUpdateSolrClient based on QueueSize and Time

2018-02-21 Thread Jason Gerlowski
My apologies Santosh. I added that comment a few releases back based on a misunderstanding I've only recently been disabused of. I will correct it. Anyway, Shawn's explanation above is correct. The queueSize parameter doesn't control batching, as he clarified. Sorry for the trouble. Best, Ja

Re: configure jetty to use both http1.1 and H2

2018-02-23 Thread Jason Gerlowski
Hi Jeff, I haven't tested your exact use case regarding H/2, but the "bin/solr" startup script has a special "-j" options that can be used to pass arbitrary flags to the underlying Jetty server. If you have options that work with vanilla Jetty, they _should_ work when passed through the "bin/solr

Re: Why are cursor mark queries recommended over regular start, rows combination?

2018-03-20 Thread Jason Gerlowski
> I can take a stab at this if someone can point me how to update the > documentation. Hey SG, Please do, that'd be awesome. Thanks to some work done by Cassandra Targett a release or two ago, the Solr Ref Guide documentation now lives in the same codebase as the Solr/Lucene code itself, and t

Re: Solrj Analytics component

2018-03-20 Thread Jason Gerlowski
Hi Asmaa, As far as I know, there aren't any SolrJ classes built expressly for Analytics component requests like what exists for the Collection Admin APIs, etc. (https://lucene.apache.org/solr/7_2_0/solr-solrj/org/apache/solr/client/solrj/request/CollectionAdminRequest.html). But it should still

Re: Solr failed to start after configuring Kerberos authentication

2018-06-15 Thread Jason Gerlowski
Hi, Sorry to reply to this so late. Hopefully you've long since figured out the issue. But if not... 1. Just to clarify, are you seeing the error message above when Solr tries to talk to ZooKeeper? Or does that error message appear in your ZK logs, or from a ZK-client you're using to test conn

Re: Connection Problem with CloudSolrClient.Builder().build When passing a Zookeeper Addresses and RootParam

2018-06-18 Thread Jason Gerlowski
Hi, Yes, Andy has the right idea. If no zk-chroot is being used, "Optional.empty()" is the correct value to specify, not null. This API is a bit trappy (or at least unintuitive), and we're in the process of hashing out some doc improvements (and/or API changes). If you're curious or would other

Re: CURL DELETE BLOB do not working in solr 7.3 cloud

2018-06-21 Thread Jason Gerlowski
Hi Maxence, Yes, unfortunately that's the wrong API to delete an item from the Blob Store. Items in the blob store are deleted like any other Solr document (i.e. either delete-by-id, or delete-by-query). This is mentioned quite obliquely in the Solr Ref Guide here: https://lucene.apache.org/solr

Re: Sole Default query parser

2018-06-22 Thread Jason Gerlowski
Hi Kamal, Sorry for the late reply. If you're still unsure, the "lucene" query parser is the default one. The first ref-guide link you posted refers to it almost ubiquitously as the "Standard Query Parser", but it's the same thing as the lucene query parser. (The page does say this, but it's ea

Re: Solr Default query parser

2018-06-26 Thread Jason Gerlowski
The "Standard Query Parser" _is_ the lucene query parser. They're the same parser. As Shawn pointed out above, they're also the default, so if you don't specify any defType, they will be used. Though if you want to be explicit and specify it anyway, the value is defType=lucene Jason On Mon, Jun

Re: Retrieving json.facet from a search

2018-06-29 Thread Jason Gerlowski
You might also have luck using the "NoOpResponseParser" https://opensourceconnections.com/blog/2015/01/08/using-solr-cloud-for-robustness-but-returning-json-format/ https://lucene.apache.org/solr/7_0_0/solr-solrj/org/apache/solr/client/solrj/impl/NoOpResponseParser.html (Disclaimer: Didn't try th

Re: SolrJ Kerberos Client API

2018-06-29 Thread Jason Gerlowski
Hi Tushar, You're right; the docs are a little out of date there. Krb5HttpClientConfigurer underwent some refactoring recently and came out with a different name: Krb5HttpClientBuilder. The ref-guide should update the snippet you were referencing to something more like: System.setProperty("java.

Re: Solr7.3.1 Installation

2018-07-11 Thread Jason Gerlowski
(I think Erick made a slight typo above: to disable "bad apple" tests, use the flag "-Dtests.badapples=false") On Wed, Jul 11, 2018 at 11:14 AM Erick Erickson wrote: > > Note that the native test runs have the know-flaky tests _enabled_ by > default, run tests with > > -Dtests.badapples=true > > t

Re: Creating a collection in Solr standalone mode using solrj

2018-07-20 Thread Jason Gerlowski
Hi Arunan, Solr runs in one of two main modes: "Cloud" mode or "Standalone" mode. Collections can only be created in Cloud mode. Standalone mode doesn't allow creation of collections; it uses cores instead. From your error message above, it looks like the problem is that you're trying to create

Re: 4 days and no solution - please help on Solr

2018-08-10 Thread Jason Gerlowski
Hi Ravion, (Note: I'm not sure what Solr version you're using. My answer below assumes Solr 7 APIs. These APIs don't change often, but you might find them under slightly different names in your version of Solr.) SolrJ provides 2 ways (that I know of) to provide basic auth credentials. The firs

Re: 4 days and no solution - please help on Solr

2018-08-10 Thread Jason Gerlowski
rt. On Fri, Aug 10, 2018 at 10:09 AM Jason Gerlowski wrote: > > Hi Ravion, > > (Note: I'm not sure what Solr version you're using. My answer below > assumes Solr 7 APIs. These APIs don't change often, but you might > find them under slightly different names in

Re: 4 days and no solution - please help on Solr

2018-08-10 Thread Jason Gerlowski
7;t surprise me if some parts of > SolrJ mishandle a URL in that format. Though that's just a hunch on > my part. > On Fri, Aug 10, 2018 at 10:09 AM Jason Gerlowski > wrote: > > > > Hi Ravion, > > > > (Note: I'm not sure what Solr version you&#

Re: 4 days and no solution - please help on Solr

2018-08-10 Thread Jason Gerlowski
ication in > this case? Seems I can't use SolrRequest. > > Thx, bye > RAVION > > On Fri, Aug 10, 2018, 10:46 AM Jason Gerlowski > wrote: > > > I'd tried to type my previous SolrJ example snippet from memory. That > > didn't work out so great. I

Re: 4 days and no solution - please help on Solr

2018-08-11 Thread Jason Gerlowski
air > > wrote: > > > > > >> I saw this. Please provide for add. My issue is with add. There is no > > >> "AddRequesg". So how to do that, thanks > > >> > > >> Best Ravion > > >> > > >> On Fri, Aug 10,

Re: Solr cloud production set up

2020-01-28 Thread Jason Gerlowski
Hi Rajdeep, Unfortunately it's near impossible for anyone here to tell you what parameters to tweak. People might take guesses based on their individual past experience, but ultimately those are just guesses. There are just too many variables affecting Solr performance for anyone to have a good

Re: Solr fact response strange behaviour

2020-01-29 Thread Jason Gerlowski
Hey Adi, There was a separate JIRA for this on the SolrJ objects it sounds like you're using: SOLR-13780. That JIRA was fixed, apparently in 8.3, so I'm surprised you're still seeing the issue. If you include the full stacktrace and a snippet of code to reproduce, I'm curious to take a look. Th

Re: Solr fact response strange behaviour

2020-01-29 Thread Jason Gerlowski
at > org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1415) > [tomcat-embed-core-9.0.17.jar:9.0.17] > at > org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) > [tomcat-embed-core-9.0.17.jar:9.0.17] > at > java.util.

Re: Replica type affinity

2020-02-03 Thread Jason Gerlowski
This is a bit of a guess - I haven't used this functionality before. But to a novice the "tag" Rule Condition for "Rule Based Replica Placement" sounds similar to the requirements you mentioned above. https://lucene.apache.org/solr/guide/8_3/rule-based-replica-placement.html#rule-conditions Good

Re: Checking in on Solr Progress

2020-03-02 Thread Jason Gerlowski
Very low-tech and manual, but worth mentioning... If there's a particularly large core that's doing a full recovery, and you have access to the disk itself you can navigate to the relevant directory for that core and run something like "watch -n 10 ls -lah" or "watch -n 10 du -sh ." to see how the

Re: Request Tracking in Solr

2020-04-01 Thread Jason Gerlowski
Hi Prakhar, Newer versions of Solr offer an "Audit Logging" plugin for use cases similar to yours. https://lucene.apache.org/solr/guide/8_1/audit-logging.html If don't think that's available as far back as 5.2.1 though. Just thought I'd mention it in case upgrading is an option. Best, Jason O

Re: SolrJ connection leak with SolrCloud and Jetty Gzip compression enabled

2020-04-22 Thread Jason Gerlowski
Hi Samuel, Thanks for the very detailed description of the problem here. Very thorough! I don't think you're missing anything obvious, please file the jira tickets if you haven't already. Best, Jason On Mon, Apr 13, 2020 at 6:12 PM Samuel Garcia Martinez < samuel...@inditex.com> wrote: > Rea

Re: Rule-Based Auth - update not working

2020-05-17 Thread Jason Gerlowski
Hi Isabelle, Two things to keep in mind with Solr's Rule-Based Authorization. 1. Each request is controlled by the first permission to that matches the request. 2. With the permissions you have present, Solr will check them in descending list order. (This isn't always true - collection-specific

Re: Rule-Based Auth - update not working

2020-05-17 Thread Jason Gerlowski
. We should really change this resolution order to be something more commonsense. Jason On Sun, May 17, 2020 at 2:52 PM Jason Gerlowski wrote: > > Hi Isabelle, > > Two things to keep in mind with Solr's Rule-Based Authorization. > > 1. Each request is controlled by the f

Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version

2020-05-21 Thread Jason Gerlowski
Hi Jay, I can't speak to why you're seeing a performance change between 6.x and 8.x. What I can suggest though is an alternative way of formulating the query: you might get different performance if you run your query using Solr's "terms" query parser: https://lucene.apache.org/solr/guide/8_5/othe

Re: SolrCloud upgrade concern

2020-05-27 Thread Jason Gerlowski
t; > I am mostly worried about CDCR feature. I am relying heavily on it. > Although, I am planning to use Solr 8.3. It has been long time since CDCR > was first introduced. I wonder what is the state of CDCR is 8.3. Is it > stable now? > > On Wed, Jan 22, 2020, 8:01 AM Jason Gerlowsk

Re: CDCR behaviour

2020-06-05 Thread Jason Gerlowski
Hi Daniel, Just a heads up that attachments and images are stripped pretty aggressively by the mailing list - none of your images made it through. You might more success linking to the images in Dropbox or some other online storage medium. Best, Jason On Thu, Jun 4, 2020 at 10:55 AM Gell-Holler

Re: HTTP 401 when searching on alias in secured Solr

2020-06-16 Thread Jason Gerlowski
Just wanted to close the loop here: Isabelle filed SOLR-14569 for this and eventually reported there that the problem seems specific to her custom configuration which specifies a seemingly innocuous in solrconfig.xml. See that jira for more detailed explanation (and hopefully a resolution coming

Re: Can't fetch table from cassandra through jdbc connection

2020-06-16 Thread Jason Gerlowski
The way I read the stack trace you provided, it looks like DIH is running the query "select test_field from test_keyspace.test_table limit 10", but the Cassandra jdbc driver is reporting that Cassandra doesn't support some aspect of that query. If I'm reading that right, this seems like a question

Re: [EXTERNAL] Re: Getting rid of Master/Slave nomenclature in Solr

2020-06-18 Thread Jason Gerlowski
+1 to rename master/slave, and +1 to choosing terminology distinct from what's used for SolrCloud. I could be happy with several of the proposed options. Since a good few have been proposed though, maybe an eventual vote thread is the most organized way to aggregate the opinions here. I'm less p

Re: Index files on Windows fileshare

2020-06-25 Thread Jason Gerlowski
Hi Fiz, Since you're just looking for a POC solution, I think Solr's "bin/post" tool would probably help you achieve your first requirement. But I don't think "bin/post" gives you much control over the fields that get indexed - if you need the file path to be stored, you might be better off writi

Re: Restored collection cluster status rendering some values as Long (as opposed to String for other collections)

2020-06-25 Thread Jason Gerlowski
Hi Aliaksandr This sounds like a bug to me - I can't think of any reason why this would be intentional behavior. Maybe I'm missing something and this is "expected", but if so someone will come along and correct me. Can you file a JIRA ticket with this information in it? Jason On Wed, Jun 24, 2

Re: SOLR and Zookeeper compatibility

2020-07-22 Thread Jason Gerlowski
Hi Mithun, AFAIK, Solr 7.5.0 comes with ZooKeeper 3.4.11. At least, those are the jar versions I see when I unpack a Solr 7.5.0 distribution. Where are you seeing 1.3.11? There is no 1.3.11 ZooKeeper release as far as I'm aware. There must be some confusion here. Generally speaking, since 3.4

Re: bin/solr auth enable

2020-07-31 Thread Jason Gerlowski
Hi David, I tried this out locally but couldn't reproduce. The command you provided above works just fine for me. Can you tell us a bit about your environment? Do you have the full stack trace of the NPE handy? Best, Jason On Fri, Jul 24, 2020 at 8:01 PM David Glick wrote: > > When I issue “

Re: Survey on ManagedResources feature

2020-08-11 Thread Jason Gerlowski
Hey Noble, Can you explain what you mean when you say it's not secured? Just for those of us who haven't been following the discussion so far? On the surface of things users taking advantage of our RuleBasedAuth plugin can secure this API like they can any other HTTP API. Or are you talking abo

Re: Slow query response from SOLR 5.4.1

2020-08-11 Thread Jason Gerlowski
Hey Abhijit, The information you provided isn't really enough for anyone else on the mailing list to debug the problem. If you'd like help, please provide some more information. Good places to start would be: what is the query, what does Solr tell you when you add a "debug=timing" parameter to y

Re: Incorrect Insecure Settings Check in CoreContainer

2020-08-11 Thread Jason Gerlowski
Yikes, yeah it's hard to argue with that. I'm a little confused because I remember testing this, but maybe it snuck in at the last minute? In any case, I'll reopen that jira to fix the check there. Sorry guys. Jason On Wed, Aug 5, 2020 at 9:22 AM Jan Høydahl wrote: > > This seems to have bee

Re: Incorrect Insecure Settings Check in CoreContainer

2020-08-13 Thread Jason Gerlowski
Hey Mark, I've fixed it for 8.7 as a part of this ticket here: https://issues.apache.org/jira/browse/SOLR-14748. Thanks for reporting this. Jason On Tue, Aug 11, 2020 at 3:19 PM Jason Gerlowski wrote: > > Yikes, yeah it's hard to argue with that. > > I'm a little

  1   2   >