Re: solr jetty based auth and distributed solr requests

Radhakrishnan, I'm not sure offhand whether or not that's possible. It sounds like you've done enough analysis to write a good Jira ticket, so if nobody speaks up on the mailing list, go ahead and create one. Cheers, Scott On Tue, Aug 22, 2017 at 7:15 PM, radha krishnan wrote: > Hi, > > I ena

Re: Excessive resources consumption migrating from Solr 6.6.0 Master/Slave to SolrCloud 6.6.0 (dozen times more resources)

Hi Daniel, Great background information about your setup! I've got just a few more questions: - Can you describe the process that queries the DB and sends records to Solr? - Is it a SolrJ-based application? - If it is, which client package are you using? - How many documents do you send at once?

Re: Get results in multiple orders (multiple boosts)

Hi Luca, Sorry, I was out. Let me try to put some dummy code as an example. Will be putting it shortly. Thnx On Tue, Aug 22, 2017 at 6:08 AM, Rick Leir wrote: > Luca, > Did you say _slower_ mySQL? It is blazing fast, I used it with over 10m > records and no appreciable latency. The underlying

Re: Get results in multiple orders (multiple boosts)

This is just an dummy code to show you how you can add a request handler in solrconfig and utilise that to sort by custom field based on your criteria. You can do lot here like using pow function etc. and create more local params etc based on your need. *:* explicit

RE: Solr uses lots of shared memory!

I do not think it is a problem of reporting after watching top after restart of some Solr instances, it dropped back to `normal`, around 350 MB, which i think it high to but anyway. Two hours later, the restarted nodes are slowly increasing shared memory consumption to about 1500 MB now. I don'

Re: Solr uses lots of shared memory!

On 8/23/2017 7:32 AM, Markus Jelsma wrote: > Why does it slowly increase over time? > Why does it appear to correlate to index size? > Is anyone else seeing this on their 6.6 cloud production or local machines? More detailed information included here.  My 6.6 dev install is NOT having the problem,

RE: Solr uses lots of shared memory!

I have the problem in production and local, with default Solr 6.6 JVM arguments, environments are: openjdk version "1.8.0_141" OpenJDK Runtime Environment (build 1.8.0_141-8u141-b15-1~deb9u1-b15) OpenJDK 64-Bit Server VM (build 25.141-b15, mixed mode) Linux idx1 4.9.0-3-amd64 #1 SMP Debian 4.9.30

Spatial search with arbitrary rectangle?

Hi All I've been skimming through the spatial search docs and came across this section: https://lucene.apache.org/solr/guide/6_6/spatial-search.html#SpatialSearch-Filteringbyanarbitraryrectangle "Sometimes the spatial search requirement calls for finding everything in a rectangular area, suc

Re: solr jetty based auth and distributed solr requests

Such setup is not supported, interfering inter node communication, start here on how to secure Solr: https://cwiki.apache.org/confluence/display/solr/Securing+Solr On Wed, 23 Aug 2017 at 14:41, Scott Stults < sstu...@opensourceconnections.com> wrote: > Radhakrishnan, > > I'm not sure offhand whe

Re: solr jetty based auth and distributed solr requests

Newest docs: https://lucene.apache.org/solr/guide/6_6/securing-solr.html On Wed, 23 Aug 2017 at 19:20, Lars Karlsson wrote: > Such setup is not supported, interfering inter node communication, start > here on how to secure Solr: > > https://cwiki.apache.org/confluence/display/solr/Securing+Solr

Custom StoredFieldVisitor in Solr

I thought I had asked this previously, but I can't find reference to it now. I am interested in using a custom StoredFieldVisitor in Solr and after spelunking through the code for a little it seems that there is no easy extension point that supports me doing so. I am currently on Solr 4.x (moving

Request to be added to the ContributorsGroup

Hi there, I would like to contribute to the Solr wiki. My username is KevinGrimes, and my e-mail is kevingrim...@me.com . Thanks, Kevin

Re: Request to be added to the ContributorsGroup

I just added you to the wiki. Note that the official documentation is now in the "solr-ref-guide" directory of the code base, and you can create patches/PRs to it. Tomás > On Aug 23, 2017, at 10:58 AM, Kevin Grimes wrote: > > Hi there, > > I would like to contribute to the Solr wiki. My user

Facet on a Payload field type?

Is it possible to facet on a payload field type? We are moving from Endeca to Solr. We have a number of Endeca facets where we have hacked in multilangauge support. The multiple languages are really just for displaying the value of a term internally the value used to search is in English. The pro

Download Sunplot for SQL/Streaming expr

Hello, >From where we can download Sunplot/setup to use SQL and streaming expressions? Thanks, Susheel

Re: Machine Learning for search

Can you describe the weather model? In general the idea is to rerank the top N docs, because it will be too slow to classify the whole result set. In this scenario the search engine ranking will already be returning relevant candidate documents and the model is only used to get a better ordering

RE: Facet on a Payload field type?

Technically they could, facetting is possible on TextField, but it would be useless for facetting. Payloads are only used for scoring via a custom Similarity. Payloads also can only contain one byte of information (or was it 64 bits?) Payloads are not something you want to use when dealing wit

Re: Facet on a Payload field type?

Certainly more than a byte of information. The most common example is to have payloads encode floats.So if there is a limit, it's more likely to be 64bits On Wed, Aug 23, 2017 at 2:10 PM, Markus Jelsma wrote: > Technically they could, facetting is possible on TextField, but it would > be useless

Re: Excessive resources consumption migrating from Solr 6.6.0 Master/Slave to SolrCloud 6.6.0 (dozen times more resources)

Hi Scott, - *Can you describe the process that queries the DB and sends records to * *Solr?* We are enqueueing ids during every ORACLE transaction (in insert/updates). An application dequeues every id and perform queries against dozen of tables in the relational model to retrieve the fields to b

Re: Facet on a Payload field type?

The payload idea was from my boss, it's similar to how they did this in Endeca. I'm not sure I follow your idea about "mapping internal value to translated value". Would you care to elaborate? My alternate idea is to have sets of facet fields for different languages, then let our service layer dete

RE: Facet on a Payload field type?

Yes, let the 'service layer' solve this, in our case our JS-interface does this job. Internal (in Lucene) values for field MIME-type are e.g. application/pdf and text/html. In the interface layer, which is JS, those values are mapped to Web page, Webpagina or PDF document, PDF-document, and more

Solr deltaImportQuery ID configuration

Hello, I am using Solr 6.3.0. Does anyone know in deltaImportQuery when referencing id, should I use '${dih.delta.id}' or '${dataimporter.delta.id} ? Both were mentioned in Delta-Import wiki. I am confused. Thank you. Kind regards, Daphne Liu BI Architect - Matrix SCM CEVA Logistics / 107

Re: Machine Learning for search

Thank you Joel.  I'm really having a good time with the machine learning component in Solr.  In this case, the weather model was built by classifying tweets as positive or negative.  I started by searching for tweets with terms like tornado, storm, forecast, typhoon, hurricane, blizzard, snow,

Re: Facet on a Payload field type?

: The payload idea was from my boss, it's similar to how they did this in : Endeca. ... : My alternate idea is to have sets of facet fields for different languages, : then let our service layer determine the correct one for the user's : language, but I'm curious as to how others have solve

Re: Solr uses lots of shared memory!

I suspect you've already seen this, but top and similar can be confusing when trying to interpret MMapDirectory. Uwe has an excellent explication: http://blog.thetaphi.de/2012/07/use-lucenes-mmapdirectory-on-64bit.html Best, Erick On Wed, Aug 23, 2017 at 9:10 AM, Markus Jelsma wrote: > I have t

Re: Solr uses lots of shared memory!

Very interesting. Do you have many DocValue fields? Have you always had them i.e. did you see this problem before you turned on DocValues? The DocValue fields are in a separate file and they will be memory mapped on demand. One thing you can experiment with is to use preload=true option on the MMap

Re: Case sensitive synonym value

Hi all, Any update on this issue. -Aman On 10-Aug-2017 8:27 AM, "Aman Deep Singh" wrote: > Yes, > Ignore case is set to true and it is working fine > > > On 10-Aug-2017 12:43 AM, "Erick Erickson" wrote: > > You set ignoreCase="true" though, right? > > On Wed, Aug 9, 2017 at 8:39 AM, Aman Deep S