Re: Sum of all values in Function Query

2016-08-03 Thread Zheng Lin Edwin Yeo
Hi Mikhail, Yes, I have tried this, and it works for individual fields. Currently I am trying to do something like sum(product(Quanity,Amount). Is is possible to do it in a single Solr query? Regards, Edwin On 3 August 2016 at 16:35, Mikhail Khludnev wrote: > Edwin, > Did you try something

Difference in boolean query parsing. Solr-5.4.0 VS Solr.6.1.0

2016-08-03 Thread Modassar Ather
Hi, During migration from Solr-5.4.1 to Solr-6.1.0 I saw a difference in the behavior of few of my boolean queries. As per my current understanding the default operator comes in when there is no operator present in between two terms. Also both the ANDed terms are marked mandatory if not, any of th

CDCR - Active-passive model

2016-08-03 Thread Mads Tomasgård Bjørgan
Hello, I read that it's being worked on 6x to fix the limitation of CDCR only covering the active-passive scenario. My question is then - does anyone know when we can expect the fix to be out? Thanks, Mads

Re: SOLR + Nutch set up (UNCLASSIFIED)

2016-08-03 Thread Walter Underwood
Ah, the difference between open source and a product. With Ultraseek, we chose a solid, stable algorithm that worked well for 3000 customers. In open source, it is a research project for every single customer. I love open source. I’ve brought Solr into Netflix and Chegg. But there is a clear di

RE: [Non-DoD Source] Re: SOLR + Nutch set up (UNCLASSIFIED)

2016-08-03 Thread Markus Jelsma
No, just run it continously, always! By default everything is refetched (if possible) every 30 days. Just read the descriptions for adaptive schedule and its javadoc. It is simple to use, but sometimes hard to predict its outcome, just because you never know what changes, at whatever time. You

RE: SOLR + Nutch set up (UNCLASSIFIED)

2016-08-03 Thread Markus Jelsma
Depending on your settings, Nutch does this as well. It is even possible to set up different inc/decremental values per mime-type. The algorithms are pluggable and overridable at any point of interest. You can go all the way. -Original message- > From:Walter Underwood > Sent: Wednes

Re: QParsePlugin not working on sharded collection

2016-08-03 Thread Erick Erickson
OK, I'm going to assume that somewhere you're keeping more complicated structures around to track all the docs coming through the collector so you can know whether they're duplicates or not. I think there are really two ways (at least) to go about it 1> use a SearchComponent to add a separate sect

Re: QParsePlugin not working on sharded collection

2016-08-03 Thread tedsolr
So I notice if I create the simplest MergeStrategy I can get my test values from the shard responses and then if I add info to the SolrQueryResponse it gets back to the caller. I still must be missing something. I wouldn't expect to have different code paths - one for single shard one for multi sha

Re: QParsePlugin not working on sharded collection

2016-08-03 Thread Erick Erickson
Right, I don't have the code in front of me right now, but I think your issue is at the "aggregation" point. You also have to put some code in the aggregation bits that pull your custom parts from the sub-request packets and puts in the final packet, "doing the right thing" in terms of assembling t

RE: [Non-DoD Source] Re: SOLR + Nutch set up (UNCLASSIFIED)

2016-08-03 Thread Musshorn, Kris T CTR USARMY RDECOM ARL (US)
CLASSIFICATION: UNCLASSIFIED Shall I assume that, even though nutch has adaptive capability, I would still have to figure out how to trigger it to go look for content that needs update? Thanks, Kris ~~ Kris T. Musshorn FileMaker Developer - Contractor – Catapult Technolo

Re: SOLR + Nutch set up (UNCLASSIFIED)

2016-08-03 Thread Walter Underwood
That’s good news. It should reset the interval estimate on page change instead of slowly shortening it. I’m pretty sure that Ultraseek used a bounded exponential backoff when the page had not changed. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) >

Re: SOLR + Nutch set up (UNCLASSIFIED)

2016-08-03 Thread Marco Scalone
Nutch also has adaptive strategy: This class implements an adaptive re-fetch algorithm. This works as > follows: > >- for pages that has changed since the last fetchTime, decrease their >fetchInterval by a factor of DEC_FACTOR (default value is 0.2f). >- for pages that haven't changed

Re: SOLR + Nutch set up (UNCLASSIFIED)

2016-08-03 Thread Walter Underwood
I’m pretty sure Nutch uses a batch crawler instead of the adaptive crawler in Ultraseek. I think we were the only people who built an adaptive crawler for enterprise use. I tried to get Ultraseek open-sourced. I made the argument to Mike Lynch. He looked at me like I had three heads and didn’t

SOLR + Nutch set up (UNCLASSIFIED)

2016-08-03 Thread Musshorn, Kris T CTR USARMY RDECOM ARL (US)
CLASSIFICATION: UNCLASSIFIED We are currently using ultraseek and looking to deprecate it in favor of solr/nutch. Ultraseek runs all the time and auto detects when pages have changed and automatically reindexes them. Is this possible with SOLR/nutch? Thanks, Kris ~~ Kri

My solr server finishes itself

2016-08-03 Thread Julien VIELLE
Hello, I'm facing strange problem my solr server stops itself randomly. with the message: Graceful shutdown SocketConnector@0.0.0.0:8983 You will find attached my solr.log I don't understand why there are no crontab running. There nothing in my log telling why solr shutdown itself. Any help

Suspicious message with attachment

2016-08-03 Thread help
The following message addressed to you was quarantined because it likely contains a virus: Subject: My solr server finishes itself From: Julien VIELLE However, if you know the sender and are expecting an attachment, please reply to this message, and we will forward the quarantined message to y

QParsePlugin not working on sharded collection

2016-08-03 Thread tedsolr
I'm trying to verify that a very simple custom post filter will work on a sharded collection. So far it doesn't. Here are the search results on my single shard test collection: { "responseHeader": { "status": 0, "QTime": 17 }, "thecountis": "946028", "myvar": "hello", "response":

Re: Replication with managed resources?

2016-08-03 Thread rosbaldeston
I was just running my own test and it seems it doesn't replicate or reload the managed schema synonyms file. Not on a manual replication request after a synonym change and not on an index change triggering an automatic replication at least. Used this as the slaves confFiles, not sure if this allow

Re: Replication with managed resources?

2016-08-03 Thread Erick Erickson
bq: I'm also guessing those _schema and managed_schema files are an implementation detail for the missing zookeeper functionality. But if I did add those to a conffiles option it might automate the slave core reloads for me? You're getting closer ;). There's nothing Cloud specific about the whole

Suspicious message with attachment

2016-08-03 Thread help
The following message addressed to you was quarantined because it likely contains a virus: Subject: My solr server finishes itself From: Julien Vielle However, if you know the sender and are expecting an attachment, please reply to this message, and we will forward the quarantined message to y

Re: EmbeddedSolrServer problem when using one-jar-with-dependency including solr

2016-08-03 Thread Steve Rowe
Oh, then likely the problem is that your uberjar packing tool doesn’t know how to (or maybe isn’t configured to?) include/merge/translate resources under META-INF/services/. E.g. lucene/core module has SPI files there. Info on the maven shade plugin’s configuration for this stuff is here here:

Re: Replication with managed resources?

2016-08-03 Thread rosbaldeston
Erick Erickson wrote > It Depends. When running in Cloud mode then "yes". If you're running > stand-alone > then there is no Zookeeper running so the answer is "no". Ah that helps, so no zookeeper in my case. I did wonder if it wasn't just sharing the same config files between master and slave fro

Re: Sort Facet Values by "Interestingness"?

2016-08-03 Thread Joel Bernstein
You first gather the candidates and then call the TermsComponent with a callback. The scoreNodes expression does this and it's very fast because Streaming expressions are run from a Solr node in the same cluster. The TermsComponent will return the global docFreq for the terms and global numDocs fo

Re: Sort Facet Values by "Interestingness"?

2016-08-03 Thread Ben Heuwing
Hi Joel, thank you, this sounds great! As to your first proposal: I am a bit out of my depth here, as I have not worked with streaming expressions so far. But I will try out your example using the facet() expression on a simple use case as soon as you publish it. Using the TermsComponent di

RE: Installing Solr with Ivy

2016-08-03 Thread Davis, Daniel (NIH/NLM) [C]
I think the free versions of either Artifactory or Sonatype Nexus would be able to be this cache in a very effective, cloud ready way. This way, you would not be dependent on shared directories.You would just need some task to pull down Solr and checksums and publish them into the reposito

RE: Where should the listeners be defined in solrconfig.xml (Solr 6.0.1)

2016-08-03 Thread Alexandre Drouin
That's good to know thanks! I should have thought to check the java code before asking. Alexandre Drouin -Original Message- From: Mikhail Khludnev [mailto:m...@apache.org] Sent: August 3, 2016 10:52 AM To: solr-user Subject: Re: Where should the listeners be defined in solrconfig.xml

Re: Replication with managed resources?

2016-08-03 Thread Erick Erickson
bq: Am I right in saying managed resources are handled by zookeeper rather than files on the filesystem It Depends. When running in Cloud mode then "yes". If you're running stand-alone then there is no Zookeeper running so the answer is "no". You can run Solr just like you always have in mast

Re: Where should the listeners be defined in solrconfig.xml (Solr 6.0.1)

2016-08-03 Thread Mikhail Khludnev
As far as I remember the code it captures everywhere https://github.com/apache/lucene-solr/blob/master/solr/core/src/java/org/apache/solr/core/SolrConfig.java#L331 Double slash "//listener" means "everywhere". On Wed, Aug 3, 2016 at 4:38 PM, Alexandre Drouin < alexandre.dro...@orckestra.com> wrot

RE: Where should the listeners be defined in solrconfig.xml (Solr 6.0.1)

2016-08-03 Thread Alexandre Drouin
Does anyone knows where the listener should be defined in solrconfig.xml? Alexandre Drouin -Original Message- From: Alexandre Drouin [mailto:alexandre.dro...@orckestra.com] Sent: July 29, 2016 10:46 AM To: solr-user@lucene.apache.org Subject: Where should the listeners be defined in so

RE: Installing Solr with Ivy

2016-08-03 Thread Demian Katz
Dan, In case you, or anyone else, is interested, let me share my current solution-in-progress: https://github.com/vufind-org/vufind/pull/769 I've written a Phing task for my project (Phing is the PHP equivalent of Ant) which takes some loose inspiration from your Ant download task. The task us

Re: Replication with managed resources?

2016-08-03 Thread rosbaldeston
Am I right in saying managed resources are handled by zookeeper rather than files on the filesystem and I should ignore any files such as: managed-schema, _rest_managed.json, _schema_analysis_stopwords_english.json, _schema_analysis_synonyms_english.json ... I should not try to copy any of th

Re: Sort Facet Values by "Interestingness"?

2016-08-03 Thread Joel Bernstein
Also the TermsComponent now can export the docFreq for a list of terms and the numDocs for the index. This can be used as a general purpose mechanism for scoring facets with a callback. https://issues.apache.org/jira/browse/SOLR-9243 Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Aug 3, 20

Re: Sort Facet Values by "Interestingness"?

2016-08-03 Thread Joel Bernstein
What you're describing is implemented with Graph aggregations in this ticket using tf-idf. Other scoring methods can be implemented as well. https://issues.apache.org/jira/browse/SOLR-9193 I'll update this thread with a description of how this can be used with the facet() streaming expression as

Sort Facet Values by "Interestingness"?

2016-08-03 Thread heuwing
Dear everybody, as the JSON-API now makes configuration of facets and sub-facets easier, there appears to be a lot of potential to enable instant calculation of facet-recommendations for a query, that is, to sort facets by their relative importance/interestingess/signficance for a current quer

Solr 6 more like this

2016-08-03 Thread sara hajili
hi i switch from solr 5 to solr 6 . i create my more like this handler that use solr more like this handler and expand query by adding some word to query. and now my question is about mlt parameter . i wanna to know about mlt.mindf and mlt.mintf.what are these doing exactly? when i didn't set mlt.m

Re: EmbeddedSolrServer problem when using one-jar-with-dependency including solr

2016-08-03 Thread Ziqi Zhang
Thanks I am not sure if Steve's suggestion was the right solution. Even when I did not have explicitly defined the dependency on lucene, I can see in the packaged jar it still contains org.apache.lucene. What solved my problem is to not pack a single jar but use a folder of individual jars.

Re: Sum of all values in Function Query

2016-08-03 Thread Mikhail Khludnev
Edwin, Did you try something from http://yonik.com/solr-facet-functions/ ? On Wed, Aug 3, 2016 at 6:58 AM, Zheng Lin Edwin Yeo wrote: > Hi, > > Would like to find out, is it possible for Solr to find a sum of all the > values that are returned in a query? > > For example, when I does a search in

Re: TooManyClauses: maxClauseCount is set to 1024

2016-08-03 Thread liubiaoxin1
-- View this message in context: http://lucene.472066.n3.nabble.com/TooManyClauses-maxClauseCount-is-set-to-1024-tp4056965p4290158.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: TooManyClauses: maxClauseCount is set to 1024

2016-08-03 Thread liubiaoxin1
set exery core solrconfig.xml: 4096 -- View this message in context: http://lucene.472066.n3.nabble.com/TooManyClauses-maxClauseCount-is-set-to-1024-tp4056965p4290157.html Sent from the Solr - User mailing list archive at Nabble.com.