Define fieldType in XML file

2016-07-14 Thread Zheng Lin Edwin Yeo
Hi, Would like to check, for Solr dyanamic field, is it possible to define the fieldType on the XML file? Currently, the method is to do the appending at the end of the file to determine the file type (Eg, for title field with string type, we append title_s). As this will results in all the _s,

Re: Reusing `geodist()` value in a function query

2016-07-14 Thread Aakash Sabharwal
Alternatively if I do the following: *q={!boost b=max(sub(abs(sub($geodz,0.0)),1.6), pow(abs(sub($geodz,0.0)),1.2))}&geodz=geodist()* Does this lead to geodist() being recomputed or not? On Thu, Jul 14, 2016 at 6:37 PM Aakash Sabharwal wrote: > Hello, > > geodist calculations can be expens

Reusing `geodist()` value in a function query

2016-07-14 Thread Aakash Sabharwal
Hello, geodist calculations can be expensive so trying ways to optimize around it. Particularly trying to figure out if sub-function queries are cached while calculating an overall boost function for queries. For example if I query with the below: *q={!boost b=max(sub(abs(sub(geodist(),0.0)),1.

Solr Cloud setup and deoployment in Azure cloud

2016-07-14 Thread Aniket Khare
Hi, I was looking for option to deploy SolrCloud in Azure. I am using ARM templetes for the deployment. Please refer the following link for ARM(Azure resource manager) templete. https://github.com/Azure/azure-quickstart-templates https://azure.microsoft.com/en-us/documentation/articles/resource-gr

RE: Simple Post Tool result question (UNCLASSIFIED)

2016-07-14 Thread Markus Jelsma
Hello - Multiple slashes beyond the URL scheme should be normalized, but some crazy CMS' or their doubtful modules actually rely on it! It's madness. M. -Original message- > From:Jamal, Sarfaraz > Sent: Thursday 14th July 2016 21:39 > To: solr-user@lucene.apache.org > Subject: RE: S

RE: Simple Post Tool result question (UNCLASSIFIED)

2016-07-14 Thread Jamal, Sarfaraz
I am not entirely sure what you mean, But extra slashes in the middle of a url produce the same result as a single slash (right?). So for example: https://www.visualstudio.com/downloads///download-visual-studio-vs is the same as: https://www.visualstudio.com/downloads/download-visual-studio-vs

Re: Idle timeout expired: 50000/50000 ms

2016-07-14 Thread Yago Riveiro
Recently I started to buffering docs and send them to Solr in blocks of 250 and 50 workers. But now I'm hitting this issue too with Solr 5.3.1 Googling a bit I found this https://bugs.eclipse.org/bugs/show_bug.cgi?id=435322 that was fixes in 9.2 version. There is another link

Solr 6.1.0 - Indexing Error

2016-07-14 Thread Joseph Obernberger
Hi all - I'm testing 6.1.0 on a small two shard setup (two physical machines) using HDFS for the index. I was indexing away when one of the shards started throwing this error: org.apache.solr.common.SolrException: Exception writing document id COLLECT2587102526510 to the index; possible analysis

Re: Is SolrCloudClient Singleton Pattern possible with multiple collections?

2016-07-14 Thread Pablo Anzorena
The thing is that back in solr4.8, when I was using solr standalone and I had to make a distributed query among multiple shards, I found that for each shard in the param "shards" it makes a request (which is the correct behaviour I know) but when I put just one shard in the "shards" param then it m

Re: Is SolrCloudClient Singleton Pattern possible with multiple collections?

2016-07-14 Thread Erick Erickson
bq: if using the param "collection" is the same Did you just try it? If so what happened? Not sure what you're asking here. It's the name of the collection you want to query against. It's only necessary when you want to go against a collection that isn't the default which you can set with setDef

Simple Post Tool result question (UNCLASSIFIED)

2016-07-14 Thread Musshorn, Kris T CTR USARMY RDECOM ARL (US)
CLASSIFICATION: UNCLASSIFIED POSTed web resource https://xx/inside/news/dispatches///view.cfm?id=9128 (depth: 4) What is the significance of the /// ? Thanks, Kris ~~ Kris T. Musshorn FileMaker Developer - Contractor - Catapult Technology Inc. US Army Research

Re: Is SolrCloudClient Singleton Pattern possible with multiple collections?

2016-07-14 Thread Pablo Anzorena
I was using public QueryResponse query(ModifiableSolrParams params, METHOD method) And my actual code is parsing that object. I can change it to your method, but before that let me ask you if using the param "collection" is the same. Actually I am using the param "collection" only when I need to

Re: java.lang.InterruptedException while reloading core

2016-07-14 Thread Jim Martin
I see this occasionally. I¹ve wondered if it¹s related to SOLR-4161. This error also correlates with a sudden growth in memory usage within the VM. Usually, this memory growth does not clear up on its own. I¹m using Solr 4.10.4. On 6/26/16, 9:11 PM, "jarpondy" wrote: >Hi > >We are seeing the

Re: SimplePostTool details (UNCLASSIFIED)

2016-07-14 Thread Erik Hatcher
The simple post tool is a glorified `curl` of the file contents (unprocessed in the tool itself) to one of Solr’s endpoints…. /update/extract for rich documents like you mentioned. See https://lucidworks.com/blog/2015/08/04/solr-5-new-binpost-utility/

Re: [Non-DoD Source] SimplePost tool (UNCLASSIFIED)

2016-07-14 Thread Erik Hatcher
What do you want to de-dupe by? There’s the Signature update processor. See https://cwiki.apache.org/confluence/display/solr/De-Duplication for details Erik > On Jul 14, 2016, at 1:14 PM, Musshorn, Kris T CTR USARMY RDE

Re: Is SolrCloudClient Singleton Pattern possible with multiple collections?

2016-07-14 Thread Erick Erickson
Just use the public NamedList request(SolrRequest request, String collection) method on the SolrCloudClient? Best, Erick On Thu, Jul 14, 2016 at 9:18 AM, Pablo Anzorena wrote: > Hey, > So the question is quite simple, Is it possible to use Singleton Pattern > with SolrCloudClient instantiation

RE: [Non-DoD Source] Re: SimplePost tool (UNCLASSIFIED)

2016-07-14 Thread Musshorn, Kris T CTR USARMY RDECOM ARL (US)
CLASSIFICATION: UNCLASSIFIED Thanks for both replies. I could configure an update handler to accomplish dedupe? Thanks, Kris ~~ Kris T. Musshorn FileMaker Developer - Contractor - Catapult Technology Inc. US Army Research Lab Aberdeen Proving Ground Application Ma

SimplePostTool details (UNCLASSIFIED)

2016-07-14 Thread Musshorn, Kris T CTR USARMY RDECOM ARL (US)
CLASSIFICATION: UNCLASSIFIED Does the simple post tool index the contents of a document (word,txt,xls,pdf etc) that it encounters? Thanks, Kris ~~ Kris T. Musshorn FileMaker Developer - Contractor - Catapult Technology Inc. US Army Research Lab Aberdeen Proving G

Re: SimplePost tool (UNCLASSIFIED)

2016-07-14 Thread Erik Hatcher
No, the tool itself is just a glorified Solr-savvy `curl`.Any deduplication would have to be in the Solr-side update handling (or before the post tool is invoked by selectively choosing what to send it). Erik > On Jul 14, 2016, at 12:36 PM, Musshorn, Kris T CTR USARMY RDECOM ARL (

RE: SimplePost tool (UNCLASSIFIED)

2016-07-14 Thread Jamal, Sarfaraz
In my experience - and if I recall correctly - If the ids are different but the file Is the same, you will have two separate documents that are indexed - Sas Sarfaraz Jamal (Sas) Revenue Assurance Tech Ops 614-560-8556 sarfaraz.ja...@verizonwireless.com -Original Message- From: Muss

RE: Strip HTML Tags and Store

2016-07-14 Thread Kalpana
I got the solution to work - thanks so much I added the below to solrconfig.xml health_content_t

SimplePost tool (UNCLASSIFIED)

2016-07-14 Thread Musshorn, Kris T CTR USARMY RDECOM ARL (US)
CLASSIFICATION: UNCLASSIFIED Does the simple post tool accomplish deduplication? Thanks, Kris ~~ Kris T. Musshorn FileMaker Developer - Contractor - Catapult Technology Inc. US Army Research Lab Aberdeen Proving Ground Application Management & Development Branch

Re: Multilevel grouping?

2016-07-14 Thread Callum Lamb
Look at the collapse module https://cwiki.apache.org/confluence/display/solr/Collapse+and+Expand+Results. It can the same thing as group. If you want to get counts/facets from before the collapse, tag the collapse statement use the exclude tags tags in your json facets (there's an equivalent for n

Is SolrCloudClient Singleton Pattern possible with multiple collections?

2016-07-14 Thread Pablo Anzorena
Hey, So the question is quite simple, Is it possible to use Singleton Pattern with SolrCloudClient instantiation and then reuse that instance to handle multiple requests concurrently accessing differente collections? Thanks.

Re: How to speed up field collapsing on large number of groups

2016-07-14 Thread Joel Bernstein
The top_fc hint doesn't come into play until Solr 5. With Solr 4x the CollapsingQParserPlugin always uses a top level field cache. Joel Bernstein http://joelsolr.blogspot.com/ On Mon, Jul 4, 2016 at 9:20 AM, Alessandro Benedetti wrote: > Have you tried with docValues for the fields involved in

Re: Multilevel grouping?

2016-07-14 Thread Aditya Sundaram
Thanks Yonik, was looking for exactly that, is there any workaround to achieve that currently? On Tue, Jul 12, 2016 at 5:07 PM, Yonik Seeley wrote: > I started this a while ago, but haven't found the time to finish: > https://issues.apache.org/jira/browse/SOLR-7830 > > -Yonik > > > On Tue, Jul 1

traversalFilter in Graphical Query parser Solr

2016-07-14 Thread Marre
I have a structure where i want to search my documents and filter/rank/set conditions on my parents. Example: a doc is a match because it contains my searched string, but also because its parent contains a certain value. Using the graph parser and experimenting with the filter is the best way i ha

Re: solrcloud consumes more time than solr when write index

2016-07-14 Thread Kent Mu
correct the URL. http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201607.mbox/%3CCAMCstK6rv0NWH3tqG0MBo%3D1kccDHTH4JQP-sNFvTuEzd2mUYFA%40mail.gmail.com%3E 2016-07-14 1:17 GMT+08:00 Jeff Wartes : > There’s another thread on this list going on right now touching on the > need to optimize,

Re: solrcloud consumes more time than solr when write index

2016-07-14 Thread Kent Mu
Thanks a lot! I see now. well, I come across an issue that so many connections in solrcloud. and I have raised a issue on mailing list. please help me! looking forward to your reply. http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201607.mbox/ajax/%3CCAMCstK6rv0NWH3tqG0MBo%3D1kccDHTH4JQP

Why Nested document 'child' entity query (iterative count)repeatedly executing?

2016-07-14 Thread Rajendran, Prabaharan
Hi All, I am trying to index nested document. While start full data-import (from UI) following options selected Verbose, Commit, Debug & Debug-Mode. Raw Debug-Response shows that "child" entity query execute repeatedly. Kindly help me to understand this, how can I resolve this, am I missed anyt

Re: solr.textfield in solr 6

2016-07-14 Thread sara hajili
yes it occur because of exsitance text field in my solr-config.xml file .and text field dos not exist in my schema file tnx On Wed, Jul 13, 2016 at 6:04 PM, Erick Erickson wrote: > You have to show us exactly what you're doing when you > add and remove "solr.TextField". > > This error _usually_

DIH:damaged files

2016-07-14 Thread kostali hassan
I try to index many files msword and pdf using solr-5.4.1 ; In solr logg I get only the description of ERROR not the file who cause the Error; how to get a list of files are corrupt and Tika cannot index them; AND even if solr try index corrupt file and fail how force solr to continue indexing the

SOLR Suggester | CFQ Variable | - not supported

2016-07-14 Thread Rajesh Kapur
Hi, I am facing issue while implementing suggester for my project where I am passing CFQ value having - in between, but it is not giving me desired output. Could you please let me know what should I do so that SOLR suggester starts accepting - in CFQ parameters. Thanks Rajesh Kapur