Re: XFS or EXT4 on Amazon AWS AMIs

I'd like to see the MongoDB report(?). ext4fs design specifications includes support for large files via allocation placement. MongoDB, the last time I checked, does pre-allocation which gives it the performance benefit of ext4fs multiple design factors (Block and Inode Allocation Policy), but t

Re: Solr Suggester

That is because my_field_2 is not indexed. Regards, Emir On 21.12.2016 18:04, Furkan KAMACI wrote: Hi All, I've a field like that: When I run a suggester on my_field_1 it returns response. However my_field_2 doesn't. I've defined suggester as: suggester FuzzyLooku

How to manages diversity in search results in Solr

How to restrict the product search in a marketplace where no more than 3 results per retailer are permitted in search results? I understand the groupby/collapse could solve the issue but is there any other way to do it? Thank you. Regards, Daisy -- CONFIDENTIALITY N

Re: Solr Suggester

Hi Emir, As far as I know, it should be enough to be stored=true for a suggestion field? Should it be both indexed and stored? Kind Regards, Furkan KAMACI On Thu, Dec 22, 2016 at 11:31 AM, Emir Arnautovic < emir.arnauto...@sematext.com> wrote: > That is because my_field_2 is not indexed. > > Re

Re: How to manages diversity in search results in Solr

On Thu, 2016-12-22 at 17:35 +0800, Daisy wrote: > How to restrict the product search in a marketplace where no more > than 3 results per retailer are permitted in search results? > > I understand the groupby/collapse could solve the issue but is there > any other way to do it? Grouping is the obv

Re: Solr Suggester

For the suggester, the field must be indexed. It's not necessary to have it stored. Best, Michael Am 22.12.2016 um 11:24 schrieb Furkan KAMACI: > Hi Emir, > > As far as I know, it should be enough to be stored=true for a suggestion > field? Should it be both indexed and stored? > > Kind Regards,

Error Loading Custom Codec class with Solr Codec Factory. Class cast exception

Hello, I am trying to experiment with my solr indexes with the patch open on JIRA - Codec for index-level encryption (LUCENE-6966). https://issues.apache.org/jira/browse/LUCENE-6966. I am currently trying to test this Custom codec with Solr to

How to get SOLR document metadata in UIMA using SOLR6.3

Hi All, I am working on SOLR and UIMA development assignment. where I need to pass some of the SOLR document metadata to UIMA chain. Is there any concrete example on how to do SO. For example if I have pass "Title" information to the UIMA update processor then how can I do it. I am searchin

Limit Suggested Term Counts

I have a list to make suggestions on it. When I check the analyser page I see that field is analysed as I intended. i.e. tokens are: java linux mac However, when I use BlendedInfixLookupFactory to run a suggestion on that field it returns me whole paragraph instead of a limited size o

FuzzyLookupFactory throws FuzzyLookupFactory

Hi, When I try suggester component and use FuzzyLookupFactory I get that error: "error": { "msg": "java.lang.StackOverflowError", "trace": "java.lang.RuntimeException: FuzzyLookupFactory n\tat org.apache.solr.servlet.HttpSolrCall.sendError(HttpSolrCall.java:607)\n\tat I searched on the web and t

Request to be added to Solr Wiki

Hi. Could you please add me to the Solr Wiki (https://wiki.apache.org/solr). My user name is KaufmannPatricia. I realized that our company (SHI GmbH) is listed in https://wiki.apache.org/solr/Support, but the name of the company has changed and I want to correct this. If it is easier, if one of

Re: Request to be added to Solr Wiki

I added you to the Contributor's group which should allow you to edit that page. If not, let us know. Best, Erick On Thu, Dec 22, 2016 at 2:54 AM, Patricia Kaufmann wrote: > Hi. > > Could you please add me to the Solr Wiki (https://wiki.apache.org/solr). My > user name is KaufmannPatricia. > I

CDCR logging is Needlessly verbose, fills up the file system fast

While testing CDCR I found that it is writing tons of log messages per second. Example: 2016-12-21 23:24:41.652 INFO (qtp110456297-13) [c:sial-catalog-material s:shard1 r:core_node1 x:sial-catalog-material_shard1_replica1] o.a.s.c.S.Request [sial-catalog-material_shard1_replica1] webapp=/solr pat

Re: How to get SOLR document metadata in UIMA using SOLR6.3

I am more interested in UIMA JCas code. as I know that from Update processing chain I can send analyze fields. I can mention there "title" but how to access that in UIMA Jcas -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-get-SOLR-document-metadata-in-UIMA-using-SO

Re: Use ConcurrentUpdateSolrClient some program

Hmmm, when you say "When we send 100 million data", _how_ are you sending it? All at once? And is the read timeout on the client or in the server logs? What I suspect is happening is that Solr is too busy to promptly read the entire packet you're sending. This could be due to several things: - you

update operation

Merry Christmas everyone, I'm using solr 5.4.1 and writing a bash script to update the value in a field of a single document in solr. Here is the bash line: UPDATE_RESULT=$( curl -s "https://snip/solr/TEST_CORE/update?&commit=true"; --data-binary '{"id":"$DOC_ID","metatag.date.single" :{"

Re: update operation

On 12/22/2016 8:45 AM, KRIS MUSSHORN wrote: > Here is the bash line: > > UPDATE_RESULT=$( curl -s "https://snip/solr/TEST_CORE/update?&commit=true"; > --data-binary '{"id":"$DOC_ID","metatag.date.single" :{"set":"$VAL"}}') One thing I know you need for sure with the "/update" handler is the Con

problem executing a query using lucene directly

Hi all, I have created an index using solr. I am trying to execute the following code, but I get zero results in the count. DirectoryReader dr = DirectoryReader.open(FSDirectory.open(new File(indexDir).toPath())); IndexSearcher searcher = new IndexSearcher( dr ); System.out.println(dr.maxDoc());

Solr | OOM

Hi, We are using solr 4.8.1 and getting OOM Error in one of the test environments. Given below are the details: 1. OS - Linux, 64 bit, 32 GB RAM 2. Solr - 4.8.1, 8 GB allocation as java heap. Installed as service. Thread size (-Xss of 256K, -XX:+UseParallelOldGC). 3. Java

Re: problem executing a query using lucene directly

On 12/22/2016 9:21 AM, Roxana Danger wrote: > I have created an index using solr. I am trying to execute the following > code, but I get zero results in the count. > > DirectoryReader dr = DirectoryReader.open(FSDirectory.open(new > File(indexDir).toPath())); > IndexSearcher searcher = new IndexSea

Re: Use ConcurrentUpdateSolrClient some program

On 12/21/2016 11:15 PM, 苗海泉 wrote: > I use the solr is 6.0 version, the solrj is 6.0 version, using > SolrCloud mode deployment, in my code did not make an explicit commit, > configure the autoCommit and softAutoCommit, using the > ConcurrentUpdateSolrClient class. > > When we send 100 million data

Re: Solr | OOM

On 12/22/2016 9:29 AM, Prateek Jain J wrote: > We are using solr 4.8.1 and getting OOM Error in one of the test > environments. Given below are the details: There are exactly two ways to deal with OOM: 1) Increase the Java heap. 2) Make the program use less memory. Any other action (such as ch

Re: update operation

Shawn, Perhaps i misunderstood the documentation but when you included the add clause does it not create an entirely new document? K - Original Message - From: "Shawn Heisey" To: solr-user@lucene.apache.org Sent: Thursday, December 22, 2016 11:00:21 AM Subject: Re: update oper

Re: update operation

Shawn, Running: UPDATE_RESULT=$( curl -s -X POST -H 'Content-Type: text/json' "https://snip/solr/TEST_CORE/update/json/docs"; --data-binary '{"id":"*'$DOC_ID'","metatag.date.single":{"set":"$VAL"}}') was the only version that did not throw an error but did not update the document. It r

Re: problem executing a query using lucene directly

Hi, FieldValueQuery reports matches using docvalues, and it looks like they’re not enabled on that field. Alan Woodward www.flax.co.uk > On 22 Dec 2016, at 16:21, Roxana Danger > wrote: > > Hi all, > > I have created an index using solr. I am trying to execute the following > code, but I

solrj: get to which shard a id will be routed

Hi Is there somewhere a sample of some solrj code that given: - a collection - the id (like "IBM!12345") returns the shard to where the doc will be routed? I was hoping to get that info from CloudSolrClient itself but it's not exposing it as far as I can see. thanks xavier

Re: problem executing a query using lucene directly

Hi Alan, thank you very much, but I am not sure if this is the reason. but if I use the solrSearcher, FieldValueQuery works well, using the same index. If SolrIndexSearcher enable this feature, how does it do it? Thank you again! On 22 December 2016 at 17:34, Alan Woodward wrote: > Hi, > >

Re: update operation

On 12/22/2016 10:18 AM, KRIS MUSSHORN wrote: > UPDATE_RESULT=$( curl -s -X POST -H 'Content-Type: text/json' > "https://snip/solr/TEST_CORE/update/json/docs"; --data-binary > '{"id":"*'$DOC_ID'","metatag.date.single":{"set":"$VAL"}}') > > was the only version that did not throw an error but did

Re: update operation

Kris: Maybe too simple, but did you commit afterwards? On Thu, Dec 22, 2016 at 10:45 AM, Shawn Heisey wrote: > On 12/22/2016 10:18 AM, KRIS MUSSHORN wrote: >> UPDATE_RESULT=$( curl -s -X POST -H 'Content-Type: text/json' >> "https://snip/solr/TEST_CORE/update/json/docs"; --data-binary >> '{"id

Re: XFS or EXT4 on Amazon AWS AMIs

http://edgystuff.tumblr.com/post/81219256714/tips-to-check-and-improve-your-storage-io Which specifies: SERVER-13417

Re: update operation

How would i exp;licitly commit? Sorry for the silly questions but im pretty fried - Original Message - From: "Erick Erickson" To: "solr-user" Sent: Thursday, December 22, 2016 2:49:05 PM Subject: Re: update operation Kris: Maybe too simple, but did you commit afterwards? On T

Re: update operation

Well, there are two options: 1> set up your autocommit interval in solrconfig.xml and wait for as long as you set it. Say 30 seconds for softcommit. Note, you must either use soft commit or your entry must have true. 2> curl (or use the browser) http://snip/solr/TEST_CORE/update?commit=true Bes

Limit = 0? Does it still calculate facet ?

We have a qt=provider and it sets facets. We want to short circuit the facet. Can we set limit=0 and will it NOT calculate it? Or does it calculate it and not return results? Can we make it faster ? f..facet.limit = 0 -- Bill Bell billnb...@gmail.com cell 720-256-8076

Re: problem executing a query using lucene directly

Solr wraps its IndexReader in an UninvertingReader, which builds doc-values structures in memory if required. If you include the solr jar file on your classpath, you should be able to use UninvertingReader.wrap() to do something similar. Alan Woodward www.flax.co.uk > On 22 Dec 2016, at 17:5

DIH Commit Issue

Hi All, I have a DIH issue where the index will commit after 1 and 2 minutes then will not commit again until the end. We would like the commit to happen at the end so the index does not lose 75% or more of the records until the end of the process. We went from 370,000+ records to around 27,000

MLT Java example for Solr 6.3

I am having trouble locating a decent example for using the MLT Java API in Solr 6.3. What I want is to retrieve document IDs that are similar to a given document ID. Todd Peterson Chief Embedded Systems Engineer Management Sciences, Inc. 6022 Constitution Ave NE Albuquerque, NM 87144 505-255-86

Re: Limit = 0? Does it still calculate facet ?

Yes, facet.limit will short circuit and not calculate the facet for the field. I'm assuming you can't just use facet=false? Tomas On Thu, Dec 22, 2016 at 1:00 PM, William Bell wrote: > We have a qt=provider and it sets facets. > > We want to short circuit the facet. Can we set limit=0 and will

Re: DIH Commit Issue

I would set the times in the autoCommit to a large number (or -1 I think). It's possible that there's a default there if the autocommit section is found but nothing specified, you'll have to look at the code to be sure. But what I would do is use aliasing (either core if you're in stand-alone or c

Customizing the search result

I’m really new to SOLR and excuse me if my question is vague. I found some of the search related things in solr-core → org.apache.solr.search package. I’m not sure this is the right package to look into. 1. I would like to know if we are going to develop our own customized re-ranking,

Re: Customizing the search result

My very, very, very first question is "why do you think you have to develop your own customized re-ranking?". How have you determined that your needs aren't satisfied out-of-the-box? What I'm going for here is wondering if this is an XY problem. You're asking how to do X because you think that will

Re: Limit = 0? Does it still calculate facet ?

> facet.limit will short circuit and not calculate the facet for the field. But not for SolrCloud, I believe. On Fri, Dec 23, 2016 at 2:15 AM, Tomás Fernández Löbbe < tomasflo...@gmail.com> wrote: > Yes, facet.limit will short circuit and not calculate the facet for the > field. I'm assuming you

Re: Limit = 0? Does it still calculate facet ?

Yeah we have a bunch of facet.fields that we need, but want to selectively turn a few off based on user input. QT - has default facet.fields. We want to turn a couple off like this: http://localhost:8983/solr/core/select?qt=provider&f.payor.facet.limit=0 Will this turn off the payor field that

RE: Customizing the search result

Thanks a lot for the response. What I would like to do is something similar to groupby function. But because of some performance issue and business requirement limitation, I rather don't want to use groupby. Our business requirement is to avoid one supplier is dominating the search result page

RE: How to manages diversity in search results in Solr

The main issue is: Our page needs 80 products to display from different suppliers per keyword search. We have some of the search keywords which only have less than 80 suppliers. If we use groupby(supplier), the 80 products per page is not possible anymore. Regards, Daisy -Original Message-