DataImport using SqlEntityProcessor running Out of Memory

I have a Data Schema which is Hierarchical i.e. I have an Entity and a number of attributes. For a small subset of the Data - about 300 MB, I can do the import with 3 GB memory. Now with the entire 4 GB Dataset, I find I cannot do the import with 9 GB of memory. I am using the SqlEntityProcessor a

Re: not getting any mails

There was an infrastructure problem, _nobody_ was getting e-mails. I think it's fixed now. But the backlog will take a while to work through. Erick On Sat, May 10, 2014 at 5:30 AM, Aman Tandon wrote: > Hi, > > I am not getting any mails from this group, did my subscription just got > ended? Is

retreive all the fields in join

Hi, Is there a way possible to retrieve all the fields present in both the cores(core 1 and core2). e.g. core1: {id:111,name: "abc" } core2: {page:17, type: "fiction"} I want is that, on querying both the cores I want to retrieve the results containing all the 4 fields, fields id, name from cor

Replica as a "leader"

Solr & Collection Info: solr 4.8 , 4 shards, 3 replicas per shard, 30-40 milion docs per shard. Process: 1. Indexing 100-200 docs per second. 2. Doing Pkill -9 java to 2 replicas (not the leader) in shard 3 (while indexing). 3. Indexing for 10-20 minutes and doing hard commit. 4. Doing Pkill -9 j

Re: Solr, How to index scripts *.sh and *.SQL

On 8 May 2014 12:25, Visser, Marc wrote: > > HI All, > Recently I have set up an image with SOLR. My goal is to index and extract > files on a Windows and Linux server. It is possible for me to index and > extract data from multiple file types. This is done by the SOLR CELL request > handler. S

is it possible for solr to calculate and give back the price of a product based on its sub-products

Hi, I am using Solr for searching magento products in my project, I want to know, is it possible for solr to calculate and give back the price of a product based on its sub-products(items); For instance, i have a product P1 and it is the parent of items m1, m2. i need to get the minimal price of

Is it possible for solr to calculate and give back the price of a product based on its sub-products

Hi, I am using Solr for searching magento products in my project, I want to know, is it possible for solr to calculate and give back the price of a product based on its sub-products(items); For instance, i have a product P1 and it is the parent of items m1, m2. i need to get the minimal price of

Re: not getting any mails

Hi Amon, Its not just you. There was a general problem with Apache mailing lists. But it is fixed now.  Please see for more info : https://blogs.apache.org/infra/entry/mail_outage Ahmet On Sunday, May 11, 2014 7:41 AM, Aman Tandon wrote: Hi, I am not getting any mails from this group, did

solr 4.2.1 spellcheck strange results

Hi I am querying the solr server spellcheck and the results I get back although at first glance look ok it seems like solr is replying back as if it made the search with the wrong key. so while I query the server with the word "καρδυα" Solr is responding me as if it was querying the database

Re: SWF content not indexed

Hi, Solr/lucene only deals with text. There are some other projects that extract text from rich documents. Solr-cell uses http://tika.apache.org for extraction. May be tika (or any other tool) already extracts text from swf? On Sunday, May 11, 2014 9:40 AM, Mauro Gregorio Binetti wrote: H

Re: LetterTokenizerFactory doesn't work as expected

Hi, Are you really using letter tokenizer? You should see LT as abbreviation in analysis page.                                           Ahmet On Sunday, May 11, 2014 12:42 PM, ienjreny wrote: Dears:I am applying  LetterTokenizerFactory as it is mentioned at the following linkhttp://wi

Problem with getting tv.tf_idf values.

Dear all, I'm trying to get tv.tf_idf values from my Solr documents into the termvector. I am using SolrJ. However it is not working. I'm setting the values to true (tv.tf_idf) in my search: public static QueryResponse doQuery(SolrServer server, String queryEnt, String myCollection) throws

solrcore.properties in solrcloud

Hi Can some one clarify the role of solrcore.properties in Solr 4.3+? We can define custom properties in solrcore.properties and use them in solrconfig.xml Will this functionality be retained going forward? Suchi

Is it possible for solr to calculate and give back the price of a product based on its sub-products

Hi, I am using Solr for searching magento products in my project, I want to know, is it possible for solr to calculate and give back the price of a product based on its sub-products(items); For instance, i have a product P1 and it is the parent of items m1, m2. i need to get the minimal price of

Re: timeAllowed in not honoring

Apologies for late reply, Thanks Toke for a great explaination :) I am new in solr so i am unaware of DocValues, so please can you explain. With Regards Aman Tandon On Fri, May 2, 2014 at 1:52 PM, Toke Eskildsen wrote: > On Thu, 2014-05-01 at 23:03 +0200, Aman Tandon wrote: > > So can you expla

Re: LetterTokenizerFactory doesn't work as expected

I got the error based on your feedback I am using inside instead of , I did the changes and it is working fine Thanks for your support On Sun, May 11, 2014 at 3:50 PM, Ahmet Arslan wrote: > Hi, > > Are you really using letter tokenizer? You should see LT as abbreviation > in analysis page.

Re: Why Solrj Default Format is XML Rather than Javabin?

On 5/9/2014 6:11 AM, Furkan KAMACI wrote: > When I index documents via Solrj it sends documents as XML. Solr processes > it with XMLLoader. Then sends response as javabin format. > > Why Solrj client does not send data as javabin format as default? > > PS: I use Solr 4.5.1 I do not know the hist

Re: is it possible for solr to calculate and give back the price of a product based on its sub-products

Do that at index time. Index a document that has the product, the child products, and the total price. Flatten your data to match what the search results will display. Solr is not a relational system, so don't design with normalized tables, joins, and calculated result columns. wunder On May

Re: ContributorsGroup add request

On 5/10/2014 6:35 PM, Jim Martin wrote: >Please add me the ContributorsGroup; I've got some Solr icons I'd > like to suggest to the community. Perhaps down the road I can contribute > more. I'm the team lead at Overstock.Com for search, and Solr is the > foundation of what we do. > >Userna

Re: Inconsistent response from Cloud Query

On 5/9/2014 11:42 AM, Cool Techi wrote: > We have noticed Solr returns in-consistent results during replica recovery > and not all replicas are in the same state, so when your query goes to a > replica which might be recovering or still copying the index then the counts > may differ. > regards,A

Website running Solr

Hi All, Is there a way to know if a website use Solr? Thanks. Regards Olivier

Re: Website running Solr

Hi, Some site owners put themselves here : https://wiki.apache.org/solr/PublicServers Besides, I would try *:* match all docs query. Ahmet On Sunday, May 11, 2014 7:55 PM, Olivier Austina wrote: Hi All, Is there a way to know if a website use Solr? Thanks. Regards Olivier

Re: LetterTokenizerFactory doesn't work as expected

Please post your full field type analyzer. The letter tokenizer should in fact return "I", "can", and "t" - if it is used properly. -- Jack Krupansky -Original Message- From: ienjreny Sent: Saturday, May 10, 2014 8:28 AM To: solr-user@lucene.apache.org Subject: LetterTokenizerFactory

Re: is it possible for solr to calculate and give back the price of a product based on its sub-products

Are these really sub-products? It sounds like you have the same product from multiple vendors and just want to return the lowest cost vendor, with no actual calculation. Either way, there is no direct method for this calculation/selection in Solr. Sure, you can always code a custom query compon

Re: Website running Solr

Not with certainty as solr may be working far behind another set of tools that make queries (and nothing licensing prevents it). If you get a software that has maybe Solr inside, I think the credits section should include a mention of some sort. However, there may be hints if a website uses solr,

Re: is it possible for solr to calculate and give back the price of a product based on its sub-products

Thanks jack for your response, Actually my use case is that the sub products are the different sizes and colors of the parent product. So in order to have the adequate price for my product in the current search i need to return the minimum price of the matching sub-products, in other words i need t

Re: Too many documents Exception

You'll need to shard your index. This assumes that your index doesn't have a huge percentage of deleted docs. This latter shouldn't be happening since as you delete docs, the number of deleted docs should drop as segments are merged. I suspect you aren't searching on this index yet, because I'm pr

Problem when i'm trying to search something

Hi everyone, I'm using an updated version of Solr module for Drupal 7. I've indexed my entire site, and i have about 8000 documents in index. I have a problem when I'm trying to research something. For example: -> "incre" => 0 results -> "incred" => n results for the word 'incre

Payload use case

Hi, everybody... This is my first post a wrote an PDF text extractor able to return text in the follow format: "The|(1,2)(3,4) quick|(5,6)(7,8) brown|(9,10)(11,12) ..." where each (x,y) is a coordinate on a two dimensions of the page in which the terms are positioned, ie: "The" (1,2) is t

Re: Problem when i'm trying to search something

Hey Anon15 It sounds like your encountering a heuristic known as stemming. Stemming takes various of words and reduces them to a base form. For example jumped jumping jumper might all get reduced to "jump" So now when a user searches for "jump" they can retrieve all docs with the various forms

Re: retreive all the fields in join

please help me out here!! With Regards Aman Tandon On Sun, May 11, 2014 at 1:44 PM, Aman Tandon wrote: > Hi, > > Is there a way possible to retrieve all the fields present in both the > cores(core 1 and core2). > > e.g. > core1: {id:111,name: "abc" } > > core2: {page:17, type: "fiction"} > > I

Re: Spatial Score by overlap area

Hi, I have the same requirement for an application that I'm working on and I'm wondering if you were able to make it work as per David's comment? Thanks. geoport wrote > Hi, > i am using solr 4.6 and i´ve indexed bounding boxes. Now, i want to test > the "area overlap sorting" > link >