Re: Indexing question on individual field update

2014-02-11 Thread shamik
Thanks Eric and Shawn, appreciate your help. -- View this message in context: http://lucene.472066.n3.nabble.com/Indexing-question-on-individual-field-update-tp4116605p4116831.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Indexing question on individual field update

2014-02-11 Thread Erick Erickson
Update and add are basically the same thing if there's an existing document. There will be some performance consequence since you're getting the stored fields on the server as opposed to getting the full input from the external source and handing it to Solr. However, I know of at least one situatio

Re: Indexing question on individual field update

2014-02-11 Thread Shawn Heisey
On 2/11/2014 2:37 PM, shamik wrote: Eric, Thanks for your reply. I should have given a better context. I'm currently running an incremental crawl daily on this particular source and indexing the documents. Incremental crawl looks for any change since last crawl date based on the document publ

Re: Indexing question on individual field update

2014-02-11 Thread shamik
Ok, I was wrong here. I can always set the indextimestamp field with current time (NOW) for every atomic update. On a similar note, is there any performance constraint with updates compared to add ? -- View this message in context: http://lucene.472066.n3.nabble.com/Indexing-question-on

Re: Indexing question on individual field update

2014-02-11 Thread shamik
he fact that I can't remove stale content. Let me know if I'm missing something here. - Thanks, Shamik -- View this message in context: http://lucene.472066.n3.nabble.com/Indexing-question-on-individual-field-update-tp4116605p4116757.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Indexing question on individual field update

2014-02-10 Thread Erick Erickson
I'm assuming you're using the atomic update feature to update the individual field, why not use it when you replace the rest of the doc? Best, Erick On Mon, Feb 10, 2014 at 5:20 PM, Shamik Bandopadhyay wrote: > Hi, > > I'm currently indexing a bunch of fields for a given document. For e.g. >

Indexing question on individual field update

2014-02-10 Thread Shamik Bandopadhyay
Hi, I'm currently indexing a bunch of fields for a given document. For e.g. let's assume there's a field called "rating". The rating field is not part of the original document during index, so the value is blank. The field gets updated by an external service when the document is rated by users.

RE: SolrCloud Indexing question

2013-08-07 Thread Kalyan Kuram
Thank you so much for the suggestion, Is the same recommended for querying too i found it very slow when i do query using clousolrserver Kalyan > Date: Tue, 6 Aug 2013 13:25:37 -0600 > From: s...@elyograg.org > To: solr-user@lucene.apache.org > Subject: Re: SolrCloud Indexing questi

Re: SolrCloud Indexing question

2013-08-06 Thread Shawn Heisey
On 8/6/2013 12:55 PM, Kalyan Kuram wrote: Hi AllI need suggestion on how to send indexing commands to 2 different solr server,Basically i want to mirror my index,here is the scenarioi have 2 cluster, each cluster has one master and 2 slaves with external zookeeper in the fronti need suggestion

SolrCloud Indexing question

2013-08-06 Thread Kalyan Kuram
Hi AllI need suggestion on how to send indexing commands to 2 different solr server,Basically i want to mirror my index,here is the scenarioi have 2 cluster, each cluster has one master and 2 slaves with external zookeeper in the fronti need suggestion on what solr api class i should use to send

Re: Indexing question

2013-01-23 Thread Upayavira
you can do this with cores. You can have one core to serve the public, and one for indexing. Then, when you've finished updating your index, you use the core admin handler to swap the cores around. Then you do the same thing the following night. Doesn't require any file moving nor any restarts of s

Re: Indexing question

2013-01-23 Thread Alan Rykhus
Hello, I do nightly builds for one of my sites. I build the new index in a parallel directory. When it is finished I move the old files to a backup directory(I only save one, delete the previous), move the new database files to the correct place, then stop and restart solr. It sees the new databas

Re: Indexing question

2013-01-23 Thread Michael Della Bitta
Hi Ron, If you turn off autoCommit and only commit after your delete and refresh, the user's experience will be totally uninterrupted. Commits are used to control visibility in a Solr index. Michael Della Bitta Appinions 18 East 41st Street, 2nd

Indexing question

2013-01-23 Thread Ron Poling
Hello! I'm new to solr and trying to figure out how to implement it in our environment. My question involves building the index. Our data does not lend itself to delta updates so we have to build the entire index each time. Is there some way to feed solr a file with all index records and tell i

Re: Bulk Indexing Question

2012-11-27 Thread Shawn Heisey
On 11/27/2012 1:07 PM, Joseph C. Trubisz wrote: When I curl a file to be indexed (in this case, as CSV), how do I know which index it’s going to, if I have multiple indexes currently being managed by Solr? For example, I have indexes for drug, company, author, abstract and I want to CSV load to

Bulk Indexing Question

2012-11-27 Thread Joseph C. Trubisz
Greetings… I’m new to Solr, so this might be a real amateur question. When I curl a file to be indexed (in this case, as CSV), how do I know which index it’s going to, if I have multiple indexes currently being managed by Solr? For example, I have indexes for drug, company, author, abstract and

Re: SolrCloud indexing question

2012-04-20 Thread Jamie Johnson
I believe the SolrJ code round robins which server the request is sent to and as such probably wouldn't send to the same server in your case, but if you had an HttpSolrServer for instance and were pointing to only one particular intsance my guess would be that would be 5 separate requests from the

Re: SolrCloud indexing question

2012-04-20 Thread Darren Govoni
Gotcha. Now does that mean if I have 5 threads all writing to a local shard, will that shard piggyhop those index requests onto a SINGLE connection to the leader? Or will they spawn 5 connections from the shard to the leader? I really hope the formerthe latter won't scale well. On Fri, 2012-0

Re: SolrCloud indexing question

2012-04-20 Thread Jamie Johnson
my understanding is that you can send your updates/deletes to any shard and they will be forwarded to the leader automatically. That being said your leader will always be the place where the index happens and then distributed to the other replicas. On Fri, Apr 20, 2012 at 7:54 AM, Darren Govoni

SolrCloud indexing question

2012-04-20 Thread Darren Govoni
Hi, I just wanted to make sure I understand how distributed indexing works in solrcloud. Can I index locally at each shard to avoid throttling a central port? Or all the indexing has to go through a single shard leader? thanks

Re: RE: Indexing Question for large dataset

2011-04-14 Thread karsten-solr
for all your responses so far! > > -Original Message- > From: kenf_nc [mailto:ken.fos...@realestate.com] > Sent: Wednesday, April 13, 2011 1:15 PM > To: solr-user@lucene.apache.org > Subject: RE: Indexing Question for large dataset > > Is NAME a product name? W

RE: Indexing Question for large dataset

2011-04-13 Thread Joshua Bouchair
Message- From: kenf_nc [mailto:ken.fos...@realestate.com] Sent: Wednesday, April 13, 2011 1:15 PM To: solr-user@lucene.apache.org Subject: RE: Indexing Question for large dataset Is NAME a product name? Why would it be multivalue? And why would it appear on more than one document? Is each

RE: Indexing Question for large dataset

2011-04-13 Thread kenf_nc
.472066.n3.nabble.com/Indexing-Question-for-large-dataset-tp2816344p2816994.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: Indexing Question for large dataset

2011-04-13 Thread Joshua Bouchair
r all those columns)? Example Query: q=name&fl=NAME,ID&facet=true&facet.field=PRICELIST500 Thanks, Josh B. -Original Message- From: kenf_nc [mailto:ken.fos...@realestate.com] Sent: Wednesday, April 13, 2011 10:47 AM To: solr-user@lucene.apache.org Subject: Re: Indexing Ques

Re: Indexing Question for large dataset

2011-04-13 Thread kenf_nc
lot, could the documents be organized differently? Hard to tell from your example. -- View this message in context: http://lucene.472066.n3.nabble.com/Indexing-Question-for-large-dataset-tp2816344p2816377.html Sent from the Solr - User mailing list archive at Nabble.com.

Indexing Question for large dataset

2011-04-13 Thread Joshua Bouchair
We have an ecommerce application B2C/B2B with a large amount of price list that range into 2000+ and growing. They want to index price to have facets and sorting. That seems like that would be a lot of columns to index, example below: INDEX COLUMN: NamePrice PriceList1Price

RE: Basic indexing question

2010-02-03 Thread Stefan Maric
Thanks that was it - I've now configured a dismax requesthandler that suits my needs -Original Message- From: Joe Calderon [mailto:calderon@gmail.com] Sent: 03 February 2010 00:20 To: solr-user@lucene.apache.org Subject: Re: Basic indexing question see http://wiki.apache.org

Re: Basic indexing question

2010-02-02 Thread Joe Calderon
calderon@gmail.com] > Sent: 02 February 2010 23:42 > To: solr-user@lucene.apache.org > Subject: Re: Basic indexing question > > > by default solr will only search the default fields, you have to > either query all fields field1:(ore) or field2:(ore) or field3:(ore) > or us

RE: Basic indexing question

2010-02-02 Thread Stefan Maric
o:calderon@gmail.com] Sent: 02 February 2010 23:42 To: solr-user@lucene.apache.org Subject: Re: Basic indexing question by default solr will only search the default fields, you have to either query all fields field1:(ore) or field2:(ore) or field3:(ore) or use a different query parser like dismax O

Re: Basic indexing question

2010-02-02 Thread Joe Calderon
by default solr will only search the default fields, you have to either query all fields field1:(ore) or field2:(ore) or field3:(ore) or use a different query parser like dismax On Tue, Feb 2, 2010 at 3:31 PM, Stefan Maric wrote: > I have got a basic configuration of Solr up and running and have

Basic indexing question

2010-02-02 Thread Stefan Maric
I have got a basic configuration of Solr up and running and have loaded some data to experiment with When I run a query for 'ore' I get 3 results when I'm expecting 4 Dataimport is pulling the expected number of rows in from my DB view In my schema.xml I have and the defaults

Re: Indexing question - split word and comma

2007-07-05 Thread Martin Grotzke
On Thu, 2007-07-05 at 11:56 -0700, Mike Klaas wrote: > On 5-Jul-07, at 11:43 AM, Martin Grotzke wrote: > > > Hi all, > > > > I have a document with a name field like this: > > MP3-Player, Apple, »iPod nano«, silber, > > 4GB > > > > and want to find "apple". Unfortunately, I only find "apple,"... >

Re: Indexing question - split word and comma

2007-07-05 Thread Mike Klaas
On 5-Jul-07, at 11:43 AM, Martin Grotzke wrote: Hi all, I have a document with a name field like this: MP3-Player, Apple, »iPod nano«, silber, 4GB and want to find "apple". Unfortunately, I only find "apple,"... Can anybody help me with this? Sure: you're using WhitespaceAnalyzer, which onl

Indexing question - split word and comma

2007-07-05 Thread Martin Grotzke
Hi all, I have a document with a name field like this: MP3-Player, Apple, »iPod nano«, silber, 4GB and want to find "apple". Unfortunately, I only find "apple,"... Can anybody help me with this? The schema.xml containts the following field definition and this fieldType definition for type te