Re: Solr TCP layer

2015-03-10 Thread Saumitra Srivastav
Thanks everyone for the responses. My motivation for TCP is coming from a very heavy indexing pipeline where the smallest of optimization matters. I am working on a machine data parser which feeds data into Cassandra and Solr and we have SLAs based on how fast we can make data available in both th

Solr TCP layer

2015-03-08 Thread Saumitra Srivastav
Dear Solr Contributors, I want to start working on adding a TCP layer for client to node and inter-node communication. I am not up to date on recent changes happening to Solr. So before I start looking into code, I would like to know if there is already some work done in this direction, which I c

Re: Solr Dynamic Field Performance

2014-09-15 Thread Saumitra Srivastav
Thanks for reply Erick. I found this article: http://e-mats.org/2011/01/solr-memory-usage-and-dynamic-fields/ Just to confirm, the fieldCache doesn't store anything extra when we use dynamic fields and do sorting query on that...

Solr Dynamic Field Performance

2014-09-14 Thread Saumitra Srivastav
I have a collection with 200 fields and >300M docs running in cloud mode. Each doc have around 20 fields. I now have a use case where I need to replace these explicit fields with 6 dynamic fields. Each of these 200 fields will match one of the 6 dynamic field. I am evaluating performance implicati

Re: Unload collection in SolrCloud

2014-05-22 Thread Saumitra Srivastav
Eric, Can you elaborate more on what you mean by "age out"? -- View this message in context: http://lucene.472066.n3.nabble.com/Unload-collection-in-SolrCloud-tp4135706p4137707.html Sent from the Solr - User mailing list archive at Nabble.com.

Atomic update by query instead of ID

2014-05-22 Thread Saumitra Srivastav
Is is possible to update a single field in multiple documents through atomic updates, using a query instead of ID? Here's my use case: I have a multivalued field called 'tags' and a text field called 'content'. User can define a pattern(regex) and name it, say my_pattern. Value 'my_pattern' shoul

Re: Unload collection in SolrCloud

2014-05-22 Thread Saumitra Srivastav
APIs will > gradually be phased out and satisfying your use-case would become > impossible. Let me think more on this. > > > On Thu, May 22, 2014 at 4:57 PM, Saumitra Srivastav < > [hidden email] <http://user/SendEmail.jtp?type=node&node=4137630&i=0>> > wrot

Re: Unload collection in SolrCloud

2014-05-22 Thread Saumitra Srivastav
a Lucene] < ml-node+s472066n4137608...@n3.nabble.com> wrote: > You can use the delete Collection API. > > > https://cwiki.apache.org/confluence/display/solr/Collections+API#CollectionsAPI-api6 > > > > On Thu, May 22, 2014 at 3:56 PM, Saumitra Srivastav < > [hidden

Re: Unload collection in SolrCloud

2014-05-22 Thread Saumitra Srivastav
Guys, any suggestions for this?? -- View this message in context: http://lucene.472066.n3.nabble.com/Unload-collection-in-SolrCloud-tp4135706p4137602.html Sent from the Solr - User mailing list archive at Nabble.com.

Unload collection in SolrCloud

2014-05-16 Thread Saumitra Srivastav
Is there a way to unload the complete collection in SolrCloud env? I can achieve the same by unloading all shards of collection using core admin API, but is there a better/cleaner approach? -Saumitra -- View this message in context: http://lucene.472066.n3.nabble.com/Unload-collection-in-Solr

Understanding core unload in SolrCloud

2014-05-16 Thread Saumitra Srivastav
When a core is unloaded it is unregistered from zookeeper and stops taking request, while retaining data on disk(with default params). Can someone explain what happens internally and how memory, CPU and network bandwidth will be affected if we load/unload shards frequently in SolrCloud setup using

Re: facet problem

2014-02-13 Thread Saumitra Srivastav
Change the type of 'status' field to 'string'. At present it must be 'text_en' and hence while indexing its getting tokenized. After changing the type in schema.xml you will have to re-index the documents to see the expected facet response. -- View this message in context: http://lucene.47206

Perl Client for SolrCloud

2014-01-07 Thread Saumitra Srivastav
Is there any perl client for SolrCloud. There are some Solr clients in perl but they are for single node Solr. I couldn't find anyone which can connect to SolrCloud similar to SolrJ's CloudSolrServer. Regards, Saumtra -- View this message in context: http://lucene.472066.n3.nabble.com/Perl-C

Re: Solr maxIndexingThreads

2014-01-05 Thread Saumitra Srivastav
Yes, I am using SolrCloud. So lets say I have a 2 host cluster with 2 collections and 1 shard 1 replica for each collection. Host-1(10.0.0.111) -solr/ -collectionAAA_shard1_replica1/ -collectionBBB_shard1_replica1/ Host-2:(10.0.0.222) -solr/ -collection

Re: Solr maxIndexingThreads

2014-01-05 Thread Saumitra Srivastav
Thanks Shawn. But what about *maxIndexingThreads* config in solrconfig.xml. Does it apply to the the collection or solr instance? For example, lets say I have two indexing clients with multiple threads, each sending docs to 2 different collections. And maxIndexingThreads is set to 8 for both col

Solr maxIndexingThreads

2014-01-05 Thread Saumitra Srivastav
I have a solr cluster with 8 server(4 shards with one replica for each). I have 80 client threads indexing to this cluster. Client is running on a different machine. I am trying to figure out optimal number of indexing threads. Now, solrconfig.xml have a config for *maxIndexingThreads*: "The maxi

Re: Solr maxIndexingThreads

2014-01-05 Thread Saumitra Srivastav
Also is there a way to specify number of threads for queries? -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-maxIndexingThreads-tp4109604p4109612.html Sent from the Solr - User mailing list archive at Nabble.com.

Solr maxIndexingThreads

2014-01-05 Thread Saumitra Srivastav
I have a solr cluster with 8 server(4 shards with one replica for each). I have 80 client threads indexing to this cluster. Client is running on a different machine. I am trying to figure out optimal number of indexing threads. Now, solrconfig.xml have a config for *maxIndexingThreads*: "The maxi