Bringing Old Collections Up Again

2016-05-02 Thread Salman Ansari
Hi, I am hosting Zookeeper ensemble and Solr servers on Microsoft cloud (Azure). From time to time machines are forced to restart to install updates. Recently, this happened again and it caused Zookeeper ensemble and Solr instances to go down. When the machines came back up again. I tried the foll

Re: Problem in Issuing a Command to Upload Configuration

2016-05-02 Thread Salman Ansari
pr 7, 2016 at 3:56 PM, Shawn Heisey wrote: > On 4/7/2016 5:40 AM, Salman Ansari wrote: > > Any comments regarding the issue I mentioned above "the proper procedure > of > > bringing old collections up after a restart of zookeeper ensemble and > Solr > > instances"

Re: Problem in Issuing a Command to Upload Configuration

2016-04-07 Thread Salman Ansari
Any comments regarding the issue I mentioned above "the proper procedure of bringing old collections up after a restart of zookeeper ensemble and Solr instances"? Your feedback is appreciated. Regards, Salman On Tue, Mar 29, 2016 at 12:04 PM, Salman Ansari wrote: > Moreover, I

Re: Distributing Collections across Shards

2016-03-30 Thread Salman Ansari
Factor=1, then use the > ADDREPLICA command to specify exactly what node the replicas > for each shard are created on with the 'node' parameter. > 2> For recent versions of Solr, you can create a collection with _no_ > replicas and then ADDREPLICA as you choose. > > Best, >

Distributing Collections across Shards

2016-03-29 Thread Salman Ansari
Hi, I believe the default behavior of creating collections distributed across shards through the following command http:// [solrlocation]:8983/solr/admin/collections?action=CREATE&name=[collection_name]&numShards=2&replicationFactor=2&maxShardsPerNode=2&collection.configName=[configuration_name]

Re: Problem in Issuing a Command to Upload Configuration

2016-03-29 Thread Salman Ansari
ensemble and Solr instances. Appreciate any feedback and comments. Regards, Salman On Tue, Mar 29, 2016 at 11:53 AM, Salman Ansari wrote: > Thanks Reth for your response. It did work. > > Regards, > Salman > > On Mon, Mar 28, 2016 at 8:01 PM, Reth RM wrote: > >> I th

Re: Problem in Issuing a Command to Upload Configuration

2016-03-29 Thread Salman Ansari
loud-scripts/zkcli.bat -zkhost 127.0.0.1:9983 \ >-cmd upconfig -confname my_new_config -confdir > server/solr/configsets/basic_configs/conf > > On Mon, Mar 28, 2016 at 8:18 PM, Salman Ansari > wrote: > > > Hi, > > > > I am facing issue uploading configuration

Problem in Issuing a Command to Upload Configuration

2016-03-28 Thread Salman Ansari
Hi, I am facing issue uploading configuration to Zookeeper ensemble. I am running this on Windows as *Command* ** zkCli.cmd -cmd upconfig -zkhost "[localserver]:2181,[second_server]:2181,[third_server]:2181" -confname [config_name] -confdir "[config_dir]" and I got the following result

Issue With Manual Lock

2016-03-23 Thread Salman Ansari
Hi, I am facing an issue which I believe has something to do with recent changes in Solr. I already have a collection spread on 2 shards (each with 2 replicas). What happened is that my Solr and Zookeeper ensemble went down and I restarted the servers. I have performed the following steps 1) I r

Issue Running Solr

2016-03-21 Thread Salman Ansari
Hi, I am facing an issue in running Solr server. I tried different approaches and still receive the following error "ERROR: Solr at http://localhost:8983/solr did not come online within 30 seconds" I tried running the following commands 1) solr -e cloud 2) solr.cmd start -cloud -p 8983 -s "C:\S

Re: Querying data based on field type

2016-02-18 Thread Salman Ansari
gex. > > https://cwiki.apache.org/confluence/display/solr/Updating+Parts+of+Documents > > On Thu, 18 Feb 2016, 13:07 Salman Ansari wrote: > > > Hi, > > > > Due to some mis-configuration issues, I have a field that has values as > > single string and an array of strin

Querying data based on field type

2016-02-17 Thread Salman Ansari
Hi, Due to some mis-configuration issues, I have a field that has values as single string and an array of strings. Looks like there are some old values that got indexed as an array of strings while anything new are single valued string. I have checked the configuration and multivalued for that fie

Re: Negating multiple array fileds

2016-02-17 Thread Salman Ansari
Thanks Shawn for explaining in details. Regarding the performance issue you mentioned, there are 2 points 1) "The [* TO *] syntax is an all-inclusive range query, which will usually be much faster than a wildcard query." I will take your statement for granted and let the space for people to comme

Re: Negating multiple array fileds

2016-02-14 Thread Salman Ansari
y term in a purely negative sub-query. Usually this means > using *:* to select all documents. Note that the use of parentheses > introduces a sub-query. So, (-persons:*) s.b. (*:* -persons:*). > > -- Jack Krupansky > > On Sun, Feb 14, 2016 at 8:21 AM, Salman Ansari > wrote: >

Negating multiple array fileds

2016-02-14 Thread Salman Ansari
Hi, I think what I am asking should be easy to do but for some reasons I am facing issues in making that happen. The issue is that I want include/exclude some fields from my Solr query. All the fields that I need to include are multi valued int fields. When I include the fields I have the followin

Re: URI is too long

2016-02-06 Thread Salman Ansari
, Shawn Heisey wrote: > On 2/2/2016 1:46 PM, Salman Ansari wrote: > > OK then, if there is no way around this problem, can someone tell me the > > maximum size a POST body can handle in Solr? > > It is configurable in solrconfig.xml. Look for the > formdataUploadLimi

Re: URI is too long

2016-02-02 Thread Salman Ansari
OK then, if there is no way around this problem, can someone tell me the maximum size a POST body can handle in Solr? Regards, Salman On Tue, Feb 2, 2016 at 12:12 AM, Salman Ansari wrote: > That is what I have tried. I tried using POST with > application/x-www-form-urlencoded and I g

Re: URI is too long

2016-02-01 Thread Salman Ansari
;rows=2 > > > Thanks, > Susheel > > On Mon, Feb 1, 2016 at 2:38 AM, Salman Ansari > wrote: > > > Cool. I would give POST a try. Any samples of using Post while passing > the > > query string values (such as ORing between Solr field values) using > >

Re: URI is too long

2016-02-01 Thread Salman Ansari
> On Mon, Feb 1, 2016, at 11:05 AM, Midas A wrote: > > Is there any drawback of POST request and why we prefer GET. > > > > On Mon, Feb 1, 2016 at 1:08 PM, Salman Ansari > > wrote: > > > > > Cool. I would give POST a try. Any samples of using Post while p

Re: URI is too long

2016-01-31 Thread Salman Ansari
Cool. I would give POST a try. Any samples of using Post while passing the query string values (such as ORing between Solr field values) using Solr.NET? Regards, Salman On Sun, Jan 31, 2016 at 10:21 PM, Shawn Heisey wrote: > On 1/31/2016 7:20 AM, Salman Ansari wrote: > > I am buildi

URI is too long

2016-01-31 Thread Salman Ansari
Hi, I am building a long query containing multiple ORs between query terms. I started to receive the following exception: The remote server returned an error: (414) Request-URI Too Long. Any idea what is the limit of the URL in Solr? Moreover, as a solution I was thinking of chunking the query in

Re: Returning all documents in a collection

2016-01-20 Thread Salman Ansari
esults. > > > > > > Regards, > > > Emir > > > > > > -- > > > Monitoring * Alerting * Anomaly Detection * Centralized Log Management > > > Solr & Elasticsearch Support * http://sematext.com/ > > > > > > > > > > > > On

Returning all documents in a collection

2016-01-20 Thread Salman Ansari
Hi, I am looking for a way to return all documents from a collection. Currently, I am restricted to specifying the number of rows using Solr.NET but I am looking for a better approach to actually return all documents. If I specify a huge number such as 1M, the processing takes a long time. Any fe

Re: Changing Solr Schema with Data

2015-12-30 Thread Salman Ansari
old docs won't be matched against > queries matched against the newly added fields. > > On Tue, 29 Dec 2015, 23:38 Salman Ansari wrote: > > > Thanks guys for your responses. > > > > @Shalin: Do you have a documentation that explains this? Moreover, is it > > o

Re: Changing Solr Schema with Data

2015-12-29 Thread Salman Ansari
gt; On Tue, Dec 29, 2015 at 1:58 AM, Salman Ansari > wrote: > > You can say that we are not removing any fields (so the old data should > not > > get affected), however, we need to add new fields (which new data will > > have). Does that answer your question? > > &g

Re: Changing Solr Schema with Data

2015-12-28 Thread Salman Ansari
nge affects the data you want to keep? > > Newsletter and resources for Solr beginners and intermediates: > http://www.solr-start.com/ > > > On 29 December 2015 at 01:48, Salman Ansari > wrote: > > Hi, > > > > I am facing an issue where I need to change Solr s

Changing Solr Schema with Data

2015-12-28 Thread Salman Ansari
Hi, I am facing an issue where I need to change Solr schema but I have crucial data that I don't want to delete. Is there a way where I can change the schema of the index while keeping the data intact? Regards, Salman

Multiple Unique Keys

2015-12-23 Thread Salman Ansari
Hi, I am wondering if I can specify multiple unique keys in the same document in Solr. My scenario is that I want to integrate with another system that has an ID and our system has a reference number (auto-generated for each document on the fly) as well that is unique. What I am trying to achieve

Re: Issue with Querying Solr

2015-12-08 Thread Salman Ansari
https://github.com/mausch/SolrNet/blob/master/Documentation/Querying.md#pagination > > Regards, >Alex. > > Newsletter and resources for Solr beginners and intermediates: > http://www.solr-start.com/ > > > On 8 December 2015 at 07:52, Salman Ansari > wrote: > >

Issue with Querying Solr

2015-12-08 Thread Salman Ansari
Hi, I have created a cluster of Solr and Zookeepers on 3 machines connected together. Currently, I am facing a weird problem. My collection has only 261 documents and when I try to query the documents using the browser such as http:// [ASolrServerInTheCluster]:8983/solr/sabrLocationsStore/select?

Re: Solr Auto-Complete

2015-12-08 Thread Salman Ansari
reversed strings. > > I can dig up an example if it is not clear. > On 6 Dec 2015 8:06 am, "Salman Ansari" wrote: > > > That is right. I am actually looking for phrase prefixes not each term > > prefix within the phrase. That satisfies my requirements. However, my >

Re: Solr Auto-Complete

2015-12-06 Thread Salman Ansari
ext_suggestion_phrase_prefix_search^b1 > > text_suggestion_terms_prefix_search^b2 > > > > > > > > > > b1 and b2 values strictly depend on your search logic. > > > > Is that close that what you were looking for? > > > > Best, > > A

Re: Solr Auto-Complete

2015-12-06 Thread Salman Ansari
* mapping="mapping-FoldToASCII.txt"/>* > > > generateWordParts="0" generateNumberParts="0" catenateAll="1" > splitOnCaseChange="0"

Re: Solr Auto-Complete

2015-12-06 Thread Salman Ansari
ase is the same. > > Regards, >Alex. > > Newsletter and resources for Solr beginners and intermediates: > http://www.solr-start.com/ > > > On 4 December 2015 at 10:11, Salman Ansari > wrote: > > Thanks Alan, Alessandaro and Andrea for your great explanations.

Re: Solr Auto-Complete

2015-12-04 Thread Salman Ansari
. > > > > IMHO, that is the "recommended way" if the component's features meet your > > needs (i.e. do not reinvent the wheel) but it seems you're out of those > > bounds. > > > > Best, > > Andrea > > On 2 Dec 2015 21:51, &q

Re: Solr Auto-Complete

2015-12-02 Thread Salman Ansari
> > This is a very sample example, please adapt it to your use case. > > Cheers > > On 2 December 2015 at 09:41, Alan Woodward wrote: > > > Hi Salman, > > > > It sounds as though you want to do a normal search against a special > > 'suggest'

Solr Auto-Complete

2015-12-02 Thread Salman Ansari
Hi, I am looking for auto-complete in Solr but on top of just auto complete I want as well to return the data completely (not just suggestions), so I want to get back the ids, and other fields in the whole document. I tried the following 2 approaches but each had issues 1) Used the /suggest compo

Re: Setting up Solr on multiple machines

2015-11-29 Thread Salman Ansari
replicas? On Nov 30, 2015 1:36 AM, "Salman Ansari" wrote: > Correct me if I am wrong but my understanding is that even connecting to > one zookeeper should be enough as internally that zookeeper will sync Solr > server info to other zookeepers in the ensemble (as long as that zookee

Re: Setting up Solr on multiple machines

2015-11-29 Thread Salman Ansari
che.org/doc/r3.2.2/zookeeperOver.html#sc_designGoals > > > > On 11/29/15, 12:04 PM, "Salman Ansari" wrote: > > > >> my point is that what is the exact difference between the whole list and > >> one zookeeper? Moreover, I think this issue is related t

Re: Setting up Solr on multiple machines

2015-11-29 Thread Salman Ansari
t; > > > On 11/29/15, 11:51 AM, "Salman Ansari" wrote: > > >but the point is: do I really need to list all the zookeepers in the > >ensemble when starting solr or I can just specify one of them? > > > >On Sun, Nov 29, 2015 at 10:45 PM, Don Bosco Durai >

Re: Setting up Solr on multiple machines

2015-11-29 Thread Salman Ansari
t; On 11/29/15, 11:30 AM, "Salman Ansari" wrote: > > >Thanks for your reply. > > > > > > > >Actually I am following the official guide to start solr using (on Windows > >machines) > > > > > > > >bin/solr start -e cloud -z

Re: Setting up Solr on multiple machines

2015-11-29 Thread Salman Ansari
d and replica exactly > where you want it to go. > > But I wouldn't bother first, just do what I outlined in 2b and it > should be fine. > > Best, > Erick > > On Sat, Nov 28, 2015 at 1:03 PM, Salman Ansari > wrote: > > I have started with one Zookeeper to t

Re: Setting up Solr on multiple machines

2015-11-28 Thread Salman Ansari
> machine), but I assume it is windows compatible ( I can see binaries > .cmd ) > > > > Cheers > > > > On 26 November 2015 at 12:38, Salman Ansari > > wrote: > > > > > Hi, > > > > > > I have seen the guide of setting up Solr on one

Setting up Solr on multiple machines

2015-11-26 Thread Salman Ansari
Hi, I have seen the guide of setting up Solr on one machine as well as setting it up on multiple machines on Liunx. Is there a good guide of how to setup Solr on multiple machines on Windows Server with Zookeeper ensemble? My structure is as follows 1) 3 machines will have Zookeeper to create an

Solr Date Format

2015-11-25 Thread Salman Ansari
Hi, I was exploring Solr date formats and came across the following link https://cwiki.apache.org/confluence/display/solr/Working+with+Dates which specifies that the date format in Solr is as -MM-DDThh:mm:ssZ I was wondering if 1) Solr support other date formats? 2) Solr supports other calen

Re: Solr Cloud and Multiple Indexes

2015-11-08 Thread Salman Ansari
he start version but in the latest and > Solr-5.2.1 there is a "Segments info" link available where you can see > number of segments. > > Regards, > Modassar > > On Thu, Nov 5, 2015 at 5:41 PM, Salman Ansari > wrote: > > > Thanks for your response. I ha

Re: Solr Features

2015-11-05 Thread Salman Ansari
Analyzers, Tokenizers, Filters, URPs and even a newsletter: > http://www.solr-start.com/ > > > On 5 November 2015 at 01:08, Salman Ansari > wrote: > > Hi, > > > > I am in the process of looking for a comprehensive list of Solr features > in > > order to assess ho

Re: Solr Cloud and Multiple Indexes

2015-11-05 Thread Salman Ansari
seen gc pauses of 30 seconds and more in > some complex queries. > > I am facing delay of 2-3 seconds but previously I > had delays of around 28 seconds. > Is this after you moved to solrcloud? > > Regards, > Modassar > > > On Thu, Nov 5, 2015 at 3:09 PM, Salman Ansa

Re: Solr Cloud and Multiple Indexes

2015-11-05 Thread Salman Ansari
> the indexes into multiple indexes and consequently distributed search. Can > anyone guide me to some sources (articles) that discuss this in Solr Cloud? > > This is what you are already doing. Did you mean that you want to add more > shards? > > Regards, > Modassar > &g

Solr Cloud and Multiple Indexes

2015-11-05 Thread Salman Ansari
Hi, I am using Solr cloud and I have created a single index that host around 70M documents distributed into 2 shards (each having 35M documents) and 2 replicas. The queries are very slow to run so I was thinking to distribute the indexes into multiple indexes and consequently distributed search. C

Solr Features

2015-11-04 Thread Salman Ansari
Hi, I am in the process of looking for a comprehensive list of Solr features in order to assess how much have we implemented, what are some features that we were unaware of that we can utilize etc. I have looked at the following link for Solr features http://lucene.apache.org/solr/features.html bu

Re: Solr Pagination

2015-10-28 Thread Salman Ansari
index size and machine specs and its effect on Solr query performance? Regards, Salman On Mon, Oct 26, 2015 at 5:55 PM, Upayavira wrote: > > > On Sun, Oct 25, 2015, at 05:43 PM, Salman Ansari wrote: > > Thanks guys for your responses. > > > > That's a very very large

Analytics using Solr

2015-10-25 Thread Salman Ansari
Hi, I was wondering if it is possible (and recommended) to run Analytics using Solr. For example big data analytics. Any ideas? Regards, Salman

Re: Solr Pagination

2015-10-25 Thread Salman Ansari
Thanks guys for your responses. That's a very very large cache size. It is likely to use a VERY large amount of heap, and autowarming up to 4096 entries at commit time might take many *minutes*. Each filterCache entry is maxDoc/8 bytes. On an index core with 70 million documents, each filterCac

Re: Filtering on a Field with Suggestion

2015-10-16 Thread Salman Ansari
, "Alessandro Benedetti" wrote: > This will sound silly, but which version of Solr are you using ? > According to : > https://issues.apache.org/jira/browse/SOLR-7888 > This new cool feature will be included in solr 5.4 . > > Cheers > > On 15 October 2015 at 22:53, Sal

Filtering on a Field with Suggestion

2015-10-15 Thread Salman Ansari
Hi guys, I am working with Solr suggester as explained in this article. https://cwiki.apache.org/confluence/display/solr/Suggester The suggester is working fine but I want to filter the results based on a filed (which is type). I have tried to follow what was written at the end of the article (ab

Re: AutoComplete Feature in Solr

2015-10-14 Thread Salman Ansari
o > my > > lat,long... Kinda combine suggester and bq=geodist() > > > > On Mon, Oct 12, 2015 at 2:24 PM, Salman Ansari > > wrote: > > > > > Hi, > > > > > > I have been trying to get the autocomplete feature in Solr working with > > no > >

Re: AutoComplete Feature in Solr

2015-10-13 Thread Salman Ansari
complete feature ! > Please take a read to the docs Erick linked and to my blog as well. > It will definitely give you more insight about the Autocomplete world ! > > Cheers > > [1] http://alexbenedetti.blogspot.co.uk/2015/07/solr-you-complete-me.html > > On 12 Octo

AutoComplete Feature in Solr

2015-10-12 Thread Salman Ansari
Hi, I have been trying to get the autocomplete feature in Solr working with no luck up to now. First I read that "suggest component" is the recommended way as in the below article (and this is the exact functionality I am looking for, which is to autocomplete multiple words) http://blog.trifork.co

Re: Solr Pagination

2015-10-10 Thread Salman Ansari
eciate your comments. Regards, Salman On Sat, Oct 10, 2015 at 11:55 AM, Salman Ansari wrote: > Thanks Shawn for your response. Based on that > 1) Can you please direct me where I can get more information about cold > shard vs hot shard? > > 2) That 10GB number assumes there

Re: Solr Pagination

2015-10-10 Thread Salman Ansari
sc id desc * category Will this be using more cache in Solr and prepoupulate it? Regards, Salman On Sat, Oct 10, 2015 at 5:10 AM, Shawn Heisey wrote: > On 10/9/2015 1:39 PM, Salman Ansari wrote: > > > INFO - 2015-10-09 18:46:17.95

Re: Solr Pagination

2015-10-09 Thread Salman Ansari
u're > returning, then it could be decompressing time, unlikely but possible. > > Try again with rows=0&start=1000 to see if it's something weird with > getting > the stored data, but that's highly doubtful. > > I think the only real way to get to the bottom o

Re: Solr Pagination

2015-10-09 Thread Salman Ansari
> and then initiates another GC cycle immediately. Turn on GC logging > and take a look > at the stats provided, see: > https://lucidworks.com/blog/2011/03/27/garbage-collection-bootcamp-1-0/ > > Tens of seconds is entirely unexpected though. Do the Solr logs point > to anythi

Re: Solr Pagination

2015-10-09 Thread Salman Ansari
t next and they'll > tire out way before that. > > Cursor mark's sweet spot is handling some kind of automated process that > goes through the whole result set. It'll work for what you're trying > to do though. > > Best, > Erick > > On Fri, Oct 9, 20

Re: Solr Pagination

2015-10-09 Thread Salman Ansari
results? On Fri, Oct 9, 2015 at 5:20 PM, Toke Eskildsen wrote: > Salman Ansari wrote: > > [Pagination with cursors] > > > For example, what happens if the user navigates from page 1 to page 2, > > does the front end need to store the next cursor at each query? > >

Solr Pagination

2015-10-09 Thread Salman Ansari
Hi guys, I have been working with Solr and Solr.NET for some time for a big project that requires around 300M documents. Consequently, I faced an issue and I am highlighting it here in case you have any comments: As mentioned here ( https://cwiki.apache.org/confluence/display/solr/Pagination+of+R