index.
Is there some error message that solr logs when rename and deletion of the
directories fails. If so we could monitor our logs to get a better idea for
the root cause. At present we can only react when things go wrong based on
disk space alarms.
Thanks,
Rishi.
--
View this message in co
Hi All,
I have a cluster that has the overseer leader gone. This is on Solr 4.10.3
version.
Its completely gone from zookeeper and bouncing any instance does not start a
new election process.
Anyone experience this issue before and any ideas to fix this.
Thanks,
Rishi.
t, atleast to me. Any help to get it working with 4.10
would be great.
Thanks,
Rishi.
On 2/20/2015 9:37 AM, Rishi Easwaran wrote:
> We are trying to upgrade from Solr 4.6 to 4.10.3. When testing search 4.10.3
search results are not being returned, actually looks like only the first word
in a sentence is getting indexed.
> Ex: inserting "This is a test message" only
/UniversalLexer.jflex
From the looks of it the text is being indexed as a single token and not broken
across whitespace.
Thanks,
Rishi.
-Original Message-
From: Shawn Heisey
To: solr-user
Sent: Fri, Feb 20, 2015 11:52 am
Subject: Re: Strange search behaviour when upgrading to 4.10.3
On 2
65]
0
7
1
ALNUM
1
Version 4.6
SF
text
raw_bytes
type
start
end
position
message
[6d 65 73 73 61 67 65]
ALNUM
0
7
1
Thanks,
Rishi.
-Original Message-
From: Shawn Heisey
To: solr-user
Sent: Fri, Feb 20, 2015 6:51 pm
Subject: Re: Strange
e.com/How-to-implement-multilingual-word-components-fields-schema-td4157140.html#a4158923
https://issues.apache.org/jira/browse/SOLR-6492
Thanks,
Rishi.
to tokenize email addresses
(ex:he...@aol.com- i think standardTokenizer already does this), filenames
(здравствуйте.pdf), but maybe we can use filters to accomplish that.
Thanks,
Rishi.
-Original Message-
From: Alexandre Rafalovitch
To: solr-user
Sent: Mon, Feb 23, 2015 5:49 pm
://cwiki.apache.org/confluence/display/solr/Tokenizers#Tokenizers-ICUTokenizer)
"This tokenizer processes multilingual text and tokenizes it appropriately
based on its script attribute."
or am I missing something?
Thanks,
Rishi.
-Original Message-
From: Walter Underwood
To:
forward to trying out once its integrated to main.
Thanks,
Rishi.
-Original Message-
From: Trey Grainger
To: solr-user
Sent: Tue, Feb 24, 2015 1:40 am
Subject: Re: Basic Multilingual search capability
Hi Rishi,
I don't generally recommend a language-insensitive approach excep
Hi Alex,
Thanks for the suggestions. These steps will definitely help out with our use
case.
Thanks for the idea about the lengthFilter to protect our system.
Thanks,
Rishi.
-Original Message-
From: Alexandre Rafalovitch
To: solr-user
Sent: Tue, Feb 24, 2015 8:50 am
Subject
.
Just one clarification, when you say ICUFilterFactory am I correct in thinking
its ICUFodingFilterFactory.
Thanks,
Rishi.
-Original Message-
From: Tom Burton-West
To: solr-user
Sent: Wed, Feb 25, 2015 4:33 pm
Subject: Re: Basic Multilingual search capability
Hi Rishi,
As
, mergeScheduler
thread counts etc would be great.
Thanks,
Rishi.
Thanks Shawn for the quick reply.
Our indexes are running on SSD, so 3 should be ok.
Any recommendation on bumping it up?
I guess will have to run optimize for entire solr cloud and see if we can
reclaim space.
Thanks,
Rishi.
-Original Message-
From: Shawn Heisey
To: solr
il optimization
completes.
Is it a problem? Not if optimization occurs over shards serially and
your
index is broken to many small shards.
On Apr 18, 2015 1:54 AM, "Rishi
Easwaran" wrote:
> Thanks Shawn for the quick
reply.
> Our indexes are running on SSD, so 3 should be ok.
> A
factor
Thanks,
Rishi.
-Original Message-
From: Shawn Heisey
To: solr-user
Sent: Mon, Apr 20, 2015 11:25 am
Subject: Re: Solr Cloud reclaiming disk space from deleted documents
On 4/20/2015 8:44 AM, Rishi Easwaran wrote:
> Yeah I noticed that. Looks like
optimize won't work
recovering.
Usually this requires a manual intervention of bouncing the instance and
wiping the disk clean to allow for a clean recovery.
Any ideas on how to prevent solr from creating multiple copies of index
directory.
Thanks,
Rishi.
Sadly with the size of our complex, spiting and adding more HW is not a viable
long term solution.
I guess the options we have are to run optimize regularly and/or become
aggressive in our merges proactively even before solr cloud gets into this
situation.
Thanks,
Rishi
't it delete the old information and
replicate from scratch, not requiring more disk space.
Is the concern data loss (a case when both leader and follower lose data)?.
Thanks,
Rishi.
-Original Message-
From: Mark Miller
To: solr-user
Sent: Tue, Apr 28, 2015 10:52
what I am talking about is copy of a whole index as is into a new
directory. The new directory has no relation to the older index directory or
its segments, so not sure what merges are going on across directories/indexes,
and why solr needs the older index.
Thanks,
Rishi
by the replica.
I was searching around for optimize behaviour of solr cloud and could not find
much information.
Does anyone have experience running optimize for solr cloud in a loaded
production env?
Thanks,
Rishi.
-Original Message-
From: Shawn Heisey
To: solr-user
Sent
still come up with a
mechanism to drop existing files, but those
won't hold good in case of serious
issues with the cloud, you could end up
losing data. That's worse than using a
bit more disk space!
On 4 May 2015 11:56, "Rishi Easwaran"
wrote:
Thanks for the responses Mark
Hi All,
Aol is hosting a meetup in Dulles VA. The topic this time is Solr/ Solr Cloud.
http://www.meetup.com/Code-Brew/events/53217/
Thanks,
Rishi.
e only option we are left with it is to clean up
the entire index to free up disk space, and allow a replica to sync from
scratch.
Thanks,
Rishi.
-Original Message-
From: Shawn Heisey
To: solr-user
Sent: Tue, May 5, 2015 10:55 am
Subject: Re: Multiple index.timestamp directories usin
6
false
1000
Any idea why its warning every second, the only config that has 1 second is
softcommit.
Thanks,
Rishi.
Hi Dmitry,
I thought auto soft commit was for NRT search (shouldn't it be optimized for
search performance), if i have to wait 10 mins how is it NRT? or am I missing
something?
Thanks,
Rishi.
-Original Message-
From: Dmitry Kan
To: solr-user
Sent: Fri, Mar 28, 2014 1:
on SSD drives is a long time to
handle a 4GB index.
Thanks,
Rishi.
-Original Message-
From: Shawn Heisey
To: solr-user
Sent: Fri, Mar 28, 2014 3:28 pm
Subject: Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2
On 3/28/2014 1:03 PM, Rishi Easwaran wrote:
>
-user
Sent: Fri, Mar 28, 2014 8:35 pm
Subject: Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2
On 3/28/2014 4:07 PM, Rishi Easwaran wrote:
>
> Shawn,
>
> I changed the autoSoftCommit value to 15000 (15 sec).
> My index size is pretty small ~4GB and
14 5:51 pm
Subject: Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2
On 3/30/2014 2:59 PM, Rishi Easwaran wrote:
> RAM shouldn't be a problem.
> I have a box with 144GB RAM, running 12 instances with 4GB Java heap each.
> There are 9 instances wrting to 1TB of SSD
All,
There is a tech talk on AOL Dulles campus tomorrow. Do swing by if you can and
share it with your colleagues and friends.
www.meetup.com/Code-Brew/events/192361672/
There will be free food and beer served at this event :)
Thanks,
Rishi.
w has 6 shards and 2 replicas (1 leader & 1 replica) for
each shard.
Now I want to add extra replicas to each shard in my cluster without
out changing the replicationFactor used to create the collection.
Any ideas on how to go about doing that.
Thanks,
Rishi.
://newNode2:port/solr/admin/cores?action=CREATE&name=testCloud1_shard2_replica3&collection=testCloud1&shard=shard2&collection.configName=myconf
Is there an easier way to do this.
Any ideas.
Thanks,
Rishi.
-Original Message-
From: Rishi Easwaran
To: solr-user
Sent: T
distributed, what is the determining criteria.
Thanks,
Rishi.
-Original Message-
From: Anshum Gupta
To: solr-user
Sent: Tue, May 14, 2013 9:42 pm
Subject: Re: SOLR Cloud Collection Management quesiotn.
Hi Rishi,
If you have your cluster up and running, just add the nodes and they
rd we are looking at prototyping SOLR Cloud for our search
system, upgrade java and tomcat, tune our application further. Lots of fun
stuff :)
Have a great weekend everyone.
Thanks,
Rishi.
Sure Shalin, hopefully soon.
-Original Message-
From: Shalin Shekhar Mangar
To: solr-user
Sent: Sat, May 18, 2013 11:35 pm
Subject: Re: Upgrading from SOLR 3.5 to 4.2.1 Results.
Awesome news Rishi! Looking forward to your SolrCloud updates.
On Sat, May 18, 2013 at 12:59 AM
We use commodity H/W which we procured over the years as our complex grew.
Running on jdk6 with tomcat 5. (Planning to upgrade to jdk7 and tomcat7 soon).
We run them with about 4GB heap. Using CMS GC.
-Original Message-
From: adityab
To: solr-user
Sent: Sat, May 18, 2013 10:37
Results.
Hi Rishi,
Have you done any tests with Solr 4.3 ?
Regards,
Cordialement,
BOUHLEL Noureddine
On 17 May 2013 21:29, Rishi Easwaran wrote:
>
>
> Hi All,
>
> Its Friday 3:00pm, warm & sunny outside and it was a good week. Figured
> I'd share some good
there was an inbuilt SOLR
mechanism of doing this. That would prevent us from creating and storing an
extra field.
Thanks,
Rishi.
. And set
the delimiter string as well in the concat update processor.
I managed to reverse the field order from what you requested (userid,
docid).
I used the standard Solr example schema, so I used dynamic fields for the
two ids, but use your own field names.
-- Jack Krupansky
-Orig
12345
1
I get the following compositeId 12345-1 .
In this case the compositeId is not unique and I am getting duplicates.
Thanks,
Rishi.
-Original Message-
From: Jack Krupansky
To: solr-user
Sent: Tue, May 28, 2013 12:07 pm
Subject: Re: Solr Composite Unique key from existing
order of the field
names in the processor configuration:
docid_s
userid_s
-- Jack Krupansky
-Original Message-
From: Rishi Easwaran
Sent: Tuesday, May 28, 2013 2:54 PM
To: solr-user@lucene.apache.org
Subject: Re: Solr Composite Unique key from existing fields in schema
Jack,
No sure if
like to avoid the overhead of storing this field in my index.
Thanks,
Rishi.
-Original Message-
From: Jack Krupansky
To: solr-user
Sent: Tue, May 28, 2013 4:33 pm
Subject: Re: Solr Composite Unique key from existing fields in schema
The TL;DR response: Try this
.
You can use select?q=xyz&shard.keys=uniquekey to focus your search to hit only
the shard that has your shard.key
Thanks,
Rishi.
-Original Message-
From: Joshi, Shital
To: 'solr-user@lucene.apache.org'
Sent: Wed, Jun 12, 2013 10:01 am
Subject: shardkey
Hi
p from the community would be great, I got some heap dumps and stack
dumps, but haven't found a smoking gun yet.
If I can provide anything else to diagnose this issue. just let me know.
Thanks,
Rishi.
Mark,
I got a few stack dumps of the instance that was stuck ssdtest-d03:8011
http://apaste.info/cofK
http://apaste.info/sv4M
http://apaste.info/cxUf
I can get dumps of others if needed.
Thanks,
Rishi.
-Original Message-
From: Mark Miller
To: solr-user
Sent: Mon, Jun 17
FYI..you can ignore http4ClientExpiryService thread in the stack dump.
Its a dummy executor service, i created to test out something, unrelated to
this issue.
-Original Message-
From: Rishi Easwaran
To: solr-user
Sent: Mon, Jun 17, 2013 2:54 pm
Subject: Re: Solr Cloud Hangs
ble state of my index.
I understand from the previous discussions, that it was intended for update
durability and realtime get.
But, unless I am missing something an ability to disable it in SOLR cloud if
not needed would be good.
Thanks,
Rishi.
es receive writes and acknowledge. durability should be
high.
Peer-Sync and Recovery - Can we achieve that merging indexes from leader as
needed, instead of replaying the transaction logs?
Rishi.
-Original Message-
From: Shalin Shekhar Mangar
To: solr-user
Sent: Mon, Jun 17, 20
://www.linkedin.com/jobs?viewJob=&jobId=6073910
If interested, send your current resume to rishi.easwa...@aol.com.
I will take it to my Director.
This position is in Dulles, VA.
Thanks,
Rishi.
and easily reproducible issue on SOLR cloud.
Thanks,
Rishi.
-Original Message-
From: Yago Riveiro
To: solr-user
Sent: Mon, Jun 17, 2013 5:15 pm
Subject: Re: Solr Cloud Hangs consistently .
I can confirm that the deadlock happen with only 2 replicas by shard. I need
solr community uses (preferably with jmeter),
we are write heavy so at the moment focusing on inserts only.
Thanks,
Rishi.
-Original Message-
From: Yago Riveiro
To: solr-user
Sent: Mon, Jun 17, 2013 6:19 pm
Subject: Re: Solr Cloud Hangs consistently .
I do all the indexing
more
slower network IO. The transaction log is a append-only log -- it is not
pretty cheap especially so if you compare it with the indexing process.
Plus your write request/sec will drop a lot once you start doing
synchronous replication.
On Tue, Jun 18, 2013 at 2:18 AM, Rishi Easwaran
t;availability zone at any given time should be pretty low. Why have tLogs if
>all replicas on an update get the request anyway, In theory 1 replica must be
>able to commit eventually.
NRT is an optional feature and probably not tied to Cloud, correct?
Thanks,
Rishi.
-Origin
, which is very small for a
server app.
One of our install script had changed.
I had to up the ulimits - -n,-u,-v and for now no other issues seen.
-Original Message-
From: Rishi Easwaran
To: solr-user
Sent: Tue, Jun 18, 2013 10:40 am
Subject: Re: Solr Cloud Hangs consistently
54 matches
Mail list logo
