Hi - we are using 64bit OS and 64bit JVM. The JVM settings are currently:
-
-DSTOP.KEY=solrrocks
-DSTOP.PORT=8100
-Dhost=helios
-Djava.net.preferIPv4Stack=true
-Djetty.port=9100
-DnumShards=27
-Dsolr.clustering.enabled=true
-Dsolr.install.dir=/opt/solr
-Dso
On 30/05/2015 00:30, Shawn Heisey wrote:
On 5/29/2015 5:08 PM, Joseph Obernberger wrote:
Hi All - I have a lot of fields to delete, but noticed that once I
started deleting them, I quickly ran out of heap space. Is
delete-field a memory intensive operation? Should I delete one field,
wait a wh
Joseph,
You are doing a memory intensive operation and perhaps an IO intensive
operation at once. That makes your C-heap run out of memory or hit a thread
limit (thus first problem, java.lang.OutOfMemoryError: unable to create new
native thread) and later you're also hitting the problem of Java he
Faceting on very high cardinality fields can use up memory, no doubt
about that. I think the entire delete question was a red herring, but
you know that already ;)
So I think you can forget about the delete stuff. Although do note
that if you do re-index your old documents, the new version won
Hi Joseph,
> On May 30, 2015, at 8:18 AM, Joseph Obernberger
> wrote:
>
> Thank you Erick. I was thinking that it actually went through and removed
> the index data; that you for the clarification.
I added more info to the Schema API page about this not being true. Here’s
what I’ve got so
Thank you Erick. I was thinking that it actually went through and
removed the index data; that you for the clarification. What happened
was I had some bad data that created a lot of fields (some 8000). I was
getting some errors adding new fields where solr could not talk to
zookeeper, and I
Yes, but deleting fields from the schema only means that _future_
documents will throw an "undefined field" error. All the documents
currently in the index will retain that field.
Why you're hitting an OOM is a mystery though. But delete field isn't
removing the contents if indexed documents. Show
Thank you Shawn - I'm referring to fields in the schema. With Solr 5,
you can delete fields from the schema.
https://cwiki.apache.org/confluence/display/solr/Schema+API#SchemaAPI-DeleteaField
-Joe
On 5/29/2015 7:30 PM, Shawn Heisey wrote:
On 5/29/2015 5:08 PM, Joseph Obernberger wrote:
Hi Al
On 5/29/2015 5:08 PM, Joseph Obernberger wrote:
> Hi All - I have a lot of fields to delete, but noticed that once I
> started deleting them, I quickly ran out of heap space. Is
> delete-field a memory intensive operation? Should I delete one field,
> wait a while, then delete the next?
I'm not
