Ok, now the situation is clearer !
Can you check the stored data size as Daniel correctly suggested ?
You are using a recent version of Solr, so your stored data should be
properly compressed.
An other idea that comes to my mind is related your merging policy.
Are you merging segments often or not
Why are most of your fields stored but not indexed? That suggests to me
that you are using Solr as your primary data store, not as an index (which
is not Solr's ideal use case)
Secondly, I think there is confusion around the term "segments". You have
a field called segment in your schema, but se
Is this test index? Do you rewrite documents with same ids? Did you try
to optimize index?
Emir
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/
On 22.07.2015 13:10, Daniel Holmes wrote:
Upayavira number of docs in
Upayavira number of docs in that case is 140275. The solr memory is 30Gb.
Yes Emir I need most of them to be saved.
I don't know Alessandro is that usual to use disk for indexing more than 3x
of document size and presumably it will grow up in continue of crawl
exponentially... Its so suboptimal I
"In one case for instance my segments size is 8.4G while index size is
28G!!! It seems unusual…"
The index is a collection of index segments + few overhead .
So, do you simply mean you have 4 segments ?
Where is the problem anyway ?
You are also storing content which usually is a big part of the
Hi Daniel,
Do you need all fields stored in your index? Only field that is not
stored is host.
Thanks,
Emir
On 22.07.2015 12:27, Daniel Holmes wrote:
Hi All
I have problem with index size in solr 4.7.2. My OS is Ubuntu 14.10 64-bit.
my fields are :
In one case for instance my seg
How many documents do you have? What makes you think that a 28Gb index
is large? How much memory do you have in your Solr server?
Upayavira
On Wed, Jul 22, 2015, at 11:27 AM, Daniel Holmes wrote:
> Hi All
> I have problem with index size in solr 4.7.2. My OS is Ubuntu 14.10
> 64-bit.
> my fields
