Solr is designed in scalable aritechture. So you question depends on how
many resources (cpu, memory, space, etc.) you have to scale Solr how high
(within a single machine), how wide (how fast a request you wish to response
to user using replication), and how deep (how many slices/partition (Solr's
designers call them 'shard') you wish to split for a huge size index, if
any.
In my experience, to analyaze the data itself & collect usage/guess possible
usage of your users is more important. I can share one of my experience
with you. Initially we try to build 1 Solr Architecture to service all the
search requests from our users. Then we re-analyze the past usage of search
of our users, we found over 65% of all searches concentrates on recent
1-week news. So we split to 2 Solr with 2 physical architecture. 70% of the
machines are invested on 1st Solr to service recent 1-week news searches.
Although I believe there must be a technicall maximum parameters there, I
don't think we'll reach that limit in normal usage.
----- Original Message -----
From: "Otis Gospodnetic" <otis_gospodne...@yahoo.com>
To: <d...@lucene.apache.org>
Cc: <solr-user@lucene.apache.org>
Sent: Thursday, October 14, 2010 8:58 AM
Subject: Re: What is the maximum number of documents that can be indexed ?
Marco (use solr-u...@lucene list to follow up, please),
There are no precise answers to such questions. Solr can keep indexing.
The
limit is, I think, the available disk space. I've never pushed Solr or
Lucene
to the point where Lucene index segments would become a serious pain, but
even
that can be controlled. Same thing with number of open files, large file
support, etc.
Otis
----
Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecosystem search :: http://search-lucene.com/
From: Marco Ciaramella <ciaramellama...@gmail.com>
To: d...@lucene.apache.org
Sent: Wed, October 13, 2010 6:19:15 PM
Subject: What is the maximum number of documents that can be indexed ?
Hi all,
I am working on a performance specification document on a
Solr/Lucene-based
application; this document is intended for the final customer. My question
is:
what is the maximum number of document I can index assuming 10 or 20kbytes
for
each document?
I could not find a precise answer to this question, and I tend to consider
that
Solr index can be virtually limited only by the JVM, the Operating System
(limits to large file support), or by hardware constraints (mainly RAM,
etc. ...
).
Thanks
Marco
--------------------------------------------------------------------------------
¥¼¦b¶Ç¤J°T®§¤¤§ä¨ì¯f¬r¡C
Checked by AVG - www.avg.com
Version: 9.0.862 / Virus Database: 271.1.1/3193 - Release Date: 10/13/10
02:37:00
