On Wed, 2015-01-21 at 09:46 +0100, Toke Eskildsen wrote:
> Anyway, RAID 0 does really help for random access, [...]
Should have been "...does not really help...".
- Toke Eskildsen
On Wed, 2015-01-21 at 07:56 +0100, Nimrod Cohen wrote:
> RAID [0] configuration
>
> each shard has data on each one of the 8 disks in the RAID, on each
> query to get 1K docs, each shard request to get data from the one RAID
> disk, so we get 8 request to get date from all of the disks and we get
MROD COHEN
Software Engineer
RTI
(T) +972 (9) 775-3668
(M) +972 (0) 52-5522901
nimrod.co...@nice.com
www.nice.com
-Original Message-
From: Toke Eskildsen [mailto:t...@statsbiblioteket.dk]
Sent: יום ג, 20 ינואר 2015 19:43
To: solr-user@lucene.apache.org
Subject: RE: shards per
I think this makes sense to (ie. the setup), since the search is getting 1K
documents each time (for textual analysis, ie. they are probably large
docs), and use Solr as a storage (which is totally fine) then the parallel
multiple drive i/o shards speed things up. The index is probably large, so
it
Nimrod Cohen [nimrod.co...@nice.com] wrote:
> We need to get 1K documents out of 100M documents each
> time we query solr and send them to text Analysis.
> First configuration had 8 shards on one RAD (Disk F) we
> got the 1K in around 15 seconds.
> Second configuration we removed the RAD and work o
On 1/20/2015 7:45 AM, Nimrod Cohen wrote:
> All shards are on the same system each one use different port.
> BTW
> Data size is about 1T, memory is 192G.
If Solr has to actually go to the disk to satisfy a query, it's going to
be slow. This will always be true, no matter how many disks you use.
...@gmail.com]
Sent: יום ג, 20 ינואר 2015 16:37
To: solr-user@lucene.apache.org
Subject: Re: shards per disk
Hey Nimrod,
Nice try. I just want to know that these 8 shards are each on different system
or do you implemented sharding on single system and each shard with different
port?
On Tue, Jan 20
Hey Nimrod,
Nice try. I just want to know that these 8 shards are each on different
system or do you implemented sharding on single system and each shard with
different port?
On Tue, Jan 20, 2015 at 7:54 PM, Nimrod Cohen wrote:
> Hi
>
> I done some performance test, and I wanted to know if any o
It sounds like your app needs a lot more RAM so that it is not doing so
much I/O.
-- Jack Krupansky
On Tue, Jan 20, 2015 at 9:24 AM, Nimrod Cohen wrote:
> Hi
>
> I done some performance test, and I wanted to know if any one saw the same
> behavior.
>
>
>
> We need to get 1K documents out of 100
