On Wed, 2015-01-21 at 09:46 +0100, Toke Eskildsen wrote:
> Anyway, RAID 0 does really help for random access, [...]
Should have been "...does not really help...".
- Toke Eskildsen
On Wed, 2015-01-21 at 07:56 +0100, Nimrod Cohen wrote:
> RAID [0] configuration
>
> each shard has data on each one of the 8 disks in the RAID, on each
> query to get 1K docs, each shard request to get data from the one RAID
> disk, so we get 8 request to get date from all of the disks and we get
MROD COHEN
Software Engineer
RTI
(T) +972 (9) 775-3668
(M) +972 (0) 52-5522901
nimrod.co...@nice.com
www.nice.com
-Original Message-
From: Toke Eskildsen [mailto:t...@statsbiblioteket.dk]
Sent: יום ג, 20 ינואר 2015 19:43
To: solr-user@lucene.apache.org
Subject: RE: shards per
I think this makes sense to (ie. the setup), since the search is getting 1K
documents each time (for textual analysis, ie. they are probably large
docs), and use Solr as a storage (which is totally fine) then the parallel
multiple drive i/o shards speed things up. The index is probably large, so
it
Nimrod Cohen [nimrod.co...@nice.com] wrote:
> We need to get 1K documents out of 100M documents each
> time we query solr and send them to text Analysis.
> First configuration had 8 shards on one RAD (Disk F) we
> got the 1K in around 15 seconds.
> Second configuration we removed the RAD and work o
On 1/20/2015 7:45 AM, Nimrod Cohen wrote:
> All shards are on the same system each one use different port.
> BTW
> Data size is about 1T, memory is 192G.
If Solr has to actually go to the disk to satisfy a query, it's going to
be slow. This will always be true, no matter how many disks you use.
...@gmail.com]
Sent: יום ג, 20 ינואר 2015 16:37
To: solr-user@lucene.apache.org
Subject: Re: shards per disk
Hey Nimrod,
Nice try. I just want to know that these 8 shards are each on different system
or do you implemented sharding on single system and each shard with different
port?
On Tue, Jan 20
Hey Nimrod,
Nice try. I just want to know that these 8 shards are each on different
system or do you implemented sharding on single system and each shard with
different port?
On Tue, Jan 20, 2015 at 7:54 PM, Nimrod Cohen wrote:
> Hi
>
> I done some performance test, and I wanted to know if any o
It sounds like your app needs a lot more RAM so that it is not doing so
much I/O.
-- Jack Krupansky
On Tue, Jan 20, 2015 at 9:24 AM, Nimrod Cohen wrote:
> Hi
>
> I done some performance test, and I wanted to know if any one saw the same
> behavior.
>
>
>
> We need to get 1K documents out of 100
Hi
I done some performance test, and I wanted to know if any one saw the same
behavior.
We need to get 1K documents out of 100M documents each time we query solr and
send them to text Analysis.
First configuration had 8 shards on one RAD (Disk F) we got the 1K in around
15 seconds.
Second conf
10 matches
Mail list logo
