Re: DIH Issue

2014-05-31 Thread Ahmet Arslan
Hi, Did you restart solr? Can you paste relevant portions of data-config.xml and schema.xml? On Saturday, May 31, 2014 3:46 AM, PeriS wrote: I added the primaryKey as the and still same result. On May 30, 2014, at 8:38 PM, Ahmet Arslan wrote: > Hi, > > Sure, have a look at definition i

Re: slow performance on simple filter

2014-05-31 Thread mizayah
i show you my full query it's rly simple one q=*:* and fq=class_name:CdnFile debug q shows that process of q takes so long. single filter is critical here. And cache is ot an option here. It work well but i need to know why such sipmple filter can takes so long. class_name:CdnFile 421.0

Re: slow performance on simple filter

2014-05-31 Thread Yonik Seeley
On Sat, May 31, 2014 at 8:47 AM, mizayah wrote: > i show you my full query > > it's rly simple one > q=*:* and fq=class_name:CdnFile > > debug q shows that process of q takes so long. > single filter is critical here. 400ms is too long... something is strange. One possibility is that the part of

Re: DIH Issue

2014-05-31 Thread PeriS
db-import.xml: schema.xml: person_id Thanks Peri On May 31, 2014, at 8:05 AM, Ahmet Arslan wrote: > Hi, > > Did you restart solr? Can you paste relevant portions of data-config.xml and > schema.xml? > > > > On Saturday, May 31, 2014 3:46 AM, PeriS wrote: > I added the prima

Uneven shard heap usage

2014-05-31 Thread Joe Gresock
Hi folks, I'm trying to figure out why one shard of an evenly-distributed 3-shard cluster would suddenly start running out of heap space, after 9+ months of stable performance. We're using the "!" delimiter in our ids to distribute the documents, and indeed the disk size of our shards are very si

Re: Uneven shard heap usage

2014-05-31 Thread Jack Krupansky
When you restart, how long does it take it hit the problem? And how much query or update activity is happening in that time? Is there any other activity showing up in the log? If you bring up only a single node in that problematic shard, do you still see the problem? -- Jack Krupansky -

Re: Uneven shard heap usage

2014-05-31 Thread Joe Gresock
It has taken as little as 2 minutes to happen the last time we tried. It basically happens upon high query load (peak user hours during the day). When we reduce functionality by disabling most searches, it stabilizes. So it really is only on high query load. Our ingest rate is fairly low. It h

Re: search multiple cores

2014-05-31 Thread sunayansaikia
Hi Alvaro Cabrerizo, Regarding the following -- "- B is a constraint over the documents in the coreB" I tried and it seems if I try with the fields available only in coreB but not in coreA, it throws an error saying, 'undefined field ''. The field '' in coreB is indexed enabled. Any inputs will

Re: Uneven shard heap usage

2014-05-31 Thread Erick Erickson
This is very weird. Are you sure that all the Java versions are identical? And all the JVM parameters are the same? Grasping at straws here. More grasping at straws: I'm a little suspicious that you are using routing. You say that the indexes are about the same size, but is it is possible that yo

Re: DIH Issue

2014-05-31 Thread PeriS
Seems like the issue got fixed after I updated my import query to the following; On May 31, 2014, at 9:24 AM, PeriS wrote: > db-import.xml: > > query="SELECT p.person_id, p.details, p.authz_id, > p.last_modified, a.address_info from person p, address a where p.pe

Re: Full Indexing fails on Solr-Probable connection issue.HELP!

2014-05-31 Thread Aniket Bhoi
still awaiting a response from someone On Tue, May 27, 2014 at 1:35 PM, Aniket Bhoi wrote: > > > > On Mon, May 26, 2014 at 4:14 PM, Aniket Bhoi > wrote: > >> Another thing I have noted is that the exception always follows a commit >> operation.Log excerpt below: >> >> INFO: SolrDeletionPolicy.

Re: Uneven shard heap usage

2014-05-31 Thread Joe Gresock
Interesting thought about the routing. Our document ids are in 3 parts: <10-digit identifier>!! e.g., 5/12345678!13025603!TEXT Each object has an identifier, and there may be multiple versions of the object, hence the timestamp. We like to be able to pull back all of the versions of an obj

Re: Uneven shard heap usage

2014-05-31 Thread Michael Sokolov
Is it possible that all your requests are routed to that single shard? I.e. you are not using the smart client that round-robins requests? I think that could cause all of the merging of results to be done on a single node. Also - is it possible you have a "bad" document in that shard? Like o

Re: Uneven shard heap usage

2014-05-31 Thread Otis Gospodnetic
Hi Joe, Are you/how are you sure all 3 shards are roughly the same size? Can you share what you run/see that shows you that? Are you sure queries are evenly distributed? Something like SPM should give you insight into that. How big are your caches? Otis -- Performan

Re: Compression vs FieldCache for doc ids retrieval

2014-05-31 Thread William Bell
Why not just submit a JIRA issue - and add your patch so that we can all benefit? On Fri, May 30, 2014 at 5:34 AM, Manuel Le Normand < manuel.lenorm...@gmail.com> wrote: > Is the issue SOLR-5478 what you were looking for? > -- Bill Bell billnb...@gmail.com cell 720-256-8076