Re: Solr multicore join performance tuning

2016-01-25 Thread Mikhail Khludnev
What a solr version, query parameters and debug output? 26.01.2016 6:38 пользователь "Bhawna Asnani" написал: > Hi, > I am using solr multicore join queries for some admin filters. The queries > are really slow taking up to 40-60 seconds ins some cases. > > I recently r

Solr multicore join performance tuning

2016-01-25 Thread Bhawna Asnani
Hi, I am using solr multicore join queries for some admin filters. The queries are really slow taking up to 40-60 seconds ins some cases. I recently read that the schema field used to join to should have 'docValues=true'. Besides that, any suggestion to improve the performance? -Bhawna

Re: solr multicore vs sharding vs 1 big collection

2015-08-04 Thread Shawn Heisey
On 8/4/2015 3:30 PM, Jay Potharaju wrote: > For the last few days I have been trying to correlate the timeouts with GC. > I noticed in the GC logs that full GC takes long time once in a while. Does > this mean that the jvm memory is to high or is it set to low? > 1973953.560: [GC 4474277K->33004

Re: solr multicore vs sharding vs 1 big collection

2015-08-04 Thread Jay Potharaju
For the last few days I have been trying to correlate the timeouts with GC. I noticed in the GC logs that full GC takes long time once in a while. Does this mean that the jvm memory is to high or is it set to low? [GC 4730643K->3552794K(4890112K), 0.0433146 secs] 1973853.751: [Full GC 3552794K->

Re: solr multicore vs sharding vs 1 big collection

2015-08-03 Thread Bill Bell
Yeah a separate by month or year is good and can really help in this case. Bill Bell Sent from mobile > On Aug 2, 2015, at 5:29 PM, Jay Potharaju wrote: > > Shawn, > Thanks for the feedback. I agree that increasing timeout might alleviate > the timeout issue. The main problem with increasing t

Re: solr multicore vs sharding vs 1 big collection

2015-08-03 Thread Upayavira
There are two things that are likely to cause the timeouts you are seeing, I'd say. Firstly, your server is overloaded - that can be handled by adding additional replicas. However, it doesn't seem like this is the case, because the second query works fine. Secondly, you are hitting garbage colle

Re: solr multicore vs sharding vs 1 big collection

2015-08-02 Thread Jay Potharaju
Shawn, Thanks for the feedback. I agree that increasing timeout might alleviate the timeout issue. The main problem with increasing timeout is the detrimental effect it will have on the user experience, therefore can't increase it. I have looked at the queries that threw errors, next time I try it

Re: solr multicore vs sharding vs 1 big collection

2015-08-02 Thread Shawn Heisey
On 8/2/2015 8:29 AM, Jay Potharaju wrote: > The document contains around 30 fields and have stored set to true for > almost 15 of them. And these stored fields are queried and updated all the > time. You will notice that the deleted documents is almost 30% of the > docs. And it has stayed around t

Re: solr multicore vs sharding vs 1 big collection

2015-08-02 Thread Jay Potharaju
The document contains around 30 fields and have stored set to true for almost 15 of them. And these stored fields are queried and updated all the time. You will notice that the deleted documents is almost 30% of the docs. And it has stayed around that percent and has not come down. I did try optim

Re: solr multicore vs sharding vs 1 big collection

2015-08-01 Thread Shawn Heisey
On 8/1/2015 6:49 PM, Jay Potharaju wrote: > I currently have a single collection with 40 million documents and index > size of 25 GB. The collections gets updated every n minutes and as a result > the number of deleted documents is constantly growing. The data in the > collection is an amalgamation

Re: solr multicore vs sharding vs 1 big collection

2015-08-01 Thread Erick Erickson
40 million docs isn't really very many by modern standards, although if they're huge documents then that might be an issue. So is this a single shard or multiple shards? If you're really facing performance issues, simply making a new collection with more than one shard (independent of how many rep

solr multicore vs sharding vs 1 big collection

2015-08-01 Thread Jay Potharaju
Hi I currently have a single collection with 40 million documents and index size of 25 GB. The collections gets updated every n minutes and as a result the number of deleted documents is constantly growing. The data in the collection is an amalgamation of more than 1000+ customer records. The numb

Re: jetty solr multicore log files

2014-04-17 Thread Shawn Heisey
On 4/17/2014 4:35 AM, Kim, Soonho (IFPRI) wrote: > I have a quick question on the log files of solr 3.4 (multicore) in Jetty > (linux). I am using this solr search linking with Drupal 6. > I tried to find the log files for this multicore (live/dev) but I couldn't > find it. > For the single core,

jetty solr multicore log files

2014-04-17 Thread Kim, Soonho (IFPRI)
Dear all; I have a quick question on the log files of solr 3.4 (multicore) in Jetty (linux). I am using this solr search linking with Drupal 6. I tried to find the log files for this multicore (live/dev) but I couldn't find it. For the single core, I found it under apache-solr-3.4/example/logs/

Re: Deciding how to correctly use Solr multicore

2014-02-09 Thread Erick Erickson
speak at all about HA (High Availability) requirements or > replication. > > Or about query latency requirements or query load - which can impact > replication requirements. > > -- Jack Krupansky > > -Original Message- From: Pisarev, Vitaliy > Sent: Sunday, February

Re: Deciding how to correctly use Solr multicore

2014-02-09 Thread Jack Krupansky
aliy Sent: Sunday, February 9, 2014 4:22 AM To: solr-user@lucene.apache.org Subject: Deciding how to correctly use Solr multicore Hello! We are evaluating Solr usage in our organization and have come to the point where we are past the functional tests and are now looking in choosing the best

Deciding how to correctly use Solr multicore

2014-02-09 Thread Pisarev, Vitaliy
Hello! We are evaluating Solr usage in our organization and have come to the point where we are past the functional tests and are now looking in choosing the best deployment topology. Here are some details about the structure of the problem: The application deals with storing and retrieving art

Solr multicore aborts with socket timeout exceptions

2013-01-17 Thread eShard
I'm currently running Solr 4.0 final on tomcat v7.0.34 with ManifoldCF v1.2 dev running on Jetty. I have solr multicore set up with 10 cores. (Is this too much?) I so I also have at least 10 connectors set up in ManifoldCF (1 per core, 10 JVMs per connection) >From the look of it; Solr

Re: solr multicore problem on SLES 11

2012-09-17 Thread Jochen Lienhard
] Gesendet: Montag, 17. September 2012 09:17 An: solr-user@lucene.apache.org Betreff: solr multicore problem on SLES 11 Hello, I have a problem with solr and multicores on SLES 11 SP 2. I have 3 cores, each with more than 20 segments. When I try to start the tomcat6, it can not start the CoreContain

AW: solr multicore problem on SLES 11

2012-09-17 Thread André Widhani
ual memory. So if the size of your index files are larger than the allowed virtual memory, it may fail. Regards, André Von: Jochen Lienhard [lienh...@ub.uni-freiburg.de] Gesendet: Montag, 17. September 2012 09:17 An: solr-user@lucene.apache.org Bet

solr multicore problem on SLES 11

2012-09-17 Thread Jochen Lienhard
Hello, I have a problem with solr and multicores on SLES 11 SP 2. I have 3 cores, each with more than 20 segments. When I try to start the tomcat6, it can not start the CoreContainer. Caused by: java.lang.OutOfMemoryError: Map failed at sun.nio.ch.FileChannelImpl.map0(Native Method) I r

How to check for inactive cores in a solr multicore setup?

2012-02-20 Thread Nasima Banu
Hello, I am trying to figure out a way to detect inactive cores in a multicore setup. How is that possible? I queried the STATUS of a core through the CoreAdminHandler. Could anyone please tell me what the 'current' field means?? Eg : http://localhost:8080/solr/admin/cores?action=STATUS&core=2

Re: Searching accross Solr-Multicore

2011-05-09 Thread Erick Erickson
t;> > Hi, >> > >> > sorry that I did not so well explained my issue. >> > >> > That is exactly as you described it(* Or, is it that queries are working >> on >> > one core, and not on the >> >  other?) >> > >> > Regard

Re: Searching accross Solr-Multicore

2011-05-09 Thread Benyahya, Fahd
> On 9 May 2011 10:58, Gora Mohanty wrote: > > > > > On Mon, May 9, 2011 at 2:10 PM, Benyahya, Fahd < > fahd.benya...@netmoms.de > > > > > > wrote: > > > > Hallo everyone, > > > > > > > > i'm using solr-multicore with 3 cores to

Re: Searching accross Solr-Multicore

2011-05-09 Thread rajini maski
> one core, and not on the > other?) > > Regards, > Fahd > > On 9 May 2011 10:58, Gora Mohanty wrote: > > > On Mon, May 9, 2011 at 2:10 PM, Benyahya, Fahd > > > wrote: > > > Hallo everyone, > > > > > > i'm using solr-multicore w

Re: Searching accross Solr-Multicore

2011-05-09 Thread Benyahya, Fahd
; > Hallo everyone, > > > > i'm using solr-multicore with 3 cores to index my Web-Site. For testing > i'm > > using the solr-admin GUI to get responses. The Problem is, that i get > > results only from one core, but not from the others also. > [...] > > Wh

Re: Searching accross Solr-Multicore

2011-05-09 Thread Gora Mohanty
On Mon, May 9, 2011 at 2:10 PM, Benyahya, Fahd wrote: > Hallo everyone, > > i'm using solr-multicore with 3 cores to index my Web-Site. For testing i'm > using the solr-admin GUI to get responses. The Problem is, that i get > results only from one core, but not from the

Searching accross Solr-Multicore

2011-05-09 Thread Benyahya, Fahd
Hallo everyone, i'm using solr-multicore with 3 cores to index my Web-Site. For testing i'm using the solr-admin GUI to get responses. The Problem is, that i get results only from one core, but not from the others also. Each core has its own schema.xml. The Cores are like follow

Re: Solr Multicore - cant seem to get it working?

2011-02-28 Thread Ahmet Arslan
> I'm waiting on my > host to add my IP to the > firewall for me, so I can test that part of it (they setup > the bog standard > Solr for me, but I'm now trying to get it working with the > multicore, as I > think we are gonna need several Solr instances for > different parts of the If you have m

Re: Solr Multicore - cant seem to get it working?

2011-02-28 Thread ultranerds
> > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> >

Re: Solr Multicore - cant seem to get it working?

2011-02-28 Thread Stefan Matheis
n/WebService/Solr.pm line 180 >> >        WebService::Solr::_send_update('WebService::Solr=HASH(0x13d4b68)', >> >> > 'XML::Generator::overload=ARRAY(0x13da3f8)') called at >> > /home/user/site.com/cgi-bin/art/admin/WebService/Solr.pm line 73 >>

Re: Solr Multicore - cant seem to get it working?

2011-02-28 Thread ultranerds
alled at solr_add_test.cgi > > line 42 > > rgillen@factory /home/rgillen/solr $ > > > > Am I doing something wrong? Still reading through the setup process in > the > > "Solr 1.4" book I brough a while back, but just wanted to make sure it > > wasn&#x

Re: Solr Multicore - cant seem to get it working?

2011-02-27 Thread Chris Wilkes
ll reading through the setup process in the > "Solr 1.4" book I brough a while back, but just wanted to make sure it > wasn't something on the server end that wasn't quite working right =) > > If I don't use the multicore it seems to work ok (but it obviously doesn't > use the multicore, which is what I wanted to do) > > TIA > > Andy > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Solr-Multicore-cant-seem-to-get-it-working-tp2588149p2588149.html > Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr Multicore - cant seem to get it working?

2011-02-27 Thread Ahmet Arslan
> I'm trying to get a Solr install to work with multicores, > as I wanna use it > on several sites (each totally different, and I don't > obviously wanna have > loads of seperate Solr installs) > > Here is what I've done so far (Solr was already uploaded > and working > normally, without multicore

Solr Multicore - cant seem to get it working?

2011-02-27 Thread ultranerds
through the setup process in the "Solr 1.4" book I brough a while back, but just wanted to make sure it wasn't something on the server end that wasn't quite working right =) If I don't use the multicore it seems to work ok (but it obviously doesn't use the multicore, w

Re: Indexing Problem with SOLR multicore

2010-06-14 Thread seesiddharth
arth -- View this message in context: http://lucene.472066.n3.nabble.com/Indexing-Problem-with-SOLR-multicore-tp884745p896347.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Indexing Problem with SOLR multicore

2010-06-14 Thread Chris Hostetter
n problem gets sort out. but comes gaing if I restart my tomcat : server. : : Is there any issue with my core configuration? Please help : : : Thanks, : Siddharth : : : : -- : View this message in context: http://lucene.472066.n3.nabble.com/Indexing-Problem-with-SOLR-multicore-tp884745p

Indexing Problem with SOLR multicore

2010-06-09 Thread seesiddharth
gets sort out. but comes gaing if I restart my tomcat server. Is there any issue with my core configuration? Please help Thanks, Siddharth -- View this message in context: http://lucene.472066.n3.nabble.com/Indexing-Problem-with-SOLR-multicore-tp884745p884745.html Sent from the Solr -

Re: solr multicore and nfs

2010-02-08 Thread Lance Norskog
Solr generally does not work well over NFS. This looks like a transient NFS error; apps have to assume that NFS will randomly fail and that they have to try again. This may be due to a locking problem. There is a LockFactory class in Lucene that controls how indexes are shared between programs. So

solr multicore and nfs

2010-02-04 Thread Valérie TAESCH
Hello, We are using Solr(v 1.3.0 694707 with Lucene version 2.4-dev 691741) in multicore mode with an average of 400 indexes (all indexes have the same structure). These indexes are stored on a nfs disk. A java process writes continuously in these indexes while solr is only used to read th

Re: Problem regarding Solr MultiCore

2009-08-12 Thread deepak agrawal
given > > path.when i am using > > http://localhost:8080/solr/admin/ > > > > then it is working fine. > > But when i am using - *http://localhost:8080/solr/admin/cores* > > then following error occur - > > > > *type* Status report > > > > *mess

Re: Problem regarding Solr MultiCore

2009-08-12 Thread Noble Paul നോബിള്‍ नोब्ळ्
> *description* *The requested resource (/solr/admin/cores) is not available.* > > So can  you please help me what are the changes required for Solr Multicore. > > > -- > DEEPAK AGRAWAL > +91-9379433455 > GOOD LUCK. > -- - Noble Paul | Principal Engineer| AOL | http://aol.com

Problem regarding Solr MultiCore

2009-08-12 Thread deepak agrawal
. But when i am using - *http://localhost:8080/solr/admin/cores* then following error occur - *type* Status report *message* */solr/admin/cores* *description* *The requested resource (/solr/admin/cores) is not available.* So can you please help me what are the changes required for Solr Multicore

RE: Solr MultiCore query

2009-07-17 Thread Manepalli, Kalyan
ject: Re: Solr MultiCore query Both schema.xml ( in example/multicore/core0/conf and example/multicore/core1/conf ) already have * name* Here are the following query responses: 1) http://localhost:8983/solr/core0/select?shards=localhost:8983/solr/core0,localhost:8983/solr/core1&q=*:* 025

Re: Solr MultiCore query

2009-07-17 Thread Code Tester
> >> > >> This will return the datasources that are defined with their number of > >> results for the query. > >> > >> Making the facet results clickable in order to narrow down the results > >> can > >> be achieved by adding a filter

Re: Solr MultiCore query

2009-07-17 Thread ahammad
with their number of >> results for the query. >> >> Making the facet results clickable in order to narrow down the results >> can >> be achieved by adding a filter to the query and filtering to a specific >> dataSource. I actually ended uo creating a fairly i

Re: Solr MultiCore query

2009-07-17 Thread Code Tester
ended uo creating a fairly intuitive front-end for > my > system with faceting, filtering, paging etc all using jsp and SolrJ. SolrJ > is powerful enough to handle all of the backend processing. > > Good luck! > > > > > > > joe_coder wrote: > > > > I miss

Re: Solr MultiCore query

2009-07-17 Thread ahammad
uery above. > > D1 and D2 would have close to 1 million records each > D3 would have ~10 million records. > > Thanks! > -- View this message in context: http://www.nabble.com/Solr-MultiCore-query-tp24534383p24534793.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr MultiCore query

2009-07-17 Thread joe_coder
I missed adding some size related information in the query above. D1 and D2 would have close to 1 million records each D3 would have ~10 million records. Thanks! -- View this message in context: http://www.nabble.com/Solr-MultiCore-query-tp24534383p24534421.html Sent from the Solr - User

Solr MultiCore query

2009-07-17 Thread joe_coder
the faceting work? 3) How can I get spellcheck/morelikethis work ( incase I choose single/multiple cores )? PS: I am planning to use SolrJ. -- View this message in context: http://www.nabble.com/Solr-MultiCore-query-tp24534383p24534383.html Sent from the Solr - User mailing list archive at

Re: Distributed querying using solr multicore.

2009-06-18 Thread Rakhi Khatwani
Hi Michael, Sorry for the misinterpretation. in that case, its the same like querying multiple shards. :) Thanks, Raakhi On Thu, Jun 18, 2009 at 4:09 PM, Michael Ludwig wrote: > Rakhi Khatwani schrieb: > >> On Thu, Jun 18, 2009 at 3:51 PM, Michael Ludwig >> wrote: >> > > I do

Re: Distributed querying using solr multicore.

2009-06-18 Thread Michael Ludwig
Rakhi Khatwani schrieb: On Thu, Jun 18, 2009 at 3:51 PM, Michael Ludwig wrote: I don't know how we're supposed to use it. I did the following: http://flunder:8983/solr/xpg/select?q=bla&shards=flunder:8983/solr/xpg,flunder:8983/solr/kk i am gettin a page load error... "cannot find server"

Re: Distributed querying using solr multicore.

2009-06-18 Thread Rakhi Khatwani
On Thu, Jun 18, 2009 at 3:51 PM, Michael Ludwig wrote: > Rakhi Khatwani schrieb: > >> [...] how do we do a distributed search across multicores?? is it >> just like how we query using multiple shards? >> > > I don't know how we're supposed to use it. I did the following: > > > http://flunder:898

Re: Distributed querying using solr multicore.

2009-06-18 Thread Michael Ludwig
Rakhi Khatwani schrieb: [...] how do we do a distributed search across multicores?? is it just like how we query using multiple shards? I don't know how we're supposed to use it. I did the following: http://flunder:8983/solr/xpg/select?q=bla&shards=flunder:8983/solr/xpg,flunder:8983/solr/kk

Fwd: Solr MultiCore dataDir bug - a fix

2009-05-07 Thread Noble Paul നോബിള്‍ नोब्ळ्
I didn't notice that the mail was not sent to the list. Plz send all your communication to the mailing list -- Forwarded message -- From: Noble Paul നോബിള്‍ नोब्ळ् Date: 2009/5/8 Subject: Re: Solr MultiCore dataDir bug - a fix To: pasi.j.matilai...@tieto.com are you sure

Re: Solr Multicore ...

2008-11-07 Thread Shalin Shekhar Mangar
>From what I can understand, you have little full-text search involved here. You should probably look at Hadoop and its contrib and sub-projects such as Pig, Hive and Chukwa. http://wiki.apache.org/hadoop/ http://wiki.apache.org/hadoop/Hive http://wiki.apache.org/hadoop/Chukwa http://incubator.apa

RE: Solr Multicore ...

2008-11-07 Thread souravm
Hi Guys, Here I'm struggling with to decide whether Solr would be a fitting solution for me. Highly appreciate you The key requirements can be summarized as below - 1. Need to process very high volume of data online from log files of various applications - around 100s of Millions of total size

RE: Solr Multicore ...

2008-11-07 Thread souravm
Thanks Noble for your answer. Regards, Sourav -Original Message- From: Noble Paul നോബിള്‍ नोब्ळ् [mailto:[EMAIL PROTECTED] Sent: Thursday, November 06, 2008 7:41 PM To: solr-user@lucene.apache.org Subject: Re: Solr Multicore ... On Fri, Nov 7, 2008 at 3:28 AM, souravm <[EMAIL PROTEC

Re: Solr Multicore ...

2008-11-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Fri, Nov 7, 2008 at 3:28 AM, souravm <[EMAIL PROTECTED]> wrote: > > Hi, > > Can I use multi core feature to have multiple indexes (That is each core > would take care of one type of index) within a single Solar instance ? Yes .And this is why it is conceived > > Will there be any performance im

Solr Multicore ...

2008-11-06 Thread souravm
Hi, Can I use multi core feature to have multiple indexes (That is each core would take care of one type of index) within a single Solar instance ? Will there be any performance impact due to this type of setup ? Regards, Sourav CAUTION - Disclaimer * This e-m

Re: Solr Multicore, are there any way to retrieve all the cores registered?

2008-05-09 Thread Walter Ferrara
Ryan McKinley wrote: check the "status" action also, check the index.jsp page index.jsp do: org.apache.solr.core.MultiCore multicore = (org.apache.solr.core.MultiCore)request.getAttribute("org.apache.solr.MultiCore"); which is ok in a servlet, but how should I do the same inside an handler,

Re: Solr Multicore, are there any way to retrieve all the cores registered?

2008-05-09 Thread Ryan McKinley
check the "status" action also, check the index.jsp page (i don't have the code in front of me) On May 9, 2008, at 10:16 AM, Walter Ferrara wrote: In solr, last trunk version in svn, is it possible to access the "core registry", or what used to be the static MultiCore object? My goal is to

Solr Multicore, are there any way to retrieve all the cores registered?

2008-05-09 Thread Walter Ferrara
In solr, last trunk version in svn, is it possible to access the "core registry", or what used to be the static MultiCore object? My goal is to retrieve all the cores registered in a given (multicore) enviroment. It used to be MultiCore.getRegistry() initially, at first stages of solr-350; but n

Re: Solr multicore admin JSP problem on tomcat

2008-04-28 Thread Chris Hostetter
: 1. I use the following URL to successfully browse to the Admin interface of : one of the cores: : : http://devbox:8080/solr/solrtest/admin/ : : 2. On the resulting page, I click on the link [SCHEMA] : : 3. This results in a 404 error. The link to this page is : http://devbox:8080/solr/solrtest

Solr multicore admin JSP problem on tomcat

2008-04-23 Thread Suman Ghosh
I have successfully setup a Solr multicore configuration on Apache Tomcat 5.5 (Solaris 9, JDK 5). I used the 4/21/2008 nightly build for this purpose. At present, I have two cores defined. I can index and search documents on both these cores using the java client. I'm having a minor issue o

Re: Solr Multicore

2008-01-08 Thread Ryan McKinley
The multicore stuff has changed around a bit since its debut (and may change some more before the final release) check: http://wiki.apache.org/solr/MultiCore There is no longer a 'SETASDEFAULT' action and all requests require the core name, so you will need: http://localhost:8983/

Solr Multicore

2008-01-08 Thread Jae Joo
I have set multicores - core0 and core1, core0 is default. Once I update the index by http://localhost:8983/solr/update, it updates core1 not core0. Also, I tried to set the deault core using SETASDEFAULT, but it is "unknown action command". Can any one help me? Thanks, Jae