Latest stable SOLR version
Hello, In our project we are planning to use SOLR and I'm new to it. So, what is the latest stable version we can use and that is supported by Apache? Kindly let me know your suggestions because we started with installing SOLR 6.2 but heard that there are many issues and need to be upgraded to 6.3 or so. Thanks, GVK
Re: Latest stable SOLR version
Thank You! I believe 6.6 should have fixed all the previous version issues. But in 6.6 is there any major issues noticed? if so I will go with 6.5.1 else will proceed with 6.6. Kindly confirm! GVK On Mon, Sep 11, 2017 at 10:59 AM, Walter Underwood wrote: > We have been running 6.5.1 in production since May. I would not run > anything before that. > > The new metrics code caused performance problems. That was fixed in 6.5.0. > > There was a memory leak talking to Zookeeper. That was fixed in 6.5.1. > > Solr 6.6.1 should be released very soon. > > wunder > Walter Underwood > wun...@wunderwood.org > http://observer.wunderwood.org/ (my blog) > > > > On Sep 11, 2017, at 8:36 AM, Gunalan V wrote: > > > > Hello, > > > > In our project we are planning to use SOLR and I'm new to it. So, what is > > the latest stable version we can use and that is supported by Apache? > > > > Kindly let me know your suggestions because we started with installing > SOLR > > 6.2 but heard that there are many issues and need to be upgraded to 6.3 > or > > so. > > > > > > Thanks, > > GVK > >
Re: Latest stable SOLR version
Thanks Alessandro! On Mon, Sep 11, 2017 at 11:31 AM, Alessandro Hoss wrote: > Solr 6.6.1 was already released on September 7: > > http://www.apache.org/dyn/closer.lua/lucene/solr/6.6.1 > Release notes: https://lucene.apache.org/solr/6_6_1/changes/Changes.html > > Guess you should give it a try. > > On Mon, Sep 11, 2017 at 1:15 PM Gunalan V wrote: > > > Thank You! > > > > I believe 6.6 should have fixed all the previous version issues. But in > 6.6 > > is there any major issues noticed? if so I will go with 6.5.1 else will > > proceed with 6.6. > > > > Kindly confirm! > > > > > > > > GVK > > > > On Mon, Sep 11, 2017 at 10:59 AM, Walter Underwood < > wun...@wunderwood.org> > > wrote: > > > > > We have been running 6.5.1 in production since May. I would not run > > > anything before that. > > > > > > The new metrics code caused performance problems. That was fixed in > > 6.5.0. > > > > > > There was a memory leak talking to Zookeeper. That was fixed in 6.5.1. > > > > > > Solr 6.6.1 should be released very soon. > > > > > > wunder > > > Walter Underwood > > > wun...@wunderwood.org > > > http://observer.wunderwood.org/ (my blog) > > > > > > > > > > On Sep 11, 2017, at 8:36 AM, Gunalan V > wrote: > > > > > > > > Hello, > > > > > > > > In our project we are planning to use SOLR and I'm new to it. So, > what > > is > > > > the latest stable version we can use and that is supported by Apache? > > > > > > > > Kindly let me know your suggestions because we started with > installing > > > SOLR > > > > 6.2 but heard that there are many issues and need to be upgraded to > 6.3 > > > or > > > > so. > > > > > > > > > > > > Thanks, > > > > GVK > > > > > > > > >
Re: Latest stable SOLR version
Thanks Shawn! On Mon, Sep 11, 2017 at 2:01 PM, Shawn Heisey wrote: > On 9/11/2017 9:36 AM, Gunalan V wrote: > > In our project we are planning to use SOLR and I'm new to it. So, what is > > the latest stable version we can use and that is supported by Apache? > > As of four days ago, the latest release is 6.6.1. This is a point > release, intended to fix known bugs in the 6.6.0 version without adding > any new features. > > All releases are considered "stable", or they would not be released. > Every attempt is made to find and fix problems before release, but bugs > do happen. > > > Kindly let me know your suggestions because we started with installing > SOLR > > 6.2 but heard that there are many issues and need to be upgraded to 6.3 > or > > so. > > If you need a search engine to be up and in production quickly, the > recommendation right now is the latest version - 6.6.1. This is the > thirteenth release in the 6.x line, and represents over a year of new > features and bugfixes since the 6.0.0 release. > > The 7.0 release is underway right now, and could be announced as soon as > later this week. It also might end up delayed. That depends on whether > problems are found and if so, what those problems are. > > If you have a longer timeframe before you need to be online, it would > probably be a good idea to plan on testing 7.0 when it is released, and > be ready to upgrade your test environment to new 7.x versions as they > come out. You could choose to test 6.6.1 and 7.x concurrently, and go > with whichever version you can get working correctly. > > My personal feeling is that a brand new major release (x.0 version) > should not be deployed into production without an extensive amount of > testing. That applies to ANY software, not just Solr. It's not that I > think the 7.0 version is going to be bad software. It's just that it > hasn't received any widespread user testing yet, so any major problems > are currently unknown. The developers do a lot of testing, but they can > only come up with so many test scenarios. Real-world installations tend > to be better at sniffing out bugs. > > Thanks, > Shawn > >
SOLR Cloud Installation Instructions
Hello All, Kindly share me some reference link to install a solrcloud architecture with external zookeepers in my project. We are using SOLR 6.5.1 GVK
AEM SOLR integaration
Hello, I'm looking for suggestion in building the SOLR infrastructure so Kindly let me know if anyone has integerated AEM (Adobe Experience Manager) with SOLR? Thanks, GVK
Re: AEM SOLR integaration
Thank You! I was looking for some suggestions in building the SOLR infrastructure. Like how each AEM instance should point to ? Might be one AEM instance to one SOLR cloud (With internal zookeeper) in all environments or any specific architecture we need to follow while going with AEM. Thanks, GVK On Fri, Sep 22, 2017 at 02:58 Atita Arora wrote: > > https://www.slideshare.net/DEEPAKKHETAWAT/basics-of-solr-and-solr-integration-with-aem6-61150010 > > This could probably help too along with the link Nicole shared. > > On Fri, Sep 22, 2017 at 12:28 PM, Nicole Bilić > wrote: > > > Hi, > > > > Maybe this could help you out http://www.aemsolrsearch.com/ > > > > Regards, > > Nicole > > > > On Sep 22, 2017 05:41, "Gunalan V" wrote: > > > > > Hello, > > > > > > I'm looking for suggestion in building the SOLR infrastructure so > Kindly > > > let me know if anyone has integerated AEM (Adobe Experience Manager) > with > > > SOLR? > > > > > > > > > > > > Thanks, > > > GVK > > > > > >
Re: AEM SOLR integaration
Thanks Daniel and Tommaso! I will go through the links shared. On integrating SOLR with AEM, Do we need to have individual SOLRCloud for each AEM instance ? Or we can have a common SOLR cloud for all AEM instance in each environment. We are not using shared data store. So any pointers on this would be helpful! On Mon, Sep 25, 2017 at 1:05 AM, Tommaso Teofili wrote: > integrating can be done in AEM at different layers, however my suggestion > would be to enable that at the repository (Oak) level [1] so that usual AEM > search would also take ACLs into account. > > [1] : http://jackrabbit.apache.org/oak/docs/query/solr.html > > Il giorno ven 22 set 2017 alle ore 18:47 Davis, Daniel (NIH/NLM) [C] < > daniel.da...@nih.gov> ha scritto: > > > Gunalan, > > > > I think this depends on your system environment. It is a general > > "service discovery" issue. On-premise, my organization uses f5 BigIP > as a > > load balancer, and so we merely have f5 LTM direct traffic from one name > to > > any of a number of Solr instances. If they are all SolrCloud, it mostly > > just works. > > > > In AWS Cloud, the same thing could work with an Elastic Load Balancer > > (ELB) or Application Load Balancer (ALB), which is more flexible. > > > > AEM Solr Search appears to be for embedding search results into AEM, > > rather than to index AEM content in a structured manner. These are two > > different but related features. Which are you looking to do? > > > > Hope this helps, > > > > -Dan > > > > -Original Message- > > From: Gunalan V [mailto:visagan2...@gmail.com] > > Sent: Friday, September 22, 2017 7:32 AM > > To: solr-user@lucene.apache.org > > Subject: Re: AEM SOLR integaration > > > > Thank You! > > > > I was looking for some suggestions in building the SOLR infrastructure. > > > > Like how each AEM instance should point to ? Might be one AEM instance to > > one SOLR cloud (With internal zookeeper) in all environments or any > > specific architecture we need to follow while going with AEM. > > > > > > > > Thanks, > > GVK > > > > On Fri, Sep 22, 2017 at 02:58 Atita Arora wrote: > > > > > > > > https://www.slideshare.net/DEEPAKKHETAWAT/basics-of-solr-and-solr-inte > > > gration-with-aem6-61150010 > > > > > > This could probably help too along with the link Nicole shared. > > > > > > On Fri, Sep 22, 2017 at 12:28 PM, Nicole Bilić > > > > > > wrote: > > > > > > > Hi, > > > > > > > > Maybe this could help you out http://www.aemsolrsearch.com/ > > > > > > > > Regards, > > > > Nicole > > > > > > > > On Sep 22, 2017 05:41, "Gunalan V" wrote: > > > > > > > > > Hello, > > > > > > > > > > I'm looking for suggestion in building the SOLR infrastructure so > > > Kindly > > > > > let me know if anyone has integerated AEM (Adobe Experience > > > > > Manager) > > > with > > > > > SOLR? > > > > > > > > > > > > > > > > > > > > Thanks, > > > > > GVK > > > > > > > > > > > > > > >
SOLR terminology
Hello, Could someone please tell me the difference between Solr Core (core), Collections, Nodes, SolrCluster referred in SolrColud. It's bit confusing. If there are any diagrammatic representation or example please share me. Thanks!
Where the uploaded configset from SOLR into zookeeper ensemble resides?
Hello, Could you please let me know where can I find the uploaded configset from SOLR into zookeeper ensemble ? In docs it says they will "/configs/" but I'm not able to see the configs directory in zookeeper. Please let me know if I need to check somewhere else. Thanks!
Getting user-level KeeperException
Hello, Could someone please let me know what this user-level keeper exception in zookeeper mean? and How to fix the same. Thanks, GVK 2017-10-12 01:56:25,276 [myid:3] - INFO [CommitProcessor:3:ZooKeeperServer@687] - Established session 0x35f0e3edd390001 with negotiated timeout 15000 for client /10.138.66.12:33935 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 3 (n.sid), 0x0 (n.peerEpoch) LEADING (my state) 2017-10-12 01:42:01,778 [myid:2] - INFO [LearnerHandler-/10.138.66.12:47249:LearnerHandler@346] - Follower sid: 3 : info : org.apache.zookeeper.server.quorum.QuorumPeer$QuorumServer@26153a56 2017-10-12 01:42:01,781 [myid:2] - INFO [LearnerHandler-/10.138.66.12:47249:LearnerHandler@401] - Synchronizing with Follower sid: 3 maxCommittedLog=0x0 minCommittedLog=0x0 peerLastZxid=0x0 2017-10-12 01:42:01,781 [myid:2] - INFO [LearnerHandler-/10.138.66.12:47249:LearnerHandler@475] - Sending SNAP 2017-10-12 01:42:01,781 [myid:2] - INFO [LearnerHandler-/10.138.66.12:47249:LearnerHandler@499] - Sending snapshot last zxid of peer is 0x0 zxid of leader is 0x1sent zxid of db as 0x1 2017-10-12 01:42:01,789 [myid:2] - INFO [LearnerHandler-/10.138.66.12:47249:LearnerHandler@535] - Received NEWLEADER-ACK message from 3 2017-10-12 01:45:39,311 [myid:2] - INFO [SyncThread:2:FileTxnLog@203] - Creating new log file: log.10001 2017-10-12 01:45:39,645 [myid:2] - INFO [ProcessThread(sid:2 cport:-1)::PrepRequestProcessor@486] - Processed session termination for sessionid: 0x35f0e3edd39 2017-10-12 01:51:46,310 [myid:2] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2182:NIOServerCnxnFactory@192] - Accepted socket connection from /10.138.66.12:39420 2017-10-12 01:51:46,376 [myid:2] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2182:ZooKeeperServer@942] - Client attempting to establish new session at /10.138.66.12:39420 2017-10-12 01:51:46,389 [myid:2] - INFO [CommitProcessor:2:ZooKeeperServer@687] - Established session 0x25f0e3de4e5 with negotiated timeout 3 for client /10.138.66.12:39420 2017-10-12 01:51:46,470 [myid:2] - INFO [ProcessThread(sid:2 cport:-1)::PrepRequestProcessor@486] - Processed session termination for sessionid: 0x25f0e3de4e5 2017-10-12 01:51:46,474 [myid:2] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2182:NIOServerCnxn@1044] - Closed socket connection for client /10.138.66.12:39420 which had sessionid 0x25f0e3de4e5 2017-10-12 01:56:24,946 [myid:2] - INFO [ProcessThread(sid:2 cport:-1)::PrepRequestProcessor@486] - Processed session termination for sessionid: 0x15f0e3de4e1 2017-10-12 01:56:25,307 [myid:2] - INFO [ProcessThread(sid:2 cport:-1)::PrepRequestProcessor@648] - Got user-level KeeperException when processing sessionid:0x35f0e3edd390001 type:create cxid:0x7 zxid:0x1003c txntype:-1 reqpath:n/a Error Path:/overseer Error:KeeperErrorCode = NodeExists for /overseer 2017-10-12 01:56:25,315 [myid:2] - INFO [ProcessThread(sid:2 cport:-1)::PrepRequestProcessor@648] - Got user-level KeeperException when processing sessionid:0x35f0e3edd390001 type:create cxid:0xd zxid:0x1003e txntype:-1 reqpath:n/a Error Path:/overseer Error:KeeperErrorCode = NodeExists for /overseer 2017-10-12 01:56:25,316 [myid:2] - INFO [ProcessThread(sid:2 cport:-1)::PrepRequestProcessor@648] - Got user-level KeeperException when processing sessionid:0x35f0e3edd390001 type:create cxid:0xe zxid:0x1003f txntype:-1 reqpath:n/a Error Path:/overseer Error:KeeperErrorCode = NodeExists for /overseer 2017-10-12 01:56:25,318 [myid:2] - INFO [ProcessThread(sid:2 cport:-1)::PrepRequestProcessor@648] - Got user-level KeeperException when processing sessionid:0x35f0e3edd390001 type:create cxid:0x10 zxid:0x10040 txntype:-1 reqpath:n/a Error Path:/overseer Error:KeeperErrorCode = NodeExists for /overseer 2017-10-12 01:56:25,323 [myid:2] - INFO [ProcessThread(sid:2 cport:-1)::PrepRequestProcessor@648] - Got user-level KeeperException when processing sessionid:0x35f0e3edd390001 type:create cxid:0x16 zxid:0x10042 txntype:-1 reqpath:n/a Error Path:/overseer Error:KeeperErrorCode = NodeExists for /overseer 2017-10-12 01:56:25,328 [myid:2] - INFO [ProcessThread(sid:2 cport:-1)::PrepRequestProcessor@648] - Got user-level KeeperException when processing sessionid:0x35f0e3edd390001 type:create cxid:0x1c zxid:0x10044 txntype:-1 reqpath:n/a Error Path:/overseer Error:KeeperErrorCode = NodeExists for /overseer 2017-10-12 01:56:25,394 [myid:2] - INFO [ProcessThread(sid:2 cport:-1)::PrepRequestProcessor@648] - Got user-level KeeperException when processing sessionid:0x35f0e3edd390001 type:create cxid:0x51 zxid:0x1004f txntype:-1 reqpath:n/a Error Path:/overseer Error:KeeperErrorCode = NodeExists for /overseer 2017-10-12 01:56:25,399 [myid:2] - INFO [ProcessThread(sid:2 cport:-1)::PrepRequestProcessor@648] - Got user-level KeeperException when processing sessionid:0x35f0e3edd390001 type:create cxid:0x52 zxid
SOLR cores are getting locked
Hello, I'm using SOLR 6.5.1 and I have 2 SOLR nodes in SOLRCloud and created collection using the below [1] and it was created successfully during initial time but next day I tried to restart the nodes in SOLR cloud. When I start the first node the collection health is active but when I start the second node the collection is became down and could see the locks in the logs [2]. Also I have the set the solr home in zookeeper using the command [3]. Did anyone came across this issue? If so please let me know how to fix it. [1] http://localhost:8983/solr/admin/collections?action=CREATE&name=testcollection&numShards=2&replicationFactor=2&maxShardsPerNode=2&collection.configName=testconfigs [2] Caused by: org.apache.lucene.store.LockObtainFailedException: Index dir '/data01/solr/solr-6.5.1/server/solr/testcollection_shard1_replica2/data/index/' of core 'testcollection_shard1_replica2' is already locked. The most likely cause is another Solr server (or another solr core in this server) also configured to use this directory; other possible causes may be specific to lockType: native at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:713) [3] ./solr zk cp file:/data01/solr/solr-6.5.1/server/solr/solr.xml zk:/solr.xml -z 10.120.166.12:2181,10.120.166.12:2182,10.120.166.12:2183 Thanks, GVK
Re: Getting user-level KeeperException
Thanks Shawn and Amrit! On Thu, Oct 12, 2017 at 4:05 PM, Shawn Heisey wrote: > On 10/11/2017 8:22 PM, Gunalan V wrote: > >> Could someone please let me know what this user-level keeper exception in >> zookeeper mean? and How to fix the same. >> > > Those are not errors. They are INFO logs. They are not an indication of > a problem. If they were a problem, they would most likely be at the WARN > or ERROR level instead of INFO. > > The message indicates that 16 requests came in to create "/overseer" in > the zookeeper database. These requests all failed because that entry in > the database was already there. The failure is just information, not an > error. > > All of the requests indicate that they came from session ID > 0x35f0e3edd390001. An earlier entry in the log indicates that this session > is a connection from 10.138.66.12. > > The code in Solr that creates that ZK node looks like it is called in MANY > places. Once of those places is the code for leader elections. This > probably means that it gets called at least once for every shard in the > entire cloud on each Solr node startup, and could be called quite > frequently for other reasons. > > It could be argued that this code in Solr should check for the existence > of the node before it tries to create it, but as I already said, this isn't > a problem. > > Thanks, > Shawn > >
Re: SOLR cores are getting locked
Thanks Erick, I'm using the one VM where all SOLRCloud and Zookeeper nodes are running. I have two solr nodes in solrcloud. Just wanted to check do I need to create different solr home directory using -s param for each SOLR nodes ? If yes kindly share me some documentation to configure separate node directories. GVK On Thu, Oct 12, 2017 at 10:17 AM, Erick Erickson wrote: > You might be hitting SOLR-11297, which is fixed in Solr 7.0.1. The > patch should back-port cleanly to 6x versions though. > > Best, > Erick > > On Thu, Oct 12, 2017 at 12:14 AM, Gunalan V wrote: > > Hello, > > > > I'm using SOLR 6.5.1 and I have 2 SOLR nodes in SOLRCloud and created > > collection using the below [1] and it was created successfully during > > initial time but next day I tried to restart the nodes in SOLR cloud. > When > > I start the first node the collection health is active but when I start > the > > second node the collection is became down and could see the locks in the > > logs [2]. > > > > Also I have the set the solr home in zookeeper using the command [3]. > > > > Did anyone came across this issue? If so please let me know how to fix > it. > > > > > > [1] > > http://localhost:8983/solr/admin/collections?action= > CREATE&name=testcollection&numShards=2&replicationFactor= > 2&maxShardsPerNode=2&collection.configName=testconfigs > > > > > > [2] Caused by: org.apache.lucene.store.LockObtainFailedException: Index > > dir > > '/data01/solr/solr-6.5.1/server/solr/testcollection_ > shard1_replica2/data/index/' > > of core 'testcollection_shard1_replica2' is already locked. The most > likely > > cause is another Solr server (or another solr core in this server) also > > configured to use this directory; other possible causes may be specific > to > > lockType: native > > at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:713) > > > > > > [3] ./solr zk cp file:/data01/solr/solr-6.5.1/server/solr/solr.xml > > zk:/solr.xml -z 10.120.166.12:2181,10.120.166.12:2182,10.120.166.12:2183 > > > > > > > > Thanks, > > GVK >
Re: SOLR cores are getting locked
Thanks Erik! I have created separate solr home directory for each solrclound node and looks like now it's working fine. GVK On Mon, Oct 16, 2017 at 9:05 AM, Erick Erickson wrote: > bin/solr start -help > > will give you a lot of info. But yes, the -s option is what you should > use. Here's one of my batch files I used to start various cloud > examples: > > bin/solr start -c -z localhost:2181 -p 898 -s example/cloud/node1/solr > > On Sun, Oct 15, 2017 at 11:48 PM, Gunalan V wrote: > > Thanks Erick, > > > > I'm using the one VM where all SOLRCloud and Zookeeper nodes are running. > > > > I have two solr nodes in solrcloud. Just wanted to check do I need to > > create different solr home directory using -s param for each SOLR nodes ? > > > > If yes kindly share me some documentation to configure separate node > > directories. > > > > > > GVK > > > > > > On Thu, Oct 12, 2017 at 10:17 AM, Erick Erickson < > erickerick...@gmail.com> > > wrote: > > > >> You might be hitting SOLR-11297, which is fixed in Solr 7.0.1. The > >> patch should back-port cleanly to 6x versions though. > >> > >> Best, > >> Erick > >> > >> On Thu, Oct 12, 2017 at 12:14 AM, Gunalan V > wrote: > >> > Hello, > >> > > >> > I'm using SOLR 6.5.1 and I have 2 SOLR nodes in SOLRCloud and created > >> > collection using the below [1] and it was created successfully during > >> > initial time but next day I tried to restart the nodes in SOLR cloud. > >> When > >> > I start the first node the collection health is active but when I > start > >> the > >> > second node the collection is became down and could see the locks in > the > >> > logs [2]. > >> > > >> > Also I have the set the solr home in zookeeper using the command [3]. > >> > > >> > Did anyone came across this issue? If so please let me know how to fix > >> it. > >> > > >> > > >> > [1] > >> > http://localhost:8983/solr/admin/collections?action= > >> CREATE&name=testcollection&numShards=2&replicationFactor= > >> 2&maxShardsPerNode=2&collection.configName=testconfigs > >> > > >> > > >> > [2] Caused by: org.apache.lucene.store.LockObtainFailedException: > Index > >> > dir > >> > '/data01/solr/solr-6.5.1/server/solr/testcollection_ > >> shard1_replica2/data/index/' > >> > of core 'testcollection_shard1_replica2' is already locked. The most > >> likely > >> > cause is another Solr server (or another solr core in this server) > also > >> > configured to use this directory; other possible causes may be > specific > >> to > >> > lockType: native > >> > at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:713) > >> > > >> > > >> > [3] ./solr zk cp file:/data01/solr/solr-6.5.1/server/solr/solr.xml > >> > zk:/solr.xml -z 10.120.166.12:2181,10.120.166.12:2182, > 10.120.166.12:2183 > >> > > >> > > >> > > >> > Thanks, > >> > GVK > >> >
