Re: POSSIBLE RESOURCE LEAK- solr 6.6.2
It looks like it got into this state of recovery after "ZooKeeper session
was expired" and then never recovered. In what situations this warn
message "Zookeeper session was expired" can come and how does it puts into
recovery... Any suggestions ?
2018-09-19 22:48:44.945 INFO
(searcherExecutor-7-thread-1-processing-n:server62:8080_solr
x:COLL_shard8_replica2 s:shard8 c:COLL r:core_node16) [c:COLL s:shard8
r:core_node16 x:COLL_shard8_replica2] o.a.s.c.SolrCore
[COLL_shard8_replica2] Registered new searcher
Searcher@6d5ccad4[COLL_shard8_replica2]
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_8j4y(6.6.2):C879512/181359:delGen=2713)
Uninverting(_8z2y(6.6.2):C801846/163497:delGen=4342)
Uninverting(_81f9(6.6.2):C774110/378113:delGen=2398)
Uninverting(_82ll(6.6.2):C769263/348530:delGen=2427)
Uninverting(_83ne(6.6.2):C848884/94595:delGen=2131)
Uninverting(_4l73(6.6.2):C814472/317397:delGen=2514)
Uninverting(_7yqo(6.6.2):C724552/169735:delGen=3154)
Uninverting(_852r(6.6.2):C707686/75053:delGen=3037)
Uninverting(_ejht(6.6.2):C725012/321185:delGen=3588)
Uninverting(_gxvh(6.6.2):c432789/82230:delGen=1073)
Uninverting(_gblg(6.6.2):c215311/112981:delGen=1780)
Uninverting(_h8mr(6.6.2):c92526/13326:delGen=268)
Uninverting(_h71f(6.6.2):c51823/8823:delGen=371)
Uninverting(_h1p2(6.6.2):c58771/20717:delGen=617)
Uninverting(_h8uz(6.6.2):c9264/2802:delGen=143)
Uninverting(_hb7e(6.6.2):c35846/399:delGen=18)
Uninverting(_h9m4(6.6.2):c12335/1404:delGen=111)
Uninverting(_haiz(6.6.2):c9691/1786:delGen=67)
Uninverting(_halr(6.6.2):c960/62:delGen=24)
Uninverting(_hb16(6.6.2):c1196/69:delGen=12)
Uninverting(_hb5q(6.6.2):c2112/619:delGen=6)
Uninverting(_hb6u(6.6.2):c648/65:delGen=8)
Uninverting(_hb74(6.6.2):c664/35:delGen=9)
Uninverting(_hbba(6.6.2):c465/70:delGen=1)
Uninverting(_hbcf(6.6.2):c269/1:delGen=1)
Uninverting(_hba6(6.6.2):c504/26:delGen=3) Uninverting(_hbcq(6.6.2):c377)
Uninverting(_hbaq(6.6.2):c248/4:delGen=4)
Uninverting(_hbc4(6.6.2):c443/1:delGen=1)
Uninverting(_hb90(6.6.2):C875/376:delGen=1)
Uninverting(_hbbu(6.6.2):c431/1:delGen=1)
Uninverting(_hbbk(6.6.2):c262/2:delGen=2)
Uninverting(_hbcs(6.6.2):C9/1:delGen=1)
Uninverting(_hbct(6.6.2):C7/2:delGen=1)
Uninverting(_hbcu(6.6.2):C47/1:delGen=1)
Uninverting(_hbcv(6.6.2):C147/1:delGen=1) Uninverting(_hbcw(6.6.2):C1)
Uninverting(_hbcx(6.6.2):C4/2:delGen=1)
Uninverting(_hbcy(6.6.2):C6/3:delGen=1)))}
@
@
@
@
/recovery
2018-09-19 23:45:18.846 WARN
(zkCallback-5-thread-50-processing-n:server62:8080_solr-EventThread) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@28bc45b1 name:
ZooKeeperConnection
Watcher:zk1:2182,zk2:2182,zk3:2182,zk4:2182,zk5:2182/chroot got event
WatchedEvent state:Disconnected type:None path:null path: null type: None
2018-09-19 23:45:18.846 WARN
(zkCallback-5-thread-50-processing-n:server62:8080_solr-EventThread) [ ]
o.a.s.c.c.ConnectionManager zkClient has disconnected
2018-09-19 23:45:19.185 INFO (commitScheduler-11-thread-1) [c:COLL
s:shard8 r:core_node16 x:COLL_shard8_replica2] o.a.s.s.SolrIndexSearcher
Opening [Searcher@711c5774[COLL_shard8_replica2] main]
2018-09-19 23:45:19.186 INFO (commitScheduler-11-thread-1) [c:COLL
s:shard8 r:core_node16 x:COLL_shard8_replica2] o.a.s.u.DirectUpdateHandler2
end_commit_flush
2018-09-19 23:45:19.496 INFO (commitScheduler-10-thread-1) [c:COLL
s:shard8 r:core_node16 x:COLL_shard8_replica2] o.a.s.u.DirectUpdateHandler2
end_commit_flush
2018-09-19 23:45:19.506 WARN
(zkCallback-5-thread-50-processing-n:server62:8080_solr-SendThread(zk2:2182))
[ ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session
0x36591d677ff0003 has expired
2018-09-19 23:45:19.507 WARN
(zkCallback-5-thread-50-processing-n:server62:8080_solr-EventThread) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@28bc45b1 name:
ZooKeeperConnection
Watcher:zk1:2182,zk2:2182,zk3:2182,zk4:2182,zk5:2182/chroot got event
WatchedEvent state:Expired type:None path:null path: null type: None
2018-09-19 23:45:19.507 WARN
(zkCallback-5-thread-50-processing-n:server62:8080_solr-EventThread) [ ]
o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired.
Attempting to reconnect to recover relationship with ZooKeeper...
2018-09-19 23:45:19.507 WARN
(zkCallback-5-thread-50-processing-n:server62:8080_solr-EventThread) [ ]
o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new
one...
2018-09-19 23:45:19.518 INFO
(zkCallback-5-thread-50-processing-n:server62:8080_solr-EventThread) [ ]
o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished.
2018-09-19 23:45:19.518 INFO
(zkCallback-5-thread-50-processing-n:server62:8080_solr-EventThread) [ ]
o.a.s.c.ZkController ZooKeeper session re-connected ... refreshing core
states after session expiration.
2018-09-19 23:45:19.521 INFO
(zkCallback-5-thread-50-processing-n:server62:8080_solr-EventThread) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper...
Term insight with facets
Hi all. I’m trying to do some analysis on our data. Specifically hoping to see the top and bottom x% of terms in a particular field. I’d prefer to not loop through all terms by way of an updated offset if I can help it. Is there any cool way to request in the facet query a subset based on a dynamically set limit? Thanks for any thoughts! -- John Blythe
Enum Types in SolrCloud
Hi all, I am a Solr newbie and would like to understand how enum types can be added to solrcloud schema which resides in zookeeper. In the example here < https://lucene.apache.org/solr/guide/7_0/working-with-enum-fields.html#working-with-enum-fields > it relies on an enumsConfig.xml file that would further contain the definition of the enum field type. Not sure how this is done in SolrCloud. Further more it is not obvious how to add an enum type from the UI. Any help here will be appreciated. Regards Parag
Re: Solrcloud admin not asking for login
Any one have any ideas as to what could be going wrong. Thank you On Fri, Sep 21, 2018 at 10:43 PM Sushant Vengurlekar < svengurle...@curvolabs.com> wrote: > I followed the guide over here to setup basic auth for solrcloud > > http://lucene.apache.org/solr/guide/7_4/basic-authentication-plugin.html > > Our solrcloud version is 7.4. We have a 3 ensemble zookeeper with 3 solr > nodes. I restarted the zookeepers and the solr nodes but I still don't get > prompted for username & popup dialog. On my local setup when I followed the > same steps, I get a popup for login. I had followed the same steps on the > current solrcloud setup before it went into production and that time I was > getting prompted to login. > > Any ideas or hints what could be going wrong or is amiss. > > Thank you >
Re: Solrcloud admin not asking for login
Perhaps your browser remembers the password. Try to quit and start your browser and try again. Also you can go to Cloud tab under Tree menu and look at the contents of security.json - I guess it mentions solr.BasicAuthPlugin, check that the option blockUnknown is set to true, else not all requests will require authentication. Jan > 22. sep. 2018 kl. 20:11 skrev Sushant Vengurlekar > : > > Any one have any ideas as to what could be going wrong. > Thank you > > On Fri, Sep 21, 2018 at 10:43 PM Sushant Vengurlekar < > svengurle...@curvolabs.com> wrote: > >> I followed the guide over here to setup basic auth for solrcloud >> >> http://lucene.apache.org/solr/guide/7_4/basic-authentication-plugin.html >> >> Our solrcloud version is 7.4. We have a 3 ensemble zookeeper with 3 solr >> nodes. I restarted the zookeepers and the solr nodes but I still don't get >> prompted for username & popup dialog. On my local setup when I followed the >> same steps, I get a popup for login. I had followed the same steps on the >> current solrcloud setup before it went into production and that time I was >> getting prompted to login. >> >> Any ideas or hints what could be going wrong or is amiss. >> >> Thank you >>
Re: POSSIBLE RESOURCE LEAK- solr 6.6.2
I've nailed down some edge cases of ZK expiration at 7.4 under SOLR-12200.
Not sure if it may help.
On Sat, Sep 22, 2018 at 5:05 PM Susheel Kumar wrote:
> It looks like it got into this state of recovery after "ZooKeeper session
> was expired" and then never recovered. In what situations this warn
> message "Zookeeper session was expired" can come and how does it puts into
> recovery... Any suggestions ?
>
>
> 2018-09-19 22:48:44.945 INFO
> (searcherExecutor-7-thread-1-processing-n:server62:8080_solr
> x:COLL_shard8_replica2 s:shard8 c:COLL r:core_node16) [c:COLL s:shard8
> r:core_node16 x:COLL_shard8_replica2] o.a.s.c.SolrCore
> [COLL_shard8_replica2] Registered new searcher
> Searcher@6d5ccad4[COLL_shard8_replica2]
>
> main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_8j4y(6.6.2):C879512/181359:delGen=2713)
> Uninverting(_8z2y(6.6.2):C801846/163497:delGen=4342)
> Uninverting(_81f9(6.6.2):C774110/378113:delGen=2398)
> Uninverting(_82ll(6.6.2):C769263/348530:delGen=2427)
> Uninverting(_83ne(6.6.2):C848884/94595:delGen=2131)
> Uninverting(_4l73(6.6.2):C814472/317397:delGen=2514)
> Uninverting(_7yqo(6.6.2):C724552/169735:delGen=3154)
> Uninverting(_852r(6.6.2):C707686/75053:delGen=3037)
> Uninverting(_ejht(6.6.2):C725012/321185:delGen=3588)
> Uninverting(_gxvh(6.6.2):c432789/82230:delGen=1073)
> Uninverting(_gblg(6.6.2):c215311/112981:delGen=1780)
> Uninverting(_h8mr(6.6.2):c92526/13326:delGen=268)
> Uninverting(_h71f(6.6.2):c51823/8823:delGen=371)
> Uninverting(_h1p2(6.6.2):c58771/20717:delGen=617)
> Uninverting(_h8uz(6.6.2):c9264/2802:delGen=143)
> Uninverting(_hb7e(6.6.2):c35846/399:delGen=18)
> Uninverting(_h9m4(6.6.2):c12335/1404:delGen=111)
> Uninverting(_haiz(6.6.2):c9691/1786:delGen=67)
> Uninverting(_halr(6.6.2):c960/62:delGen=24)
> Uninverting(_hb16(6.6.2):c1196/69:delGen=12)
> Uninverting(_hb5q(6.6.2):c2112/619:delGen=6)
> Uninverting(_hb6u(6.6.2):c648/65:delGen=8)
> Uninverting(_hb74(6.6.2):c664/35:delGen=9)
> Uninverting(_hbba(6.6.2):c465/70:delGen=1)
> Uninverting(_hbcf(6.6.2):c269/1:delGen=1)
> Uninverting(_hba6(6.6.2):c504/26:delGen=3) Uninverting(_hbcq(6.6.2):c377)
> Uninverting(_hbaq(6.6.2):c248/4:delGen=4)
> Uninverting(_hbc4(6.6.2):c443/1:delGen=1)
> Uninverting(_hb90(6.6.2):C875/376:delGen=1)
> Uninverting(_hbbu(6.6.2):c431/1:delGen=1)
> Uninverting(_hbbk(6.6.2):c262/2:delGen=2)
> Uninverting(_hbcs(6.6.2):C9/1:delGen=1)
> Uninverting(_hbct(6.6.2):C7/2:delGen=1)
> Uninverting(_hbcu(6.6.2):C47/1:delGen=1)
> Uninverting(_hbcv(6.6.2):C147/1:delGen=1) Uninverting(_hbcw(6.6.2):C1)
> Uninverting(_hbcx(6.6.2):C4/2:delGen=1)
> Uninverting(_hbcy(6.6.2):C6/3:delGen=1)))}
> @
> @
> @
> @
> /recovery
> 2018-09-19 23:45:18.846 WARN
> (zkCallback-5-thread-50-processing-n:server62:8080_solr-EventThread) [ ]
> o.a.s.c.c.ConnectionManager Watcher
> org.apache.solr.common.cloud.ConnectionManager@28bc45b1 name:
> ZooKeeperConnection
> Watcher:zk1:2182,zk2:2182,zk3:2182,zk4:2182,zk5:2182/chroot got event
> WatchedEvent state:Disconnected type:None path:null path: null type: None
> 2018-09-19 23:45:18.846 WARN
> (zkCallback-5-thread-50-processing-n:server62:8080_solr-EventThread) [ ]
> o.a.s.c.c.ConnectionManager zkClient has disconnected
> 2018-09-19 23:45:19.185 INFO (commitScheduler-11-thread-1) [c:COLL
> s:shard8 r:core_node16 x:COLL_shard8_replica2] o.a.s.s.SolrIndexSearcher
> Opening [Searcher@711c5774[COLL_shard8_replica2] main]
> 2018-09-19 23:45:19.186 INFO (commitScheduler-11-thread-1) [c:COLL
> s:shard8 r:core_node16 x:COLL_shard8_replica2] o.a.s.u.DirectUpdateHandler2
> end_commit_flush
> 2018-09-19 23:45:19.496 INFO (commitScheduler-10-thread-1) [c:COLL
> s:shard8 r:core_node16 x:COLL_shard8_replica2] o.a.s.u.DirectUpdateHandler2
> end_commit_flush
> 2018-09-19 23:45:19.506 WARN
>
> (zkCallback-5-thread-50-processing-n:server62:8080_solr-SendThread(zk2:2182))
> [ ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session
> 0x36591d677ff0003 has expired
> 2018-09-19 23:45:19.507 WARN
> (zkCallback-5-thread-50-processing-n:server62:8080_solr-EventThread) [ ]
> o.a.s.c.c.ConnectionManager Watcher
> org.apache.solr.common.cloud.ConnectionManager@28bc45b1 name:
> ZooKeeperConnection
> Watcher:zk1:2182,zk2:2182,zk3:2182,zk4:2182,zk5:2182/chroot got event
> WatchedEvent state:Expired type:None path:null path: null type: None
> 2018-09-19 23:45:19.507 WARN
> (zkCallback-5-thread-50-processing-n:server62:8080_solr-EventThread) [ ]
> o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired.
> Attempting to reconnect to recover relationship with ZooKeeper...
> 2018-09-19 23:45:19.507 WARN
> (zkCallback-5-thread-50-processing-n:server62:8080_solr-EventThread) [ ]
> o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new
> one...
> 2018-09-19 23:45:19.518 INFO
> (zkCallback-5-thread-50-processing-n:server62:8080_solr-EventThread) [ ]
> o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished.
> 2018-09-19 23:45:19.518
Re: Nested entity unrolled record
Tanya, have you tried to designate it by rootEntity attribute? On Fri, Sep 21, 2018 at 11:06 PM Tanya Bompi wrote: > Hi, > I am wondering if with a nested entity using the DataImportHandler, if > its possible to unroll the parent document with each of the child document > as a separate entry in the index. > I am using Solr 7.4.0 version. > > For eg. > > > > cacheImpl=SortedMapBackedCache" cacheKey="RecordKey" cacheLookup="Parent. > RecordKey" > > > > > > So what i would desire the index to create multiple entries for each > Id,Name,Country combination. > Currently with the above config it combines all the entries of country > together in a single field for each Parent record. > > What would the change look like? In my scenario, the child table has > multiple fields and combining all the data together for each field is not > what I desire. > > Kindly let me know. > Thanks, > Tanya > -- Sincerely yours Mikhail Khludnev
Connect to Nutch Core with Solr
Hello there, hope all is well! I just installed both Nutch and Solr onto a Linux/Ubuntu sytems and trying to connect them through the nutch core. I notice in the wiki it said that Nutch 1.15 is compatible to Solr 7.3.0 but I installed Solr 7.4.0. How do I connect the two so I can begin my crawls? Thank ya, Timeka Cobb
