Re: Nested Docs issue

[Mikhail Khludnev]

I want to fix it in scope of https://issues.apache.org/jira/browse/SOLR-5211
and hope it will be released in 5.5.
It will *copy* $UniqueKey into "_root_" aways (regardless of having a
child).
Thus we will have $UniqueKey really unique. Overriding update will work.
But deleteByID won't work out-of-the-box for parents with child. And
deleteByQuery should be tweaked to handle blocks.
I almost done it in earlier patch.
https://issues.apache.org/jira/secure/attachment/12739197/SOLR-7606.patch
Is it really urgent for you? I'm asking because there is an easy
workaround, despite it seems odd overall.


On Thu, Dec 10, 2015 at 10:41 AM, Bogdan Marinescu <
bogdan.marine...@awinta.com> wrote:

> Any suggestions about this ?
>
>
> On 12/04/2015 08:26 AM, Bogdan Marinescu wrote:
>
>> Hi Mikhail,
>>
>> I would expect the same behaviour as for a database. Meaning if I have a
>> field declared as an uniqueKey, then there should only be one document with
>> that key, regardless if it has a child or not.
>>
>> If you add the childless document first and afterwards the child, then
>> sol'r should append the child to the already existing document (or rather
>> delete the existing one as the new one has newer data).
>>
>> It's weird because when I query sol'r for that ID, I get two documents
>> when I am only expecting one.
>> I could do a sort of 'workaround' logic where I would always pick the one
>> with children but I think better would be to fix this in sol'r.
>>
>> Regarding your issue SOLR-5211 <
>> https://issues.apache.org/jira/browse/SOLR-5211>. If a document has
>> children and you update the parent as childless or in fact delete the
>> parent altogether, then the child documents should also be deleted.
>>
>> I've faced this problem where I was just deleting the parent by id and I
>> had lots of orphan documents just laying around.
>>
>> Regards,
>> Bogdan Marinescu
>>
>> On 12/03/2015 06:26 PM, Mikhail Khludnev wrote:
>>
>>> Hello Bogdan,
>>> You described how it works now. That's how it was implemented. And I can
>>> explain why it was done so.
>>>
>>> Could you please describe the expected behavior for you?
>>>
>>> Notice, I want to enforce nested (block) behavior always in scope of
>>> https://issues.apache.org/jira/browse/SOLR-5211. So, the fields
>>> assigned to
>>> parent with child and childless single doc will be the same. So, far it's
>>> not clear how to amend  semantic.
>>>
>>> On Thu, Dec 3, 2015 at 6:35 PM, Bogdan Marinescu <
>>> bogdan.marine...@awinta.com> wrote:
>>>
>>> Hi,

 I have a problem with nested docs. If I create a document with id: 1 and
 fieldA:sometext and then add it to sol'r, I get one doc in sol'r.

 Afterwards if I add a child/nested doc to this document I additionally
 get
 a _root_:1 to the document but the problem is I now have two documents
 with
 the same ID (id: 1) in sol'r, one with _root_ and the child/nested doc
 and
 one without it.

 Any ideas why this happens?
 Any ideas how to avoid this?

 Thanks,


>>>
>>>
>>
>>
>


-- 
Sincerely yours
Mikhail Khludnev
Principal Engineer,
Grid Dynamics

Re: Nested Docs issue

[Bogdan Marinescu]

I've already implemented something similar to what you've said. Setting 
the _root_ into the document and for safety double checking that I don't 
have the same ID twice.


I'm interested in the workaround.

Thanks

On 12/10/2015 10:24 AM, Mikhail Khludnev wrote:

I want to fix it in scope of https://issues.apache.org/jira/browse/SOLR-5211
and hope it will be released in 5.5.
It will *copy* $UniqueKey into "_root_" aways (regardless of having a
child).
Thus we will have $UniqueKey really unique. Overriding update will work.
But deleteByID won't work out-of-the-box for parents with child. And
deleteByQuery should be tweaked to handle blocks.
I almost done it in earlier patch.
https://issues.apache.org/jira/secure/attachment/12739197/SOLR-7606.patch
Is it really urgent for you? I'm asking because there is an easy
workaround, despite it seems odd overall.


On Thu, Dec 10, 2015 at 10:41 AM, Bogdan Marinescu <
bogdan.marine...@awinta.com> wrote:


Any suggestions about this ?


On 12/04/2015 08:26 AM, Bogdan Marinescu wrote:


Hi Mikhail,

I would expect the same behaviour as for a database. Meaning if I have a
field declared as an uniqueKey, then there should only be one document with
that key, regardless if it has a child or not.

If you add the childless document first and afterwards the child, then
sol'r should append the child to the already existing document (or rather
delete the existing one as the new one has newer data).

It's weird because when I query sol'r for that ID, I get two documents
when I am only expecting one.
I could do a sort of 'workaround' logic where I would always pick the one
with children but I think better would be to fix this in sol'r.

Regarding your issue SOLR-5211 <
https://issues.apache.org/jira/browse/SOLR-5211>. If a document has
children and you update the parent as childless or in fact delete the
parent altogether, then the child documents should also be deleted.

I've faced this problem where I was just deleting the parent by id and I
had lots of orphan documents just laying around.

Regards,
Bogdan Marinescu

On 12/03/2015 06:26 PM, Mikhail Khludnev wrote:


Hello Bogdan,
You described how it works now. That's how it was implemented. And I can
explain why it was done so.

Could you please describe the expected behavior for you?

Notice, I want to enforce nested (block) behavior always in scope of
https://issues.apache.org/jira/browse/SOLR-5211. So, the fields
assigned to
parent with child and childless single doc will be the same. So, far it's
not clear how to amend  semantic.

On Thu, Dec 3, 2015 at 6:35 PM, Bogdan Marinescu <
bogdan.marine...@awinta.com> wrote:

Hi,

I have a problem with nested docs. If I create a document with id: 1 and
fieldA:sometext and then add it to sol'r, I get one doc in sol'r.

Afterwards if I add a child/nested doc to this document I additionally
get
a _root_:1 to the document but the problem is I now have two documents
with
the same ID (id: 1) in sol'r, one with _root_ and the child/nested doc
and
one without it.

Any ideas why this happens?
Any ideas how to avoid this?

Thanks,

Re: Nested Docs issue

[Mikhail Khludnev]

On Thu, Dec 10, 2015 at 12:38 PM, Bogdan Marinescu <
bogdan.marine...@awinta.com> wrote:

> I'm interested in the workaround.


If you add the childless document first and afterwards the child, then
> sol'r should append the child to the already existing document (or rather
> delete the existing one as the new one has newer data).
>
I'd suggest to add empty child doc into every empty parent.

I've faced this problem where I was just deleting the parent by id and I
> had lots of orphan documents just laying around.
>
deleteByQuery should be amended :999 should be turned to
_root_:999, the you need to do instead of deleteById.
If you have deleteByQuery(Brand:Nike) (matching parents), it needs to be
turned to deleteByQuery(Brand:Nike {!child of=parent:true}Brand:Nike)

-- 
Sincerely yours
Mikhail Khludnev
Principal Engineer,
Grid Dynamics

Re: Nested Docs issue

[Bogdan Marinescu]

Problem is I was manually exporting data from a database and converting 
it into sol'r docs and writing it to sol'r. No checks were performed if 
the converted doc had children or not so I can't really tell if I was 
doing it in this order or reversed (first the parent and child and then 
only the childless parent).


I'm not entirely sure that sol'r would append the child to the already 
existing parent but I can check that out.


As for the delete, I'm using deleteByQuery(_root_:parentID). This works 
fine because the id of the parent is placed in the _root_ of the children.


I wouldn't use the child query as that performs a ToBlockJoinQuery and 
I've had problems with that before (if you recall SOLR-6700 
)


I'll try your workaround suggestion and hopefully this will be fixed so 
I don't have to worry about the order I add the parents and children to 
sol'r :)


Thanks


On 12/10/2015 11:14 AM, Mikhail Khludnev wrote:

On Thu, Dec 10, 2015 at 12:38 PM, Bogdan Marinescu <
bogdan.marine...@awinta.com> wrote:


I'm interested in the workaround.


If you add the childless document first and afterwards the child, then

sol'r should append the child to the already existing document (or rather
delete the existing one as the new one has newer data).


I'd suggest to add empty child doc into every empty parent.

I've faced this problem where I was just deleting the parent by id and I

had lots of orphan documents just laying around.


deleteByQuery should be amended :999 should be turned to
_root_:999, the you need to do instead of deleteById.
If you have deleteByQuery(Brand:Nike) (matching parents), it needs to be
turned to deleteByQuery(Brand:Nike {!child of=parent:true}Brand:Nike)

Re: Nested Docs issue

[Mikhail Khludnev]

On Thu, Dec 10, 2015 at 1:26 PM, Bogdan Marinescu <
bogdan.marine...@awinta.com> wrote:

> Problem is I was manually exporting data from a database and converting it
> into sol'r docs and writing it to sol'r. No checks were performed if the
> converted doc had children or not so I can't really tell if I was doing it
> in this order or reversed (first the parent and child and then only the
> childless parent).
>

Empty child doc can be added into childless parent by
http://wiki.apache.org/solr/ScriptUpdateProcessor.


>
> I'm not entirely sure that sol'r would append the child to the already
> existing parent but I can check that out.
>
> As for the delete, I'm using deleteByQuery(_root_:parentID). This works
> fine because the id of the parent is placed in the _root_ of the children.
>
> I wouldn't use the child query as that performs a ToBlockJoinQuery and
> I've had problems with that before (if you recall SOLR-6700 <
> https://issues.apache.org/jira/browse/SOLR-6700>)
>
> I'll try your workaround suggestion and hopefully this will be fixed so I
> don't have to worry about the order I add the parents and children to sol'r
> :)
>
> Thanks
>
>
>
> On 12/10/2015 11:14 AM, Mikhail Khludnev wrote:
>
>> On Thu, Dec 10, 2015 at 12:38 PM, Bogdan Marinescu <
>> bogdan.marine...@awinta.com> wrote:
>>
>> I'm interested in the workaround.
>>>
>>
>> If you add the childless document first and afterwards the child, then
>>
>>> sol'r should append the child to the already existing document (or rather
>>> delete the existing one as the new one has newer data).
>>>
>>> I'd suggest to add empty child doc into every empty parent.
>>
>> I've faced this problem where I was just deleting the parent by id and I
>>
>>> had lots of orphan documents just laying around.
>>>
>>> deleteByQuery should be amended :999 should be turned to
>> _root_:999, the you need to do instead of deleteById.
>> If you have deleteByQuery(Brand:Nike) (matching parents), it needs to be
>> turned to deleteByQuery(Brand:Nike {!child of=parent:true}Brand:Nike)
>>
>>
>


-- 
Sincerely yours
Mikhail Khludnev
Principal Engineer,
Grid Dynamics

Re: Nested Docs issue

[Bogdan Marinescu]

So you mean to write my own script update processor which would do that ?


On 12/10/2015 11:51 AM, Mikhail Khludnev wrote:

On Thu, Dec 10, 2015 at 1:26 PM, Bogdan Marinescu <
bogdan.marine...@awinta.com> wrote:


Problem is I was manually exporting data from a database and converting it
into sol'r docs and writing it to sol'r. No checks were performed if the
converted doc had children or not so I can't really tell if I was doing it
in this order or reversed (first the parent and child and then only the
childless parent).


Empty child doc can be added into childless parent by
http://wiki.apache.org/solr/ScriptUpdateProcessor.



I'm not entirely sure that sol'r would append the child to the already
existing parent but I can check that out.

As for the delete, I'm using deleteByQuery(_root_:parentID). This works
fine because the id of the parent is placed in the _root_ of the children.

I wouldn't use the child query as that performs a ToBlockJoinQuery and
I've had problems with that before (if you recall SOLR-6700 <
https://issues.apache.org/jira/browse/SOLR-6700>)

I'll try your workaround suggestion and hopefully this will be fixed so I
don't have to worry about the order I add the parents and children to sol'r
:)

Thanks



On 12/10/2015 11:14 AM, Mikhail Khludnev wrote:


On Thu, Dec 10, 2015 at 12:38 PM, Bogdan Marinescu <
bogdan.marine...@awinta.com> wrote:

I'm interested in the workaround.
If you add the childless document first and afterwards the child, then


sol'r should append the child to the already existing document (or rather
delete the existing one as the new one has newer data).

I'd suggest to add empty child doc into every empty parent.

I've faced this problem where I was just deleting the parent by id and I


had lots of orphan documents just laying around.

deleteByQuery should be amended :999 should be turned to

_root_:999, the you need to do instead of deleteById.
If you have deleteByQuery(Brand:Nike) (matching parents), it needs to be
turned to deleteByQuery(Brand:Nike {!child of=parent:true}Brand:Nike)

Re: Nested Docs issue

[Mikhail Khludnev]

It seems so.

On Thu, Dec 10, 2015 at 2:06 PM, Bogdan Marinescu <
bogdan.marine...@awinta.com> wrote:

> So you mean to write my own script update processor which would do that ?
>
>
>
> On 12/10/2015 11:51 AM, Mikhail Khludnev wrote:
>
>> On Thu, Dec 10, 2015 at 1:26 PM, Bogdan Marinescu <
>> bogdan.marine...@awinta.com> wrote:
>>
>> Problem is I was manually exporting data from a database and converting it
>>> into sol'r docs and writing it to sol'r. No checks were performed if the
>>> converted doc had children or not so I can't really tell if I was doing
>>> it
>>> in this order or reversed (first the parent and child and then only the
>>> childless parent).
>>>
>>> Empty child doc can be added into childless parent by
>> http://wiki.apache.org/solr/ScriptUpdateProcessor.
>>
>>
>> I'm not entirely sure that sol'r would append the child to the already
>>> existing parent but I can check that out.
>>>
>>> As for the delete, I'm using deleteByQuery(_root_:parentID). This works
>>> fine because the id of the parent is placed in the _root_ of the
>>> children.
>>>
>>> I wouldn't use the child query as that performs a ToBlockJoinQuery and
>>> I've had problems with that before (if you recall SOLR-6700 <
>>> https://issues.apache.org/jira/browse/SOLR-6700>)
>>>
>>> I'll try your workaround suggestion and hopefully this will be fixed so I
>>> don't have to worry about the order I add the parents and children to
>>> sol'r
>>> :)
>>>
>>> Thanks
>>>
>>>
>>>
>>> On 12/10/2015 11:14 AM, Mikhail Khludnev wrote:
>>>
>>> On Thu, Dec 10, 2015 at 12:38 PM, Bogdan Marinescu <
 bogdan.marine...@awinta.com> wrote:

 I'm interested in the workaround.
 If you add the childless document first and afterwards the child, then

 sol'r should append the child to the already existing document (or
> rather
> delete the existing one as the new one has newer data).
>
> I'd suggest to add empty child doc into every empty parent.
>
 I've faced this problem where I was just deleting the parent by id and I

 had lots of orphan documents just laying around.
>
> deleteByQuery should be amended :999 should be turned to
>
 _root_:999, the you need to do instead of deleteById.
 If you have deleteByQuery(Brand:Nike) (matching parents), it needs to be
 turned to deleteByQuery(Brand:Nike {!child of=parent:true}Brand:Nike)



>>
>


-- 
Sincerely yours
Mikhail Khludnev
Principal Engineer,
Grid Dynamics

Re: Re: secure solr 5.3.1

[kostali hassan]

Iam looking to secure my solr runing in standalone Mode within windows ;the
kerberose plugin is only able to secure solr in standalone mode. how create
principale and here password.

2015-12-10 9:35 GMT+00:00 kostali hassan :

> Iam looking to secure my solr runing in standalone Mode the kerberose
> plugin is only able to secure solr in standalone mode.
>
> 2015-12-09 23:00 GMT+00:00 kostali hassan :
>
>> -- Message transféré --
>> De : "Ishan Chattopadhyaya" 
>> Date : 9 déc. 2015 19:39
>> Objet : Re: secure solr 5.3.1
>> À : 
>> Cc :
>>
>> I don't have much personal experience with setting up a kerberos server on
>> a Windows machine, but I remember things being painful when I tried and
>> failed once. If you have an option to use a VM, I suggest try setting up
>> the KDC in a GNU/Linux VM (through VirtualBox).
>> In that case, make sure the Windows host is able to access the ports of
>> the
>> guest machine. Better still, setup GNU/Linux VMs for Solr too.
>>
>> On Thu, Dec 10, 2015 at 12:39 AM, kostali hassan <
>> med.has.kost...@gmail.com>
>> wrote:
>>
>> > I install MIT Kerberos for Windows 4.0.1
>> >
>> > 2015-12-09 19:05 GMT+00:00 Ishan Chattopadhyaya <
>> ichattopadhy...@gmail.com
>> > >:
>> >
>> > > What exactly is your confusion? Do you have access to a KDC?
>> > >
>> > > Briefly:
>> > > Login to your KDC server, do a kadmin.local:
>> > > Then,
>> > > addprinc HTTP/192.168.0.107
>> > > ktadd -k /tmp/107.keytab HTTP/192.168.0.107
>> > >
>> > > Then copy the keytab file to your solr node to the appropriate places.
>> > >
>> > >
>> > > On Thu, Dec 10, 2015 at 12:08 AM, kostali hassan <
>> > > med.has.kost...@gmail.com>
>> > > wrote:
>> > >
>> > > > I folow this two resources and Iam stuck in
>> > > >
>> > > >- Create service principals and keytab files.
>> > > >
>> > > >
>> > > > 2015-12-09 18:06 GMT+00:00 Ishan Chattopadhyaya <
>> > > ichattopadhy...@gmail.com
>> > > > >:
>> > > >
>> > > > > The kerberos plugin is available for use with Solr out of the box.
>> > The
>> > > > two
>> > > > > resources which Bosco mentioned should get you up and running.
>> > > > >
>> > > > > On Wed, Dec 9, 2015 at 11:34 PM, Don Bosco Durai <
>> bo...@apache.org>
>> > > > wrote:
>> > > > >
>> > > > > > There are two resources available:
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> https://cwiki.apache.org/confluence/display/solr/Kerberos+Authentication+Plugin
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> https://cwiki.apache.org/confluence/display/RANGER/How+to+configure+Solr+Cloud+with+Kerberos+for+Ranger+0.5
>> > > > > >
>> > > > > >
>> > > > > > Bosco
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > > On 12/9/15, 3:14 AM, "kostali hassan" <
>> med.has.kost...@gmail.com>
>> > > > wrote:
>> > > > > >
>> > > > > > >how I setting up Solr to use Kerberos ? i have to dowload
>> kerberos
>> > > and
>> > > > > put
>> > > > > > >the plug-in implementation in the classpath(/server/solr).
>> > > > > > >
>> > > > > > >2015-12-08 22:19 GMT+00:00 Ishan Chattopadhyaya <
>> > > > > > ichattopadhy...@gmail.com>:
>> > > > > > >
>> > > > > > >> Right, as Bosco said, this has been tested well and
>> supported on
>> > > > > > SolrCloud.
>> > > > > > >> It should be possible to run it in standalone mode, but it is
>> > not
>> > > > > > something
>> > > > > > >> that has been well test yet.
>> > > > > > >>
>> > > > > > >> On Tue, Dec 8, 2015 at 11:02 PM, Don Bosco Durai <
>> > > bo...@apache.org>
>> > > > > > wrote:
>> > > > > > >>
>> > > > > > >> > It was tested and meant to work only in SolrCloud mode.
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> > On Tue, Dec 8, 2015 at 9:30 AM -0800, "kostali hassan" <
>> > > > > > >> > med.has.kost...@gmail.com> wrote:
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> >- Kerberos authentication
>> > > > > > >> >:
>> > > > > > >> >work in SolrCloud or standalone mode but the
>> documentation
>> > is
>> > > > not
>> > > > > > >> clear
>> > > > > > >> >-
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >>
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> https://cwiki.apache.org/confluence/display/solr/Kerberos+Authentication+Plugin?focusedCommentId=61331746#comment-61331746
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> > 2015-12-08 17:14 GMT+00:00 Don Bosco Durai :
>> > > > > > >> >
>> > > > > > >> > > Not sure exactly what you mean here. Even if you are
>> running
>> > > in
>> > > > > > >> > SolrCloud,
>> > > > > > >> > > you can access it using URL. So there won't be any
>> change on
>> > > the
>> > > > > > client
>> > > > > > >> > > side.
>> > > > > > >> > > Bosco
>> > > > > > >> > >
>> > > > > > >> > >
>> > > > > > >> > >
>> > > > > > >> > >

Re: Re: secure solr 5.3.1

[Ishan Chattopadhyaya]

1. Please set up your Kerberos server. (KDC)
2. Create principals (usernames) and keytab files as mentioned in the
document.
3. Copy the keytab files to your Solr machines
4. Mention all parameters in your bin/solr.in.sh file.
5. Start Solr using a separate parameter,
"-DauthenticationPlugin=org.apache.solr.security.KerberosPlugin". You can
put this parameter also in your bin/solr.in.sh file.

All the best,
Regards,
Ishan


On Thu, Dec 10, 2015 at 5:19 PM, kostali hassan 
wrote:

> Iam looking to secure my solr runing in standalone Mode within windows ;the
> kerberose plugin is only able to secure solr in standalone mode. how create
> principale and here password.
>
> 2015-12-10 9:35 GMT+00:00 kostali hassan :
>
> > Iam looking to secure my solr runing in standalone Mode the kerberose
> > plugin is only able to secure solr in standalone mode.
> >
> > 2015-12-09 23:00 GMT+00:00 kostali hassan :
> >
> >> -- Message transféré --
> >> De : "Ishan Chattopadhyaya" 
> >> Date : 9 déc. 2015 19:39
> >> Objet : Re: secure solr 5.3.1
> >> À : 
> >> Cc :
> >>
> >> I don't have much personal experience with setting up a kerberos server
> on
> >> a Windows machine, but I remember things being painful when I tried and
> >> failed once. If you have an option to use a VM, I suggest try setting up
> >> the KDC in a GNU/Linux VM (through VirtualBox).
> >> In that case, make sure the Windows host is able to access the ports of
> >> the
> >> guest machine. Better still, setup GNU/Linux VMs for Solr too.
> >>
> >> On Thu, Dec 10, 2015 at 12:39 AM, kostali hassan <
> >> med.has.kost...@gmail.com>
> >> wrote:
> >>
> >> > I install MIT Kerberos for Windows 4.0.1
> >> >
> >> > 2015-12-09 19:05 GMT+00:00 Ishan Chattopadhyaya <
> >> ichattopadhy...@gmail.com
> >> > >:
> >> >
> >> > > What exactly is your confusion? Do you have access to a KDC?
> >> > >
> >> > > Briefly:
> >> > > Login to your KDC server, do a kadmin.local:
> >> > > Then,
> >> > > addprinc HTTP/192.168.0.107
> >> > > ktadd -k /tmp/107.keytab HTTP/192.168.0.107
> >> > >
> >> > > Then copy the keytab file to your solr node to the appropriate
> places.
> >> > >
> >> > >
> >> > > On Thu, Dec 10, 2015 at 12:08 AM, kostali hassan <
> >> > > med.has.kost...@gmail.com>
> >> > > wrote:
> >> > >
> >> > > > I folow this two resources and Iam stuck in
> >> > > >
> >> > > >- Create service principals and keytab files.
> >> > > >
> >> > > >
> >> > > > 2015-12-09 18:06 GMT+00:00 Ishan Chattopadhyaya <
> >> > > ichattopadhy...@gmail.com
> >> > > > >:
> >> > > >
> >> > > > > The kerberos plugin is available for use with Solr out of the
> box.
> >> > The
> >> > > > two
> >> > > > > resources which Bosco mentioned should get you up and running.
> >> > > > >
> >> > > > > On Wed, Dec 9, 2015 at 11:34 PM, Don Bosco Durai <
> >> bo...@apache.org>
> >> > > > wrote:
> >> > > > >
> >> > > > > > There are two resources available:
> >> > > > > >
> >> > > > > >
> >> > > > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> https://cwiki.apache.org/confluence/display/solr/Kerberos+Authentication+Plugin
> >> > > > > >
> >> > > > > >
> >> > > > > >
> >> > > > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> https://cwiki.apache.org/confluence/display/RANGER/How+to+configure+Solr+Cloud+with+Kerberos+for+Ranger+0.5
> >> > > > > >
> >> > > > > >
> >> > > > > > Bosco
> >> > > > > >
> >> > > > > >
> >> > > > > >
> >> > > > > >
> >> > > > > >
> >> > > > > > On 12/9/15, 3:14 AM, "kostali hassan" <
> >> med.has.kost...@gmail.com>
> >> > > > wrote:
> >> > > > > >
> >> > > > > > >how I setting up Solr to use Kerberos ? i have to dowload
> >> kerberos
> >> > > and
> >> > > > > put
> >> > > > > > >the plug-in implementation in the classpath(/server/solr).
> >> > > > > > >
> >> > > > > > >2015-12-08 22:19 GMT+00:00 Ishan Chattopadhyaya <
> >> > > > > > ichattopadhy...@gmail.com>:
> >> > > > > > >
> >> > > > > > >> Right, as Bosco said, this has been tested well and
> >> supported on
> >> > > > > > SolrCloud.
> >> > > > > > >> It should be possible to run it in standalone mode, but it
> is
> >> > not
> >> > > > > > something
> >> > > > > > >> that has been well test yet.
> >> > > > > > >>
> >> > > > > > >> On Tue, Dec 8, 2015 at 11:02 PM, Don Bosco Durai <
> >> > > bo...@apache.org>
> >> > > > > > wrote:
> >> > > > > > >>
> >> > > > > > >> > It was tested and meant to work only in SolrCloud mode.
> >> > > > > > >> >
> >> > > > > > >> >
> >> > > > > > >> >
> >> > > > > > >> >
> >> > > > > > >> >
> >> > > > > > >> >
> >> > > > > > >> > On Tue, Dec 8, 2015 at 9:30 AM -0800, "kostali hassan" <
> >> > > > > > >> > med.has.kost...@gmail.com> wrote:
> >> > > > > > >> >
> >> > > > > > >> >
> >> > > > > > >> >
> >> > > > > > >> >
> >> > > > > > >> >
> >> > > > > > >> >
> >> > > > > > >> >
> >> > > > > > >> >
> >> > > > > > >> >
> >> > > > > > >> >
> >> > > > > > >> >- Kerberos authentication
> >> > > > > > >> >:
> >> > > > > > >> >work in SolrCloud or standalone mode but the
> >> documenta

Re: Increasing Solr5 time out from 30 seconds while starting solr

[Debraj Manna]

The logs that I am seeing:-

jabong@jabong1143:~/Downloads/software/dev/solr5$ sudo bin/solr start -p

[sudo] password for jabong:
Waiting to see Solr listening on port  [-]  Still not seeing Solr
listening on  after 30 seconds!
INFO  - 2015-12-10 15:37:16.816; [   ]
org.apache.solr.core.SolrResourceLoader; Adding
'file:/home/jabong/Downloads/software/dev/solr5/contrib/clustering/lib/jackson-core-asl-1.9.13.jar'
to classloader
INFO  - 2015-12-10 15:37:16.817; [   ]
org.apache.solr.core.SolrResourceLoader; Adding
'file:/home/jabong/Downloads/software/dev/solr5/contrib/clustering/lib/attributes-binder-1.2.1.jar'
to classloader
INFO  - 2015-12-10 15:37:16.817; [   ]
org.apache.solr.core.SolrResourceLoader; Adding
'file:/home/jabong/Downloads/software/dev/solr5/contrib/clustering/lib/jackson-mapper-asl-1.9.13.jar'
to classloader
WARN  - 2015-12-10 15:37:16.817; [   ]
org.apache.solr.core.SolrResourceLoader; Can't find (or read) directory to
add to classloader: /home/jabong/Downloads/software/dev/solr5/dist/
(resolved as: /home/jabong/Downloads/software/dev/solr5/dist).
INFO  - 2015-12-10 15:37:16.834; [   ]
org.apache.solr.core.SolrResourceLoader; Adding
'file:/home/jabong/Downloads/software/dev/solr5/contrib/langid/lib/langdetect-1.1-20120112.jar'
to classloader
INFO  - 2015-12-10 15:37:16.834; [   ]
org.apache.solr.core.SolrResourceLoader; Adding
'file:/home/jabong/Downloads/software/dev/solr5/contrib/langid/lib/langdetect-1.1-20120112.jar'
to classloader
INFO  - 2015-12-10 15:37:16.835; [   ]
org.apache.solr.core.SolrResourceLoader; Adding
'file:/home/jabong/Downloads/software/dev/solr5/contrib/langid/lib/jsonic-1.2.7.jar'
to classloader
INFO  - 2015-12-10 15:37:16.835; [   ]
org.apache.solr.core.SolrResourceLoader; Adding
'file:/home/jabong/Downloads/software/dev/solr5/contrib/langid/lib/jsonic-1.2.7.jar'
to classloader
WARN  - 2015-12-10 15:37:16.835; [   ]
org.apache.solr.core.SolrResourceLoader; Can't find (or read) directory to
add to classloader: /home/jabong/Downloads/software/dev/solr5/dist/
(resolved as: /home/jabong/Downloads/software/dev/solr5/dist).
WARN  - 2015-12-10 15:37:16.835; [   ]
org.apache.solr.core.SolrResourceLoader; Can't find (or read) directory to
add to classloader: /home/jabong/Downloads/software/dev/solr5/dist/
(resolved as: /home/jabong/Downloads/software/dev/solr5/dist).
INFO  - 2015-12-10 15:37:16.842; [   ]
org.apache.solr.core.SolrResourceLoader; Adding
'file:/home/jabong/Downloads/software/dev/solr5/contrib/velocity/lib/commons-beanutils-1.8.3.jar'
to classloader
INFO  - 2015-12-10 15:37:16.842; [   ]
org.apache.solr.core.SolrResourceLoader; Adding
'file:/home/jabong/Downloads/software/dev/solr5/contrib/velocity/lib/commons-beanutils-1.8.3.jar'
to classloader
INFO  - 2015-12-10 15:37:16.842; [   ]
org.apache.solr.core.SolrResourceLoader; Adding
'file:/home/jabong/Downloads/software/dev/solr5/contrib/velocity/lib/velocity-1.7.jar'
to classloader
INFO  - 2015-12-10 15:37:16.842; [   ]
org.apache.solr.core.SolrResourceLoader; Adding
'file:/home/jabong/Downloads/software/dev/solr5/contrib/velocity/lib/velocity-1.7.jar'
to classloader
INFO  - 2015-12-10 15:37:16.843; [   ]
org.apache.solr.core.SolrResourceLoader; Adding
'file:/home/jabong/Downloads/software/dev/solr5/contrib/velocity/lib/commons-collections-3.2.1.jar'
to classloader
INFO  - 2015-12-10 15:37:16.843; [   ]
org.apache.solr.core.SolrResourceLoader; Adding
'file:/home/jabong/Downloads/software/dev/solr5/contrib/velocity/lib/commons-collections-3.2.1.jar'
to classloader
INFO  - 2015-12-10 15:37:16.843; [   ]
org.apache.solr.core.SolrResourceLoader; Adding
'file:/home/jabong/Downloads/software/dev/solr5/contrib/velocity/lib/velocity-tools-2.0.jar'
to classloader
WARN  - 2015-12-10 15:37:16.844; [   ]
org.apache.solr.core.SolrResourceLoader; Can't find (or read) directory to
add to classloader: /home/jabong/Downloads/software/dev/solr5/dist/
(resolved as: /home/jabong/Downloads/software/dev/solr5/dist).
INFO  - 2015-12-10 15:37:16.847; [   ]
org.apache.solr.core.SolrResourceLoader; Adding
'file:/home/jabong/Downloads/software/dev/solr5/contrib/velocity/lib/velocity-tools-2.0.jar'
to classloader
WARN  - 2015-12-10 15:37:16.848; [   ]
org.apache.solr.core.SolrResourceLoader; Can't find (or read) directory to
add to classloader: /home/jabong/Downloads/software/dev/solr5/dist/
(resolved as: /home/jabong/Downloads/software/dev/solr5/dist).
INFO  - 2015-12-10 15:37:17.476; [   ]
org.apache.solr.update.SolrIndexConfig; IndexWriter infoStream solr logging
is enabled
INFO  - 2015-12-10 15:37:17.482; [   ]
org.apache.solr.update.SolrIndexConfig; IndexWriter infoStream solr logging
is enabled
INFO  - 2015-12-10 15:37:17.485; [   ] org.apache.solr.core.SolrConfig;
Using Lucene MatchVersion: 5.0.0
INFO  - 2015-12-10 15:37:17.488; [   ] org.apache.solr.core.SolrConfig;
Using Lucene MatchVersion: 5.2.1
INFO  - 2015-12-10 15:37:17.702; [   ] org.apache.solr.core.SolrConfig;
Loaded SolrConfig: solrconfig.xml
INFO  - 2015-12

Re: Re: secure solr 5.3.1

[kostali hassan]

to setup kerberos in windows :

https://github.com/krb5/krb5/blob/master/src/windows/README

2015-12-10 12:10 GMT+00:00 Ishan Chattopadhyaya :

> 1. Please set up your Kerberos server. (KDC)
> 2. Create principals (usernames) and keytab files as mentioned in the
> document.
> 3. Copy the keytab files to your Solr machines
> 4. Mention all parameters in your bin/solr.in.sh file.
> 5. Start Solr using a separate parameter,
> "-DauthenticationPlugin=org.apache.solr.security.KerberosPlugin". You can
> put this parameter also in your bin/solr.in.sh file.
>
> All the best,
> Regards,
> Ishan
>
>
> On Thu, Dec 10, 2015 at 5:19 PM, kostali hassan  >
> wrote:
>
> > Iam looking to secure my solr runing in standalone Mode within windows
> ;the
> > kerberose plugin is only able to secure solr in standalone mode. how
> create
> > principale and here password.
> >
> > 2015-12-10 9:35 GMT+00:00 kostali hassan :
> >
> > > Iam looking to secure my solr runing in standalone Mode the kerberose
> > > plugin is only able to secure solr in standalone mode.
> > >
> > > 2015-12-09 23:00 GMT+00:00 kostali hassan :
> > >
> > >> -- Message transféré --
> > >> De : "Ishan Chattopadhyaya" 
> > >> Date : 9 déc. 2015 19:39
> > >> Objet : Re: secure solr 5.3.1
> > >> À : 
> > >> Cc :
> > >>
> > >> I don't have much personal experience with setting up a kerberos
> server
> > on
> > >> a Windows machine, but I remember things being painful when I tried
> and
> > >> failed once. If you have an option to use a VM, I suggest try setting
> up
> > >> the KDC in a GNU/Linux VM (through VirtualBox).
> > >> In that case, make sure the Windows host is able to access the ports
> of
> > >> the
> > >> guest machine. Better still, setup GNU/Linux VMs for Solr too.
> > >>
> > >> On Thu, Dec 10, 2015 at 12:39 AM, kostali hassan <
> > >> med.has.kost...@gmail.com>
> > >> wrote:
> > >>
> > >> > I install MIT Kerberos for Windows 4.0.1
> > >> >
> > >> > 2015-12-09 19:05 GMT+00:00 Ishan Chattopadhyaya <
> > >> ichattopadhy...@gmail.com
> > >> > >:
> > >> >
> > >> > > What exactly is your confusion? Do you have access to a KDC?
> > >> > >
> > >> > > Briefly:
> > >> > > Login to your KDC server, do a kadmin.local:
> > >> > > Then,
> > >> > > addprinc HTTP/192.168.0.107
> > >> > > ktadd -k /tmp/107.keytab HTTP/192.168.0.107
> > >> > >
> > >> > > Then copy the keytab file to your solr node to the appropriate
> > places.
> > >> > >
> > >> > >
> > >> > > On Thu, Dec 10, 2015 at 12:08 AM, kostali hassan <
> > >> > > med.has.kost...@gmail.com>
> > >> > > wrote:
> > >> > >
> > >> > > > I folow this two resources and Iam stuck in
> > >> > > >
> > >> > > >- Create service principals and keytab files.
> > >> > > >
> > >> > > >
> > >> > > > 2015-12-09 18:06 GMT+00:00 Ishan Chattopadhyaya <
> > >> > > ichattopadhy...@gmail.com
> > >> > > > >:
> > >> > > >
> > >> > > > > The kerberos plugin is available for use with Solr out of the
> > box.
> > >> > The
> > >> > > > two
> > >> > > > > resources which Bosco mentioned should get you up and running.
> > >> > > > >
> > >> > > > > On Wed, Dec 9, 2015 at 11:34 PM, Don Bosco Durai <
> > >> bo...@apache.org>
> > >> > > > wrote:
> > >> > > > >
> > >> > > > > > There are two resources available:
> > >> > > > > >
> > >> > > > > >
> > >> > > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> https://cwiki.apache.org/confluence/display/solr/Kerberos+Authentication+Plugin
> > >> > > > > >
> > >> > > > > >
> > >> > > > > >
> > >> > > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> https://cwiki.apache.org/confluence/display/RANGER/How+to+configure+Solr+Cloud+with+Kerberos+for+Ranger+0.5
> > >> > > > > >
> > >> > > > > >
> > >> > > > > > Bosco
> > >> > > > > >
> > >> > > > > >
> > >> > > > > >
> > >> > > > > >
> > >> > > > > >
> > >> > > > > > On 12/9/15, 3:14 AM, "kostali hassan" <
> > >> med.has.kost...@gmail.com>
> > >> > > > wrote:
> > >> > > > > >
> > >> > > > > > >how I setting up Solr to use Kerberos ? i have to dowload
> > >> kerberos
> > >> > > and
> > >> > > > > put
> > >> > > > > > >the plug-in implementation in the classpath(/server/solr).
> > >> > > > > > >
> > >> > > > > > >2015-12-08 22:19 GMT+00:00 Ishan Chattopadhyaya <
> > >> > > > > > ichattopadhy...@gmail.com>:
> > >> > > > > > >
> > >> > > > > > >> Right, as Bosco said, this has been tested well and
> > >> supported on
> > >> > > > > > SolrCloud.
> > >> > > > > > >> It should be possible to run it in standalone mode, but
> it
> > is
> > >> > not
> > >> > > > > > something
> > >> > > > > > >> that has been well test yet.
> > >> > > > > > >>
> > >> > > > > > >> On Tue, Dec 8, 2015 at 11:02 PM, Don Bosco Durai <
> > >> > > bo...@apache.org>
> > >> > > > > > wrote:
> > >> > > > > > >>
> > >> > > > > > >> > It was tested and meant to work only in SolrCloud mode.
> > >> > > > > > >> >
> > >> > > > > > >> >
> > >> > > > > > >> >
> > >> > > > > > >> >
> > >> > > > > > >> >
> > >> > > > > > >> >
> > >> > > > > > >> > On Tu

Re: Solr Integration tests

[Shalin Shekhar Mangar]

Did you try using the MiniSolrCloudCluster helper class?

On Thu, Dec 10, 2015 at 11:27 AM, Sathyakumar Seshachalam
 wrote:
> Am giving up on this, and resorting to my own test framework using
> JettySolrRunner Before a Suite runs.
>
> Facing quite a few hurdles -
> 1. When I run tests from IDE I get, java.lang.AssertionError: fix your
> classpath to have tests-framework.jar before lucene-core.jar
> 2. Gradle "test" works Ok, But getSolrHome in AbstractSolrTestCase is
> never called
> 3. The code imposes a class hierarchy on the test classes
> 4. Not enough documentation / samples etc.,
>
>
>
>
> On 10/12/15, 10:51 AM, "Sathyakumar Seshachalam"
>  wrote:
>
>>Hello Andrea,
>>
>>Thanks for the link. Am running 4.10.3. However the test-framework classes
>>haven¹t changed much. I will give this a try.
>>
>>
>>On 09/12/15, 4:11 PM, "Andrea Gazzarini"  wrote:
>>
>>>Hi Sathyakumar,
>>>check this post [1] (assuming you're using Solr 5.x), maybe it can help.
>>>
>>>Andrea
>>>
>>>[1]
>>>http://andreagazzarini.blogspot.it/2015/10/how-to-do-integration-tests-wi
>>>t
>>>h-solr.html
>>>
>>>2015-12-09 11:32 GMT+01:00 Sathyakumar Seshachalam <
>>>sathyakumar_seshacha...@trimble.com>:
>>>
 Are there any documentations around Solr test framework. (
 http://mvnrepository.com/artifact/org.apache.solr/solr-test-framework)

 I am looking to do integration tests to just check if I am able to add
 document and search it via JUnitTests. There does seem to be a
 test-framework from solr, but the documentation seems to be woefully
 inadequate.
 In my case I have a conf folder that contains the schema and solrconfig
 (that I will actually copy to my solr home and run in production), Just
 with these two files in a folder, Is it possible to run an Integration
Test
 ?

 Any pointers/suggestions ? I tried running test case pointing it to the
 parent folder but got an error

 java.lang.AssertionError: fix your classpath to have
tests-framework.jar
 before lucene-core.jar

 And I cannot seem to fix the above either. Am using gradle and actually
do
 have test-framework as the first dependency.



>>
>



-- 
Regards,
Shalin Shekhar Mangar.

Re: secure solr 5.3.1

[Don Bosco Durai]

Kostali

If you are using Windows, then you can also use your AD as the KDC.

Bosco




On 12/10/15, 8:18 AM, "kostali hassan"  wrote:

>to setup kerberos in windows :
>
>https://github.com/krb5/krb5/blob/master/src/windows/README
>
>2015-12-10 12:10 GMT+00:00 Ishan Chattopadhyaya :
>
>> 1. Please set up your Kerberos server. (KDC)
>> 2. Create principals (usernames) and keytab files as mentioned in the
>> document.
>> 3. Copy the keytab files to your Solr machines
>> 4. Mention all parameters in your bin/solr.in.sh file.
>> 5. Start Solr using a separate parameter,
>> "-DauthenticationPlugin=org.apache.solr.security.KerberosPlugin". You can
>> put this parameter also in your bin/solr.in.sh file.
>>
>> All the best,
>> Regards,
>> Ishan
>>
>>
>> On Thu, Dec 10, 2015 at 5:19 PM, kostali hassan > >
>> wrote:
>>
>> > Iam looking to secure my solr runing in standalone Mode within windows
>> ;the
>> > kerberose plugin is only able to secure solr in standalone mode. how
>> create
>> > principale and here password.
>> >
>> > 2015-12-10 9:35 GMT+00:00 kostali hassan :
>> >
>> > > Iam looking to secure my solr runing in standalone Mode the kerberose
>> > > plugin is only able to secure solr in standalone mode.
>> > >
>> > > 2015-12-09 23:00 GMT+00:00 kostali hassan :
>> > >
>> > >> -- Message transféré --
>> > >> De : "Ishan Chattopadhyaya" 
>> > >> Date : 9 déc. 2015 19:39
>> > >> Objet : Re: secure solr 5.3.1
>> > >> À : 
>> > >> Cc :
>> > >>
>> > >> I don't have much personal experience with setting up a kerberos
>> server
>> > on
>> > >> a Windows machine, but I remember things being painful when I tried
>> and
>> > >> failed once. If you have an option to use a VM, I suggest try setting
>> up
>> > >> the KDC in a GNU/Linux VM (through VirtualBox).
>> > >> In that case, make sure the Windows host is able to access the ports
>> of
>> > >> the
>> > >> guest machine. Better still, setup GNU/Linux VMs for Solr too.
>> > >>
>> > >> On Thu, Dec 10, 2015 at 12:39 AM, kostali hassan <
>> > >> med.has.kost...@gmail.com>
>> > >> wrote:
>> > >>
>> > >> > I install MIT Kerberos for Windows 4.0.1
>> > >> >
>> > >> > 2015-12-09 19:05 GMT+00:00 Ishan Chattopadhyaya <
>> > >> ichattopadhy...@gmail.com
>> > >> > >:
>> > >> >
>> > >> > > What exactly is your confusion? Do you have access to a KDC?
>> > >> > >
>> > >> > > Briefly:
>> > >> > > Login to your KDC server, do a kadmin.local:
>> > >> > > Then,
>> > >> > > addprinc HTTP/192.168.0.107
>> > >> > > ktadd -k /tmp/107.keytab HTTP/192.168.0.107
>> > >> > >
>> > >> > > Then copy the keytab file to your solr node to the appropriate
>> > places.
>> > >> > >
>> > >> > >
>> > >> > > On Thu, Dec 10, 2015 at 12:08 AM, kostali hassan <
>> > >> > > med.has.kost...@gmail.com>
>> > >> > > wrote:
>> > >> > >
>> > >> > > > I folow this two resources and Iam stuck in
>> > >> > > >
>> > >> > > >- Create service principals and keytab files.
>> > >> > > >
>> > >> > > >
>> > >> > > > 2015-12-09 18:06 GMT+00:00 Ishan Chattopadhyaya <
>> > >> > > ichattopadhy...@gmail.com
>> > >> > > > >:
>> > >> > > >
>> > >> > > > > The kerberos plugin is available for use with Solr out of the
>> > box.
>> > >> > The
>> > >> > > > two
>> > >> > > > > resources which Bosco mentioned should get you up and running.
>> > >> > > > >
>> > >> > > > > On Wed, Dec 9, 2015 at 11:34 PM, Don Bosco Durai <
>> > >> bo...@apache.org>
>> > >> > > > wrote:
>> > >> > > > >
>> > >> > > > > > There are two resources available:
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >> >
>> > >>
>> >
>> https://cwiki.apache.org/confluence/display/solr/Kerberos+Authentication+Plugin
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >> >
>> > >>
>> >
>> https://cwiki.apache.org/confluence/display/RANGER/How+to+configure+Solr+Cloud+with+Kerberos+for+Ranger+0.5
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > > > Bosco
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > > > On 12/9/15, 3:14 AM, "kostali hassan" <
>> > >> med.has.kost...@gmail.com>
>> > >> > > > wrote:
>> > >> > > > > >
>> > >> > > > > > >how I setting up Solr to use Kerberos ? i have to dowload
>> > >> kerberos
>> > >> > > and
>> > >> > > > > put
>> > >> > > > > > >the plug-in implementation in the classpath(/server/solr).
>> > >> > > > > > >
>> > >> > > > > > >2015-12-08 22:19 GMT+00:00 Ishan Chattopadhyaya <
>> > >> > > > > > ichattopadhy...@gmail.com>:
>> > >> > > > > > >
>> > >> > > > > > >> Right, as Bosco said, this has been tested well and
>> > >> supported on
>> > >> > > > > > SolrCloud.
>> > >> > > > > > >> It should be possible to run it in standalone mode, but
>> it
>> > is
>> > >> > not
>> > >> > > > > > something
>> > >> > > > > > >> that has been well test yet.
>> > >> > > > > > >>
>> > >> > > > > > >> On Tue, Dec 8, 2015 at 11:02 PM, Don Bosco Durai <
>> > >> > > bo...@

RE: Authorization API versus zkcli.sh

[Oakley, Craig (NIH/NLM/NCBI) [C]]

Looking at security.json in Zookeeper, I notice that both the authentication 
section and the authorization section ends with something like

"":{"v":47}},

Am I correct in thinking that this 47 (in this case) is a version number, and 
that ANY number could be used in the file uploaded to security.json using 
"zkcli.sh -putfile"?

Or is this some sort of checksum whose value must match some unclear criteria?


-Original Message-
From: Anshum Gupta [mailto:ans...@anshumgupta.net] 
Sent: Sunday, December 06, 2015 8:42 AM
To: solr-user@lucene.apache.org
Subject: Re: Authorization API versus zkcli.sh

There's nothing cluster specific in security.json if you're using those
plugins. It is totally safe to just take the file from one cluster and
upload it for another for things to work.

On Sat, Dec 5, 2015 at 3:38 AM, Oakley, Craig (NIH/NLM/NCBI) [C] <
craig.oak...@nih.gov> wrote:

> Looking through
> cwiki.apache.org/confluence/display/solr/Authentication+and+Authorization+Plugins
> one notices that security.json is initially created by zkcli.sh, and then
> modified by means of the Authentication API and the Authorization API. By
> and large, this sounds like a good way to accomplish such tasks, assuming
> that these APIs do some error checking to prevent corruption of
> security.json
>
> I was wondering about cases where one is cloning an existing Solr
> instance, such as when creating an instance in Amazon Cloud. If one has a
> security.json that has been thoroughly tried and successfully tested on
> another Solr instance, is it possible / safe / not-un-recommended to use
> zkcli.sh to load the full security.json (as extracted via zkcli.sh from the
> Zookeeper of the thoroughly tested existing instance)? Or would the
> official verdict be that the only acceptable way to create security.json is
> to load a minimal version with zkcli.sh and then to build the remaining
> components with the Authentication API and the Authorization API (in a
> script, if one wants to automate the process: although such a script would
> have to include plain-text passwords)?
>
> I figured there is no harm in asking.
>



-- 
Anshum Gupta

Re: Solr Spatial search with self-intersecting polygons

[david.w.smi...@gmail.com]

Hello,

To have Solr be tolerant to invalid polygons, use the “validationRule”
attribute on the field type definition.  This setting and some others are
documented here:
https://locationtech.github.io/spatial4j/apidocs/com/spatial4j/core/context/jts/JtsSpatialContextFactory.html
Try using repairBuffer0.

I fixed the links in the ref guide which were recently made out of date,
and I added a use of validationRule to the example:
https://cwiki.apache.org/confluence/display/solr/Spatial+Search

~ David

On Tue, Dec 8, 2015 at 1:04 AM Vishnu perumal  wrote:

> Hi,
>
> I’m using Solr 4.10.2 with an up to date version of JTS and spatial4j. As
> field type in my schema.xml i’m using “location_rpt” like the description
> in the documentation. (
> http://wiki.apache.org/solr/SolrAdaptersForLuceneSpatial4#How_to_Use)
>
> location_rpt field type setup:
>
>  class="solr.SpatialRecursivePrefixTreeFieldType"
>
>
> spatialContextFactory="com.spatial4j.core.context.jts.JtsSpatialContextFactory"
>  distErrPct="0.025"
>  maxDistErr="0.001"
>  units="degrees" />
>
>
>  stored="true"  multiValued="true" />
>
> My filter query like this :
>
> latlon_rpt:"INTERSECTS (POLYGON((16.243972778320312 48.27016879304729,
> 16.411170959472656 48.268340583150504, 16.44275665283203 48.19058119922813,
> 16.32396697998047 48.15921534239267,16.243972778320312 48.27016879304729)))
>
>
> Everything works fine. My problem is when i am trying to use a more complex
> polygon (self-intersecting) Solr only shows an Error like this:
>
> "Couldn't parse shape 'POLYGON((-87.525029 41.676998,-87.508635
> 41.680781,-87.494559 41.681037,-87.485719 41.680332,-87.475333
> 41.677447,-87.465205 41.675011,-87.443232 41.667574,-87.434992
> 41.658084,-87.443876 41.653338,-87.435615 41.646604,-87.43216
> 41.641409,-87.432332 41.630857,-87.432374 41.621907,-87.432418
> 41.611289,-87.433083 41.606523,-87.432718 41.600475,-87.432846
> 41.58709,-87.433018 41.577716,-87.432675 41.565902,-87.424092
> 41.560892,-87.423147 41.548814,-87.425594 41.540271,-87.439713
> 41.530443,-87.471643 41.520933,-87.493787 41.517463,-87.525721
> 41.516847,-87.52572 41.570552,-87.536797 41.574096,-87.545295
> 41.577723,-87.549801 41.577852,-87.568684 41.57737,-87.568727
> 41.587835,-87.56907 41.639941,-87.524953 41.625187,-87.525471
> 41.648549,-87.539761 41.6481,-87.539751 41.643562,-87.543345
> 41.646272,-87.548001 41.650056,-87.5362 41.650089,-87.533582
> 41.650056,-87.533625 41.648292,-87.525492 41.648549,-87.525029 41.676998))'
> because: com.spatial4j.core.exception.InvalidShapeException:
> Self-intersection at or near point (-87.52917652682729, 41.648432570220756,
> NaN)","code":400}
>
>
> Are there any workarounds to get self-intersecting polygon query to work?
>
-- 
Lucene/Solr Search Committer, Consultant, Developer, Author, Speaker
LinkedIn: http://linkedin.com/in/davidwsmiley | Book:
http://www.solrenterprisesearchserver.com

Re: Long Running Data Import Handler - Notifications

[Shawn Heisey]

On 12/8/2015 6:37 PM, Brian Narsi wrote:
> Is there a way to receive notifications when a Data Import Handler finishes
> up and whether it succeeded or failed. (typically runs about an hour)

The code I have which uses DIH (full rebuilds of the index) must
regularly get a status from DIH after it starts the import.  There's a
lot of complicated code to parse that status into something useful.

I am not aware of any way to send a notification when DIH completes, you
must ask it whether it's done.

Some kind of callback would be interesting ... but there are not very
many reliable methods that are not language or platform specific. 
Having the code do an HTTP request on completion (where a URL and
perhaps a POST body are defined in the DIH config) would be something
that might be useful.

Thanks,
Shawn

Re: Solr memory usage

[Shawn Heisey]

On 12/9/2015 7:56 AM, Steven White wrote:
> Thanks Erick!!  Your summary and the blog by Uwe (thank you too Uwe) are
> very helpful.
>
> A follow up question.  I also noticed the "JVM-Memory" report off Solr's
> home page is fluctuating.  I expect some fluctuation, but it kinda worries
> me when it fluctuates up / down in a range of 4 GB and maybe more.  I.e.:
> at times it is at 5 GB and other times it is at 10 GB (this is while I'm
> running my search tests).  What does such high fluctuation means?
>
> If it helps, Solr's "JVM-Memory" report states 2.5 GB usage when Solr is
> first started and before I run any search on it.  I'm taking this as my
> base startup memory usage.

The heap usage at any particular instant in time (even right after
startup) is nearly useless information.  To reach any useful conclusions
and change your heap size based on those conclusions, heap usage must be
tracked (and ideally graphed) for several minutes or hours, sampling no
less frequently than about every five or ten seconds -- exactly what
programs like JConsole (included with the Java JDK) do.  You will want
to do the tracking/graphing during your your heaviest usage for both
queries and indexing.

See the "How much heap space do I need?" section here for some
relatively vague pointers:

https://wiki.apache.org/solr/SolrPerformanceProblems#How_much_heap_space_do_I_need.3F

Thanks,
Shawn

Re: Increasing Solr5 time out from 30 seconds while starting solr

[Susheel Kumar]

Hi Debraj,

>From the log i can't see any issue/error.  Do you mind running solr with -f
and see on console if you get any error otherwise launch Solr from browser (
http://localhost:8983/solr)

Thnx

On Thu, Dec 10, 2015 at 10:39 AM, Debraj Manna 
wrote:

> The logs that I am seeing:-
>
> jabong@jabong1143:~/Downloads/software/dev/solr5$ sudo bin/solr start -p
> 
> [sudo] password for jabong:
> Waiting to see Solr listening on port  [-]  Still not seeing Solr
> listening on  after 30 seconds!
> INFO  - 2015-12-10 15:37:16.816; [   ]
> org.apache.solr.core.SolrResourceLoader; Adding
>
> 'file:/home/jabong/Downloads/software/dev/solr5/contrib/clustering/lib/jackson-core-asl-1.9.13.jar'
> to classloader
> INFO  - 2015-12-10 15:37:16.817; [   ]
> org.apache.solr.core.SolrResourceLoader; Adding
>
> 'file:/home/jabong/Downloads/software/dev/solr5/contrib/clustering/lib/attributes-binder-1.2.1.jar'
> to classloader
> INFO  - 2015-12-10 15:37:16.817; [   ]
> org.apache.solr.core.SolrResourceLoader; Adding
>
> 'file:/home/jabong/Downloads/software/dev/solr5/contrib/clustering/lib/jackson-mapper-asl-1.9.13.jar'
> to classloader
> WARN  - 2015-12-10 15:37:16.817; [   ]
> org.apache.solr.core.SolrResourceLoader; Can't find (or read) directory to
> add to classloader: /home/jabong/Downloads/software/dev/solr5/dist/
> (resolved as: /home/jabong/Downloads/software/dev/solr5/dist).
> INFO  - 2015-12-10 15:37:16.834; [   ]
> org.apache.solr.core.SolrResourceLoader; Adding
>
> 'file:/home/jabong/Downloads/software/dev/solr5/contrib/langid/lib/langdetect-1.1-20120112.jar'
> to classloader
> INFO  - 2015-12-10 15:37:16.834; [   ]
> org.apache.solr.core.SolrResourceLoader; Adding
>
> 'file:/home/jabong/Downloads/software/dev/solr5/contrib/langid/lib/langdetect-1.1-20120112.jar'
> to classloader
> INFO  - 2015-12-10 15:37:16.835; [   ]
> org.apache.solr.core.SolrResourceLoader; Adding
>
> 'file:/home/jabong/Downloads/software/dev/solr5/contrib/langid/lib/jsonic-1.2.7.jar'
> to classloader
> INFO  - 2015-12-10 15:37:16.835; [   ]
> org.apache.solr.core.SolrResourceLoader; Adding
>
> 'file:/home/jabong/Downloads/software/dev/solr5/contrib/langid/lib/jsonic-1.2.7.jar'
> to classloader
> WARN  - 2015-12-10 15:37:16.835; [   ]
> org.apache.solr.core.SolrResourceLoader; Can't find (or read) directory to
> add to classloader: /home/jabong/Downloads/software/dev/solr5/dist/
> (resolved as: /home/jabong/Downloads/software/dev/solr5/dist).
> WARN  - 2015-12-10 15:37:16.835; [   ]
> org.apache.solr.core.SolrResourceLoader; Can't find (or read) directory to
> add to classloader: /home/jabong/Downloads/software/dev/solr5/dist/
> (resolved as: /home/jabong/Downloads/software/dev/solr5/dist).
> INFO  - 2015-12-10 15:37:16.842; [   ]
> org.apache.solr.core.SolrResourceLoader; Adding
>
> 'file:/home/jabong/Downloads/software/dev/solr5/contrib/velocity/lib/commons-beanutils-1.8.3.jar'
> to classloader
> INFO  - 2015-12-10 15:37:16.842; [   ]
> org.apache.solr.core.SolrResourceLoader; Adding
>
> 'file:/home/jabong/Downloads/software/dev/solr5/contrib/velocity/lib/commons-beanutils-1.8.3.jar'
> to classloader
> INFO  - 2015-12-10 15:37:16.842; [   ]
> org.apache.solr.core.SolrResourceLoader; Adding
>
> 'file:/home/jabong/Downloads/software/dev/solr5/contrib/velocity/lib/velocity-1.7.jar'
> to classloader
> INFO  - 2015-12-10 15:37:16.842; [   ]
> org.apache.solr.core.SolrResourceLoader; Adding
>
> 'file:/home/jabong/Downloads/software/dev/solr5/contrib/velocity/lib/velocity-1.7.jar'
> to classloader
> INFO  - 2015-12-10 15:37:16.843; [   ]
> org.apache.solr.core.SolrResourceLoader; Adding
>
> 'file:/home/jabong/Downloads/software/dev/solr5/contrib/velocity/lib/commons-collections-3.2.1.jar'
> to classloader
> INFO  - 2015-12-10 15:37:16.843; [   ]
> org.apache.solr.core.SolrResourceLoader; Adding
>
> 'file:/home/jabong/Downloads/software/dev/solr5/contrib/velocity/lib/commons-collections-3.2.1.jar'
> to classloader
> INFO  - 2015-12-10 15:37:16.843; [   ]
> org.apache.solr.core.SolrResourceLoader; Adding
>
> 'file:/home/jabong/Downloads/software/dev/solr5/contrib/velocity/lib/velocity-tools-2.0.jar'
> to classloader
> WARN  - 2015-12-10 15:37:16.844; [   ]
> org.apache.solr.core.SolrResourceLoader; Can't find (or read) directory to
> add to classloader: /home/jabong/Downloads/software/dev/solr5/dist/
> (resolved as: /home/jabong/Downloads/software/dev/solr5/dist).
> INFO  - 2015-12-10 15:37:16.847; [   ]
> org.apache.solr.core.SolrResourceLoader; Adding
>
> 'file:/home/jabong/Downloads/software/dev/solr5/contrib/velocity/lib/velocity-tools-2.0.jar'
> to classloader
> WARN  - 2015-12-10 15:37:16.848; [   ]
> org.apache.solr.core.SolrResourceLoader; Can't find (or read) directory to
> add to classloader: /home/jabong/Downloads/software/dev/solr5/dist/
> (resolved as: /home/jabong/Downloads/software/dev/solr5/dist).
> INFO  - 2015-12-10 15:37:17.476; [   ]
> org.apache.solr.update.SolrIndexConfig; IndexWriter infoStream solr logging
> is

Re: capacity of storage a single core

[Susheel Kumar]

Like the details here Eric how you broke memory into different parts. I
feel if we can combine lot of this knowledge from your various posts, above
sizing blog, Solr wiki pages, Uwe article on MMap/heap,  consolidate and
present in at single place which may help lot of new folks/folks struggling
with memory/heap/sizing issues questions etc.

Thanks,
Susheel

On Wed, Dec 9, 2015 at 12:40 PM, Erick Erickson 
wrote:

> I object to the question. And the advice. And... ;).
>
> Practically, IMO guidance that "the entire index should
> fit into memory" is misleading, especially for newbies.
> Let's break it down:
>
> 1>  "the entire index". What's this? The size on disk?
> 90% of that size on disk may be stored data which
> uses very little memory, which is limited by the
> documentCache in Solr. OTOH, only 10% of the on-disk
> size might be stored data.
>
> 2> "fit into memory". What memory? Certainly not
> the JVM as much of the Lucene-level data is in
> MMapDirectory which uses the OS memory. So
> this _probably_ means JVM + OS memory, and OS
> memory is shared amongst other processes as well.
>
> 3> Solr and Lucene build in-memory structures that
> aren't reflected in the index size on disk. I've seen
> filterCaches for instance that have been (mis) configured
> that could grow to 100s of G. This is totally not reflected in
> the "index size".
>
> 4> Try faceting on a text field with lots of unique
> values. Bad Practice, but you'll see just how quickly
> the _query_ can change the memory requirements.
>
> 5> Sure, with modern hardware we can create huge JVM
> heaps... that hit GC pauses that'll drive performance
> down, sometimes radically.
>
> I've seen 350M docs, 200-300 fields (aggregate) fit into 12G
> of JVM. I've seen 25M docs (really big ones) strain 48G
> JVM heaps.
>
> Jack's approach is what I use; pick a number and test with it.
> Here's an approach:
>
> https://lucidworks.com/blog/2012/07/23/sizing-hardware-in-the-abstract-why-we-dont-have-a-definitive-answer/
>
> Best,
> Erick
>
> On Wed, Dec 9, 2015 at 8:54 AM, Susheel Kumar 
> wrote:
> > Thanks, Jack for quick reply.  With Replica / Shard I mean to say on a
> > given machine there may be two/more replicas and all of them may not fit
> > into memory.
> >
> > On Wed, Dec 9, 2015 at 11:00 AM, Jack Krupansky <
> jack.krupan...@gmail.com>
> > wrote:
> >
> >> Yes, there are nuances to any general rule. It's just a starting point,
> and
> >> your own testing will confirm specific details for your specific app and
> >> data. For example, maybe you don't query all fields commonly, so each
> >> field-specific index may not require memory or not require it so
> commonly.
> >> And, yes, each app has its own latency requirements. The purpose of a
> >> general rule is to generally avoid unhappiness, but if you have an
> appetite
> >> and tolerance for unhappiness, then go for it.
> >>
> >> Replica vs. shard? They're basically the same - a replica is a copy of a
> >> shard.
> >>
> >> -- Jack Krupansky
> >>
> >> On Wed, Dec 9, 2015 at 10:36 AM, Susheel Kumar 
> >> wrote:
> >>
> >> > Hi Jack,
> >> >
> >> > Just to add, OS Disk Cache will still make query performant even
> though
> >> > entire index can't be loaded into memory. How much more latency
> compare
> >> to
> >> > if index gets completely loaded into memory may vary depending to
> index
> >> > size etc.  I am trying to clarify this here because lot of folks takes
> >> this
> >> > as a hard guideline (to fit index into memory)  and try to come up
> with
> >> > hardware/machines (100's of machines) just for the sake of fitting
> index
> >> > into memory even though there may not be much load/qps on the cluster.
> >> For
> >> > e.g. this may vary and needs to be tested on case by case basis but a
> >> > machine with 64GB  should still provide good performance (not the
> best)
> >> for
> >> > 100G index on that machine.  Do you agree / any thoughts?
> >> >
> >> > Same i believe is the case with Replicas,   as on a single machine you
> >> have
> >> > replicas which itself may not fit into memory as well along with shard
> >> > index.
> >> >
> >> > Thanks,
> >> > Susheel
> >> >
> >> > On Tue, Dec 8, 2015 at 11:31 AM, Jack Krupansky <
> >> jack.krupan...@gmail.com>
> >> > wrote:
> >> >
> >> > > Generally, you will be resource limited (memory, cpu) rather than by
> >> some
> >> > > arbitrary numeric limit (like 2 billion.)
> >> > >
> >> > > My personal general recommendation is for a practical limit is 100
> >> > million
> >> > > documents on a machine/node. Depending on your data model and actual
> >> data
> >> > > that number could be higher or lower. A proof of concept test will
> >> allow
> >> > > you to determine the actual number for your particular use case,
> but a
> >> > > presumed limit of 100 million is not a bad start.
> >> > >
> >> > > You should have enough memory to hold the entire index in system
> >> memory.
> >> > If
> >> > > not, your query latency will suffer due to I/O required to
> const

RE: JSON facets and excluded queries

[Aigner, Max]

Another question popped up around this: 
Is the facet.threads parameter still relevant with Json facets? I saw that the 
facet prefix bug https://issues.apache.org/jira/browse/SOLR-6686 got fixed in  
5.3 so I'm looking into re-enabling this parameter for our searches. 

On a side note, I've been testing Json facet performance and I've observed that 
they're generally  faster unless facet prefix filtering comes into play, then 
they seem to be slower than standard facets. 
Is that just a fluke or should I switch to Json Query Facets instead of using 
facet prefix filtering?

Thanks again,
Max

-Original Message-
From: Aigner, Max [mailto:max.aig...@nordstrom.com] 
Sent: Wednesday, November 25, 2015 11:54 AM
To: solr-user@lucene.apache.org
Subject: RE: JSON facets and excluded queries

Yes, just tried that and it works fine. 

That just removed a showstopper for me as my queries contain lots of tagged FQs 
and multi-select facets (implemented the 'good way' :). 

Thank you for the quick help! 

-Original Message-
From: Yonik Seeley [mailto:ysee...@gmail.com] 
Sent: Wednesday, November 25, 2015 11:38 AM
To: solr-user@lucene.apache.org
Subject: Re: JSON facets and excluded queries

On Wed, Nov 25, 2015 at 2:29 PM, Yonik Seeley  wrote:
> On Wed, Nov 25, 2015 at 2:15 PM, Aigner, Max  wrote:
>> Thanks, this is great :=))
>>
>> I hadn't seen the domain:{excludeTags:...} syntax yet and it doesn't seem to 
>> be working on 5.3.1 so I'm assuming this is work slated for 5.4 or 6. Did I 
>> get that right?
>
> Hmmm, the "domain" keyword was added for 5.3 along with block join
> faceting: http://yonik.com/solr-nested-objects/
> That's when I switched "excludeTags" to also be under the "domain" keyword.
>
> Let me try it out...

Ah, I messed up that migration...
OK, for now, instead of
  domain:{excludeTags:foo}
just use
  excludeTags:foo
and it should work.

-Yonik

Zookeeper connection refused error

[Aswath Srinivasan (TMS)]

Hi all,

I tried to create a collection with 3 shards and it got created. Verified the 
same in SOLR Dashboard.

But while creating the collection I'm seeing a "Connection Refused" when 
connecting to Zookeeper.

Following is the expectation trace. Can somebody spot the mistake that is 
happening with my settings?


[something@something solr-5.3.1]$ bin/solr create_collection -c T3Collection1 
-n T3Collection1_Config -d /opt/solr-5.3.1/example/example-DIH/solr/db -shards 
3 -p 8993

Connecting to ZooKeeper at server01:2181,server02:2181,server03:2181/t3solr ...
WARN  - 2015-12-10 14:46:58.476; org.apache.zookeeper.ClientCnxn$SendThread; 
Session 0x0 for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
Uploading /opt/solr-5.3.1/example/example-DIH/solr/db/conf for config 
T3Collection1_Config to ZooKeeper at 
server01:2181,server02:2181,server03:2181/t3solr

Creating new collection 'T3Collection1' using command:
http://localhost:8993/solr/admin/collections?action=CREATE&name=T3Collection1&numShards=3&replicationFactor=1&maxShardsPerNode=1&collection.configName=T3Collection1_Config

{
  "responseHeader":{
"status":0,
"QTime":2141},
  "success":{"":{
  "responseHeader":{
"status":0,
"QTime":1932},
  "core":"T3Collection1_shard2_replica1"}}}


When I try to do a downconfig I get the following exception,

[something@something solr-5.3.1]$ ./server/scripts/cloud-scripts/zkcli.sh 
-zkhost server01:2181,server02:2181,server03:2181 -cmd downconfig -confname 
T3Collection1_Config -confdir "/opt/solr-5.3.1/downconfigs"
Exception in thread "main" java.io.IOException: Error downloading files from 
zookeeper path /configs/T3Collection1_Config to /opt/solr-5.3.1/downconfigs
at 
org.apache.solr.common.cloud.ZkConfigManager.downloadFromZK(ZkConfigManager.java:107)
at 
org.apache.solr.common.cloud.ZkConfigManager.downloadConfigDir(ZkConfigManager.java:131)
at org.apache.solr.cloud.ZkCLI.main(ZkCLI.java:230)
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: 
KeeperErrorCode = NoNode for /configs/T3Collection1_Config
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
at 
org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:328)
at 
org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:325)
at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
at 
org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:325)
at 
org.apache.solr.common.cloud.ZkConfigManager.downloadFromZK(ZkConfigManager.java:92)
... 2 more


Thank you,
Aswath NS

Re: Authorization API versus zkcli.sh

[Noble Paul]

Please do not put any number. That number is used by the system to
optimize loading/reloading plugins. It is not relevant for the user.

On Thu, Dec 10, 2015 at 11:52 PM, Oakley, Craig (NIH/NLM/NCBI) [C]
 wrote:
> Looking at security.json in Zookeeper, I notice that both the authentication 
> section and the authorization section ends with something like
>
> "":{"v":47}},
>
> Am I correct in thinking that this 47 (in this case) is a version number, and 
> that ANY number could be used in the file uploaded to security.json using 
> "zkcli.sh -putfile"?
>
> Or is this some sort of checksum whose value must match some unclear criteria?
>
>
> -Original Message-
> From: Anshum Gupta [mailto:ans...@anshumgupta.net]
> Sent: Sunday, December 06, 2015 8:42 AM
> To: solr-user@lucene.apache.org
> Subject: Re: Authorization API versus zkcli.sh
>
> There's nothing cluster specific in security.json if you're using those
> plugins. It is totally safe to just take the file from one cluster and
> upload it for another for things to work.
>
> On Sat, Dec 5, 2015 at 3:38 AM, Oakley, Craig (NIH/NLM/NCBI) [C] <
> craig.oak...@nih.gov> wrote:
>
>> Looking through
>> cwiki.apache.org/confluence/display/solr/Authentication+and+Authorization+Plugins
>> one notices that security.json is initially created by zkcli.sh, and then
>> modified by means of the Authentication API and the Authorization API. By
>> and large, this sounds like a good way to accomplish such tasks, assuming
>> that these APIs do some error checking to prevent corruption of
>> security.json
>>
>> I was wondering about cases where one is cloning an existing Solr
>> instance, such as when creating an instance in Amazon Cloud. If one has a
>> security.json that has been thoroughly tried and successfully tested on
>> another Solr instance, is it possible / safe / not-un-recommended to use
>> zkcli.sh to load the full security.json (as extracted via zkcli.sh from the
>> Zookeeper of the thoroughly tested existing instance)? Or would the
>> official verdict be that the only acceptable way to create security.json is
>> to load a minimal version with zkcli.sh and then to build the remaining
>> components with the Authentication API and the Authorization API (in a
>> script, if one wants to automate the process: although such a script would
>> have to include plain-text passwords)?
>>
>> I figured there is no harm in asking.
>>
>
>
>
> --
> Anshum Gupta



-- 
-
Noble Paul