Solr Schema API seems broken to me after 8.2.0
Hey everybody,
First of all, I wanted to say that this is my first time writing here. I
hope I don't do anything wrong.
I went to create the "bug" ticket and saw it would be a good idea to first
talk to some of you via IRC (didn't work for me or I did something wrong
after 20 years of not using it..)
I'm currently using Solr 8.1.1 in production and I use the Schema API to
create the necessary fields before starting to index my new data. (Reason,
the managed-schema would be big for me to take care of and I decided to
automate this process by using the REST API).
I started trying to upgrade* from 8.1.1* directly to *8.6.1* and the python
script I use to add some fields and analyzers started to *kill solr after
some successful processes to finish* without issues.
*Let's put it simply that I have to make sure the fields that contain the
word "blablabla" in it need to be deleted and then recreated. I have ~33 of
them.*
The script works as expected but after some successful creations it kills
Solr!
This script was implemented in python and I thought that I might have done
something that doesn't work with Solr 8.6.1 anymore and decided to test it
with the *proper implementation of the library in Java*, SolrJ 8.6.1 as
well. The same error occurred. I also didn't see any change in the
documentation with regards to the request I was making.
Unfortunately I don't have any stacktrace from Solr as there were no errors
popping up in the console for me. The only thing I see was the output of my
script, saying that the *Remote closed connection without response*:
...
Traceback (most recent call last):
File "/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py",
line 677, in urlopen
chunked=chunked,
File "/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py",
line 426, in _make_request
six.raise_from(e, None)
File "", line 3, in raise_from
File "/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py",
line 421, in _make_request
httplib_response = conn.getresponse()
File "/usr/lib/python3.7/http/client.py", line 1336, in getresponse
response.begin()
File "/usr/lib/python3.7/http/client.py", line 306, in begin
version, status, reason = self._read_status()
File "/usr/lib/python3.7/http/client.py", line 275, in _read_status
raise RemoteDisconnected("Remote end closed connection without"
http.client.RemoteDisconnected: Remote end closed connection without
response
With *Java and SolrJ* matching the Solr version I was using, I got this:
Deleting field field_name_1
{responseHeader={status=0,QTime=2187}}
Deleting field field_name_2
{responseHeader={status=0,QTime=1571}}
Deleting field field_name_3
{responseHeader={status=0,QTime=1587}}
Deleting field field_name_4
Exception while deleting the field field_name_4:* IOException occured when
talking to server at: http://localhost:32783/solr/my_core_name
*
Deleting field field_name_5
Exception while deleting the field field_name_5:* IOException occured when
talking to server at: http://localhost:32783/solr/my_core_name
*
// THIS REPEATES FOR + 30 TIMES AND THEN THE MESSAGE CHANGES A BIT
Exception while deleting the field field_name_6:* Server refused connection
at: http://localhost:32783/solr/my_core_name/schema?wt=javabin&version=2
*
Deleting field field_name_6
// REPEATS ALSO MANY TIMES
Maybe I need to run the same thing again with some different configuration
to help give you guys a hint on what the problem is?
To finalize, I started to go "back in time" to see when this happened and
realized that *I can only upgrade from 8.1.1. to 8.2.1* without this error
to happen. (I'm using the docker images in here btw:
https://github.com/docker-solr/docker-solr)
Thank you very much and I hope I can also help with this if it's really a
bug.
Best Regards,
*Jean Silva*
https://github.com/jeancsil
https://linkedin.com/in/jeancsil
Re: Solr Schema API seems broken to me after 8.2.0
Hey guys, good morning.
As I didn't get any reply for this one, is it ok then that I create the
Jira ticket?
Best Regards,
*Jean Silva*
https://github.com/jeancsil
https://linkedin.com/in/jeancsil
On Fri, Aug 28, 2020 at 11:10 AM jeanc...@gmail.com
wrote:
> Hey everybody,
>
> First of all, I wanted to say that this is my first time writing here. I
> hope I don't do anything wrong.
> I went to create the "bug" ticket and saw it would be a good idea to first
> talk to some of you via IRC (didn't work for me or I did something wrong
> after 20 years of not using it..)
>
> I'm currently using Solr 8.1.1 in production and I use the Schema API to
> create the necessary fields before starting to index my new data. (Reason,
> the managed-schema would be big for me to take care of and I decided to
> automate this process by using the REST API).
>
> I started trying to upgrade* from 8.1.1* directly to *8.6.1* and the
> python script I use to add some fields and analyzers started to *kill
> solr after some successful processes to finish* without issues.
>
> *Let's put it simply that I have to make sure the fields that contain the
> word "blablabla" in it need to be deleted and then recreated. I have ~33 of
> them.*
>
> The script works as expected but after some successful creations it kills
> Solr!
>
> This script was implemented in python and I thought that I might have done
> something that doesn't work with Solr 8.6.1 anymore and decided to test it
> with the *proper implementation of the library in Java*, SolrJ 8.6.1 as
> well. The same error occurred. I also didn't see any change in the
> documentation with regards to the request I was making.
>
> Unfortunately I don't have any stacktrace from Solr as there were no
> errors popping up in the console for me. The only thing I see was the
> output of my script, saying that the *Remote closed connection without
> response*:
> ...
> Traceback (most recent call last):
> File "/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py",
> line 677, in urlopen
> chunked=chunked,
> File "/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py",
> line 426, in _make_request
> six.raise_from(e, None)
> File "", line 3, in raise_from
> File "/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py",
> line 421, in _make_request
> httplib_response = conn.getresponse()
> File "/usr/lib/python3.7/http/client.py", line 1336, in getresponse
> response.begin()
> File "/usr/lib/python3.7/http/client.py", line 306, in begin
> version, status, reason = self._read_status()
> File "/usr/lib/python3.7/http/client.py", line 275, in _read_status
> raise RemoteDisconnected("Remote end closed connection without"
> http.client.RemoteDisconnected: Remote end closed connection without
> response
>
>
> With *Java and SolrJ* matching the Solr version I was using, I got this:
>
> Deleting field field_name_1
> {responseHeader={status=0,QTime=2187}}
>
> Deleting field field_name_2
> {responseHeader={status=0,QTime=1571}}
>
> Deleting field field_name_3
> {responseHeader={status=0,QTime=1587}}
>
> Deleting field field_name_4
> Exception while deleting the field field_name_4:* IOException occured
> when talking to server at: http://localhost:32783/solr/my_core_name
> <http://localhost:32783/solr/my_core_name>*
>
> Deleting field field_name_5
> Exception while deleting the field field_name_5:* IOException occured
> when talking to server at: http://localhost:32783/solr/my_core_name
> <http://localhost:32783/solr/my_core_name>*
> // THIS REPEATES FOR + 30 TIMES AND THEN THE MESSAGE CHANGES A BIT
>
> Exception while deleting the field field_name_6:* Server refused
> connection at:
> http://localhost:32783/solr/my_core_name/schema?wt=javabin&version=2
> <http://localhost:32783/solr/my_core_name/schema?wt=javabin&version=2>*
> Deleting field field_name_6
> // REPEATS ALSO MANY TIMES
>
> Maybe I need to run the same thing again with some different configuration
> to help give you guys a hint on what the problem is?
>
> To finalize, I started to go "back in time" to see when this happened and
> realized that *I can only upgrade from 8.1.1. to 8.2.1* without this
> error to happen. (I'm using the docker images in here btw:
> https://github.com/docker-solr/docker-solr)
>
> Thank you very much and I hope I can also help with this if it's really a
> bug.
>
> Best Regards,
>
> *Jean Silva*
>
>
> https://github.com/jeancsil
>
> https://linkedin.com/in/jeancsil
>
>
Re: Solr Schema API seems broken to me after 8.2.0
Thanks for the reply,
I didn't see anything in the Solr logs BUT I'm going to recheck it next
week and update you.
Will check this as well:
* It could be that after the upgrade some filesystem permissions do not
work anymore *
Thanks
Best Regards,
*Jean Silva*
https://github.com/jeancsil
https://linkedin.com/in/jeancsil
On Tue, Sep 8, 2020 at 9:39 AM Jörn Franke wrote:
> Can you check the logfiles of Solr?
>
> It could be that after the upgrade some filesystem permissions do not work
> anymore
>
> > Am 08.09.2020 um 09:27 schrieb "jeanc...@gmail.com" >:
> >
> > Hey guys, good morning.
> >
> > As I didn't get any reply for this one, is it ok then that I create the
> > Jira ticket?
> >
> > Best Regards,
> >
> > *Jean Silva*
> >
> >
> > https://github.com/jeancsil
> >
> > https://linkedin.com/in/jeancsil
> >
> >
> >
> >> On Fri, Aug 28, 2020 at 11:10 AM jeanc...@gmail.com >
> >> wrote:
> >>
> >> Hey everybody,
> >>
> >> First of all, I wanted to say that this is my first time writing here. I
> >> hope I don't do anything wrong.
> >> I went to create the "bug" ticket and saw it would be a good idea to
> first
> >> talk to some of you via IRC (didn't work for me or I did something wrong
> >> after 20 years of not using it..)
> >>
> >> I'm currently using Solr 8.1.1 in production and I use the Schema API to
> >> create the necessary fields before starting to index my new data.
> (Reason,
> >> the managed-schema would be big for me to take care of and I decided to
> >> automate this process by using the REST API).
> >>
> >> I started trying to upgrade* from 8.1.1* directly to *8.6.1* and the
> >> python script I use to add some fields and analyzers started to *kill
> >> solr after some successful processes to finish* without issues.
> >>
> >> *Let's put it simply that I have to make sure the fields that contain
> the
> >> word "blablabla" in it need to be deleted and then recreated. I have
> ~33 of
> >> them.*
> >>
> >> The script works as expected but after some successful creations it
> kills
> >> Solr!
> >>
> >> This script was implemented in python and I thought that I might have
> done
> >> something that doesn't work with Solr 8.6.1 anymore and decided to test
> it
> >> with the *proper implementation of the library in Java*, SolrJ 8.6.1 as
> >> well. The same error occurred. I also didn't see any change in the
> >> documentation with regards to the request I was making.
> >>
> >> Unfortunately I don't have any stacktrace from Solr as there were no
> >> errors popping up in the console for me. The only thing I see was the
> >> output of my script, saying that the *Remote closed connection without
> >> response*:
> >> ...
> >> Traceback (most recent call last):
> >> File
> "/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py",
> >> line 677, in urlopen
> >>chunked=chunked,
> >> File
> "/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py",
> >> line 426, in _make_request
> >>six.raise_from(e, None)
> >> File "", line 3, in raise_from
> >> File
> "/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py",
> >> line 421, in _make_request
> >>httplib_response = conn.getresponse()
> >> File "/usr/lib/python3.7/http/client.py", line 1336, in getresponse
> >>response.begin()
> >> File "/usr/lib/python3.7/http/client.py", line 306, in begin
> >>version, status, reason = self._read_status()
> >> File "/usr/lib/python3.7/http/client.py", line 275, in _read_status
> >>raise RemoteDisconnected("Remote end closed connection without"
> >> http.client.RemoteDisconnected: Remote end closed connection without
> >> response
> >>
> >>
> >> With *Java and SolrJ* matching the Solr version I was using, I got this:
> >>
> >> Deleting field field_name_1
> >> {responseHeader={status=0,QTime=2187}}
> >>
> >> Deleting field field_name_2
> >> {responseHeader={status=0,QTime=1571}}
> >>
> >> Deleting field field_name_3
> >> {responseHeader={status=0,QTime=1587}}
> >>
> >> Deleting field field_name_4
> >>
