Jack, thanks for the reply. With other sites over https I'm not having trouble. What logic suggests you change? Did not quite understand.
2016-03-29 21:01 GMT-03:00 Jack Krupansky <jack.krupan...@gmail.com>: > Medium switches from http to https, so you would need the logic for dealing > with https security handshakes. > > -- Jack Krupansky > > On Tue, Mar 29, 2016 at 7:54 PM, Jeferson dos Anjos < > jefersonan...@packdocs.com> wrote: > > > I'm trying to index some pages of the medium. But I get error 403. I > > believe it is because the medium does not accept the user-agent solr. Has > > anyone ever experienced this? You know how to change? > > > > I appreciate any help > > > > <lst name="responseHeader"> > > <int name="status">500</int> > > <int name="QTime">94</int> > > </lst> > > <lst name="error"> > > <str name="msg"> > > Server returned HTTP response code: 403 for URL: > > > > > https://medium.com/@producthunt/10-mac-menu-bar-apps-you-can-t-live-without-df087d2c6b1 > > </str> > > <str name="trace"> > > java.io.IOException: Server returned HTTP response code: 403 for URL: > > > > > https://medium.com/@producthunt/10-mac-menu-bar-apps-you-can-t-live-without-df087d2c6b1 > > at sun.reflect.GeneratedConstructorAccessor314.newInstance(Unknown > > Source) at > > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown > > Source) at java.lang.reflect.Constructor.newInstance(Unknown Source) > > at sun.net.www.protocol.http.HttpURLConnection$10.run(Unknown Source) > > at sun.net.www.protocol.http.HttpURLConnection$10.run(Unknown Source) > > at java.security.AccessController.doPrivileged(Native Method) at > > sun.net.www.protocol.http.HttpURLConnection.getChainedException(Unknown > > Source) at > > sun.net.www.protocol.http.HttpURLConnection.getInputStream0(Unknown > > Source) at > > sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown > > Source) at > > sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(Unknown > > Source) at > > > org.apache.solr.common.util.ContentStreamBase$URLStream.getStream(ContentStreamBase.java:87) > > at > > > org.apache.solr.handler.extraction.ExtractingDocumentLoader.load(ExtractingDocumentLoader.java:158) > > at > > > org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74) > > at > > > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144) > > at > > > org.apache.solr.core.RequestHandlers$LazyRequestHandlerWrapper.handleRequest(RequestHandlers.java:291) > > at org.apache.solr.core.SolrCore.execute(SolrCore.java:2006) at > > > > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:777) > > at > > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:413) > > at > > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:204) > > at > > > org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) > > at > > > org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) > > at > > > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) > > at > > > org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) > > at > > > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) > > at > > > org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075) > > at > > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) > > at > > > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) > > at > > > org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) > > at > > > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) > > at > > > org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255) > > at > > > org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) > > at > > > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) > > at org.eclipse.jetty.server.Server.handle(Server.java:368) at > > > > > org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) > > at > > > org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) > > at > > > org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942) > > at > > > org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004) > > at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640) at > > org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235) > > at > > > org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) > > at > > > org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) > > at > > > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) > > at > > > org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) > > at java.lang.Thread.run(Unknown Source) Caused by: > > java.io.IOException: Server returned HTTP response code: 403 for URL: > > > > > https://medium.com/@producthunt/10-mac-menu-bar-apps-you-can-t-live-without-df087d2c6b1 > > at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(Unknown > > Source) at > > sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown > > Source) at > > sun.net.www.protocol.http.HttpURLConnection.getHeaderField(Unknown > > Source) at java.net.URLConnection.getContentType(Unknown Source) at > > sun.net.www.protocol.https.HttpsURLConnectionImpl.getContentType(Unknown > > Source) at > > > org.apache.solr.common.util.ContentStreamBase$URLStream.getStream(ContentStreamBase.java:84) > > ... 33 more > > </str> > > <int name="code">500</int> > > </lst> > > </response> > > > > > > Jeferson M. dos Anjos > > CEO do Packdocs > > ps.: Mantenha seus arquivos vivos com o Packdocs (www.packdocs.com) > > > -- Jeferson M. dos Anjos CEO do Packdocs ps.: Mantenha seus arquivos vivos com o Packdocs (www.packdocs.com)