solr newbie
Trying to run the test tutorial to index an xml file and keep getting an error message: curl: command not found? Any help is greatly appreciated.
RE: solr newbie
You can download curl from http://curl.haxx.se/ if you don't have it on your machine. -D -Original Message- From: Tim Archambault [mailto:[EMAIL PROTECTED] Sent: Thursday, June 01, 2006 9:42 AM To: solr-user@lucene.apache.org Subject: solr newbie Trying to run the test tutorial to index an xml file and keep getting an error message: curl: command not found? Any help is greatly appreciated.
Re: solr newbie
Hi Tim, Curl is a little command-line networking tool. The easiest way to get it is cygwin if you are not on a UNIX system. See the 'Requirements" section of the tutorial: 3. On Win32, cygwin, for shell support. (If you plan to use Subversion on Win32, be sure to select the subversion package when you install, in the "Devel" category.) This tutorial will assume that "sh" is in your PATH, and that you have "curl" installed from the "Web" category. -Yonik On 6/1/06, Tim Archambault <[EMAIL PROTECTED]> wrote: Trying to run the test tutorial to index an xml file and keep getting an error message: curl: command not found? Any help is greatly appreciated.
!Solr
Hi all, I need to get something up and running in 12 hours, so I thought it could be fun to see if Solr would work out of the box for me. Neither the example nor the dist war would start. No big deal, I'll hack something up another way. Just thought it would be a good thing to report this. I'm on IBM 1.5 on my PPC Linux. Here are the logs: [EMAIL PROTECTED]:~/download/solr-nightly/example$ java -jar start.jar 18:52:16.463 INFO [main] org.mortbay.log.LogImpl.add(LogImpl.java:110) >14> added [EMAIL PROTECTED] 18:52:16.215 INFO [main] org.mortbay.util.FileResource.(FileResource.java:61) >09> Checking Resource aliases 18:52:16.774 WARN!! [main] org.mortbay.xml.XmlParser.(XmlParser.java:82) >10> Schema validation may not be supported 18:52:17.335 INFO [main] org.mortbay.http.HttpServer.doStart(HttpServer.java:686) >07> Version Jetty/5.1.11RC0 18:52:17.537 INFO [main] org.mortbay.util.Container.start(Container.java:75) >11> Started [EMAIL PROTECTED] 18:52:17.645 INFO [main] org.mortbay.util.Container.start(Container.java:75) >08> Started ServletHttpContext[/,/] 18:52:17.756 INFO [main] org.mortbay.http.SocketListener.start(SocketListener.java:206) >08> Started SocketListener on 127.0.0.1:8081 18:52:17.864 INFO [main] org.mortbay.util.Container.start(Container.java:75) >06> Started [EMAIL PROTECTED] 18:52:18.417 INFO [main] org.mortbay.http.HttpServer.setStatsOn(HttpServer.java:1131) >12> Statistics on = false for [EMAIL PROTECTED] 18:52:18.533 INFO [main] org.mortbay.http.HttpServer.doStart(HttpServer.java:686) >07> Version Jetty/5.1.11RC0 18:52:18.987 INFO [main] org.mortbay.jetty.servlet.WebApplicationContext.resolveWebApp(WebApplicationContext.java:249) >10> Extract jar:file:/home/kalle/download/solr-nightly/example/webapps/solr.war!/ to /tmp/Jetty__8983__solr/webapp 18:52:19.427 WARN!! [main] org.mortbay.xml.XmlParser.(XmlParser.java:82) >14> Schema validation may not be supported 18:52:22.850 WARN!! [main] org.mortbay.jetty.servlet.WebApplicationContext.doStart(WebApplicationContext.java:520) >09> Configuration error on jar:file:/home/kalle/download/solr-nightly/example/webapps/solr.war!/ java.net.MalformedURLException: Absolute URL required with null context: ../../../conf/web.external.xml at java.net.URL.(libgcj.so.7) at java.net.URL.(libgcj.so.7) at gnu.xml.aelfred2.SAXDriver.absolutize(libgcj.so.7) at gnu.xml.aelfred2.XmlParser.parseEntityDecl(libgcj.so.7) at gnu.xml.aelfred2.XmlParser.parseMarkupdecl(libgcj.so.7) at gnu.xml.aelfred2.XmlParser.parseDoctypedecl(libgcj.so.7) at gnu.xml.aelfred2.XmlParser.parseProlog(libgcj.so.7) at gnu.xml.aelfred2.XmlParser.parseDocument(libgcj.so.7) at gnu.xml.aelfred2.XmlParser.doParse(libgcj.so.7) at gnu.xml.aelfred2.SAXDriver.parse(libgcj.so.7) at gnu.xml.aelfred2.XmlReader.parse(libgcj.so.7) at javax.xml.parsers.SAXParser.parse(libgcj.so.7) at org.mortbay.xml.XmlParser.parse(XmlParser.java:218) at org.mortbay.xml.XmlParser.parse(XmlParser.java:235) at org.mortbay.jetty.servlet.XMLConfiguration.configureWebApp(XMLConfiguration.java:190) at org.mortbay.jetty.servlet.WebApplicationContext.configureWebApp(WebApplicationContext.java:422) at org.mortbay.jetty.servlet.WebApplicationContext.doStart(WebApplicationContext.java:481) at org.mortbay.util.Container.start(Container.java:73) at org.mortbay.http.HttpServer.doStart(HttpServer.java:708) at org.mortbay.util.Container.start(Container.java:73) at org.mortbay.jetty.Server.main(Server.java:466) at java.lang.reflect.Method.invoke(libgcj.so.7) at org.mortbay.start.Main.invokeMain(Main.java:151) at org.mortbay.start.Main.start(Main.java:481) at org.mortbay.start.Main.main(Main.java:99) 18:52:23.264 INFO [main] org.mortbay.http.SocketListener.start(SocketListener.java:206) >08> Started SocketListener on 0.0.0.0:8983 18:52:23.375 WARN!! [main] org.mortbay.jetty.Server.main(Server.java:454) >05> EXCEPTION org.mortbay.util.MultiException[java.net.MalformedURLException: Absolute URL required with null context: ../../../conf/web.external.xml] at org.mortbay.http.HttpServer.doStart(HttpServer.java:686) at org.mortbay.util.Container.start(Container.java:73) at org.mortbay.jetty.Server.main(Server.java:466) at java.lang.reflect.Method.invoke(libgcj.so.7) at org.mortbay.start.Main.invokeMain(Main.java:151) at org.mortbay.start.Main.start(Main.java:481) at org.mortbay.start.Main.main(Main.java:99) java.net.MalformedURLException: Absolute URL required with null context: ../../../conf/web.external.xml at java.net.URL.(libgcj.so.7) at java.net.URL.(libgcj.so.7) at gnu.xml.aelfred2.SAXDriver.absolutize(libgcj.so.7) at gnu.xml.aelfred2.XmlParser.parseEntityDecl(libgcj.so.7) at gnu.xml.aelfred2.XmlParser.parseMarkupdecl(libgcj.so.7) at gnu.xml.aelfred2.XmlParser.parseDoctypedecl(libgcj.so.7) at gnu.xml.aelfred2.XmlParser.parseProlog(libgcj.so.7) at gnu.xml.aelfre
Re: solr newbie
Thanks Yonik. All looks good except for the statement: curl installed from the "Web" category. Don't understand what "web category" means. SH. On 6/1/06, Yonik Seeley <[EMAIL PROTECTED]> wrote: Hi Tim, Curl is a little command-line networking tool. The easiest way to get it is cygwin if you are not on a UNIX system. See the 'Requirements" section of the tutorial: 3. On Win32, cygwin, for shell support. (If you plan to use Subversion on Win32, be sure to select the subversion package when you install, in the "Devel" category.) This tutorial will assume that "sh" is in your PATH, and that you have "curl" installed from the "Web" category. -Yonik On 6/1/06, Tim Archambault <[EMAIL PROTECTED]> wrote: > Trying to run the test tutorial to index an xml file and keep getting an > error message: curl: command not found? > > Any help is greatly appreciated.
Re: solr newbie
On 6/1/06, Tim Archambault <[EMAIL PROTECTED]> wrote: Don't understand what "web category" means. SH. The cygwin installer has different categories of packages... "base","devel",etc. If you are looking for the curl package, it should be filed under "web". It's not installed by default, so you need to select it. -Yonik
Re: solr newbie
I'll need to install cygwin again I think. Thanks. On 6/1/06, Yonik Seeley <[EMAIL PROTECTED]> wrote: On 6/1/06, Tim Archambault <[EMAIL PROTECTED]> wrote: > Don't understand what "web category" means. SH. The cygwin installer has different categories of packages... "base","devel",etc. If you are looking for the curl package, it should be filed under "web". It's not installed by default, so you need to select it. -Yonik
Re: !Solr
Thanks for the report Karl, much appreciated. It looks like a problem with your servlet container/JVM not liking the XML entity "../../../conf/web.external.xml" in the web.xml I guess the IBM JVM uses some stricter XML parsing rules or something. If you remove that from the web.xml, it should be fine (in fact I had removed it in the past already... I don't know how it came back). I'll remove it now so it will be fixed for the next nightly build. -Yonik On 6/1/06, karl wettin <[EMAIL PROTECTED]> wrote: Hi all, I need to get something up and running in 12 hours, so I thought it could be fun to see if Solr would work out of the box for me. Neither the example nor the dist war would start. No big deal, I'll hack something up another way. Just thought it would be a good thing to report this. I'm on IBM 1.5 on my PPC Linux. Here are the logs: [EMAIL PROTECTED]:~/download/solr-nightly/example$ java -jar start.jar 18:52:16.463 INFO [main] org.mortbay.log.LogImpl.add(LogImpl.java:110) >14> added [EMAIL PROTECTED] 18:52:16.215 INFO [main] org.mortbay.util.FileResource.(FileResource.java:61) >09> Checking Resource aliases 18:52:16.774 WARN!! [main] org.mortbay.xml.XmlParser.(XmlParser.java:82) >10> Schema validation may not be supported 18:52:17.335 INFO [main] org.mortbay.http.HttpServer.doStart(HttpServer.java:686) >07> Version Jetty/5.1.11RC0 18:52:17.537 INFO [main] org.mortbay.util.Container.start(Container.java:75) >11> Started [EMAIL PROTECTED] 18:52:17.645 INFO [main] org.mortbay.util.Container.start(Container.java:75) >08> Started ServletHttpContext[/,/] 18:52:17.756 INFO [main] org.mortbay.http.SocketListener.start(SocketListener.java:206) >08> Started SocketListener on 127.0.0.1:8081 18:52:17.864 INFO [main] org.mortbay.util.Container.start(Container.java:75) >06> Started [EMAIL PROTECTED] 18:52:18.417 INFO [main] org.mortbay.http.HttpServer.setStatsOn(HttpServer.java:1131) >12> Statistics on = false for [EMAIL PROTECTED] 18:52:18.533 INFO [main] org.mortbay.http.HttpServer.doStart(HttpServer.java:686) >07> Version Jetty/5.1.11RC0 18:52:18.987 INFO [main] org.mortbay.jetty.servlet.WebApplicationContext.resolveWebApp(WebApplicationContext.java:249) >10> Extract jar:file:/home/kalle/download/solr-nightly/example/webapps/solr.war!/ to /tmp/Jetty__8983__solr/webapp 18:52:19.427 WARN!! [main] org.mortbay.xml.XmlParser.(XmlParser.java:82) >14> Schema validation may not be supported 18:52:22.850 WARN!! [main] org.mortbay.jetty.servlet.WebApplicationContext.doStart(WebApplicationContext.java:520) >09> Configuration error on jar:file:/home/kalle/download/solr-nightly/example/webapps/solr.war!/ java.net.MalformedURLException: Absolute URL required with null context: ../../../conf/web.external.xml at java.net.URL.(libgcj.so.7) at java.net.URL.(libgcj.so.7) at gnu.xml.aelfred2.SAXDriver.absolutize(libgcj.so.7)
Re: solr newbie
On 6/1/06, Tim Archambault <[EMAIL PROTECTED]> wrote: I'll need to install cygwin again I think. Thanks. Don't uninstall cygwin... just re-run the cygwin setup.exe and it will do incremental updates, installing packages that have changed, and allowing you to select new packages to install. -Yonik
Re: solr newbie
I found the "web" options. Thank you very much. While that is installing incrementally, two last questions. Are there any example stylesheets to review to see how the data flows into the layout? How would one go about injecting database information into the indexs without having to create XML files for each one? Thanks again. Tim On 6/1/06, Yonik Seeley <[EMAIL PROTECTED]> wrote: On 6/1/06, Tim Archambault <[EMAIL PROTECTED]> wrote: > I'll need to install cygwin again I think. Thanks. Don't uninstall cygwin... just re-run the cygwin setup.exe and it will do incremental updates, installing packages that have changed, and allowing you to select new packages to install. -Yonik
Re: solr newbie
On 6/1/06, Tim Archambault <[EMAIL PROTECTED]> wrote: I found the "web" options. Thank you very much. While that is installing incrementally, two last questions. Are there any example stylesheets to review to see how the data flows into the layout? How would one go about injecting database information into the indexs without having to create XML files for each one? It's most efficient to make a "builder" application that reads from the database, constructs XML documents *in memory* and sends them to the Solr server. Multiple threads/connections open to the Solr server will speed up indexing and hide any request-response latency of individual adds. We don't have it yet, but there really should be a simple Java client library that creates the XML add commands and handles sending them to the server. Also on the "todo" list is indexing directly from a SQL database w/o the user having to write any code except select statements. -Yonik
Re: solr newbie
Great thanks. I manage a newspaper website in Maine USA with about 400,000-500,000 documents/database records (if not more) and I am going to try and create a solr search engine for the site. We'll see how it goes. I've been using a "bastardized" lucene search for my site up to now, but this looks much better. On 6/1/06, Yonik Seeley <[EMAIL PROTECTED]> wrote: On 6/1/06, Tim Archambault <[EMAIL PROTECTED]> wrote: > I found the "web" options. Thank you very much. While that is installing > incrementally, two last questions. > > Are there any example stylesheets to review to see how the data flows into > the layout? > How would one go about injecting database information into the indexs > without having to create XML files for each one? It's most efficient to make a "builder" application that reads from the database, constructs XML documents *in memory* and sends them to the Solr server. Multiple threads/connections open to the Solr server will speed up indexing and hide any request-response latency of individual adds. We don't have it yet, but there really should be a simple Java client library that creates the XML add commands and handles sending them to the server. Also on the "todo" list is indexing directly from a SQL database w/o the user having to write any code except select statements. -Yonik
SolPHP
Hey folks, I noticed a stub on the wiki about two PHP classes for solr. I've tried to track down the classes but have been unsuccessful so far. Does anyone know where, or if, these classes are available? Thanks! -Mike
Re: SolPHP
Nothing in SVN... It looks like Brian Lucas might have been working on something: http://www.mail-archive.com/solr-user%40lucene.apache.org/msg00325.html -Yonik On 6/1/06, Michael J. Giarlo <[EMAIL PROTECTED]> wrote: Hey folks, I noticed a stub on the wiki about two PHP classes for solr. I've tried to track down the classes but have been unsuccessful so far. Does anyone know where, or if, these classes are available? Thanks! -Mike
RE: SolPHP
Yes, I have written bindings but hadn't abstracted them fully. They're pretty solid and since you're the second person that's asked, let me get those out as soon as possible. I'm also working on the Ruby/Rails bindings as well. Brian -Original Message- From: Yonik Seeley [mailto:[EMAIL PROTECTED] Sent: Thursday, June 01, 2006 6:17 PM To: solr-user@lucene.apache.org; [EMAIL PROTECTED] Subject: Re: SolPHP Nothing in SVN... It looks like Brian Lucas might have been working on something: http://www.mail-archive.com/solr-user%40lucene.apache.org/msg00325.html -Yonik On 6/1/06, Michael J. Giarlo <[EMAIL PROTECTED]> wrote: > Hey folks, > > I noticed a stub on the wiki about two PHP classes for solr. I've tried > to track down the classes but have been unsuccessful so far. Does > anyone know where, or if, these classes are available? > > Thanks! > > -Mike
Re: SolPHP
Brian, I'd love to give any RoR bindings a try if you're a point to share. I can see all sorts of interesting fun that can be had with such bindings, such as pulling schema.xml from the server and using its field definitions to build mapping objects (like ActiveRecord), support for all the parameters of the request handler(s), clever iterators that would page through the hits by requesting bite-sized chunks from Solr. At the very least, of course, is having the request and response abstracted so no XML or HTTP is seen by the client code. Erik On Jun 1, 2006, at 8:49 PM, Brian Lucas wrote: Yes, I have written bindings but hadn't abstracted them fully. They're pretty solid and since you're the second person that's asked, let me get those out as soon as possible. I'm also working on the Ruby/Rails bindings as well. Brian -Original Message- From: Yonik Seeley [mailto:[EMAIL PROTECTED] Sent: Thursday, June 01, 2006 6:17 PM To: solr-user@lucene.apache.org; [EMAIL PROTECTED] Subject: Re: SolPHP Nothing in SVN... It looks like Brian Lucas might have been working on something: http://www.mail-archive.com/solr-user%40lucene.apache.org/ msg00325.html -Yonik On 6/1/06, Michael J. Giarlo <[EMAIL PROTECTED]> wrote: Hey folks, I noticed a stub on the wiki about two PHP classes for solr. I've tried to track down the classes but have been unsuccessful so far. Does anyone know where, or if, these classes are available? Thanks! -Mike
RE: SolPHP
Erik, I'll get the PHP bindings out to see how they suit the needs of people and use that feedback for the Rails bindings. I'm looking forward to seeing how they could be implemented as well. Brian -Original Message- From: Erik Hatcher [mailto:[EMAIL PROTECTED] Sent: Thursday, June 01, 2006 6:59 PM To: solr-user@lucene.apache.org Subject: Re: SolPHP Brian, I'd love to give any RoR bindings a try if you're a point to share. I can see all sorts of interesting fun that can be had with such bindings, such as pulling schema.xml from the server and using its field definitions to build mapping objects (like ActiveRecord), support for all the parameters of the request handler(s), clever iterators that would page through the hits by requesting bite-sized chunks from Solr. At the very least, of course, is having the request and response abstracted so no XML or HTTP is seen by the client code. Erik On Jun 1, 2006, at 8:49 PM, Brian Lucas wrote: > Yes, I have written bindings but hadn't abstracted them fully. > They're > pretty solid and since you're the second person that's asked, let > me get > those out as soon as possible. I'm also working on the Ruby/Rails > bindings > as well. > > Brian > > -Original Message- > From: Yonik Seeley [mailto:[EMAIL PROTECTED] > Sent: Thursday, June 01, 2006 6:17 PM > To: solr-user@lucene.apache.org; [EMAIL PROTECTED] > Subject: Re: SolPHP > > Nothing in SVN... It looks like Brian Lucas might have been working on > something: > http://www.mail-archive.com/solr-user%40lucene.apache.org/ > msg00325.html > > -Yonik > > On 6/1/06, Michael J. Giarlo <[EMAIL PROTECTED]> wrote: >> Hey folks, >> >> I noticed a stub on the wiki about two PHP classes for solr. I've >> tried >> to track down the classes but have been unsuccessful so far. Does >> anyone know where, or if, these classes are available? >> >> Thanks! >> >> -Mike
Re: SolPHP
I think I could get some python bindings off those as well. and if people feel there is a need some C/APR ones as well. On 02/06/2006, at 11:16 AM, Brian Lucas wrote: Erik, I'll get the PHP bindings out to see how they suit the needs of people and use that feedback for the Rails bindings. I'm looking forward to seeing how they could be implemented as well. Brian -Original Message- From: Erik Hatcher [mailto:[EMAIL PROTECTED] Sent: Thursday, June 01, 2006 6:59 PM To: solr-user@lucene.apache.org Subject: Re: SolPHP Brian, I'd love to give any RoR bindings a try if you're a point to share. I can see all sorts of interesting fun that can be had with such bindings, such as pulling schema.xml from the server and using its field definitions to build mapping objects (like ActiveRecord), support for all the parameters of the request handler(s), clever iterators that would page through the hits by requesting bite-sized chunks from Solr. At the very least, of course, is having the request and response abstracted so no XML or HTTP is seen by the client code. Erik On Jun 1, 2006, at 8:49 PM, Brian Lucas wrote: Yes, I have written bindings but hadn't abstracted them fully. They're pretty solid and since you're the second person that's asked, let me get those out as soon as possible. I'm also working on the Ruby/Rails bindings as well. Brian -Original Message- From: Yonik Seeley [mailto:[EMAIL PROTECTED] Sent: Thursday, June 01, 2006 6:17 PM To: solr-user@lucene.apache.org; [EMAIL PROTECTED] Subject: Re: SolPHP Nothing in SVN... It looks like Brian Lucas might have been working on something: http://www.mail-archive.com/solr-user%40lucene.apache.org/ msg00325.html -Yonik On 6/1/06, Michael J. Giarlo <[EMAIL PROTECTED]> wrote: Hey folks, I noticed a stub on the wiki about two PHP classes for solr. I've tried to track down the classes but have been unsuccessful so far. Does anyone know where, or if, these classes are available? Thanks! -Mike
RE: solr newbie
I wrote just such a client within the last 24h to support load-testing Solr for my application. The client stub is simple and independent of my particular application, so it would be easy for me to contribute it if there is interest. It has methods to add() a document or collection of documents, and commit() and optimize(). -D -Original Message- From: Yonik Seeley [mailto:[EMAIL PROTECTED] Sent: Thursday, June 01, 2006 10:44 AM To: solr-user@lucene.apache.org Subject: Re: solr newbie We don't have it yet, but there really should be a simple Java client library that creates the XML add commands and handles sending them to the server.
Re: solr newbie
On 6/2/06, Darren Vengroff <[EMAIL PROTECTED]> wrote: I wrote just such a client within the last 24h to support load-testing Solr for my application. The client stub is simple and independent of my particular application, so it would be easy for me to contribute it if there is interest. It has methods to add() a document or collection of documents, and commit() and optimize(). It would be great to see what you have! If you would like to contribute it, or get feedback on the API, please open a new JIRA bug (feature) and add the code there. -Yonik
Re: solr newbie
I would definitely like to use the code to run the same set of tests with my application Regards, Prabhu On 6/2/06, Darren Vengroff <[EMAIL PROTECTED]> wrote: I wrote just such a client within the last 24h to support load-testing Solr for my application. The client stub is simple and independent of my particular application, so it would be easy for me to contribute it if there is interest. It has methods to add() a document or collection of documents, and commit() and optimize(). -D -Original Message- From: Yonik Seeley [mailto:[EMAIL PROTECTED] Sent: Thursday, June 01, 2006 10:44 AM To: solr-user@lucene.apache.org Subject: Re: solr newbie We don't have it yet, but there really should be a simple Java client library that creates the XML add commands and handles sending them to the server.
RE: solr newbie
See http://issues.apache.org/jira/browse/SOLR-20. -D -Original Message- From: Yonik Seeley [mailto:[EMAIL PROTECTED] Sent: Thursday, June 01, 2006 10:15 PM To: solr-user@lucene.apache.org Subject: Re: solr newbie On 6/2/06, Darren Vengroff <[EMAIL PROTECTED]> wrote: > I wrote just such a client within the last 24h to support load-testing Solr > for my application. The client stub is simple and independent of my > particular application, so it would be easy for me to contribute it if there > is interest. It has methods to add() a document or collection of documents, > and commit() and optimize(). It would be great to see what you have! If you would like to contribute it, or get feedback on the API, please open a new JIRA bug (feature) and add the code there. -Yonik
stylesheet issue
I've got solr installed and running, with only one failure left to date. Whenver I try to select a stylesheet for my search, I get an error message such as this: Error loading stylesheet: A network error occured loading an XSLT stylesheet:http://localhost:8983/admin/tabular.xsl Something tells me something isn't mapped correctly here either in Jetty or in a Solar config. My hunch is the path should be " http://localhost:8983/solr/admin/tabular.xsl"; I must say the product is great and the synonym tool is unbelievable. Can't say enough. Any help with this stylesheet issue is greatly appreciated. Tim