Glen, Is this LuSql is free? Is that an open source. Is that requires a separate machine with Solr Master
I forgot to tell you that we have Master/Slaves environment of Solr. The Database is running Oracle and it's separate machine that running in different network than Master and Slaves Solr(There is a firewall between Oracle machine and Solr Machines). If we have LuSql Machine, do you think it's better to put into the same network with DataBase machine or Solr machines? Do I need to create a sql script to get the data from Oarcle and loading it using LuSql and convert it to Lucene index, and how solr master will get that data? Thanks Francis -----Original Message----- From: Glen Newton [mailto:glen.new...@gmail.com] Sent: Thursday, July 02, 2009 8:22 AM To: solr-user@lucene.apache.org Subject: Re: Is there any other way to load the index beside using "http" connection? LuSql can be found here: http://lab.cisti-icist.nrc-cnrc.gc.ca/cistilabswiki/index.php/LuSql User Manual: http://cuvier.cisti.nrc.ca/~gnewton/lusql/v0.9/lusqlManual.pdf.html LuSql can communicate directly with Oracle and create a Lucene index for you. Of course - as mentioned by other posters - you need to make sure the versions of Lucene and Solr are compatible (use same jars), you use the same Analyzers, and you create the appropriate 'schema' that Solr understands. -glen 2009/7/2 Francis Yakin <fya...@liquid.com>: > > Glen, > > Database we use is Oracle, I am not the database administrator, so I don't > familiar with their script. > SO, basically we have the Oracle SQL script to load the XML files over HTTP > connection to our Solr Master. > > My question is there any other way instead of using HTTP connection to load > the XML files to our SOLR Master? > > You mentioned about LuSql, I am not familiar with that. Can you provide us > the docs or something? Again I am not the database Guys, I am only the solr > Guy. The database we have is a different box than Solr master and both are > running linux(RedHat). > > Thanks > > Francis > > -----Original Message----- > From: Glen Newton [mailto:glen.new...@gmail.com] > Sent: Wednesday, July 01, 2009 8:06 PM > To: solr-user@lucene.apache.org > Subject: Re: Is there any other way to load the index beside using "http" > connection? > > You can directly load to the backend Lucene using LuSql[1]. It is > faster than Solr, sometimes as much as an order of magnitude faster. > > Disclosure: I am the author of LuSql > > -Glen > http://zzzoot.blogspot.com/ > > [1]http://lab.cisti-icist.nrc-cnrc.gc.ca/cistilabswiki/index.php/LuSql > > 2009/7/1 Francis Yakin <fya...@liquid.com>: >> >> We have several thousands of xml files in database that we load it to solr >> master >> The Database uses "http" connection and transfer those files to solr >> master. Solr then translate xml files to their lindex. >> >> We are experiencing issue with close/open connection in the firewall and >> very very slow. >> >> Is there any other way to load the data/index from Database to solr master >> beside using http connection, so it means we just scp/ftp the xml file from >> Database system to solr master and let solr convert those to lucene indexes? >> >> Any input or help will be much appreciated. >> >> >> Thanks >> >> Francis >> >> >> >> > > > > -- > > - > -- -
