Newbie SolR - Need advice
Hi we have a MSSQL Server which is just getting far to large now and performance is dying! the majority of our webservers mainly are doing search function so i thought it may be best to move to SolR But i know very little about it! My questions are! Does SolR Run as a bolt on to MSSQL - as in the data is still in MSSQL and SolR is just the search bit between? Im really struggling to understand the point of SOLR etc so if someone could point me to a Dummies website id apprecaite it! google is throwing to much confusion at me! -- View this message in context: http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: Newbie SolR - Need advice
Thanks guys So SolR is actually a database replacement for mssql... Am I right We have a lot of perl scripts that contains lots of sql insert queries. Etc How do we query the SolR database from scripts I know I have a lot to learn still so excuse my ignorance. Also... What is mongo and how does it compare I just don't understand how in 10years of Web development I have never heard of SolR till last week Sent from Samsung Mobile Original message From: "David Quarterman [via Lucene]" Date: 02/07/2013 16:57 (GMT+00:00) To: fabio1605 Subject: RE: Newbie SolR - Need advice Hi Fabio, Like Jack says, try the tutorial. But to answer your question, SOLR isn't a bolt on to SQLServer or any other DB. It's a fantastically fast indexing/searching tool. You'll need to use the DataImportHandler (see the tutorial) to import your data from the DB into the indices that SOLR uses. Once in there, you'll have more power & flexibility than SQLServer would ever give you! Haven't tried SOLR on Windows (I guess your environment) but I'm sure it'll work using Jetty or Tomcat as web container. Stick with it. The ride can be bumpy but the experience is sensational! DQ -Original Message- From: fabio1605 [mailto:[hidden email]] Sent: 02 July 2013 16:16 To: [hidden email] Subject: Newbie SolR - Need advice Hi we have a MSSQL Server which is just getting far to large now and performance is dying! the majority of our webservers mainly are doing search function so i thought it may be best to move to SolR But i know very little about it! My questions are! Does SolR Run as a bolt on to MSSQL - as in the data is still in MSSQL and SolR is just the search bit between? Im really struggling to understand the point of SOLR etc so if someone could point me to a Dummies website id apprecaite it! google is throwing to much confusion at me! -- View this message in context: http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746.html Sent from the Solr - User mailing list archive at Nabble.com. If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074772.html To unsubscribe from Newbie SolR - Need advice, click here. NAML -- View this message in context: http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074782.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Newbie SolR - Need advice
Hi Ok I'm even more confused now... Sorry for even more stupid questions. So if it's not a database replacement Where do we keep the database then. We have a website that is a documentation website that store documents. It has over 130 million records in a table and 50 million in 2 other plus lots of little tables Most searches are like searching on references or for customer information etc. However with so much information stored ms sql is starting to get slower We have approx 100 tables across 4 different database So this is why I started to look at SolR Q1 if we used SolR would we still use sql as well as SolR or does SolR become sql (speaking theoretically) Q2 if so... How do we move all the data across to SolR. Q3 is SolR useful for what we need. Or is sql the better option based on our circumstances. 50percent of our load is from a website... 50 percent is from scripts adding the information to the site etc Sorry for the silly question I'm just getting really confused now Sent from Samsung Mobile Original message From: "Sandeep Mestry [via Lucene]" Date: 02/07/2013 17:29 (GMT+00:00) To: fabio1605 Subject: Re: Newbie SolR - Need advice Hi Fabio, No, Solr isn't the database replacement for MS SQL. Solr is built on top of Lucene which is a search engine library for text searches. Solr in itself is not a replacement for any database as it does not support any relational db features, however as Jack and David mentioned its fully optimised search engine platform that can provide all search related features like faceting, highlighting etc. Solr does not have a *database*. It stores the data in binary files called indexes <http://lucene.apache.org/core/3_0_3/fileformats.html>. These indexes are populated with the data from the database. Solr provides an inbuilt functionality through DataImportHandler component to get the data and generate indexes. When you say, your web servers are mainly doing search function, do you mean it is a text search and you use queries with clauses as 'like', 'in' etc. (in addition to multiple joints) to get the results? Does the web application need faceting? If yes, then solr can be your friend to get it through. Do remember that it always takes some time to get the new concepts from understanding through to implementation. As David mentioned already, it *is* going to be a bumpy ride at the start but *definitely* a sensational one. Good Luck, Sandeep On 2 July 2013 17:09, fabio1605 <[hidden email]> wrote: > Thanks guys > > So SolR is actually a database replacement for mssql... Am I right > > > We have a lot of perl scripts that contains lots of sql insert > queries. Etc > > > How do we query the SolR database from scripts I know I have a lot to > learn still so excuse my ignorance. > > Also... What is mongo and how does it compare > > I just don't understand how in 10years of Web development I have never > heard of SolR till last week > > > > > Sent from Samsung Mobile > > Original message > From: "David Quarterman [via Lucene]" < > [hidden email]> > Date: 02/07/2013 16:57 (GMT+00:00) > To: fabio1605 <[hidden email]> > Subject: RE: Newbie SolR - Need advice > > Hi Fabio, > > Like Jack says, try the tutorial. But to answer your question, SOLR isn't > a bolt on to SQLServer or any other DB. It's a fantastically fast > indexing/searching tool. You'll need to use the DataImportHandler (see the > tutorial) to import your data from the DB into the indices that SOLR uses. > Once in there, you'll have more power & flexibility than SQLServer would > ever give you! > > Haven't tried SOLR on Windows (I guess your environment) but I'm sure > it'll work using Jetty or Tomcat as web container. > > Stick with it. The ride can be bumpy but the experience is sensational! > > DQ > > -Original Message- > From: fabio1605 [mailto:[hidden email]] > Sent: 02 July 2013 16:16 > To: [hidden email] > Subject: Newbie SolR - Need advice > > Hi > > we have a MSSQL Server which is just getting far to large now and > performance is dying! the majority of our webservers mainly are doing > search function so i thought it may be best to move to SolR But i know very > little about it! > > My questions are! > > Does SolR Run as a bolt on to MSSQL - as in the data is still in MSSQL and > SolR is just the search bit between? > > Im really struggling to understand the point of SOLR etc so if someone > could point me to a Dummies website id apprecaite it! google is throw
Re: Newbie SolR - Need advice
Arrfh I see... So SolR is the search engine for a datastore Is that what mongo is.. A datastore bit. Sent from Samsung Mobile Original message From: "Jack Krupansky-2 [via Lucene]" Date: 02/07/2013 17:51 (GMT+00:00) To: fabio1605 Subject: Re: Newbie SolR - Need advice Consider DataStax Enterprise - it combines Cassandra for NoSql data storage with Solr for indexing - fully integrated. http://www.datastax.com/ -- Jack Krupansky -Original Message----- From: fabio1605 Sent: Tuesday, July 02, 2013 12:44 PM To: [hidden email] Subject: Re: Newbie SolR - Need advice Hi Ok I'm even more confused now... Sorry for even more stupid questions. So if it's not a database replacement Where do we keep the database then. We have a website that is a documentation website that store documents. It has over 130 million records in a table and 50 million in 2 other plus lots of little tables Most searches are like searching on references or for customer information etc. However with so much information stored ms sql is starting to get slower We have approx 100 tables across 4 different database So this is why I started to look at SolR Q1 if we used SolR would we still use sql as well as SolR or does SolR become sql (speaking theoretically) Q2 if so... How do we move all the data across to SolR. Q3 is SolR useful for what we need. Or is sql the better option based on our circumstances. 50percent of our load is from a website... 50 percent is from scripts adding the information to the site etc Sorry for the silly question I'm just getting really confused now Sent from Samsung Mobile Original message From: "Sandeep Mestry [via Lucene]" <[hidden email]> Date: 02/07/2013 17:29 (GMT+00:00) To: fabio1605 <[hidden email]> Subject: Re: Newbie SolR - Need advice Hi Fabio, No, Solr isn't the database replacement for MS SQL. Solr is built on top of Lucene which is a search engine library for text searches. Solr in itself is not a replacement for any database as it does not support any relational db features, however as Jack and David mentioned its fully optimised search engine platform that can provide all search related features like faceting, highlighting etc. Solr does not have a *database*. It stores the data in binary files called indexes <http://lucene.apache.org/core/3_0_3/fileformats.html>. These indexes are populated with the data from the database. Solr provides an inbuilt functionality through DataImportHandler component to get the data and generate indexes. When you say, your web servers are mainly doing search function, do you mean it is a text search and you use queries with clauses as 'like', 'in' etc. (in addition to multiple joints) to get the results? Does the web application need faceting? If yes, then solr can be your friend to get it through. Do remember that it always takes some time to get the new concepts from understanding through to implementation. As David mentioned already, it *is* going to be a bumpy ride at the start but *definitely* a sensational one. Good Luck, Sandeep On 2 July 2013 17:09, fabio1605 <[hidden email]> wrote: > Thanks guys > > So SolR is actually a database replacement for mssql... Am I right > > > We have a lot of perl scripts that contains lots of sql insert > queries. Etc > > > How do we query the SolR database from scripts I know I have a lot to > learn still so excuse my ignorance. > > Also... What is mongo and how does it compare > > I just don't understand how in 10years of Web development I have never > heard of SolR till last week > > > > > Sent from Samsung Mobile > > Original message > From: "David Quarterman [via Lucene]" < > [hidden email]> > Date: 02/07/2013 16:57 (GMT+00:00) > To: fabio1605 <[hidden email]> > Subject: RE: Newbie SolR - Need advice > > Hi Fabio, > > Like Jack says, try the tutorial. But to answer your question, SOLR isn't > a bolt on to SQLServer or any other DB. It's a fantastically fast > indexing/searching tool. You'll need to use the DataImportHandler (see the > tutorial) to import your data from the DB into the indices that SOLR uses. > Once in there, you'll have more power & flexibility than SQLServer would > ever give you! > > Haven't tried SOLR on Windows (I guess your environment) but I'm sure > it'll work using Jetty or Tomcat as web container. > > Stick with it. The ride can be bumpy but the experience is sensational! > > DQ > > -Original Message- > From: fabio1605 [mailto:[hidden email]] > Se
RE: Newbie SolR - Need advice
So, you keep your mssql database, you just don't use it for searches - that'll relieve some of the load. Searches then all go through SOLR & its Lucene indexes. If your various tables need SQL joins, you specify those in the DataImportHandler (DIH) config. That way, when SOLR indexes everything, it indexes the data the way you want to see it. -- SO by this you mean we keep mssql as we do!! But we use the website to run through SOLR SOLR will then handle the indexing and retrieval of data from its own index's, and will make its own calls to our MSSQL server when required(i.e updating/adding to indexs..) Am I on the right tracks there now! So MSSQL becomes the datastore SOLR becomes the search engine... -- View this message in context: http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4074889.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Newbie SolR - Need advice
Hi Sandeep Thank you for your reply Il have a read through the tutorials now that i understand the principle of all this, i would ideally like to keep mssql and bolt solr on top of this so that we can keep mssql as we have a 200GB database Cheers -- View this message in context: http://lucene.472066.n3.nabble.com/Newbie-SolR-Need-advice-tp4074746p4075026.html Sent from the Solr - User mailing list archive at Nabble.com.
