Re: delay while adding document to solr index
Swapna, Your answers are inline. 2009/9/30 swapna_here : > > hi all, > > I have indexed 10 documents (daily around 5000 documents will be indexed > one at a time to solr) > at the same time daily few(around 2000) indexed documents (added 30 days > back) will be deleted using DeleteByQuery of SolrJ > Previously each document used to be indexed within 5ms.. > but recently i am facing a delay (sometimes 2min to 10 min) while adding > document to index. > And my index (folder) size is also increased to 625MB which is very large > Previously it was around 230MB > > My Questions are: > > 1) is solr not deleting the older documents(added 30 days back) permenently > from index event after committing Have you run optimize? > 2)Why the index size is increased If 5000 docs are added daily and only 2000 deleted, the index size would increase because of the remaining 3000 documents. > 3)reason for delay (2min to 10 mins) while adding the document one at a time > to index I don't know why this would happen. Is your disk nearly full? Which OS are you running on? What is the configuration of Solr? > Help is appreciated > > Thanks in advance.. > > -- > View this message in context: > http://www.nabble.com/delay-while-adding-document-to-solr-index-tp25676777p25676777.html > Sent from the Solr - User mailing list archive at Nabble.com. > > Hope this helps Pravin
Re: Solr Porting to .Net
You may want to check out - http://code.google.com/p/solrnet/ 2009/9/30 Antonio Calò : > Hi All > > I'm wondering if is already available a Solr version for .Net or if it is > still under development/planning. I've searched on Solr website but I've > found only info on Lucene .Net project. > > Best Regards > > Antonio > > -- > Antonio Calò > -- > Software Developer Engineer > @ Intellisemantic > Mail anton.c...@gmail.com > Tel. 011-56.90.429 > -- >
Re: delay while adding document to solr index
Also, what is your merge factor set to? Pravin 2009/9/30 Pravin Paratey : > Swapna, > > Your answers are inline. > > 2009/9/30 swapna_here : >> >> hi all, >> >> I have indexed 10 documents (daily around 5000 documents will be indexed >> one at a time to solr) >> at the same time daily few(around 2000) indexed documents (added 30 days >> back) will be deleted using DeleteByQuery of SolrJ >> Previously each document used to be indexed within 5ms.. >> but recently i am facing a delay (sometimes 2min to 10 min) while adding >> document to index. >> And my index (folder) size is also increased to 625MB which is very large >> Previously it was around 230MB >> >> My Questions are: >> >> 1) is solr not deleting the older documents(added 30 days back) permenently >> from index event after committing > > Have you run optimize? > >> 2)Why the index size is increased > > If 5000 docs are added daily and only 2000 deleted, the index size > would increase because of the remaining 3000 documents. > >> 3)reason for delay (2min to 10 mins) while adding the document one at a time >> to index > > I don't know why this would happen. Is your disk nearly full? Which OS > are you running on? What is the configuration of Solr? > >> Help is appreciated >> >> Thanks in advance.. >> >> -- >> View this message in context: >> http://www.nabble.com/delay-while-adding-document-to-solr-index-tp25676777p25676777.html >> Sent from the Solr - User mailing list archive at Nabble.com. >> >> > > Hope this helps > Pravin >
Re: delay while adding document to solr index
Swapna While the disk space does increase during the process of optimization, it should almost always return to the original size or slightly less. This is a silly question. But off the top of my head, I can't think of any other reason why the index size would increase - Are you running a after adding documents? If you are, you might want to compare the size of each document being currently indexed with the ones you indexed a few months back. To optimize the index, simply post to Solr. Or read [http://wiki.apache.org/solr/SolrOperationsTools] Pravin 2009/9/30 swapna_here : > > thanks for your reply > i have not optimized at all > my knowledge is optimize improves the query performance but it will take > more disk space > except that i have no idea how to use it > > previously for 10 documents the size occupied was around 250MB > > But after 2 months it is 625MB > > why this happened ? > is it because i have not optimized the index > can any body tell me when and how to optimize the index(with configuration > details) . > -- > View this message in context: > http://www.nabble.com/delay-while-adding-document-to-solr-index-tp25676777p25678531.html > Sent from the Solr - User mailing list archive at Nabble.com. > >
Re: Solr configuration with Text files
AFAIK, you're going to have to code something up. Do remember to add CDATA tags to your xml. On Tue, Mar 10, 2009 at 11:31 PM, KennyN wrote: > > This functionality is possible 'out of the box', right? Or am I going to > need > to code up something that reads in the id named files and generates the xml > file? > -- > View this message in context: > http://www.nabble.com/Solr-configuration-with-Text-files-tp22438201p22440095.html > Sent from the Solr - User mailing list archive at Nabble.com. > >
