Doubt Regarding Shards Index
I am using solr My index becomes too large I want to implement shards concept but i have some doubt. i searched a lot but not found satisfied result. 1. We need to create handler for shards in solrconfig.xml ? 2. Index will be different for each shards instance means we need to break data in part to create index for each instance or index will be same? 3. How i will recognize which instance return the result ? Please provide me above details this will be very helpful for me. Thanks & Regards Suneel Pandey -- View this message in context: http://lucene.472066.n3.nabble.com/Doubt-Regarding-Shards-Index-tp3629964p3629964.html Sent from the Solr - User mailing list archive at Nabble.com.
Round Robin concept in distributed Solr
So scenario A (round-robin): query 1: /solr-shard-1/select?q=dog... shards=shard-1,shard2 query 2: /solr-shard-2/select?q=dog... shards=shard-1,shard2 query 3: /solr-shard-1/select?q=dog... shards=shard-1,shard2 etc. or or scenario B (fixed): query 1: /solr-shard-1/select?q=dog... shards=shard-1,shard2 query 2: /solr-shard-1/select?q=dog... shards=shard-1,shard2 query 3: /solr-shard-1/select?q=dog... shards=shard-1,shard2 etc. I want to use round-robin for load balancing and got this piece of code. please anyone describe me about query. - Suneel Pandey Sr. Software Developer -- View this message in context: http://lucene.472066.n3.nabble.com/Round-Robin-concept-in-distributed-Solr-tp3636345p3636345.html Sent from the Solr - User mailing list archive at Nabble.com.
How to increase Size of Document in solr
Hello friends, I am facing a problem during indexing of solr. Indexing successfully working when data size 300 mb but now my data size have increased its around 50 GB when i caching data its taking 8 hours and after that I found that data have not committed i have tried 2 time but same issue occurred. Is this any setting need to be done in solrconfig.xml file to increase capacity of data or its is any other problem. Please suggest me this will be very helpful to me. Thanks & Regards ----- Suneel Pandey Sr. Software Developer -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-increase-Size-of-Document-in-solr-tp3771813p3771813.html Sent from the Solr - User mailing list archive at Nabble.com.
Indexing taking so much time to complete.
Hi All, I am using Apache solr 3.1 and trying to caching 50 gb records but it is taking more then 20 hours this is very painful to update records. 1. Is there any way to reduce caching time or this time is ok for 50 gb records ?. 2. What is the delta-import, this will be helpful for me cache only updated record not rather then caching all records ?. Please help me in above mentioned question. Thanks & Regards, ----- Suneel Pandey Sr. Software Developer -- View this message in context: http://lucene.472066.n3.nabble.com/Indexing-taking-so-much-time-to-complete-tp3774464p3774464.html Sent from the Solr - User mailing list archive at Nabble.com.
Delta-Import adding duplicate entry.
Hello Friend, I am working on delta-import I have configured according to given article "http://wiki.apache.org/solr/DataImportHandler#head-9ee74e0ad772fd57f6419033fb0af9828222e041";. but every time when i am executing delta-import through DIH it picked only changed data that is ok, but rather then updating its adding duplicate records. I have defined. "deltaImportQuery", "deltaQuery" in db-data-config.xml I unable to find out the reason. please help me and provide me some example. Thanks & Regards - Suneel Pandey Sr. Software Developer -- View this message in context: http://lucene.472066.n3.nabble.com/Delta-Import-adding-duplicate-entry-tp3783114p3783114.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Delta-Import adding duplicate entry.
I have made unique key in schema.xml now its working for me thanx a lot Regards, - Suneel Pandey Sr. Software Developer -- View this message in context: http://lucene.472066.n3.nabble.com/Delta-Import-adding-duplicate-entry-tp3783114p3783550.html Sent from the Solr - User mailing list archive at Nabble.com.
Bulk insertion in solr
Hello Friends, I am using sql data base and importing data in solr by using DIH. now my data have increase its taking lot of time, i want bulk insert i have tried but not got any article of net. please provide me some example to write the script to bulk insertion from sql to solr. this will be very helpful to me. - Regards, Suneel Pandey Sr. Software Developer -- View this message in context: http://lucene.472066.n3.nabble.com/Bulk-insertion-in-solr-tp3846362p3846362.html Sent from the Solr - User mailing list archive at Nabble.com.
Solr caching memory consumption Problem
Hello friends, I am using DIH for solr indexing. I have 60 million records in SQL which need to upload on solr. i started caching its smoothly working and memory consumption is normal, But after some time incrementally memory consumption going high and process reach more then 6 gb. that the reason i am not able to caching my data. please advise me if anything need to be done in configuration or in tomcat configuration. this will be very help full for me. - Regards, Suneel Pandey Sr. Software Developer -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-caching-memory-consumption-Problem-tp3873158p3873158.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr caching memory consumption Problem
Hello friends, I am using DIH for solr indexing. I have 60 million records in SQL which need to upload on solr. i started caching its smoothly working and memory consumption is normal, But after some time incrementally memory consumption going high and process reach more then 6 gb. that the reason i am not able to caching my data. please advise me if anything need to be done in configuration or in tomcat configuration. this will be very help full for me. - Regards, Suneel Pandey Sr. Software Developer -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-caching-memory-consumption-Problem-tp3873158p3877081.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Virtual Memory very high
Hello Everyone, On window server. I am facing same problem during indexing my memory consumption going very high based on above discussion i checked in my Solrconfig.xml file and found that "directoryFactory" not configured yet. if i configuring directoryfactory then its will help me reduce the consumption of memory. i think below configuration used for linex server. what will be best option for window server which solve my problem. Please suggest me. - Regards, Suneel Pandey Sr. Software Developer -- View this message in context: http://lucene.472066.n3.nabble.com/Virtual-Memory-very-high-tp3574817p3877097.html Sent from the Solr - User mailing list archive at Nabble.com.
Solr Monitoring Tool
Hi, I am want to configure solr performance monitoring tool i surf a lot and found some tool like "zabbix, SolrGaze" but i am not able to decide which tool is better. I want integrated alerting option in tools so that i can received a message whether website performance going down or in case of exception. Please help me, this will be very helpful for me. Thanks - Regards, Suneel Pandey Sr. Software Developer -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Monitoring-Tool-tp3996153.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: solr/tomcat stops responding
Hello Kevin, I am also facing same problem After few hours or few day my solr server getting crash. I try to download following patch but its not accessible now. i am using 3.1 version of solr. http://people.apache.org/~yonik/solr/current/solr.war - Regards, Suneel Pandey Sr. Software Developer -- View this message in context: http://lucene.472066.n3.nabble.com/solr-tomcat-stops-responding-tp474577p3998435.html Sent from the Solr - User mailing list archive at Nabble.com.
PatternTokenizerFactory not working to split comma separated value
Hello , I am using following field type for comma separated value but it is not working. Please suggested what i did wrong. - Regards, Suneel Pandey Sr. Software Developer -- View this message in context: http://lucene.472066.n3.nabble.com/PatternTokenizerFactory-not-working-to-split-comma-separated-value-tp4006994.html Sent from the Solr - User mailing list archive at Nabble.com.
Solr Autocomplete with "did you means" functionality handle misspell word like google
<http://lucene.472066.n3.nabble.com/file/n4092127/autocomplete.png> Hi, I have implemented auto complete it's working file but, I want to implement autosuggestion like google (see above screen) . when someone typing misspell words suggestion should be show e.g: cmputer => computer. Please help me. ----- Regards, Suneel Pandey Sr. Software Developer -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Autocomplete-with-did-you-means-functionality-handle-misspell-word-like-google-tp4092127.html Sent from the Solr - User mailing list archive at Nabble.com.
How to get solr synonyms in result set.
Hi, I want to get specific solr synonyms terms list during query time in result set based on filter criteria. I have implemented synonyms in .txt file. Thanks - Regards, Suneel Pandey Sr. Software Developer -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-get-solr-synonyms-in-result-set-tp4060796.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: [ANNOUNCE] Apache Solr 4.2 released
We presently have Indexes generated from Solr 4.1. What is the upgrade path to Solr 4.2 ? On 3/11/13 8:37 PM, "Robert Muir" wrote: >March 2013, Apache Solr 4.2 available >The Lucene PMC is pleased to announce the release of Apache Solr 4.2 > >Solr is the popular, blazing fast, open source NoSQL search platform >from the Apache Lucene project. Its major features include powerful >full-text search, hit highlighting, faceted search, dynamic >clustering, database integration, rich document (e.g., Word, PDF) >handling, and geospatial search. Solr is highly scalable, providing >fault tolerant distributed search and indexing, and powers the search >and navigation features of many of the world's largest internet sites. > >Solr 4.2 is available for immediate download at: > http://lucene.apache.org/solr/mirrors-solr-latest-redir.html > >See the CHANGES.txt file included with the release for a full list of >details. > >Solr 4.2 Release Highlights: > >* A read side REST API for the schema. Always wanted to introspect the >schema over http? Now you can. Looks like the write side will be >coming next. > >* DocValues have been integrated into Solr. DocValues can be loaded up >a lot faster than the field cache and can also use different >compression algorithms as well as in RAM or on Disk representations. >Faceting, sorting, and function queries all get to benefit. How about >the OS handling faceting and sorting caches off heap? No more tuning >60 gigabyte heaps? How about a snappy new per segment DocValues >faceting method? Improved numeric faceting? Sweet. > >* Collection Aliasing. Got time based data? Want to re-index in a >temporary collection and then swap it into production? Done. Stay >tuned for Shard Aliasing. > >* Collection API responses. The collections API was still very new in >4.0, and while it improved a fair bit in 4.1, responses were certainly >needed, but missed the cut off. Initially, we made the decision to >make the Collection API super fault tolerant, which made responses >tougher to do. No one wants to hunt through logs files to see how >things turned out. Done in 4.2. > >* Interact with any collection on any node. Until 4.2, you could only >interact with a node in your cluster if it hosted at least one replica >of the collection you wanted to query/update. No longer - query any >node, whether it has a piece of your intended collection or not and >get a proxied response. > >* Allow custom shard names so that new host addresses can take over >for retired shards. Working on Amazon without elastic ips? This is for >you. > >* Lucene 4.2 optimizations such as compressed term vectors. > >Solr 4.2 also includes many other new features as well as numerous >optimizations and bugfixes. > >Please report any feedback to the mailing lists >(http://lucene.apache.org/solr/discussion.html) > >Note: The Apache Software Foundation uses an extensive mirroring >network for distributing releases. It is possible that the mirror you >are using may not have replicated the release yet. If that is the >case, please try another mirror. This also goes for Maven access. > >Happy searching, >Lucene/Solr developers
Re: PatternTokenizerFactory not working to split comma separated value
Hi Jack, This is happening on only lucid cloud server not splitting comma separated value. but on solr server this fix is working perfectly. Is any configuration changes in solrconfig.xml which can enable and disable PatternTokenizerFactory? - Regards, Suneel Pandey Sr. Software Developer -- View this message in context: http://lucene.472066.n3.nabble.com/PatternTokenizerFactory-not-working-to-split-comma-separated-value-tp4006994p4007028.html Sent from the Solr - User mailing list archive at Nabble.com.
Authentication Not working in solrnet getting 401 error
Hi,
I am trying to connect with authenticated solr instance. I have added latest
solrnet .dll but getting authentication issue. Please Suggest me where i
did wrong.
ISolrOperations oSolrOperations = null;
const string core0url = "http://localhost:8080/solr/products";;
const string core1url = "http://localhost:8080/solr/products";;
var solrFacility = new SolrNetFacility(core0url);
var container = new WindsorContainer();
container.AddFacility("solr", solrFacility);
BasicAuthHttpWebRequestFactory OAuth = new
BasicAuthHttpWebRequestFactory("djsrNPvHsUnBSETg", "x");
// override core1 components
const string core1Connection = "core1.connection";
container.Register(Component.For().ImplementedBy().Named(core1Connection).Parameters(Castle.MicroKernel.Registration.Parameter.ForKey("serverURL").Eq(core1url)));
container.Register(Component.For(typeof(ISolrBasicOperations),
typeof(ISolrBasicReadOnlyOperations))
.ImplementedBy>()
.ServiceOverrides(ServiceOverride.ForKey("connection").Eq(core1Connection)));
container.Register(Component.For(typeof(ISolrOperations),
typeof(ISolrReadOnlyOperations))
.ImplementedBy>()
.ServiceOverrides(ServiceOverride.ForKey("connection").Eq(core1Connection)));
container.Register(Component.For>().ImplementedBy>()
.ServiceOverrides(ServiceOverride.ForKey("connection").Eq(core1Connection)));
//Authentication//
container.Register(Component.For().ImplementedBy().ServiceOverrides(ServiceOverride.ForKey("connection").Eq("")));
oSolrOperations =
container.Resolve>();
oSolrOperations.Ping();
-
Regards,
Suneel Pandey
Sr. Software Developer
--
View this message in context:
http://lucene.472066.n3.nabble.com/Authentication-Not-working-in-solrnet-getting-401-error-tp4007254.html
Sent from the Solr - User mailing list archive at Nabble.com.
Unable to implememnt SolrNet Authentication.
Hello, I am working on solr authentication with the help of solrnet dll and windsolr container getting some issue. Please suggest me and provide me some link this will be very helpful for me. - Regards, Suneel Pandey Sr. Software Developer -- View this message in context: http://lucene.472066.n3.nabble.com/Unable-to-implememnt-SolrNet-Authentication-tp4007259.html Sent from the Solr - User mailing list archive at Nabble.com.
