Synchronising two masters

Hi , Our solr setup consists of 2 Masters and 2Slaves. The slaves would point to any one of the Masters through a load balancer and replicate the data. Master1(M1) is the primary indexer. I send data to M1. In case M1 fails, i have a failover master, M2 and that would be indexing the data. The pro

Re: Two solr instances access common index

even try. I guarantee Bad Things Will Happen. > >> > >> Why do you want to do this? To save disk space? Accomplish NRT > >> searching on multiple machines? > >> > >> Please define the problem you're trying to solve and why existing > suppor

Re: Two solr instances access common index

on the same files. > You should use this option only for a readonly system. Otherwise it's easy > to corrupt the index. > > Maybe you should have a look on replication or SolrCloud. > > Uwe > > > Am 26.06.2014 11:25, schrieb Prasi S: > > Hi, >> Is it

Two solr instances access common index

Hi, Is it possible to point two solr instances to point to a common index directory. Will this work wit changing the lock type? Thanks, Prasi

Solr index pdf/word document with attachements

Hi , How can I index word / pdf documents with attachments to solr? I have tried indexing a simple file with an attachment using tika, but it does not index the attachment separately. Only the origiinal document is getting indexed. Thanks, Prasi

Inconsistent behavior with Solr replication

Hi, I am using solr 4.4 , replication set with one Master and 1 slave. Master is set to replicate after startup and commit. It has an internal autocommit of maxTime:15000. Slave polls the master every 45sec to check for updates. I indexed Master with DIH, First, indexed half million docs in Mast

Solr indexing javabean

Hi, My solr document has a field is an xml. I am indexing the xml as such to solr and at runtime, i get the xml, parse it and display. Instead of xml, can we index that XML as a Java Bean. Thanks, Prasi

Re: Solr dih to read Clob contents

lizableLocation@5780578 Thanks, Prasi On Mon, Mar 24, 2014 at 3:51 PM, Prasi S wrote: > Below is my full configuration, > > > url="jdbc:db2://IP:port/dbname" user="" password="" /> > > > > > > transformer="ClobTr

Re: Solr dih to read Clob contents

d 'xmldata' in your > data-config. > 2. You have forEach="/*:summary" but I don't think that is a syntax > supported by XPathRecordReader. > > If you can give a sample of the xml stored as Clob in your database, > then we can help you write the right xpa

Re: Solr dih to read Clob contents

My database configuration is as below and i get my response from solr as below org...@1c8e807 Am i mising anything? Thanks, Prasi On Thu, Mar 20, 2014 at 4:25 PM, Gora Mohanty wrote: > On 20 March 2014 14:53, Prasi S wr

Solr dih to read Clob contents

Hi, I have a requirement to index a database table with clob content. Each row in my table a column which is an xml stored as clob. I want to read the contents of xmlthrough dih and map each of the xml tag to a separate solr field, Below is my clob content. A 02-Dec-2013 . . . i

solr securing index files

Hi, Is there any way to secure the solr index directory . I have many users on a server and i want to restrict file access to only the administrator. does securing the index directory affect solr accessing the folder Thanks, Prasi

Network path for data directory

Hi, I have solr index directory in a machine. I want a second solr instance on a different server to use this index. Is it possible to specify the path of a remote machine for data directory. Thanks, Prasi

Setting up solr with IBM Websphere 7

Hi, I have a requirement to setup solr in IBM websphere server 7.x. Has anybody done the same in your project? Is there any blog/ link with the set of instructions for doing the same? Please advice. Thanks, Prasi

Re: Solr and SDL Tridion Integration

can then import from CSV > format. > > Otherwise, you may have to write a custom script or even maybe Java code to > read from SDL Tridion and output a supported Solr format, such as Solr XML, > Solr JSON, or CSV. > > -- Jack Krupansky > > > -Original Message--

Solr and SDL Tridion Integration

Hi, I want to index sdl tridion content to solr. Can you suggest how this can be achieved. Is there any document/tutorial for this? Thanks Thanks, Prasi

Solr standard score

Hi, I have a requirement to standardize solr scores. For example, docs with score > 7 Most relevant docs with score <7 and >4 Moderate docs with score <4 Less relevant. But in the real scenario this does not happen, as in few scenarios the top document may have a score of 3.5. Can i have th

Solr non-suuported languages

hi , I have a requirement to index and search few languages that are not supported by solr. ( E.g countries like Slovenia, Moldova, Belarus etc.) If i need to do only exact match against these langauges, what sort of analyser, tokenizers would suit thanks. Thanks, Prasi

Solrj Query Performance

Hi, We recently saw a behavior which I wanted to confirm, WE are using solrj to query solr. From the code, we use HttpSolrServer to hit the query and return the response 1. When a sample query is hit using Solrj, we get the QTime as 4seconds. The same query when we hit against solr in the browser,

Re: Persist solr cache

Currently , once solr is started, we run a batch that would fire queries to solr ( just something like the firstsearcher does). Once this is done, then the users would start using search. In case the server is restarted or anything crashes, then again i have to run this batch which i cannot contro

Persist solr cache

Hi all, Is there any way the solr caches ( document / field/ query) cache can be persisted on disk. In case of system crash, can i make the new cache loaded from the persisted cache. Thanks, Prasi

Re: Solr Autowarmed queries on jvm crash

/26/2013 11:49 PM, Prasi S wrote: > > Thanks Shawn for the reply. > > > > In that case, when the system is restarted, a new searcher would be > opened? > > It cannot populate from its previous searchers? > > > > I may be wrong here, but i wanted to confirm. >

Re: Solr Autowarmed queries on jvm crash

PM, Prasi S wrote: > > What happens to the autowarmed queries if the servers is shutdown / jvm > > crashes. > > > > Is there any possibility to recover that from the physical storage ( > > trasaction log?) > > The transaction log only contains data that is sen

Solr Autowarmed queries on jvm crash

Hi, What happens to the autowarmed queries if the servers is shutdown / jvm crashes. Is there any possibility to recover that from the physical storage ( trasaction log?) Thanks, Sinduja

Re: SolrCloud frequently hanging

ur commit settings? Both soft and hard? How are you > committing? > > In short, there's not a lot of information to go on here, you need to > provide > a number of details. > > Best, > Erick > > > On Tue, Oct 22, 2013 at 9:25 AM, Prasi S wrote: > > > H

SolrCloud frequently hanging

Hi all, We are using solrcloud 4.4 (solrcloud with external zookeeper, 2 tomcats , 2 solr- 1 in each tomcat) for indexing delimited files. Our index records count to 220 Million. We have three different files each with a partial set of data. We index the first file completely. Then the second and

Re: DIH with SolrCloud

, Raymond Wiker wrote: > It looks like your select statement does not return any rows... have you > verified it with some sort of SQL client? > > > On Tue, Oct 8, 2013 at 8:57 AM, Prasi S wrote: > > > Hi , > > I have setup solrcloud with solr4.4. The cloud has 2 tomcat

DIH with SolrCloud

Hi , I have setup solrcloud with solr4.4. The cloud has 2 tomcat instances with separate zookeeper. i execute the below command in the url, http://localhost:8180/solr/colindexer/dataimportmssql?command=full-import&commit=true&clean=false 0 0 data-config-mssql.xml status idle 1 0 0 201

Solr Commit Time

Hi, What would be the maximum commit time for indexing 1 lakh documents in solr on a 32 gb machine. Thanks, Prasi

Solr DIH call a java class

Hi, Can we call a java class inside a solr ddata-config.xml file similar to calling a script function. I have few manipulations to do before sending data via dataimporthandler. For each row, can I pass that row to a java class in the same way we pass it to a script function? Thanks, Prasi

Zookeeper could not read dataimport.properties

Hi, Im using solr 4.4 cloud setup with external zookeeper and solr running in tomcat. For the initial indexing, i use csv files to load data to solr. Then we do delta indexing from database table. My zookeeper always thorws exception saying "could not read dataimport.properties. Where should we

Re: FAcet with " " values are displayes in output

No analysis is done on the facets. The facets are string fields. On Wed, Sep 18, 2013 at 11:59 PM, tamanjit.bin...@yahoo.co.in < tamanjit.bin...@yahoo.co.in> wrote: > Any analysis happening on the country field during indexing? If so then > facets are on tokens. > > > > -- > View this message in

Re: FAcet with " " values are displayes in output

How to filter them in the query itself? Thanks, Prasi On Wed, Sep 18, 2013 at 1:06 PM, Upayavira wrote: > Filter them out in your query, or in your display code. > > Upayavira > > On Wed, Sep 18, 2013, at 06:36 AM, Prasi S wrote: > > Hi , > > Im using solr 4.4 for o

Re: Stop zookeeper from batch

Yeah, but its not yet into the zookeeper's latest releases. Is it fine with using it. On Wed, Sep 18, 2013 at 2:39 AM, Furkan KAMACI wrote: > Are you looking for that: > > https://issues.apache.org/jira/browse/ZOOKEEPER-1122 > > 16 Eylül 2013 Pazartesi tarihinde Prasi S ad

FAcet with " " values are displayes in output

Hi , Im using solr 4.4 for our search. When i query for a keyword, it returns empty valued facets in the response *1* 1 I have also tried using facet.missing parameter., but no change. How can we handle this. Thanks, Prasi

Stop zookeeper from batch

Hi, We have setup solrcloud with zookeeper and 2 tomcats . we are using a batch file to start the zookeeper, uplink config files and start tomcats. Now, i need to stop zookeeper from the batch file. How is this possible. Im using Windows server. Zookeeper 3.4.5 version. Pls help. Thanks, Prasi

Solr PingQuery

Hi, I use SolrPingResponse.getStatus method to start indexing to solr. I use SolrCloud with external zookeeper If i send it to the Zookeeper, if zookeeper is down, it returns NOTOK. But if one of my solr is up and second solr is down, the Ping returns OK status. Is this the behavior? Thanks, P

Solr wildcard search

Hi all, I am working with wildcard queries and few things are confusing. 1. Does a wildcard search omit the analysers on a particular field? 2. I have searched for q=google\ technology - >gives result q=google technology -> Gives results q=google tech* -> gives results q=google\ tech* -> 0 resu

Escaping *, ? in Solr

Hi, I want to do regex search in solr. E.g: Googl* . In my query api, i have used the ClientUtils.escapeQueryChars funtion to escape characters special to solr. In the above case, a search for 1. Google -> gives 677 records. 2. Googl* -> Escaped as Googl\* in code-> gives 12 results 3. When given

Re: number of replicas in Cloud

, 2013 at 11:17 AM, Prasi S wrote: > > > Hi, > > I want to setup solrcloud with 2 shards and 1 replica for each shard. > > > > MyCollection > > > > shard1 , shard2 > > shard1-replica , shard2-replica > > > > In this case, i would &q

number of replicas in Cloud

Hi, I want to setup solrcloud with 2 shards and 1 replica for each shard. MyCollection shard1 , shard2 shard1-replica , shard2-replica In this case, i would "numShards=2". For replicationFactor , should give replicationFactor=1 or replicationFActor=2 ? Pls suggest me. thanks, Prasi

Does configuration change requires Zookeeper restart?

Hi, I have solrcloud with two collections. I have indexed 100Million docs to the first collection. I need some changes to the solr configuration files. Im going to index the new data tot he second collection. What are the steps that i should follow? Should i restart the zookeeper? Pls suggest T

Re: SolrCloud - Path must not end with / character

The issue is resolved. I have given all the path inside tomcat as relative paths( solr home, solr war). That was the creating the problem. On Mon, Sep 2, 2013 at 2:19 PM, Prasi S wrote: > Does this have anyting to do with tomcat? I cannot go back as we already > fixed with tomcat. &

Re: SolrCloud - Path must not end with / character

g 30, 2013 at 6:28 AM, Prasi S wrote: > > > Also, this fails with the default solr 4.4 downlaoded configuration too > > > > > > On Fri, Aug 30, 2013 at 4:19 PM, Prasi S wrote: > > > > > Below is the script i run > > > > > > STA

Re: SolrCloud - Path must not end with / character

Also, this fails with the default solr 4.4 downlaoded configuration too On Fri, Aug 30, 2013 at 4:19 PM, Prasi S wrote: > Below is the script i run > > START /MAX > F:\SolrCloud\zookeeper\zk-server-1\zookeeper-3.4.5\bin\zkServer.cmd > > > START /MAX F:\solrcloud\zook

Re: SolrCloud - Path must not end with / character

\startup.bat START /MAX F:\solrcloud\tomcat2\bin\startup.bat On Fri, Aug 30, 2013 at 4:07 PM, Prasi S wrote: > Im still clueless on where the issue could be. There is no much > information in the solr logs. > > i had a running version of cloud in another server. I have copied the sa

Re: SolrCloud - Path must not end with / character

Im still clueless on where the issue could be. There is no much information in the solr logs. i had a running version of cloud in another server. I have copied the same to this server, and started zookeeper, then ran teh below commands, java -classpath .;solr-lib/* org.apache.solr.cloud.ZkCLI -cm

SolrCloud - Path must not end with / character

Hi , I have setup solrcloud with solr 4.4. It has two tomcats with 2 solr instances ( one in each tomcat). I start zookeeper , and run the commands for linking the configuration files with zookeeper. After that, when i start tomcat, getting the belwo exception, *Exception in Overseer main queue

Re: Solr 4.0 -> Fuzzy query and Proximity query

28, 2013 at 5:58 PM, Prasi S wrote: > hi Erick, > Yes it is correct. These results are because of stemming + phonetic > matching. Below is the > > Index time > > ST >trinity > services > SF >trinity > services > LCF >trinity > s

Re: Solr 4.0 -> Fuzzy query and Proximity query

> > But you didn't provide the field definition so it's just a guess. > > Best > Erick > > > On Wed, Aug 28, 2013 at 7:43 AM, Prasi S wrote: > > > Hi, > > with solr 4.0 the fuzzy query syntax is like ~1 (or 2) > > Proximity search is li

Solr 4.0 -> Fuzzy query and Proximity query

Hi, with solr 4.0 the fuzzy query syntax is like ~1 (or 2) Proximity search is like "value"~20. How does this differentiate between the two searches. My thought was promiximity would be on phrases and fuzzy on individual words. Is that correct? I wasnted to do a promiximity search for text field

Indexing status when one tomcat goes down

hi all, Im running solr cloud with solr 4.4 . I have 2 tomcat instances with 4 shards ( 2 in each). What will happen if one of the tomcats go down during indexing. The otehr tomcat throws status as " Leader not active" in the logs. Regards, Prasi

Re: Solr Indexing Status

date > handler section. > > http://localhost:8983/solr/collection1/admin/mbeans?stats=true > > On Thu, Aug 22, 2013 at 12:35 PM, Prasi S wrote: > > I am not using dih for indexing csv files. Im pushing data through solrj > > code. But i want a status something like what dih gives

DIH not proceeding after few millions

Hi, Im using DIH to index data to solr. Solr 4.4 version is used. Indexing proceeds normal in the beginning. I have some 10 data-config files. file1 -> select * from table where id between 1 and 100 file2 -> select * from table where id between 100 and 300. and so on. Here 4 batches

Re: Solr Indexing Status

:09 AM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > Yes, you can invoke > http://:/solr/dataimport?command=status which will return > how many Solr docs have been added etc. > > On Wed, Aug 21, 2013 at 4:56 PM, Prasi S wrote: > > Hi, > > I am using

Solr Indexing Status

Hi, I am using solr 4.4 to index csv files. I am using solrj for this. At frequent intervels my user may request for "Status". I have to send get something like in DIH " Indexing in progress.. Added xxx documents". Is there anything like in dih, where we can fire a command=status to get the status

Solr Filter Query

Hi, Is there any limit on how big a filter query can be ? What are the values that should be set properly for handling big filter queries. thanks, Prasi

Re: Solr 4.4 Query ignoring null values

Hi Hoss, Below is the debug output for the query1. We have values for physical_city. It is not an empty valued field. when i said no-value, it was that the query does not have a value. *business_name:Catherine AND physical_city:""* business_name:Catherine AND physical_city:"" (business_name:K0R

Solr 4.4 Query ignoring null values

Hi, I have a few questions with Solr 4.4 query parser 1. http://localhost:8180/solr/collection1/select?q=business_name:Catherine AND city:""&debugQuery=yes -> 100 results In

SolrCloud Zookeeper Exception

Hi, I have setup solrcloud with 4.4 version. There is one external zookeeper and two instances of solr ( Total 4 shards - 2 shards in each instance) I was using dih to index from sql server. I twas indexing fine initially. Later when i shutdown solr and zookeeper's and then restarted them, I get t

Giving OpenSearcher as false

Hi, 1. What is the impact , use of giving opensearcher as true ${solr.autoCommit.maxTime:15000} true 2. Giving the value as "false" , does this create index in the temp file and then commit? Regards, Prasi

Re: Solr 4.4 Cloud always indexing to only one shard

t > Erick > > > On Mon, Aug 12, 2013 at 4:51 AM, Prasi S wrote: > > > Hi, > > I have setup solrcloud in solr 4.4, with 2 solr's in 2 tomcat servers and > > Zookeeper. > > > > I setup Zookeeper with a collection "firstcollection" and the

Setting hostPort in System properties

Hi, when i set solr hostPort in tomcat system properties, it is not working. If I specify that in solr.xml then it is working. Is it mandatory that hostPort shouls be set only in solr.xml ? Solr.xml setting: ${host:} *${port:}* Tomcat runtime setting: * * *set JAVA_OPTS=-Dprogram.na

Solr 4.4 Cloud always indexing to only one shard

Hi, I have setup solrcloud in solr 4.4, with 2 solr's in 2 tomcat servers and Zookeeper. I setup Zookeeper with a collection "firstcollection" and then i give the belwo command http://localhost:8080/solr/admin/cores?action=CREATE&name=mycore_sh1&collection=firstcollection&shard=shard1 Similarly,

Re: Solr 4.4 Default shard

this was only with solr 4.4.I didnt face the issue in any other versions. On Thu, Aug 8, 2013 at 4:23 PM, Prasi S wrote: > Initially i created a single collection, > > ->java -classpath .;zoo-lib/* org.apache.solr.cloud.ZkCLI -cmd > upconfig -zkhost localhost:2181 -co

Re: Solr 4.4 Default shard

example/solr tomcat threw exception as , "could not find Configname for collection1 : found[ myconf1, myconf2]. Any idea? On Thu, Aug 8, 2013 at 3:04 PM, Prasi S wrote: > I have setup solr 4.4 with cloud and have created two cores mycore_shard1, > mycore_shard2. I have few ques

Solr 4.4 Default shard

I have setup solr 4.4 with cloud and have created two cores mycore_shard1, mycore_shard2. I have few questions here, 1. Once the setup is ready, i could see a default collection "collection" with :shard1 in the admin -> cloud page. How to remove it. I have deleted the core.properties file in the

Re: Solr 4.4 ShingleFilterFactroy exception

Any suggestions pls? On Wed, Aug 7, 2013 at 5:17 PM, Prasi S wrote: > Hi, > I have setup solr 4.4 with cloud. When i start solr, I get an exception as > below, > > *ERROR [CoreContainer] Unable to create core: mycore_sh1: > org.apache.solr.common.SolrException: Plugi

Solr 4.4 ShingleFilterFactroy exception

Hi, I have setup solr 4.4 with cloud. When i start solr, I get an exception as below, *ERROR [CoreContainer] Unable to create core: mycore_sh1: org.apache.solr.common.SolrException: Plugin init failure for [schema.xml] fieldType "text_shingle": Plugin init failure for [schema.xml] analyzer/filter:

Re: Solr 4.3 log4j

I could see there is a change in the logging for solr from 4.3 onwards and the steps for setting it up right in tomcat. But this gives a problem while loading configurations to Zookeeper . Am i missing anything. On Mon, Aug 5, 2013 at 12:51 PM, Prasi S wrote: > It didn't work for both

Re: Solr 4.3 log4j

It didn't work for both options.. On Mon, Aug 5, 2013 at 12:19 PM, Shawn Heisey wrote: > On 8/5/2013 12:19 AM, Prasi S wrote: > > Im using solr 4.3 to setup solrcloud. I haev placed all jar files in a > > folder zoo-lib. I have also placed the jar fiels from > /solr/exa

Solr 4.3 log4j

Hi, Im using solr 4.3 to setup solrcloud. I haev placed all jar files in a folder zoo-lib. I have also placed the jar fiels from /solr/example/lib/ext to zoo-lib folder. When I execute this command, java -classpath .;zoo-lib/* org.apache.solr.cloud.ZkCLI -cmd upconfig -zkhost localhost:2181 -conf

SolrCloud Exceptions

Im using SolrCloud with two solr instances in two separate tomcats and Zookeeper. I have created a collection with 4 shards ( 2 in each solr) and was able to distribute data. Now I brought down solr2, then searched. 1. As expected solr2 was down. But solr1 was throwing *no servers hosting shard

Re: SolrCloud separate indexer and Searcher

ode or > SolrCloud... > > Best > Erick > > > On Thu, Aug 1, 2013 at 10:34 AM, Shawn Heisey wrote: > > > On 8/1/2013 4:51 AM, Prasi S wrote: > > > i am using solr 4.0 for indexing db content to a cloud . Currently i > have > > > two solr isntances

Re: SolrCloud replication server and Master Server

I am rephrasing my question, > > > Currently what i haev is > > Solr 8080 ->> Shard1Shard2- Replica > Solr 9090 ->> Shard 2 Shard 1 - Replica > > > Can we have something like > > Solr 8080 ->> Shard 1, Shard 2 > solr 9090 ->> Sh

Re: SolrCloud replication server and Master Server

I am rephrasing my question, Currently what i haev is Solr 8080 -> Shard1Shard2- Replica Solr 9090 -> Shard 2 Shard 1 - Replica Can we have something like Solr 8080 -> Shard 1, Shard 2 solr 9090 -> Shard2-Replica , Shard1- Replica On Thu, Aug 1, 2013 at 6:40 PM, Pr

Re: SolrCloud replication server and Master Server

Here when i create a single shard and a replica, then my shard will be on one server and replcia in teh other isn't ? On Thu, Aug 1, 2013 at 6:29 PM, Rafał Kuć wrote: > Hello! > > There is no master - slave in SolrCloud. You can create a collection > that has only a single shard and have one re

SolrCloud replication server and Master Server

I have a requirement to set solrcloud with 2 instances of Solr( one on 8080 and otehr on 9090 ports respectivey) and a Zookeeper ensembe( 3 modes). Can I have one solr instance as a Master and the other as a replcia of the Master. Because, when i set up a solrcloud and index to one of the solr ru

SolrCloud separate indexer and Searcher

i am using solr 4.0 for indexing db content to a cloud . Currently i have two solr isntances running in separate app servers. Can I have a one solr separately as indexer instance and another as a searcher. This is possible in Master-Slave but does this hold good for SorlCloud also? Because from wh

Solr DIH loggig skipped / error documents

Hi , Im using 4.0 for indexing database content. I have a few doubts here 1. If a document fails during indexing, does indexing proceed? 2. does the faield document get logged in the solr logs? 3. Ho can I reindex the skipped documents once indexing has completed? Please help. Thanks, Prasi