How to Index multiple tables using SOLR

2010-01-22 Thread JavaGuy84
Hi, Eventhough I am new to SOLR I was able to successfully index a single table in a very short span of time. Now we have a requirement where the search needs to happen on multiple tables (mutiple table indexes) at the same time. I couldnt figure out a way to index more than one table in SOLR an

How to Create dynamic field names using script transformers

2010-01-26 Thread JavaGuy84
Hi, I am trying to generate a dynamic fieldname using custom transformers but couldn't achieve the expected results. My requirement is that I do not want to hardcode some of field names used by SOLR for indexing, instead the field name should be generated using the data retreieved from a table.

Re: How to Create dynamic field names using script transformers

2010-01-26 Thread JavaGuy84
tried, what you expected to happen, > and what actually happened. > > Erik > > > On Jan 26, 2010, at 4:15 PM, JavaGuy84 wrote: > >> >> Hi, >> >> I am trying to generate a dynamic fieldname using custom >> transformers but >> couldn&#

Re: How to Create dynamic field names using script transformers

2010-01-26 Thread JavaGuy84
name and property value as its field value..something like... <111>Test<1> Thanks, Barani JavaGuy84 wrote: > > Hi, > > I am trying to generate a dynamic fieldname using custom transformers but > couldn't achieve the expected results. > > M

How to index the fields as key value pair if a query returns multiple rows

2010-01-26 Thread JavaGuy84
Hi all, I have a scenario where a particular query returns multiple results and I need to map those results as a key value pair. Ex: http://old.nabble.com/How-to-index-the-fields-as-key-value-pair-if-a-query-returns-multiple-rows-tp27332475p27332475.html Sent from the Solr - User mailing list a

Performance issue in indexing the data with DIH when using subqueries

2010-02-22 Thread JavaGuy84
Hi, I am facing a performace issue when I am trying to index the data using DIH.. I have a model as below Tables Object ObjectProperty ObjectRelationship Object --> ObjectProperty one to Many Relationship Object --> ObjectRelationship one to Many Relationship We need to get

CachedSqlEntityProcessor- Need help using multiple lookups

2010-02-23 Thread JavaGuy84
Hi, I am trying to use the CachedSqlEntityProcessor for one of my requirement. I couldnt make the CachedSqlEntityProcessor accept more than one filter in the 'where' condition I have something like this My question is, how to make the CachedSqlEntityProcessor accept multiple filter conditi

Delta Query - DIH

2010-02-25 Thread JavaGuy84
Hi,My data config looks like below, I am able to successfully run the Full-Import query without any issue. I am not sure how can I implement a delta query as each of the tables get updated independantly and I need the updates of that particular table to get reflected independently (in

DIH Issue in Delta Query

2010-02-25 Thread JavaGuy84
Hi, My data config looks like below I am able to successfully run the Full-Import query without any issue. I am not sure how can I implement a delta query as each of the tables get updated independantly and I need the updates of that particular table to get reflected in s

Re: Performance issue in indexing the data with DIH when using subqueries

2010-02-25 Thread JavaGuy84
Thanks a lot Shalin.. This resolve my issue :). Thanks, Barani Shalin Shekhar Mangar wrote: > > On Tue, Feb 23, 2010 at 1:01 AM, JavaGuy84 wrote: > >> >> Hi, >> >> I am facing a performace issue when I am trying to index the data using >> DIH

Multi core Search is not working when used with SHARDS

2010-03-03 Thread JavaGuy84
Hi all, I am trying to search on multiple cores (distributed search) but not able to succeed using Shards. I am able to get the results when I am hitting each core seperately, http://localhost:8981/solr/core1/select/?q=test http://localhost:8981/solr/core0/select/?q=test but when I try to use

Confused with Shards multicore search results

2010-03-03 Thread JavaGuy84
Hi, I finally got shards work with multicore but now I am facing a different issue. I have 2 seperate schema / data config files for each core. I also have different unique id for each schema.xml file. I indexed both the cores and I was able to successfully search independently on each core

Re: Confused with Shards multicore search results

2010-03-03 Thread JavaGuy84
for the unique id field? > > On Wed, Mar 3, 2010 at 6:45 PM, JavaGuy84 wrote: >> >> Hi, >> >> I finally got shards work with multicore but now I am facing a different >> issue. >> >> I have 2 seperate schema / data config files for each core. I also ha

SOLR takes more than 9 hours to index 300000 rows

2010-03-06 Thread JavaGuy84
Hi, I am facing performance issue in SOLR when indexing huge data. Please find below the stats, 8:57:17.334 42778 273725 42775 0 Indexing of 273725 rows is taking almost 9 hours. Please find below my Data config file

Re: SOLR takes more than 9 hours to index 300000 rows

2010-03-06 Thread JavaGuy84
t; >user="[REMOVED]" > password="[REMOVED]"/> > > query="select * from [TABLE] where (did mod 6) = 0"> > > > > > On 3/6/2010 9:36 AM, JavaGuy84 wrote: >> Hi, >> >> I am f

Re: SOLR takes more than 9 hours to index 300000 rows

2010-03-06 Thread JavaGuy84
. > > If I'm right, basically what it's doing is issuing a real SQL query > against your first table for every entry it has read for the other two > tables. > > Shawn > > On 3/6/2010 11:58 AM, JavaGuy84 wrote: >> Shawn, >> >> Thanks a lot fo

Is it possible to use ODBC with DIH?

2010-03-06 Thread JavaGuy84
Hi, I have a ODBC driver with me for MetaMatrix DB(Redhat). I am trying to figure out a way to use DIH using the DSN which has been created in my machine with that ODBC driver? Is it possible to spcify a DSN in DIH and index the DB? if its possible, can you please let me know the ODBC URL that I

Re: SOLR takes more than 9 hours to index 300000 rows

2010-03-08 Thread JavaGuy84
eap space > available in your JVM to load the results of all three queries, that > ought to make it work very quickly. > > If I'm right, basically what it's doing is issuing a real SQL query > against your first table for every entry it has read for the other two > tab

Search on dynamic fields which contains spaces /special characters

2010-03-08 Thread JavaGuy84
Hi, We have some dynamic fields getting indexed using SOLR. Some of the dynamic fields contains spaces / special character (something like: short name, Full Name etc...). Is there a way to search on these fields (which contains the spaces etc..). Can someone let me know the filter I need to pass

How to edit / compile the SOLR source code

2010-03-11 Thread JavaGuy84
Hi, Sorry for asking this very simple question but I am very new to SOLR and I want to play with its source code. As a initial step I have a requirement to enable wildcard search (*text) in SOLR. I am trying to figure out a way to import the complete SOLR build to Eclipse and edit QueryParsing.j

Re: How to edit / compile the SOLR source code

2010-03-11 Thread JavaGuy84
ur situation may be an open question... > > Or do you have to hack into the parser for other reasons? > > Best > Erick > > On Thu, Mar 11, 2010 at 12:07 PM, JavaGuy84 wrote: > >> >> Hi, >> >> Sorry for asking this very simple question but

Re: How to edit / compile the SOLR source code

2010-03-11 Thread JavaGuy84
nd yourself in a > quagmire because you allow a* type of queries. > > There are other strategies too, but that seems easiest > > Now, all that said, SOLR has done significant work > to make wildcards work well, these are just general > things to look out for when thinking

How does ReversedWildcardFilterFactory work?

2010-03-12 Thread JavaGuy84
Hi, I am just curious to know how this class works and how this can be implemented in right way. I got the details from JIRA as below This patch is an implementation of the "reversed tokens" strategy for efficient leading wildcards queries. ReversedWildcardsTokenFilter reverses tokens and retu

Need help in deploying the modified SOLR source code

2010-03-12 Thread JavaGuy84
Hi, I had made some changes to solrqueryparser.java using Eclipse and I am able to do a leading wildcard search using Jetty plugin (downloaded this plugin for eclipse).. Now I am not sure how I can package this code and redploy it. Can someone help me out please? Thanks, B -- View this message

DIH - Out of Memory error when using CachedsqlEntityProcessor

2010-03-13 Thread JavaGuy84
Hi, I am using CachedsqlEntityProcessor in my DIH dataconfig to reduce the number of queries executed against the database , I having more than 2 million rows returned for Entity 2 and around 30 rows returned for entity1. I am have set the heap size to 1 GB but even then I am always get

Re: DIH - Out of Memory error when using CachedsqlEntityProcessor

2010-03-13 Thread JavaGuy84
.java:71) at com.metamatrix.common.comm.platform.socket.client.SocketServerInstanc eImpl$1.run(SocketServerInstanceImpl.java:578) at java.lang.Thread.run(Unknown Source) Mar 13, 2010 3:52:09 PM org.apache.solr.update.DirectUpdateHandler2 rollback INFO: end_rollback Thanks, Barani JavaGuy84 wrote: > > Hi, > > I am using Ca

Re: DIH - Out of Memory error when using CachedsqlEntityProcessor

2010-03-13 Thread JavaGuy84
find your question has probably already been answered. Let us > know if you come up blank... > > Best > Erick > > On Sat, Mar 13, 2010 at 3:56 PM, JavaGuy84 wrote: > >> >> Sorry forgot to attach the error log, >> >> Error Log: >> -

Re: Exception encountered during replication on slave....Any clues?

2010-03-17 Thread JavaGuy84
Hi William, We are facing the same issue as yourself.. just thought of checking if you had already resolve this issue? Thanks, Barani William Pierce-3 wrote: > > Folks: > > I am seeing this exception in my logs that is causing my replication to > fail.I start with a clean slate (empty d

Replication failed due to HTTP PROXY?

2010-03-17 Thread JavaGuy84
Hi, One of my collegue back in India is not able to replicate the index present in the Servers (USA). I am now thinking if this is due to any proxy related issue? He is getting the below metioned error message Is there a way to configure PROXY in SOLR config files? Server logs INFO: [] Registe