Re: Is there any other way to load the index beside using "http" connection?

2009-07-06 Thread Marcus Herou
Out of my head... but are you not supposed to active the stream-handler in SOLR ? Think it is documented... Cheers //Marcus On Mon, Jul 6, 2009 at 8:55 PM, Francis Yakin wrote: > Yes, I uploaded the CSV file that I get it from Database then I ran that > cmd and I have the error. > > Any sugges

Tagging and searching on tagged indexes.

2009-07-06 Thread Rakhi Khatwani
Hi, How do we tag solr indexes and search on those indexes, there is not much information on wiki. all i could find is this: http://wiki.apache.org/solr/UserTagDesign has anyone tried it? (using solr API) One more question, can we change the schema dynamically at runtime? (while solr instan

Query on the updation of synonym and stopword file.

2009-07-06 Thread Sagar Khetkade
Hello All, I was figuring out the issue with the synonym.txt and stopword.txt files being updated on regular interval. Here in my case I am updating the synonym.txt and stopword.txt files as the synonym and stop word dictionary is update. I am facing a problem here that even after the core

Re: Filtering MoreLikeThis results

2009-07-06 Thread Bill Au
I have been trying to restrict MoreLikeThis results without any luck also. In additional to restricting the results, I am also looking to influence the scores similar to the way boost query (bq) works in the DisMaxRequestHandler. I think Solr's MoreLikeThis depends on Lucene's contrib queries More

Creating DataSource for DIH to Oracle Database

2009-07-06 Thread Francis Yakin
Have any one had experience creating a datasource for DIH to an Oracle Database? Also, from the Solr side we are running weblogic and deploy the application using weblogic. I know in weblogic we can create a datasource that can connect to Oracle database, has any one had experience with this?

Re: Suggestions needed: Lots of updates for tiny changes

2009-07-06 Thread Development Team
Hi Otis, Thanks for your reply and for giving it some thought. Actually we have considered using something that lives outside of the main index... We've looked into using the ExternalFileField, but abandoned that when it became clear we'd have to use a function to use it, and that limited

Re: Problem in parsing non-string dynamic field by using IndexReader

2009-07-06 Thread Yuchen Wang
that works perfectly! Thanks a lot! On Mon, Jul 6, 2009 at 2:12 PM, Chris Hostetter wrote: > : OK, here is my latest code to get the IndexReader from the solr core. > : However, it still printed out the non-string fields as special chars. I > do > : use the schema file here. Please help. > > you'

Re: Problem in parsing non-string dynamic field by using IndexReader

2009-07-06 Thread Chris Hostetter
: OK, here is my latest code to get the IndexReader from the solr core. : However, it still printed out the non-string fields as special chars. I do : use the schema file here. Please help. you'll want to use the IndexSchema object to get the FieldType object for your field name. then use the Fi

Re: reindexed data on master not replicated to slave

2009-07-06 Thread solr jay
It looks that the problem is here or before that in SnapPuller.fetchLatestIndex(): terminateAndWaitFsyncService(); LOG.info("Conf files are not downloaded or are in sync"); if (isSnapNeeded) { modifyIndexProps(tmpIndexDir.getName()); } else {

RE: Is there any other way to load the index beside using "http" connection?

2009-07-06 Thread Francis Yakin
Yes, I uploaded the CSV file that I get it from Database then I ran that cmd and I have the error. Any suggestions? Thanks Francis -Original Message- From: NitinMalik [mailto:malik.ni...@yahoo.com] Sent: Monday, July 06, 2009 11:32 AM To: solr-user@lucene.apache.org Subject: RE: Is the

RE: Is there any other way to load the index beside using "http" connection?

2009-07-06 Thread NitinMalik
Hi Francis, I have experienced that update stream handler (for a xml file in my case) worked only for Solr running on the same machine. I also got same error when I tried to update the documents on a remote Solr instance. Regards Nitin Francis Yakin wrote: > > > Ok, I have a CSV file(call

Filtering MoreLikeThis results

2009-07-06 Thread Yao Ge
I could not find any support from http://wiki.apache.org/solr/MoreLikeThis on how to restrict MLT results to certain subsets. I passed along a fq parameter and it is ignored. Since we can not incorporate the filters in the query itself which is used to retrieve the target for similarity comparison

RE: Is there any other way to load the index beside using "http" connection?

2009-07-06 Thread Francis Yakin
Ok, I have a CSV file(called it test.csv) from database. When I tried to upload this file to solr using this cmd, I got "stream.contentType=text/plain: No such file or directory" error curl http://localhost:8983/solr/update/csv?stream.file=/opt/apache-1.2.0/example/exampledocs/test.csv&stream.

Re: Is there any other way to load the index beside using "http" connection?

2009-07-06 Thread Norberto Meijome
On Mon, 6 Jul 2009 09:56:03 -0700 Francis Yakin wrote: > Norberto, > > Thanks, I think my questions is: > > >>why not generate your SQL output directly into your oracle server as a file > > What type of file is this? > > a file in a format that you can then import into SOLR.

RE: Is there any other way to load the index beside using "http" connection?

2009-07-06 Thread Francis Yakin
Norberto, Thanks, I think my questions is: >>why not generate your SQL output directly into your oracle server as a file What type of file is this? Thanks again for your help. Francis -Original Message- From: Norberto Meijome [mailto:numard...@gmail.com] Sent: Monday, July 06, 2009

Re: Replication In 1.4

2009-07-06 Thread Otis Gospodnetic
And if you don't mind using the nightly Solr build, the admin page caching has been fixed in the trunk, so this won't bite you again. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: Lee Theobald > To: solr-user@lucene.apache.org > Sent:

Re: Using MMapDirectory

2009-07-06 Thread Otis Gospodnetic
Is there a benefit to using MMapDirectory instead of, say, tmpfs (RAM disk) under Linux? Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: Mark Miller > To: solr-user@lucene.apache.org > Sent: Monday, July 6, 2009 9:28:43 AM > Subject: Re:

Re: Multiple values for custom fields provided in SOLR query

2009-07-06 Thread Otis Gospodnetic
I actually don't fully understand your question. q=+fileID:111+fileID:222+fileID:333+apple looks like a valid query to me. (not sure what that space encoded as + is, though) Also not sure what you mean by: > Basically the requirement is , if fileIDs are provided as search parameter > then search

Re: Retrieve docs with > 1 multivalue field hits

2009-07-06 Thread Otis Gospodnetic
I don't recall seeing that mentioned at all... but my memory fails me all the time. Who's Solr? Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: A. Steven Anderson > To: solr-user@lucene.apache.org > Sent: Monday, July 6, 2009 12:25:48 PM

Re: Retrieve docs with > 1 multivalue field hits

2009-07-06 Thread A. Steven Anderson
I thought this would be a quick yes or no answer and/or reference to another thread, but alas, I got no replies. Is it safe to assume the answer is 'no' for both Solr 1.3 and 1.4? On Thu, Jul 2, 2009 at 3:48 PM, A. Steven Anderson wrote: > Greetings! > > I thought I remembered seeing a thread r

Re: Popular keywords statistics .

2009-07-06 Thread Alexander Wallace
Indeed that was one of the first approaches... Thanks a lot! Michael Ludwig wrote: Wallace schrieb: I'd like to hear what approaches are being used by users to know what people is searching for in their apps. You could process the access log. You could write a filter servlet logging the re

grouping and sorting by facet?

2009-07-06 Thread Peter Keane
Sorry if I am missing something obvious here Is there a way to group and sort by facet count? I have a large set of images, each of which is part of a different "collection." I am performing a faceted search: /solr/select/?q=my+term&max=30&version=2.2&rows=30&start=0&facet=true&facet.field=

Re: Replication In 1.4

2009-07-06 Thread Lee Theobald
The problem turned out to be two fold. Firstly, Tomcat was caching an old version on the admin page (hiding the replication link and some other info) and secondly I had a mistake in some configuration meaning the indexes weren't building in the correct places. But it's sorted now and I have some

Multiple values for custom fields provided in SOLR query

2009-07-06 Thread Suryasnat Das
Hi, I have a requirement in which i need to have multiple values in my custom fields while forming the search query to SOLR. For example, fileID is my custom field. I have defined the fileID in schema.xml as . Now fileID can have multiple values like 111,222,333 etc. So will my query be of the form

Re: Replication In 1.4

2009-07-06 Thread Mark Miller
On Mon, Jul 6, 2009 at 10:43 AM, Lee Theobald wrote: > > I think it's best if I just clear down and start again. I've got something > wrong somewhere. I've noticed that what I consider to be the slave does > have a "Replication" link in the admin area. My master doesn't. They both > seem to b

Re: Replication In 1.4

2009-07-06 Thread Lee Theobald
I think it's best if I just clear down and start again. I've got something wrong somewhere. I've noticed that what I consider to be the slave does have a "Replication" link in the admin area. My master doesn't. They both seem to be reporting the same version from the info page (1.3.0.2009.06.3

Re: Replication In 1.4

2009-07-06 Thread Lee Theobald
Cheers for the info Mark. That looks pretty similar to what I have. Slave is almost the same, master was slightly different but I don't think incorrect: optimize optimize solrconfig_slave.xml:solrconfig.xml,schema.xml,stopwords.txt,elevate.xml I'll keep looking as I'm bound to have mis

Re: Replication In 1.4

2009-07-06 Thread Mark Miller
Lee Theobald wrote: Hi all, I've been trying to get the replication working in my test version of Solr (1.4) but I don't think I've got it right. There doesn't seem to be any errors but it doesn't seem to be working either. I'm going to the distribution admin page [1] and just getting a bit of

Faceting with MoreLikeThis

2009-07-06 Thread Yao Ge
Does Solr support faceting on MoreLikeThis search results? -- View this message in context: http://www.nabble.com/Faceting-with-MoreLikeThis-tp24356166p24356166.html Sent from the Solr - User mailing list archive at Nabble.com.

Replication In 1.4

2009-07-06 Thread Lee Theobald
Hi all, I've been trying to get the replication working in my test version of Solr (1.4) but I don't think I've got it right. There doesn't seem to be any errors but it doesn't seem to be working either. I'm going to the distribution admin page [1] and just getting a bit of text telling me "No

Re: Using MMapDirectory

2009-07-06 Thread Mark Miller
Marc Sturlese wrote: Hey there, For testing purpose I am trying to use lucene's MMapDirectory in a recent Solr nightly instance. I have read in Lucene's documentation: "To use MMapDirectory, invoke Java with the System property org.apache.lucene.FSDirectory.class set to org.apache.lucene.store.M

Re: Is there any other way to load the index beside using "http" connection?

2009-07-06 Thread Marcus Herou
Yes exactly just being friendly sharing a working routine. Took me some hours to figure out DIH myself at the time. //Marcus On Mon, Jul 6, 2009 at 1:32 PM, Norberto Meijome wrote: > On Sun, 5 Jul 2009 21:36:35 +0200 > Marcus Herou wrote: > > > Sharing some of our exports from DB to solr. Note:

Re: Is there any other way to load the index beside using "http" connection?

2009-07-06 Thread Norberto Meijome
On Sun, 5 Jul 2009 10:28:16 -0700 Francis Yakin wrote: [...]> > >upload the file to your SOLR server? Then the data file is local to your SOLR > >server , you will bypass any WAN and firewall you may be having. (or some > >variation of it, sql -> SOLR server as file, etc..) > > How we upload th

Re: Is there any other way to load the index beside using "http" connection?

2009-07-06 Thread Norberto Meijome
On Sun, 5 Jul 2009 21:36:35 +0200 Marcus Herou wrote: > Sharing some of our exports from DB to solr. Note: many of the statements > below might not work due to clip-clip. thx Marcus - but that's a DIH config right? :) b _ {Beto|Norberto|Numard} Meijome "I respect faith,

Using MMapDirectory

2009-07-06 Thread Marc Sturlese
Hey there, For testing purpose I am trying to use lucene's MMapDirectory in a recent Solr nightly instance. I have read in Lucene's documentation: "To use MMapDirectory, invoke Java with the System property org.apache.lucene.FSDirectory.class set to org.apache.lucene.store.MMapDirectory. This wil

Re: Index partitioning with solr multiple core feature

2009-07-06 Thread Sumit Aggarwal
Shalin, First of all each entity data is unrelated so it makes sense to use solr core concept as per your suggestion. But Since you are suggesting putting each entity index on same box will consume CPU so does it make sense to add boxes based on number of entities considering i will have to add re

Re: Popular keywords statistics .

2009-07-06 Thread Michael Ludwig
Wallace schrieb: I'd like to hear what approaches are being used by users to know what people is searching for in their apps. You could process the access log. You could write a filter servlet logging the relevant part of the query string to a dedicated location. Michael Ludwig

Re: Index partitioning with solr multiple core feature

2009-07-06 Thread Shalin Shekhar Mangar
On Mon, Jul 6, 2009 at 3:05 PM, Sumit Aggarwal wrote: > Hi Shalin, > Yes i want to achieve a logical separation of indexes for performance > reason > also else index size will keep on growing as i have 8 different entities. I > am already partitioning all these entities to different servers also o

Re: Index partitioning with solr multiple core feature

2009-07-06 Thread Sumit Aggarwal
Shalin, at a time i will be doing search only on one entity... Also data will be indexed only to corresponding entity. Thanks, Sumit On Mon, Jul 6, 2009 at 3:05 PM, Sumit Aggarwal wrote: > Hi Shalin, > Yes i want to achieve a logical separation of indexes for performance > reason also else index

Re: Index partitioning with solr multiple core feature

2009-07-06 Thread Sumit Aggarwal
Hi Shalin, Yes i want to achieve a logical separation of indexes for performance reason also else index size will keep on growing as i have 8 different entities. I am already partitioning all these entities to different servers also on which i will be doing search based on distributed search by sol

Re: Index partitioning with solr multiple core feature

2009-07-06 Thread Shalin Shekhar Mangar
On Mon, Jul 6, 2009 at 1:40 PM, Sumit Aggarwal wrote: > I was trying to implement entity based partitioning using multiple core > feature. > So my solr.xml is like : > > > > > > > > > > > > Now using http://localhost:8983/solr/User/ or > http://localhost:8983/solr/Group/ i am able to rea

Re: Index partitioning with solr multiple core feature

2009-07-06 Thread Sumit Aggarwal
I forgot to mention i already have a partitioning to 3 different servers for each entity based on some unique int value. On Mon, Jul 6, 2009 at 1:40 PM, Sumit Aggarwal wrote: > I was trying to implement entity based partitioning using multiple core > feature. > So my solr.xml is like : > > >

Index partitioning with solr multiple core feature

2009-07-06 Thread Sumit Aggarwal
I was trying to implement entity based partitioning using multiple core feature. So my solr.xml is like : Now using http://localhost:8983/solr/User/ or http://localhost:8983/solr/Group/ i am able to reach seperate partition for entity based search. Now question arises for entity based in