Re: reindexed data on master not replicated to slave

On Wed, Jul 8, 2009 at 10:14 PM, solr jay wrote: > Thanks. The patch looks good, and I now see the new index directory and it > is in sync with the one on master. I'll do more testing. > > It is probably not important, but I am just curious why we switch index > directory. I thought it would be eas

Re: Best way to integrate custom functionality

How about, for example +cars -"no cars" -"nothing cars" In other words, the basic query is the original query, and then loop over all negative words and append exclude phrase clauses like in the above example. That will find documents that have the word cars in them, but any documents with "

Re: Boosting for most recent documents

Sort by the internal Lucene document ID and pick the highest one. That might do the job for you. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: vivek sar > To: solr-user > Sent: Wednesday, July 8, 2009 8:34:16 PM > Subject: Boosting fo

Boosting for most recent documents

Hi, I'm trying to find a way to get the most recent entry for the searched word. For ex., if I have a document with field name "user". If I search for user:vivek, I want to get the document that was indexed most recently. Two ways I could think of, 1) Sort by some time stamp field - but with mi

Best way to integrate custom functionality

Hello all, I am working on a project that involves searching through free-text fields and would like to add the ability to filter out negative expressions at a very simple level. For example, the field may contain the text, "person has no cars." If the user were to search for "cars," I

boosting MoreLikeThis results

I have a need to boost MoreLikeThis results. So far the only boost that I have come across is boosting query field by using mlt.qf. But what I really need is to use boost query and boost function like those in the DisMaxRequestHandler. Is that possible at all either out-of-the-box or by writing

Re: Solr's MLT query call doesn't work

Many thanks to everybody who replied to my message. 1. "A couple of things, your mlt.fl value, must be part of fl. In this case, content_mlt is not included in fl. I think the fl parameter value need to be comma separated. try fl=title,author,content_mlt,score" Yao, Although I don't understan

Re: about defaultSearchField

Yes, I have deleted whole "index" directory and re-index after making changes. Yang 2009/7/8 Jay Hill > Just to be sure: You mentioned that you "adjusted" schema.xml - did you > re-index after making your changes? > > -Jay > > > On Wed, Jul 8, 2009 at 7:07 AM, Yang Lin wrote: > > > Thanks for

Re: Solr's MLT query call doesn't work

You definitely need "mlt=true" if you are not using /solr/mlt. Bill On Wed, Jul 8, 2009 at 2:14 PM, Otis Gospodnetic wrote: > > Sergey, > > What about > http://localhost:8080/solr/select?q=id:10&mlt=true&mlt.fl=content_mlt&mlt.maxqt= > 5&mlt.interestingTerms=details&fl=title+author+score&qt=mlt

Re: Indexing rich documents from websites using ExtractingRequestHandler

I haven't tried this myself, but it sounds like what you're looking for is enabling remote streaming: http://wiki.apache.org/solr/ContentStream#head-7179a128a2fdd5dde6b1af553ed41735402aadbf As the link above shows you should be able to enable remote streaming like this: and then something like t

Re: Solr's MLT query call doesn't work

Sergey, What about http://localhost:8080/solr/select?q=id:10&mlt=true&mlt.fl=content_mlt&mlt.maxqt= 5&mlt.interestingTerms=details&fl=title+author+score&qt=mlt ? Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: SergeyG > To: solr-user@lu

Re: Multiple values for custom fields provided in SOLR query

Suryasnat, I suggest you go to your Solr Admin page and run a few searches from there, using Lucene query syntax (link on Lucene site). e.g. fieldID:111 AND fieldID:222 AND fieldID:333 AND foo:product then eplace ANDs with ORs where appropriate That should give you an idea/feel about which que

expand synonyms without tokenizing stream?

I'm pretty new to solr; my apologies if this is a naive question, and my apologies for the verbosity: I'd like to take keywords in my documents, and expand them as synonyms; for example, if the document gets annotated with a keyword of 'sf', I'd like that to expand to 'San Francisco'. (San Francis

Re: Adding new Fields ?

Here is my result when I'm adding a file to solr {...@framboise.}:java -jar post.jar FinalParsing.xml [18:37]#25 SimplePostTool: version 1.2 SimplePostTool: WARNING: Make sure your XML documents are encoded in UTF-8, other encodings are not currently supported SimplePostTool: POSTing files to http

Re: about defaultSearchField

Just to be sure: You mentioned that you "adjusted" schema.xml - did you re-index after making your changes? -Jay On Wed, Jul 8, 2009 at 7:07 AM, Yang Lin wrote: > Thanks for your reply. But it works not. > > Yang > > 2009/7/8 Yao Ge > > > > > Try with fl=* or fl=*,score added to your request

SolrException - Lock obtain timed out, no leftover locks

Hi, I'm running Solr 1.3.0 in multicore mode and feeding it data from which the core name is inferred from a specific field. My service extracts the core name and, if it has not seen it before, issues a create request for that core before attempting to add the document (via SolrJ). I have a poo

Re: Adding new Fields ?

Have you thought about looking at your index with Luke to see ifwhat you expect to be there is actually there? Best Erick On Wed, Jul 8, 2009 at 11:28 AM, Jon Gorman wrote: > I think at least you need to review your import process. If nothing > indexed, there's going to be nothing that matched.

Re: Indexing rich documents from websites using ExtractingRequestHandler

Try putting all the PDF URLs into a file, download with something like 'wget' then index locally. Glen Newton http://zzzoot.blogspot.com/ 2009/7/8 ahammad : > > Hello, > > I can index rich documents like pdf for instance that are on the filesystem. > Can we use ExtractingRequestHandler to index f

Re: Adding new Fields ?

I think at least you need to review your import process. If nothing indexed, there's going to be nothing that matched. We need a little more information. Stuff like a short but concise test sample of what you're trying to index, how you're submitting the http request and the commit request (you

Indexing rich documents from websites using ExtractingRequestHandler

Hello, I can index rich documents like pdf for instance that are on the filesystem. Can we use ExtractingRequestHandler to index files that are accessible on a website? For example, there is a file that can be reached like so: http://www.sub.myDomain.com/files/pdfdocs/testfile.pdf How would I g

Re: Adding new Fields ?

I don't really know how to solve my problem :/ On Wed, Jul 8, 2009 at 3:16 PM, Saeli Mathieu wrote: > The research debug is bit wired... > > I'll give you a typical example. > > I want to find, this word "Cycle" > > the field in my xml file is this one > " > > > .. > Cycle 2 > > >

Using relevance scores for psuedo-random-probabilistic ordenation

Hi, I've just implemented my PseudoRandomFieldComparator (migrated from PseudoRandomComparatorSource). The problem that I see is that I don't have acces to the relevance's scores in the deprecated PseudoRandomComparatorSource. I'm trying to fill the scores from my PseudoRandomComponent (in the p

Re: about defaultSearchField

Thanks for your reply. But it works not. Yang 2009/7/8 Yao Ge > > Try with fl=* or fl=*,score added to your request string. > -Yao > > Yang Lin-2 wrote: > > > > Hi, > > I have some problems. > > For my solr progame, I want to type only the Query String and get all > > field > > result that incl

Re: Solr's MLT query call doesn't work

A couple of things, your mlt.fl value, must be part of fl. In this case, content_mlt is not included in fl. I think the fl parameter value need to be comma separated. try fl=title,author,content_mlt,score -Yao SergeyG wrote: > > Hi, > > Recently, while implementing the MoreLikeThis search, I'v

Re: Placing a CSV file into SOLR Server

On Wed, Jul 8, 2009 at 9:33 AM, Anand Kumar Prabhakar wrote: > Thank you for the input Yonik, anyway again we are sending an HTTP request to > the server, my requirement is to skip the HTTP request to the SOLR server. > Is there any way to avoid these HTTP requests? You're sending a tiny HTTP requ

Solr's MLT query call doesn't work

Hi, Recently, while implementing the MoreLikeThis search, I've run into the situation when Solr's mlt query calls don't work. More specifically, the following query: http://localhost:8080/solr/select?q=id:10&mlt=true&mlt.fl=content_mlt&mlt.maxqt= 5&mlt.interestingTerms=details&fl=title+author+

Re: Placing a CSV file into SOLR Server

Thank you for the input Yonik, anyway again we are sending an HTTP request to the server, my requirement is to skip the HTTP request to the SOLR server. Is there any way to avoid these HTTP requests? Yonik Seeley-2 wrote: > > from: http://wiki.apache.org/solr/UpdateCSV > """ > The following re

Re: Preparing the ground for a real multilang index

Can't the copy field use a different analyzer? Both for query and indexing? Otherwise you need to craft your own analyzer which reads the language from the field-name... there's several classes ready for this. paul Le 08-juil.-09 à 02:36, Michael Lackhoff a écrit : On 08.07.2009 00:50 Jan H

Re: Adding new Fields ?

The research debug is bit wired... I'll give you a typical example. I want to find, this word "Cycle" the field in my xml file is this one " .. Cycle 2 " This field is refered in my schema.xml by this way. " " and " " Here is my research in debug mode with this request http

Re: Placing a CSV file into SOLR Server

from: http://wiki.apache.org/solr/UpdateCSV """ The following request will cause Solr to directly read the input file: curl http://localhost:8983/solr/update/csv?stream.file=exampledocs/books.csv&stream.contentType=text/plain;charset=utf-8 #NOTE: The full path, or a path relative to the CWD of th

Re: Adding new Fields ?

On Jul 8, 2009, at 8:10 AM, Saeli Mathieu wrote: Yep I know that, I almost add more than 60 lines in this file :) It's just an example. Do you have any idea why when I'm trying to search something, the result of Solr is equal to 0 ? The first place I start with a general question like is

Placing a CSV file into SOLR Server

Is there any way to Place the CSV file to index in the SOLR Server so that the file can be indexed and searched. If so please let me know the location in which we have to place the file. We are looking for a workaround to avoid the HTTP request to the SOLR server as it is taking much time. -- Vie

Re: Question regarding ExtractingRequestHandler

For metadata, you can add the ext.metadata.prefix field and then use a dynamic field that maps that prefix, such as: &ext.metadata.prefix=metadata_ stored="true"/> Note, some of this is currently under review to be changed. See https://issues.apache.org/jira/browse/SOLR-284 -Grant On J

Re: Adding new Fields ?

Yep I know that, I almost add more than 60 lines in this file :) It's just an example. Do you have any idea why when I'm trying to search something, the result of Solr is equal to 0 ? I'm looking forward to read you. -- Saeli Mathieu.

Re: how to do the distributed search with sort using solr?

>java.net.ConnectException: Connection refused > at >org.apache.solr.client.solrj. >impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:391) The "Connection refused" error is caused becaused that the servers have been stopped. I>Are you sure both servers are running properly? You can h

Re: Adding new Fields ?

On Jul 8, 2009, at 7:06 AM, Saeli Mathieu wrote: Hello. I posted recently in this ML a script to transform any xml files in Solr's xml files. Anyway. I've got a problem when I want to index my file, the indexation script from the demonstration works perfectly, but now the only problem is,

Re: facets and stopwords

hossman wrote: > > > but are you sure that example would actually cause a problem? > i suspect if you index thta exact sentence as is you wouldn't see the > facet count for "si" or "que" increase at all. > > If you do a query for "{!raw field=content}que" you bypass the query > parsers (whi

Re: Updating Solr index from XML files

On Jul 8, 2009, at 6:49 AM, Norberto Meijome wrote: alternatively, u can write a relatively simple java app that will pick each file up and post it for you using SolrJ Note that Solr ships with post.jar. So one could post a bunch of Solr XML file like this: java -jar post.jar *.x

Re: Updating Solr index from XML files

On Wed, Jul 8, 2009 at 4:19 PM, Norberto Meijome wrote: > On Tue, 7 Jul 2009 22:16:04 -0700 > Francis Yakin wrote: > >> >> I have the following "curl" cmd to update and doing commit to Solr ( I have >> 10 xml files just for testing) > > [...] > > hello, > DIH supports XML, right? yes. it supports

Re: how to do the distributed search with sort using solr?

On Wed, Jul 8, 2009 at 6:45 AM, shb wrote: > Sorry, the error is as follows. I have read the solr wiki carefully and > google it, but I haven't founded > any related question or solution, any one can help me, thanks! > > org.apache.solr.client.solrj.SolrServerException: Error executing query >

All in one index, or multiple indexes?

Hi, I am wondering if it is common to have just one very large index, or multiple smaller indexes specialized for different content types. We currently have multiple smaller indexes, although one of them is much larger then the others. We are considering merging them, to allow the convenience of s

Adding new Fields ?

Hello. I posted recently in this ML a script to transform any xml files in Solr's xml files. Anyway. I've got a problem when I want to index my file, the indexation script from the demonstration works perfectly, but now the only problem is, I can make any research on this document. I added an

Re: Updating Solr index from XML files

On Tue, 7 Jul 2009 22:16:04 -0700 Francis Yakin wrote: > > I have the following "curl" cmd to update and doing commit to Solr ( I have > 10 xml files just for testing) [...] hello, DIH supports XML, right? not sure if it works with n files...but it's worth looking at it. alternatively, u ca

Re: how to do the distributed search with sort using solr?

Sorry, the error is as follows. I have read the solr wiki carefully and google it, but I haven't founded any related question or solution, any one can help me, thanks! org.apache.solr.client.solrj.SolrServerException: Error executing query at org.apache.solr.client.solrj.request.QueryRequest.

Re: Is there any other way to load the index beside using "http" connection?

On Tue, 7 Jul 2009 13:54:07 -0700 Francis Yakin wrote: [...] > much on our setup. > > Like said we have file name "test.xml" which come from SQL output , we put it > locally on the solr server under "/opt/test.xml" > > So, I need to execute the commands from solr system to add and update this to

how to do the distributed search with sort using solr?

In my project, I am trying to do a distributed search sorted by some field using solr. The test code is as follows: SolrQuery query = new SolrQuery(); query.set("q", "id:[1 TO *]"); query.setSortField("id",SolrQuery.ORDER.asc); query.setParam("shards", "localhost:8983/solr, localhost:7574/solr");

Change in DocListAndSetNC not messing everything

Hey there, I had to implement something similar to field collapsing but could't use the patch as it decreases a lot performance with index of about 4 Gig. For testing, what I have done is do some hacks to SolrIndexSearcher's getDocListAndSetNC funcion. I fill the ids array in my own order or I jus

RE: Browse indexed terms in a field

Thanks ! it seems that can do the trick... > Date: Tue, 7 Jul 2009 11:10:15 -0400 > Subject: Re: Browse indexed terms in a field > From: bill.w...@gmail.com > To: solr-user@lucene.apache.org > > You can use facet.perfix to match the beginning of a given word: > > http://wiki.apache.org/solr/Si

Re: Can't limit return fields in custom request handler

II'll look SolrPluginUtils.setReturnFields. I'm running same query : http://localhost:8983/solr/select/?qt=cfacet&q=%2BitemTitle:nokia%20%2BcategoryId:130&start=0&limit=3 I get none empty r