Re[2]: multiple indices

s two Solr instances inside one >> Jetty container. I'm using Solr 1.2.0 and Jetty 6.1.3 respectively. >> >> > Hope this helps, > --matt > On Sep 11, 2007, at 11:52 AM, Jack L wrote: >> I was going through some old emails on this topic. Rafael Rossini >

Re[2]: multiple indices

Hello Mike, > but it is still just an example application. I think this is a very modest statement. I'd like to say both solr (including the example) and jetty are production level software. I suppose many users, like me, will just take it and make minimum modification of the configs and use it o

multiple indices

I was going through some old emails on this topic. Rafael Rossini figured out how to run multiple indices on single instance of jetty but it has to be jetty plus. I guess jetty doesn't allow this? I suppose I can add additional jars and make it work but I haven't tried that. It'll always be much sa

Solr 1.2 or nightly?

Hi, I'm about to start a new solr installation. Given the good quality of development builds in the past, should I use 1.2 or just grab a nightly build? -- Best regards, Jack

Re[4]: Start up script for solr?

Actually it's --stop. Thanks! > Interesting, it worked fine on the server. Try moving the -stop at > the end of the line to just before the -jar. > - Pete

Re[4]: Start up script for solr?

ete > On 8/19/07, Jack L <[EMAIL PROTECTED]> wrote: >> Hello Peter, >> >> Many thanks! >> >> solr.start works fine but I'm getting an error with solr.stop and solr is >> not being stopped: >> (I've replaced my app dir with /op

Re[4]: Start up script for solr?

end of the line to just before the -jar. > - Pete > On 8/19/07, Jack L <[EMAIL PROTECTED]> wrote: >> Hello Peter, >> >> Many thanks! >> >> solr.start works fine but I'm getting an error with solr.stop and solr is >> not being stop

Start up script for solr?

Hi, Sorry that this is not strictly a solr specific question - I wonder if anyone has a script to start solr on Linux when the system boots up? Or better yet, supports shutdown and restart? -- Thanks, Jack

Re[2]: How to do a fuzzy query

ike using this feature through the StandardRequestHandler? -- Best regards, Jack Sunday, June 24, 2007, 3:04:26 AM, you wrote: > On Jun 23, 2007, at 11:24 PM, Jack L wrote: >> I have some documents, each has a number of tags. I'd like to >> have a query to return "s

How to do a fuzzy query

Hello solr-user, I have some documents, each has a number of tags. I'd like to have a query to return "similar" documents which share largest number of tags with a given document. For example, if I have doc that has 4 tags, and I'd like to return docs that also have these 4 tags. And if this doesn

Re[7]: Where are the log files...

Hello Brian, Your suggestion works. Now I'm able to log solr output to a file. I haven't figured out how to enable Jetty logging in solr 1.2, though. But solr logs just fine. -- Best regards, Jack Friday, June 15, 2007, 1:38:13 PM, you wrote: > ...all you have to do is create a logging.proper

Re[6]: Where are the log files...

Hello Chris, Yes, I do see the logs printed to the console. Since it's a unix box, I then close the terminal after starting up solr. When a problem happens, such as that solr no longer responds, I hope to be able to to check the log files to see what happened. It's probably a Java logger setting

Re[5]: Where are the log files...

Hello Chris, With Solr 1.1, after I uncomment the logging portion of jetty.xml, jetty starts to write to log files. But that part of jetty.xml disappears in Solr 1.2, which uses a new version of Jetty. So, I still don't know how to enable Jetty logging in Solr 1.2. (The query log works, not the we

Ping fails out of the box

I just downloaded version 1.2 and set it up on my Windows PC. Search works but Ping returns error 500: --- HTTP ERROR: 500 Internal Server Error RequestURI=/solr/admin/ping Powered by Jetty:// --- Is there any minimum setting for Ping to wor

Re[4]: Where are the log files...

find it in *apache-solr-1.2.0\example\logs* > and I not use jetty. > 2007/6/15, Jack L <[EMAIL PROTECTED]>: >> >> Yeah, I'm running 1.1 with jetty. >> >> But I didn't find *.log in the whole solr directory. >> Is jetty putting the log files ou

Re[2]: Where are the log files...

ude in that example... > Jack L wrote: >> It happened twice in the past few days that the solr instance stopped >> responding (the admin page does not load) while the process was still >> running. I'd like to find out what's causing this. I notice that I can >> cha

Where are the log files...

It happened twice in the past few days that the solr instance stopped responding (the admin page does not load) while the process was still running. I'd like to find out what's causing this. I notice that I can change logger level from admin page but I didn't figure out where the log files are. Sea

Re[2]: "sort" throws exception

Hello Chris, I'm using version 1.1. If I'm only using 1.1 features, should I still try 1.2 for other improvements such as stability, error handling, etc.? -- Best regards, Jack Wednesday, June 13, 2007, 12:23:35 PM, you wrote: > : However, the moment I add sort, I get an exception (listed at

"sort" throws exception

I'm using DisMaxRequestHandler and my queries seem to work fine. I intended to add an option to sort on a "date" type field. However, the moment I add sort, I get an exception (listed at the bottom of this email.) Then I tried with "sort=score" and the exception still happens. I'm sure it's due to

Re: Solr 1.2 released

Hello Yonik, This is great news. Will it be a drop-in replacement for 1.1? I.e., do I need to make any changes other than replacing the jar files? I suppose the index files will still be good. Are 1.2 schema files and config files compatible with those of 1.1? -- Best regards, Jack Thursday, Ju

Re[2]: Multiple doc types in schema

Hello Chris, Thanks for the reply. I understand that a mixed-type index will work just fine. Just to bring up a topic for discussion/new features though: there seem to be downsides of not having a doctype: - name space conflict when two doctypes are not related. In this case the developer will

Multiple doc types in schema

As far as I understand, I can put multiple doc types in the same index, for example, web pages, images, products, etc. In order to do so, I think I need to do the following: - have a doctype field (not necessary but nice to have) - add all possible fields of all doc types in schema - when querying

Re[2]: add and delete docs at same time

Oh, is that the case? One document per request for delete? I'm about to implement delete. Just want to confirm. -- Best regards, Jack Thursday, May 24, 2007, 12:47:21 PM, you wrote: > currently no. > Right now you even need a new request for each delete... > Patrick Givisiez wrote: >> >> ca

Re[4]: Feature Request: Multiple default search fields

Thanks Yonik. If I want to try out DisMaxRequestHandler, do I need to repost? I suppose it is for searching only and does not require re-indexing? -- Best regards, Jack > It came later... "standard" was the first request handler. > dismax is the recommended starting point for anyone dealing wit

Re[2]: Feature Request: Multiple default search fields

Hello Brian, Thanks for your answer. It was helpful. > For your first issue, use a copyField to copy all the text you want > as default to a default search field. Oh, I didn't know I could copy multiple fields to one field :) I didn't quite figure out what copyField was for anyway but I guess th

Feature Request: Multiple default search fields

The default search field is really handy. It helps simplify the query, and thus simplify the application using solr. My understand is that solr only allows one default search field. It would be useful to allow multiple default fields, and maybe also specify a global field boost in the schema file,

Re[3]: Multiple fq fields in URL

Hello Chris, When I read your email again, I find that I didn't understand it very well, because although fq works for me now, when I need to construct the q variable, I run into the same set of questions and am still not clear :) > : BTW, space is sometimes encoded as %20, sometimes as "+". > :

Re[3]: Multiple fq fields in URL

Hello Chris, Thanks a lot for the explanation. Get well soon! -- Best regards, Jack Saturday, May 5, 2007, 9:02:36 PM, you wrote: > start by ignoring the URL escaping, treat the concept of a filter query > exactly as you would any other lucene query string for the standard > request handler ..

Re[2]: Multiple fq fields in URL

Hello Chris, Thanks for the reply. And sorry for sounding impatient - I've been working in the weekend and I wasn't sure if I expressed my question well, hence why the second email :) I understand I can url-encode the space. My question, which I failed to mention in my first email, is that, what

Re: Multiple fq fields in URL

Could anyone please explain a bit about the line below? No spaces is allowed in a URL so I suppose this needs to be quoted, but, what if there is space in the fq value field, which will create ambiguity between fq field boundary and term boundary? fq=+popularity:[10 TO *] +section:0 > I'm not su

Multiple fq fields in URL

Hello , I'm not sure if I understand how to specify multiple fq in CommonQueryParameters, which is described in this page http://wiki.apache.org/solr/CommonQueryParameters It says: --- cut - fq=+popularity:[10 TO *] +section:0 is equivalent to fq=popularity:[10 TO *]&fq=section:0

Re[2]: facet.sort does not work in python output

facets = [] > values = @data['facet_counts']['facet_fields'][field] > Solr::Util.paired_array_each(values) do |key, value| >facets << FacetValue.new(key, value) > end > facets >end > On May 3, 2007, at 8:10 PM, Mike Klaa

Re: facet.sort does not work in python output

The Python output uses nested dictionaries for facet counts. I read it online that Python dictionaries do not preserve order. So when a string is eval()'d, the sorted order is lost in the generated Python object. Is it a good idea to use list to wrap around the dictionary? This is only needed for t

solr.py - set boosts?

I've been using solr.py to post and search. It works well. Is it possible to specify doc boost and field boost with it? Jack Erik> There is a solr.py in the Solr clients directory: Erik> http://svn.apache.org/repos/asf/lucene/solr/trunk/client/python/solr.py Erik> It's got some utility methods fo

Re[2]: Snippet Generation at Punctuation Marks?

Thanks. Looking forward to it! > We are working on this and hope to have a solr patch soon. Doing > simple splitting on punctuation is a new fragmenter, which trunk solr > does not support yet. But we're hoping to fix that asap. > -brian

Snippet Generation at Punctuation Marks?

Snippet generation use hl.fragsize to determine the size of the snippets. This works very well. However, the snippets often have half of a sentence at the beginning, and half at the end. Is there a parameter I can use to tell the snippet generation code to cut at punctuation marks when possible? -

facet.sort does not work in python output

When facet.sort is used, the facet fields are sorted by the count in the reply string when using python output. However, after calling eval(), the sort order seems to be lost. Not sure if anyone has come up with a way to avoid this problem. Using the JSON output with a JSON parser for Python shou

PING returns error 500

Hello solr-user, When running the original "example" index, PING works fine. When running my real index that has 230K documents, PING gives eror 500 very quickly even. There is no load. Restarting solr does not fix this problem. Any ideas? I didn't put in any custom code. HTTP ERROR: 500 Internal

Re[8]: Things are not quite stable...

Hello Bertrand, Is there a build script that automagically grab files from jetty's source tree (local) and build a solr release? In other words, I can try building with a newer version of jetty if it doesn't take too much work - I don't know much about jetty or solr at the code level. -- Best re

Re[6]: Things are not quite stable...

ay, April 25, 2007, 12:27:41 PM, you wrote: > On 4/25/07, Jack L <[EMAIL PROTECTED]> wrote: >> That is understood. >> >> For people who are not familiar with Java servlet containers, like >> myself, the embedded web server takes the least effort to set up. >&g

Re[4]: Things are not quite stable...

That is understood. For people who are not familiar with Java servlet containers, like myself, the embedded web server takes the least effort to set up. And jetty is supposed be a production quality quality package, it'll be great that the default package with jetty can be used for production. --

Re[2]: Things are not quite stable...

Hello Bertrand, >> ...solr stops functioning properly after running for a few days. >> The symptom is search returning nothing, or when I go to /solr/admin/, >> I get file browsing page showing a list of files (.css, etc),... > Are your symptoms similar to those of > https://issues.apache.org/jir

Things are not quite stable...

I'm running the default solr package with my data, about 10 million small documents. I'm not sure if it's jetty or solr, but often times solr stops functioning properly after running for a few days. The symptom is search returning nothing, or when I go to /solr/admin/, I get file browsing page sh

Solr Query Language

Is the lucene query syntax available in solr? I saw this page about lucene query syntax: http://lucene.apache.org/java/docs/queryparsersyntax.html I tried "width:[0 TO 500]" and got an exception: java.lang.NumberFormatException: For input string: "TO500" at java.lang.NumberFormatExceptio

Re[2]: Python utilities for solr?

Mike and Erik, thanks for the reply. Excellent. I'll try it out. > On 4/15/07, Jack L <[EMAIL PROTECTED]> wrote: >> Doing queries is so easy with Python, thanks to solr's >> Python format support. Is there any Python utility classes for >> posting documents? W

Python utilities for solr?

Doing queries is so easy with Python, thanks to solr's Python format support. Is there any Python utility classes for posting documents? Which I think, is essentially a Python class to generate XML documents (before JSON support is available) from Python objects. Then again, JSON for posting would

Post in JSON format?

Hello solr-user, Query result in JSON format is really convenient, especially for Python clients. Is there any plan to allow posting in JSON format? -- Best regards, Jack

Re[2]: Update doc boost and field boost w/o reposting?

so they can > be extracted and re-indexed on the server side. This may not help > your performance concern, but it may be easier to deal with. > ryan > On 3/31/07, Jack L <[EMAIL PROTECTED]> wrote: >> I understand that I'm supposed to delete the old record and >>

Update doc boost and field boost w/o reposting?

I understand that I'm supposed to delete the old record and re-post in order to update a document. But in many cases, it takes time to extract data (from a database, etc.) and all I want to change is the document boost. I wonder if it's possible to adjust the document boost without deleting and re-

Re[2]: Searching in multiple fields

Hello Sachin, I'm not understanding the second option. Could you explain a bit? -- Best regards, Jack Friday, March 9, 2007, 2:35:36 AM, you wrote: > Well, > One way you can do this is: > "Description:php AND title:php AND Subject:php AND notes:php" > The other option is to create an extra

Re[2]: Solr and Multiple Index Partitions

Selecting by type will do the job. But I suppose it sacrifice performance because having multiple document types in the same index will render a larger index. Is it bad? -- Best regards, Jack Wednesday, March 7, 2007, 2:15:14 PM, you wrote: > As it is now... I don't think so. SolrCore is a sta

Re[2]: Federated Search

This is very interesting discussion. I have a few question while reading Tim and Venkatesh's email: To Tim: 1. is there any reason you don't want to use HTTP? Since solr has an HTTP interface already, I suppose using HTTP is the simplest way to communicate the solr servers from the merger/se

Re[2]: How to stop solr/jetty

> Otis > . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . > Simpy -- http://www.simpy.com/ - Tag - Search - Share > - Original Message ---- > From: Jack L <[EMAIL PROTECTED]> > To: solr-user@lucene.apache.org > Sent: Monday, March 5, 2007 5:21:56 AM > Subject: How to stop solr/jet

How to stop solr/jetty

Hello, I guess this is more of a (naive) jetty question - I'm running a modified instance of the "example" project with jetty on a linux server. How should I stop this jetty instance? Note that I may have multiple jetty instances and other java processes running and I'd like to stop a particular i

Re[2]: What to use for the unique key?

Hello Yonik, You are right. = is allowed. The problem was because & was not properly escaped in xml. -- Thanks, Jack Tuesday, February 27, 2007, 8:47:35 AM, you wrote: > On 2/27/07, Jack L <[EMAIL PROTECTED]> wrote: >> I am indexing some pages whose urls are unique. >&g

What to use for the unique key?

I am indexing some pages whose urls are unique. I wanted to use url as the unique key but got a problem that "=" is not allowed in unique keys. I could use a MD5 hash of the url as the unique key but I'm not sure if there is a better/simpler way. I wonder what others use for the unique keys? -- B

Re[4]: Starting an index...

Hello Erik, > Wouldn't even matter if there were field name "conflicts". A field > by any other name is just a field. All document types could have a > "title" field, for example. That makes sense. I wonder what happens if I change the schema after some documents have been inserted? Is this al

Re[2]: Starting an index...

Thanks Chris and Eric for the replies. Very helpful. > no, each instance manages a single schema and a single data index -- but > thta schema can allow for various differnt types of documents that don't > need to have anything in common. Does this mean that as long as I have the schema for all do

Starting an index...

I have played with the "example" directory for a while. Everything seems to work well. Now I'd like to start my own index and I have a few questions. 1. I suppose I can start from copying the whole example directory and name it myindex. I understand that I need to modify the solr/conf/schema.xml

Re[4]: solr performance

Thanks for all who replied. > my number 1000 was per minute, not second! I can't read! :-p > couple of times today at around 158 documents / sec. This is not bad at all. How about search performance? How many concurrent queries have people been having? What does the response time look like? >

Re[2]: solr performance

Thanks to all who replied. It's encouraging :) The numbers vary quite a bit though, from 13 docs/s (Burkamp) to 250 docs/s (Walter) to 1000 docs/s I understand the results also depend on the doc size and hardware. I have a question for Erik: you mentioned "single threaded indexer" (below). I'm no

solr performance

Hello, I have a question about solr's performance of accepting inserts and indexing. If I have 10 million documents that I'd like to index, I suppose it will take some time to submit them to solr. Is there any faster way to do this than through the web interface? -- Best regards, Jack _