Max Field Scoring?

Hi all - I am trying to figure out if a particular use case is possible with solr. Let's say we are using solr to store a group of people and the universities they attended. We have four fields - NAME, PHD to house the name of the university they received a phd degree from, MASTERS to house th

Re: Sorting on multivalued fields?

Thanks Markus. I should have caught that, but I skipped a couple releases. ;) On 10/07/2011 06:31 PM, Markus Jelsma wrote: Here's the snippet from the changelog of 3.1.0. 571 * In previous releases, sorting or evaluating function queries on 572 fields that were "multiValued" (either by

is SOLR-2412 production ready?

hi i need pivot kind of facet functionality but for multipath hierarchy. I am using 4.0 from trunk. Is this patch production ready? And where can i see more details/docs on how to use it Any help on this? -- View this message in context: http://lucene.472066.n3.nabble.com/is-SOLR-2412-produ

Re: Sorting on multivalued fields?

Here's the snippet from the changelog of 3.1.0. 571 * In previous releases, sorting or evaluating function queries on 572 fields that were "multiValued" (either by explicit declaration in 573 schema.xml or by implict behavior because the "version" attribute on 574 the schema was le

Sorting on multivalued fields?

Hi, I could be wrong here but my app worked fine with sorting on multivalued date fields before 3.4. But now it is giving an error. *HTTP Status 400 - can not sort on multivalued field: creation_date_dm *Is this a regression/bug? thanks, Darren

Re: Please help - Solr Cell using 'stream.url'

Hi, What Solr version? How often do you do commits, or do you use autocommit? What kind and size of docs? Do you feed from a Java program? Where is the read timeout occurring? Can you paste in some logs? How much RAM on your server, and how much did you give to the JVM? -- Jan Høydahl, search s

Re: Slowdown on adds with Solr 3.4 compared to 1.4

Hi, Could you post more info about your environment? OS, JVM version, Total RAM and how much allocated to JVM? JVM options such as GC settings, other applications running on same box? document type and size, size of your "index" folder on disk, schema & solrconfig changes (have you migrated sc

Re: Multithreaded JdbcDataStore and CachedSqlEntityProcessor

Hello, First of all I've got the same feeling for some time. I've checked TestThreaded and got that it doesn't cover CachedSqlEntityProce

facet pivot query and find details abt results

hi here is my snippet of schema.xml == . here is my query which works fine = q=device_type:"NA" OR device_type:"iphone"&start=0&rows=0&facet=true&facet.pivot=CATEGORY_LEVEL_1,CATEGORY_LEVEL_2,CATEGORY_LEVEL_3,CATEGORY_

Re: Lock error when indexing with curl

Hi, i have a similar "lock" error. Did you find any solution ? -- View this message in context: http://lucene.472066.n3.nabble.com/Lock-error-when-indexing-with-curl-tp480958p3403119.html Sent from the Solr - User mailing list archive at Nabble.com.

Please help - Solr Cell using 'stream.url'

I'm batching documents into solr using solr cell with the 'stream.url' parameter. Everything is working fine until I get to about 5k documents in and then it starts issuing 'read timeout 500' errors on every document. The sysadmin says there's plenty of CPU, memory, and no paging so it doesn'

Re: how to determine whether indexing is occurring?

I did this bin/nutch crawl urls -solr http://localhost:8983/solr/ -depth 3 -topN 5 per http://wiki.apache.org/nutch/NutchTutorial On Fri, Oct 7, 2011 at 13:36, Andy Lindeman wrote: > On Fri, Oct 7, 2011 at 13:32, Fred Zimmerman wrote: > > I am running a big nutch job which is supposed to

Re: Solr not using allocated memory?

What are you trying to speed up and what are the timings you are getting? Giving solr a lot of memory does not always speed things up. You must leave some room to allow the O/S to cache the index files. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-not-using-allocated-

Re: how to determine whether indexing is occurring?

On Fri, Oct 7, 2011 at 13:32, Fred Zimmerman wrote: > I am running a big nutch job which is supposed to be sending information to > solr for indexing, but it does not seem to be occurring. the number of docs > and max docs in solr statistics is not changing. how can I figure out what's > happening

how to determine whether indexing is occurring?

I am running a big nutch job which is supposed to be sending information to solr for indexing, but it does not seem to be occurring. the number of docs and max docs in solr statistics is not changing. how can I figure out what's happening here?

Re: Solr not using allocated memory?

When I have seen that sawtooth pattern before, it was because the cache hit rate was low. Items ejected from the cache become garbage. If that happens at a fairly constant rate, you get that slope of increasing memory usage. wunder On Oct 7, 2011, at 8:48 AM, Tristan Roddis wrote: > We have a

Re: Solr not using allocated memory?

On 10/7/2011 9:48 AM, Tristan Roddis wrote: I was advised that, to increase performance, we should increase the amount of memory allocated to Tomcat so that Solr could use this to cache query results and so reduce CPU usage and disk I/O. So, I set both the min and max RAM allocation for Tomcat

Solr not using allocated memory?

We have a Solr server running on 64-bit Windows 2008, and under the default Tomcat settings it seems to be using a small fraction of the available memory (fluctuating between 100Mb and 300Mb: see trace from VisualVM at http://imgur.com/4Om2El&tqLKW ) I was advis

Solr Database Connection Pooling across cores

Hi, Does solr support database connection pulling? We have 100+ core created which are querying to same database using dataimporthandler. Now the issue we need to do full index nightly and delta index every 20 minutes and if all core start indexing there are lots of database connection created. So

Re: solrj with multiple cores

a per-core SolrServer object is needed. it's lightweight, so should be fine. Erik On Oct 6, 2011, at 20:13 , Christopher Condit wrote: > I have a Solr 3.4 installation with many cores. Is there a way to use > a single SolrServer instance across my requests or is the best > practice to c

"Private" fields in solr

Is there a way to include the notion of "private" fields for a text search? For example, let's say I have three fields: UserName - text name UserCity - city the user belongs to PrivateUserTags - key/value pair of another user's "tags" about that user I'd like to have a text search on all three fi

Re: Replication with an HA master

Your idea sounds like the correct path. Setup 2 masters, one running in "slave" mode which pulls replicas from the live master. When/if live master goes down, you just reconfigure and restart the backup master to be the live master. You'd also need to then start data import on the backup mast

Re: Slowdown on adds with Solr 3.4 compared to 1.4

Hi there Yes I have tried that, and it makes a small difference but still getting the slowdown, just slightly later. No hints from the logs about the slowdown, no errors or useful info in there even if I set all the logging on. Willem On Fri, Oct 7, 2011 at 2:38 PM, Jan Høydahl wrote: > Hi, >

Replication with an HA master

We are getting ready to start a project using Solr as our backend search engine and I am trying to devise a deployment architecture that works for us. We definitely need a master/slave replication strategy, that's for sure, but my concern is the master becomes a single point of failure. Fortun

Re: DeltaQuery for more than one table

On Fri, Oct 7, 2011 at 3:28 PM, jhansiredrowthu wrote: > Hi All, > >    i am new to solr.I have to write a deltaQuery for retriving data from > two tables but i want to mention two tables in a single entity not in > different entites.Can anyone help me. Do you mean a JOIN across two tables? Could

Re: Slowdown on adds with Solr 3.4 compared to 1.4

Hi, Have you tried to do a commit after the deleteByQuery only? Also, what seems to cause the slowdown? Any hints from the logs? -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com Solr Training - www.solrtraining.com On 7. okt. 2011, at 10:04, Willem Basson wrote: > Hi t

Re: Hierarchical faceting with Date

Ravi - It's not a feature, currently, of pivot facets to do date ranges along with it. Is that what you're after? It should still "work" to facet on date fields and pivot those with other fields in a standard per-value sort of way. Can you elaborate on the specific data and results you'd like

Re: query synonym expansion howto?

Just tried dismax which is even worse than edismax. edismax is constructing a proximity search, for some reason. Feels like there is some work to be done. Nevertheless the attribute SYNONYM is there and edismax could do the right processing for it. From my understanding the endOffset seams also

Fuzzy Prefix Length

Is it possible to set the default fuzzy prefix length via solrconfig.xml or similar? Basically I want to call QueryParser.setFuzzyPrefixLength: Was

Re: query synonym expansion howto?

> So the problem is in the ExtendedDismaxQParser because it > can't > handle synonym expansion? Probably something like that but someone more familiar with e(dismax) query parser plugin can clarify this. defType=lucene works as you expected, how about defType=dismax ? Is it same as edismax? >

DeltaQuery for more than one table

Hi All, i am new to solr.I have to write a deltaQuery for retriving data from two tables but i want to mention two tables in a single entity not in different entites.Can anyone help me. Thanks in advance. Regards, Jhansi. -- View this message in context: http://lucene.472066.

R: URL Redirect

Ok, so I installed tucky on Tomcat 6.0. I have the following configuration: /solr-p <- the solr configuration /solr <- the tucky configuration I want to redirect request such as http://localhost:8080/solr/select/?q=Somename&;... to a different address, and this is promptly done with rule:

Shard Search and pagination

Hello. i searching over 5 cores and i have a problem with the pagination. is it possible to return only the first 25 matches of a search over several cores ? the solution i have now, is that ervery core returns 25 documents, but i want only the first 25 docs of the "complete" search. my goal is

Re: Field Collapsing and Record Filtering

I don't think this possible in only one search with what Solr currently has to offer. I guess the only way to support this, is by post processing your results on the client side. So for each group you display you query what to latest version is. If that doesn't match then you omit the result from r

Re: Selective Result Grouping

So if look at the old SOLR-236 fieldcollapsing (http://wiki.apache.org/solr/FieldCollapsingUncommitted) you mean collapse.type=adjacent ? I think we shouldn't change group.query parameter. Since it serves a different purpose. I think it is better to have a new parameter for this different way of g

Re: Faceted query performance problem when group.truncate set to true

Hi Dmitry, What is the fieldtype of field objid? Grouping works much slower on non string fields. Post grouped faceting in general slows down your search time, b/c it is an expensive operation to compute the grouped docset. However a qtime that is 100 times slower is a lot. I have noticed that if

Possible bug in Solr JoinQParserPlugin?!

Hi I think I might have found a bug in the JoinQParser. But I want to verify this first before creating a issue. I have two cores with 2 different schema's now I want to join between the 2 cores. where I filter on a field from one core that doesn't exist in the other core. core1: {childIds,

Slowdown on adds with Solr 3.4 compared to 1.4

Hi there We are currently moving from Solr 1.4 to 3.4 and we are seeing a few issues with adding documents. We do a delete by query and then do a lot of adds, about 100k before we do a commit and optimise. With 1.4 this was all fine, not super quick but didn't see any problems. With 3.4 the rate o

Highlighting configuration

Hi, When I try to enable my highlighting with hl=true I get the following exception. (Note: My default search field it both stored and tokenized.) message null java.lang.NullPointerException at org.apache.solr.handler.component.HighlightComponent.process(HighlightComponent.java:83) at org.apache.s

multiple document types in a core

I've prototyped a solution which makes use of multiple doc types. Does the following have any value in terms of field value storage or are field values saved once and pointers from other records maintained making the below design redundant? we have CITY (500) and each city has many HOTEL (75000).

lib directory on 1.4.1 with multi cores and tomcat

lib directory on 1.4.1 with multi cores I've specified shared lib as "lib" in the solr.xml file. My assumption being this will be the lib under solr-home. However my cores cannot load classes from any new jar's placed in this dir after a tomcat restart. What am I missing ?