Re: solr search issue

2012-11-01 Thread Erick Erickson
First, define a "free text search". If what you're after is that your terms (i.e. q=term1 term2) get spread across multiple fields, simply add them to your qf parameter (qf=field1,field2). If you want the terms bound to a particular field, it's just the usual q=field:term, in which case any field t

Re: How to migrate index from 3.6 to 4.0 with solrcloud

2012-11-01 Thread Erick Erickson
It's not clear whether your index is already sharded or not. But it doesn't matter because: 1> if it's not sharded, there's no shard-splitter (yet). So you can't copy the right parts of your single index to the right shard. 2> if your 3.6 index _is_ sharded already, I pretty much guarantee that it

Re: solr search issue

2012-11-01 Thread Romita Saha
Hi, Thank you for your reply. What if I want to do a free text search? Thanks and regards, Romita From: Gora Mohanty To: solr-user@lucene.apache.org, Date: 11/02/2012 12:36 PM Subject:Re: solr search issue On 2 November 2012 09:51, Romita Saha wrote: > > Hi, > > I am try

Re: solr search issue

2012-11-01 Thread Gora Mohanty
On 2 November 2012 09:51, Romita Saha wrote: > > Hi, > > I am trying to search a database . In my database I have a field level2. > > My query: > http://localhost:8983/solr/db/select/?defType=dismax&q=search%20level2&qf=data%20id^2%20&start=0&rows=11&fl=data,id Where did you get this syntax from?

Re: solr replication against active indexing on master

2012-11-01 Thread Jie Sun
thanks... I just read the related code ... now I understand it seems the master keeps replicable snapshots (version), so it should be static. thank you Otis! -- View this message in context: http://lucene.472066.n3.nabble.com/solr-replication-against-active-indexing-on-master-tp4017696p4017743.

solr search issue

2012-11-01 Thread Romita Saha
Hi, I am trying to search a database . In my database I have a field level2. My query: http://localhost:8983/solr/db/select/?defType=dismax&q=search%20level2&qf=data%20id^2%20&start=0&rows=11&fl=data,id When I make the above query, I do not get any response. However I get the require the respo

Re: Production Release process with Solr 3.5 implementation.

2012-11-01 Thread adityab
Our main issue is for new index we need to update DB first as data needs to be pulled from DB as per new schema and publish to Solr. So DB update has to be first step. -- View this message in context: http://lucene.472066.n3.nabble.com/Production-Release-process-with-Solr-3-5-implementation-t

Re: How to migrate index from 3.6 to 4.0 with solrcloud

2012-11-01 Thread Otis Gospodnetic
Hi, I think you can't upgrade by copying, but I could be wrong. If I'm wrong a write-up on the Wiki is probably needed. If I had to migrate I would reindex. Otis -- Performance Monitoring - http://sematext.com/spm On Nov 1, 2012 9:34 PM, "Zeng Lames" wrote: > Dear all, > > we have an existing

How to migrate index from 3.6 to 4.0 with solrcloud

2012-11-01 Thread Zeng Lames
Dear all, we have an existing index with solr 3.6, and now we want to migrate it to Solr4.0 with shard (2 shards, 2 nodes in a shard). The question are: 1.which node should i copy the existing index files to? any node in any shard ? 2. if copy the index files into any one of nodes, can it be rep

Re: need help on solr search

2012-11-01 Thread Otis Gospodnetic
Hi, Have a look at your solrconfig.xml and look for your default operator. Also look at the docs for the mm parameter on the Wiki. Let us know if that does it for you. Otis -- Performance Monitoring - http://sematext.com/spm On Nov 1, 2012 5:11 PM, "jchen2000" wrote: > Otis Gospodnetic-5 wrote

Re: DataImport Handler : Transformer Function Eval Failed Error

2012-11-01 Thread Otis Gospodnetic
Hi, That looks a little painful... what are you trying to achieve by storing JSON in there? Maybe there's a simpler way to get there... Otis -- Performance Monitoring - http://sematext.com/spm On Nov 1, 2012 6:16 PM, "Mishra, Shikhar" wrote: > Hi, > > I'm trying to store a list of JSON objects

Re: solr replication against active indexing on master

2012-11-01 Thread Otis Gospodnetic
Hi, I don't have sources handy but you could start from SnapPuller.Java. Otis -- Performance Monitoring - http://sematext.com/spm On Nov 1, 2012 6:18 PM, "Jie Sun" wrote: > thanks ... > > could you please point me to some more detailed explanation on line or I > will have to read the code to fi

Re: Production Release process with Solr 3.5 implementation.

2012-11-01 Thread Alexander Kanarsky
Why not to change the order to this: 3. Upgrade Solr Schema (Master) Replication is disabled. 4. Start Index Rebuild. (if step 3) 1. Pull up Maintenance Pages 2. Upgrade DB 5. Upgrade UI code 6. Index build complete ? Start Replication 7. Verify UI and Drop Maintenance Pages. So your slaves will

Re: Where can I find an example of a 4.0 contraction file?

2012-11-01 Thread Robert Muir
You have a character encoding issue: this is telling you the file is not correctly encoded as UTF-8. On Thu, Nov 1, 2012 at 6:11 PM, dm_tim wrote: > I should have mentioned I tried that. I get the following exception: > SEVERE: Unable to create core: core0 > java.lang.RuntimeException: java.nio.c

Re: Where can I find an example of a 4.0 contraction file?

2012-11-01 Thread dm_tim
Apparently there is some problem in some of my other configuration files that was tripping me up. When I copy all of the configuration files from the 4.0 source I can start up. Now I'll start messing with the files one at a time and see what happens Regards, Tim -- View this message in con

Re: Production Release process with Solr 3.5 implementation.

2012-11-01 Thread Shawn Heisey
On 11/1/2012 2:46 PM, adityab wrote: 1. Pull up Maintenance Pages 2. Upgrade DB 3. Upgrade Solr Schema (Master) Replication is disabled. 4. Start Index Rebuild. (if step 3) 5. Upgrade UI code 6. Index build complete ? Start Replication 7. Verify UI and Drop Maintenance Pages. As # 4 takes couple

Re: solr replication against active indexing on master

2012-11-01 Thread Jie Sun
thanks ... could you please point me to some more detailed explanation on line or I will have to read the code to find out? I would like to understand a little more on how this is achieved. thanks! Jie -- View this message in context: http://lucene.472066.n3.nabble.com/solr-replication-agains

DataImport Handler : Transformer Function Eval Failed Error

2012-11-01 Thread Mishra, Shikhar
Hi, I'm trying to store a list of JSON objects as stored value for the field prices (see below). I'm getting the following error from the custom transformer function (see the data-config file at the end) of data import handler. Error Message

Re: Where can I find an example of a 4.0 contraction file?

2012-11-01 Thread dm_tim
I should have mentioned I tried that. I get the following exception: SEVERE: Unable to create core: core0 java.lang.RuntimeException: java.nio.charset.MalformedInputException: Input length = 1 Any other suggestions? Regards, Tim -- View this message in context: http://lucene.472066.n3.nabble

Re: Where can I find an example of a 4.0 contraction file?

2012-11-01 Thread Walter Underwood
Use an empty file to get started. touch contractions_ca.txt wunder On Nov 1, 2012, at 2:50 PM, dm_tim wrote: > I'm attempting to get a working example of v4 running and I apparently need a > contractions_ca.txt file. I have been unsuccessful locating an example of > this file. Could someone ple

Re: How to change the boost of fields in edismx at runtime

2012-11-01 Thread Chris Hostetter
: Then, If I find that results are not of my liking then I would like to : change the boost as following : : - Title - boosted to 2 : -Keyword - boosted to 10 : : Is there any way to change this boost, at run-time, without having to : restart solr with new boosts in edismax? edismax field boost

Where can I find an example of a 4.0 contraction file?

2012-11-01 Thread dm_tim
I'm attempting to get a working example of v4 running and I apparently need a contractions_ca.txt file. I have been unsuccessful locating an example of this file. Could someone please point me to one? Regards, Tim -- View this message in context: http://lucene.472066.n3.nabble.com/Where-can-I

solr replication against active indexing on master

2012-11-01 Thread Jie Sun
I have a question about the solr replication (master/slaves). when index activities are on going on master, when slave send in file list command to get a version (actually to my understand a snapshot of the time) of all files and their size/timestamp etc. then slaves will decide which files need

Re: Production Release process with Solr 3.5 implementation.

2012-11-01 Thread adityab
Thanks Paul, In our case we need to upgrade DB with new version before re-building the index as we pull data from DB. Once DB is upgraded, UI needs to be upgraded too. We do the same in case when there is no DB schema changes. We disable the replication and build index on Master. Once index is

Re: need help on solr search

2012-11-01 Thread jchen2000
Otis Gospodnetic-5 wrote > You want "ordered term matching" (like in a phrase), but you cannot use > AND > because you do not want all query terms to be required. Correct? That's exactly right! actually none of the query term is required, but we need to base similarity score on how many terms are

Re: Production Release process with Solr 3.5 implementation.

2012-11-01 Thread Paul Libbrecht
Here is what we do for Curriki.org: We run a background indexing by setting up another solr that performs all the indexing. Then we can start the install process. Then we can update the index with the things changed since the background indexing. paul Le 1 nov. 2012 à 21:46, adityab a écrit :

Production Release process with Solr 3.5 implementation.

2012-11-01 Thread adityab
Hi, My question is generally to understand how people are dealing with such situation to minimize production downtime. Any suggestion/advice are welcomed. We have Solr 3.5 setup as master Slave. Our UI almost has 70% data fetched from Solr Slaves where as other 30% are for authentication and oth

Re: Feature & design question: use autocomplete to search on 2 different fields, and return 2 different data groups

2012-11-01 Thread Erick Erickson
You might be able to do something like append "tags" to the suggestions. So, you'd actually index pizza:cat pizza hut:business Then you app gets these back and can display them however is most pleasing to the user. But consider that all autosuggest is doing is searching the indexed terms. So

Re: Feature & design question: use autocomple?te to search on 2 different fields, and return 2 different data groups

2012-11-01 Thread fernando.beck
Otis, you are right: think + dev + try + test + keep iterating until it works. We've come up with a different approach: change the way we're thinking the schema. Until now we have 1 document per "business" and each business is related to one category. Instead, we can think that each document coul

Re: Forwardslash delimiter.Solr4.0 query for path like /Customer/Content/*

2012-11-01 Thread Jack Krupansky
It would be nice to be able to customize or even disable features like this. Same goes for wildcards. But... feel free to propose something! -- Jack Krupansky -Original Message- From: Dirk Högemann Sent: Thursday, November 01, 2012 4:02 PM To: solr-user@lucene.apache.org Subject: Re:

Re: Forwardslash delimiter.Solr4.0 query for path like /Customer/Content/*

2012-11-01 Thread Dirk Högemann
Ok.If there is no other way I will have some string parsing to do, but in this case I am wondering a little bit about the chosen delimiter...as it is central to nearly any path in directories, web resources etc.,right? Best Dirk Am 30.10.2012 19:16 schrieb "Jack Krupansky" : > Maybe a custom searc

Re: Feature & design question: use autocomple?te to search on 2 different fields, and return 2 different data groups

2012-11-01 Thread Otis Gospodnetic
Hi, On Thu, Nov 1, 2012 at 9:54 AM, fernando.beck wrote: > David, > > appreciate the suggestion. Our current autocomplete feature is actually > working pretty good. > No perfomance issues; functionally is providing 100% results as expected. > I checked sematext and also http://www.cominvent.com

Re: Subqueries... using results from the main query

2012-11-01 Thread Otis Gospodnetic
+ means "required (this must be in the FAQ, please check) Otis -- Search Analytics - http://sematext.com/search-analytics/index.html Performance Monitoring - http://sematext.com/spm/index.html On Thu, Nov 1, 2012 at 3:33 PM, Gustav wrote: > Could you please explain what the "+" operator mean?

Re: Subqueries... using results from the main query

2012-11-01 Thread Gustav
Could you please explain what the "+" operator mean? About the X and Y... i don't have the products_ids related to the results, and i was expecting to make a subquery related to the ids returned from the main query -- View this message in context: http://lucene.472066.n3.nabble.com/Subqueries-u

Re: After adding field to schema, the field is not being returned in results.

2012-11-01 Thread Lance Norskog
Have you uploaded data with that field populated? Solr is not like a relational database. It does not automatically populate a new field when you add it to the schema. If you sort on a field, a document with no data in that field comes first or last (I don't know which). - Original Message

Re: need help on solr search

2012-11-01 Thread Otis Gospodnetic
Hi, I don't follow. :( See inline. On Thu, Nov 1, 2012 at 2:16 PM, jchen2000 wrote: > Seems like phrase query is close, but not exactly what we needed. Here is > an > example assuming just one field: > the doc: a1 a2 a3 b1 b2 c1 c2 c3 c4 d1 d2 > the query: a1 a2* a3 a4* b1 b2* c2 d1* d2 > Are

Re: After adding field to schema, the field is not being returned in results.

2012-11-01 Thread Erick Erickson
What happens if you sort ascending rather than descending? Depending on what (if anything) you've done with sortMissingFirst/Last on that field, it's possible that you're just seeing the results of the sort and docs with your new field are somewhere down the list. If you've done nothing, you should

Re: need help on solr search

2012-11-01 Thread jchen2000
Seems like phrase query is close, but not exactly what we needed. Here is an example assuming just one field: the doc: a1 a2 a3 b1 b2 c1 c2 c3 c4 d1 d2 the query: a1 a2* a3 a4* b1 b2* c2 d1* d2 both doc and query terms are ordered. We know that a term should never go match with b or c terms. Obvio

Re: Dynamic core selection

2012-11-01 Thread Chris Hostetter
: as I said we have our own search handler (wrapping handleRequestBody method : and adding logic before it) where we convert those custom_paramX params into : Solr understandable params like q, fq, facet, etc. Then we delegate to Solr to : process them. : : So what I want to do is core0 handle th

Re: Dynamic core selection

2012-11-01 Thread Dzmitry Petrushenka
The idea is to send req to http://server.com/solr. Here are some sample URLs: http://server.com/solr?custom_param1=aaa&custom_param2=bbb http://server.com/solr?custom_param1=ccc&custom_param2= as I said we have our own search handler (wrapping handleRequestBody method and adding logic be

Re: hot shard concept

2012-11-01 Thread Dmitry Kan
Hi Shawn, Too much technical details are often better, than too little, to my taste of course :-) You approach to sharding is apparently hashing based. And that's why you need to maintain doc did values that come from MySQL in a separate storage and decide on split point. That's totally legit. And

Re: Dynamic core selection

2012-11-01 Thread Travis Low
If I understand you correctly, you would use a multicore setup and send the request to http://server.com/solr/core0 in one case, and http://server.com/solr/core1 in the other. Is there something else that makes this complicated? cheers, Travis On Thu, Nov 1, 2012 at 12:08 PM, Dzmitry Petrushenk

Dynamic core selection

2012-11-01 Thread Dzmitry Petrushenka
Hi All! I need to be able to send requests to 2 different cores based on the value of some request parameter. First core (active) contains most recent docs. This core is used in 99% of cases. The second core (it has 100-1000 times more docs then active core) and used in 0.1% of cases.

Re: After adding field to schema, the field is not being returned in results.

2012-11-01 Thread Dotan Cohen
On Thu, Nov 1, 2012 at 3:00 PM, Erick Erickson wrote: > I'd try several things > > 1> just because you an sort has nothing to do with whether the field is > returned. Sorting uses the indexed data, returning it is the stored data. > So it's a bit of a red herring when you can sort on a field b

Re: SOLRJ - Error while using CommonsHttpSolrServer

2012-11-01 Thread Jegannathan Mehalingam
I am using the default solr.xml that came with the installation. The core name is defined as "solr". So, I changed the url to "http://localhost:8983/solr/solr/"; and that resolves the issue. I also replaced CommonsHttpSolrServer with HttpSolrServer and this works as well. I tried both XMLRespon

Re: solr selects blocking on commit

2012-11-01 Thread Michael Della Bitta
Is it possible your machine is falling into iowait and that's what's blocking selects? If this is a Linux box, install sysstat and do: iostat 5 The first response will be an average since startup, and then you'll get 5 second averages. Watch the iowait% figure... if that's over say 10%, that mig

RE: Feature & design question: use autocomple?te to search on 2 different fields, and return 2 different data groups

2012-11-01 Thread David Quarterman
Fernando, Pretty much the problem we came up against. We had a basic AC running using SpellChecker a while ago but it was the grouping that floored us and sent us elsewhere. Again, multiple queries seemed like the only possible answer but in an AC scenario, even with SOLR's speed, probably too slo

Data Import from HTTPBasic Authentication secured database

2012-11-01 Thread Alexandru Toader
Dear all, I have just started working with Solr but I have stumbled upon a problem and I would really appreciate assistance. I want to use the DataImportHandler to get data from a remote database that requires Basic HTTP Authentication. I have tried the following configuration:

Re: [Announce] Apache Solr 4.0 with RankingAlgorithm 1.4.4 and Realtime NRT available for download

2012-11-01 Thread Nagendra Nagarajayya
Yup, the whole idea of providing a patch is to ensure that the contribution goes into Solr. I have renamed realtime nrt to realtime-search based on feedback on the list. I have provided a new patch for the 4.x trunk: https://issues.apache.org/jira/b

Re: [Announce] Apache Solr 4.0 with RankingAlgorithm 1.4.4 and Realtime NRT available for download

2012-11-01 Thread Nagendra Nagarajayya
I have renamed Realtime NRT to Realtime-search now. Thanks for the feedback. Regards, Nagendra Nagarajayya http://solr-ra.tgels.org http://rankingalgorithm.tgels.org On 10/30/2012 9:09 AM, Michael Della Bitta wrote: Happy to help! Cheers, Michael

RE: Feature & design question: use autocomple?te to search on 2 different fields, and return 2 different data groups

2012-11-01 Thread fernando.beck
David, appreciate the suggestion. Our current autocomplete feature is actually working pretty good. No perfomance issues; functionally is providing 100% results as expected. I checked sematext and also http://www.cominvent.com; they are great, and our budget to go get them is 0. At this time, a

RE: Feature & design question: use autocomple?te to search on 2 different fields, and return 2 different data groups

2012-11-01 Thread David Quarterman
We had a similar requirement and found the best solution (unfortunately) was to spend a small amount of money. Have a look at Sematext's site (www.sematext.com). Their Autocomplete is awesome and we have a fantastic looking AC now on our development site, grouped by category, product & brand with p

Feature & design question: use autocomple​te to search on 2 different fields, and return 2 different data groups

2012-11-01 Thread fernando.beck
Hello, we're facing a new feature request, and we can't get the right way to come up with a working solution. Context: we have a list of businesses . For each business we have: name, category, address, city. One business may have 1 or more categories. Example: Name: Outback SteakHo

solr selects blocking on commit

2012-11-01 Thread dbabits
I use Solr 3.6.0 and all selects are blocked during commits. This appears to be contrary to all documentation I have seen, quoting from the "Solr Enterprise.." book: "No matter how long a commit or optimize command takes, Solr still executes searches concurrently—there is no read lock." I have

Re: After adding field to schema, the field is not being returned in results.

2012-11-01 Thread Erick Erickson
I'd try several things 1> just because you an sort has nothing to do with whether the field is returned. Sorting uses the indexed data, returning it is the stored data. So it's a bit of a red herring when you can sort on a field but not see it, although it is a good test that your schema knows

Re: hot shard concept

2012-11-01 Thread hupadhyay
Shawn this seems to be a great implementation work. I am also trying to do something similar. But i am planning to use SolrCloud which manages shards and replication automatically,pls make me correct if i am wrong. I had explored mongoDB and cassandra too and mongoDB was fair enough to be used, b

Re: Modelling Access Control

2012-11-01 Thread hupadhyay
Hello All, I am also trying to model ACL on solr search. Since in my case the data itself is very huge and user base is also too big. Putting ACL inside solr gives quite good response time, but ACL outside the solr seems to a nightmare. In case of ACL inside the solr puts heavy load on keeping so

Re: solr indexing using jquery AJAX

2012-11-01 Thread amit
I changed as per your feedback. Added quotes and escaped them before id and name. Still not able to insert. data: "20trailblazers", The tomcat log says bad request. 192.168.11.88 - - [01/Nov/2012:17:10:35 +0530] "OPTIONS /solr/update?commit=true HTTP/1.1" 400 1052 In google chrome there are

index solr using jquery AJAX

2012-11-01 Thread amit
Is is possible to index (add/update) solr using jquery AJAX? I am trying with jasonp first, but no luck. try { $.ajax({ type: "POST", url: "http://192.168.10.113:8080/solr/update/json?commit=true";, data: { "add": { "doc": { "id": "22"

Re: SOLR 3.5 sometimes throws java.lang.NumberFormatException: For input string: "java.math.BigDecimal:1848.66"

2012-11-01 Thread Marcin Pilaczynski
Thanks for adding this issue to JIRA. I tried to find the exact problem using debugger step by step analysis, but do to lack of SOLR internals knowledge and time I didn't find anything fishy. I only found that when we were feeding SOLR directly with BigDecimal objects, class JavaBinCodec at line 1

Continuous Ping query caused exception: java.util.concurrent.RejectedExecutionException

2012-11-01 Thread Markus Jelsma
Hi, Using this week's trunk we sometime see nodes entering a some funky state where it continuously reports exceptions. Replication and query handling is still possible but there is an increase in CPU time: 2012-11-01 09:24:28,337 INFO [solr.core.SolrCore] - [http-8080-exec-4] - : [openindex_f

Re: solr blocking on commit

2012-11-01 Thread Martin Koch
Are you using solr 4.0? We had some problems similar to this (not in a master/slave setup, though), where the resolution was to disable the transaction log, i.e. remove in the section - we don't need NRT get, so this isn't important to us. Cheers, /Martin Koch On Thu, Nov 1, 2012 at 1:25 AM, db

RE: trunk is unable to replicate between nodes ( Unable to download ... completely)

2012-11-01 Thread Markus Jelsma
Hi, What we're seeing is two replica's that are, for whatever reason, not completely in sync and unable to recover. While one node is in the `recovering state` we can fool it to be in active state by simply reloading the core on the machine on which it is in a bad state. Some arbitrary time lat