Re: DIH import from MySQL results in garbage text for special chars

2012-09-26 Thread Hasan Diwan
Mr Prakash, On 27 September 2012 02:06, Pranav Prakash wrote: > > | Variable_name| Value | > +--++ > | character_set_client | latin1 | > | character_set_connection | latin1

Re: DIH import from MySQL results in garbage text for special chars

2012-09-26 Thread Pranav Prakash
The output of Show variables goes like this. I have verified with the hex values and they are different in MySQL and Solr. | Variable_name| Value | +--++ | character_set_client | latin1 | |

Re: Change config to use port 8080 instead of port 8983

2012-09-26 Thread Sami Siren
On Thu, Sep 27, 2012 at 4:46 AM, JesseBuesking wrote: > What configuration file sets the port to 8983 when running SolrCloud? I'd > like to change this to port 8080 since I'm running tomcat. > > These are the JAVA_OPTS that I pass to tomcat when starting the server: > -DzkHost=/*xxx.xx.xxx.xxx*/:

Re: How can I create about 100000 independent indexes in Solr?

2012-09-26 Thread 韦震宇
Hi,Otis Thank you for your suggestion! I'm considering the "a single index" solution. Best Regards! Monton - Original Message - From: "Otis Gospodnetic" To: Sent: Wednesday, September 26, 2012 10:26 AM Subject: Re: How can I create about 10 independent indexes in Solr? Hi, Ha

Re: Solr Replication and Autocommit

2012-09-26 Thread Otis Gospodnetic
No issues that I know of, never encountered such an issue with any if our clients using Solr. Otis -- Performance Monitoring - http://sematext.com/spm On Sep 27, 2012 12:00 AM, "Aleksey Vorona" wrote: > Hi, > > I remember having some issues with replication and autocommit previously. > But now w

Re: At a high level how does faceting in SolrCloud work?

2012-09-26 Thread Yonik Seeley
On Wed, Sep 26, 2012 at 6:21 PM, Chris Hostetter wrote: > 2) the coordinator node sums up the counts for any constraint returned by > multiple nodes, and then picks the top (facet.limit) constraints based n > the counts it knows about. It's actually more sophisticated than that - we don't limit t

Solr Replication and Autocommit

2012-09-26 Thread Aleksey Vorona
Hi, I remember having some issues with replication and autocommit previously. But now we are using Solr 3.6.1. Are there any known issues or any other reasons to avoid autocommit while using replication? I guess not, just want confirmation from someone confident and competent. -- Aleksey

Re: Problem configuring Solr plugin for Liferay 6.1 GA2 Ver 6.1.20

2012-09-26 Thread Anand Sudabattula
In this case we have installed both Liferay+Tomcat bundle and Solr over Tomcat on the same Linux Box. Thanks Anand On Wed, Sep 26, 2012 at 10:32 PM, Anand Sudabattula < anand.sudabatt...@gmail.com> wrote: > Hi, > > > As solr-web plugin still not available I wanted to configure Liferay 6.1 > GA2

Re: Ranking / Posiiton info per document

2012-09-26 Thread deniz
Hello Otis, can you explain how to do that please? And what do you mean by "just ++"? - Zeki ama calismiyor... Calissa yapar... -- View this message in context: http://lucene.472066.n3.nabble.com/Ranking-Posiiton-info-per-document-tp4010415p4010664.html Sent from the Solr - User mailing l

Re: solr binary protocol

2012-09-26 Thread Koji Sekiguchi
(12/09/27 9:29), Radim Kolar wrote: Its possible to use SOLR binary protocol instead of xml for taking TO SOLR? I know that it can be used in Solr reply. Have you looked javabin? http://wiki.apache.org/solr/javabin koji -- http://soleami.com/blog/starting-lab-work.html

solr binary protocol

2012-09-26 Thread Radim Kolar
Its possible to use SOLR binary protocol instead of xml for taking TO SOLR? I know that it can be used in Solr reply.

Re: Using different queries for q and facet.query parameters

2012-09-26 Thread Kiran Jayakumar
Thank you very much Hoss, thats exactly what I was looking for ! :) On Wed, Sep 26, 2012 at 2:12 PM, Chris Hostetter wrote: > > I think you are missunderstanding the purpose of 'facet.query', it doesn't > change the base query used when faceting, it gives you a count of > documents that match an

Re: At a high level how does faceting in SolrCloud work?

2012-09-26 Thread Chris Hostetter
: I'd like to wrap my head around how faceting in SolrCloud works, does : Solr ask each shard for their maximum value and then use that to : determine what else should be asked for from other shards, or does it : ask for all values and do the aggregation on the requesting server? For things like

Re: CQL instead of SQL in Solr data-config

2012-09-26 Thread Chris Hostetter
: Does anyone have experience with or know if it's possible with the Solr : data-config combined with Cassandra JDBC drivers : (http://code.google.com/a/apache-extras.org/p/cassandra-jdbc/) to add CQL to : data-config instead of SQL and query Cassandra instead of a RDBMS? "data-config" is just a f

Re: Using different queries for q and facet.query parameters

2012-09-26 Thread Chris Hostetter
I think you are missunderstanding the purpose of 'facet.query', it doesn't change the base query used when faceting, it gives you a count of documents that match an arbitrary query. what you are looking for is a way to "exclude" the fq used to drill down on the facet when computing facet resul

Using different queries for q and facet.query parameters

2012-09-26 Thread Kiran Jayakumar
Hi everyone, I facet by Category field. When the user drills down, I still want to show all the original facets before drill down. So instead of using the filter query, I use +(Category:<...>) in syntax. Obviously this restricts the facets returned to only that particular category. So I do somethi

Re: Proximity(tilde) combined with wildcard, AutomatonQuery ?

2012-09-26 Thread Ahmet Arslan
> we assume i have a simple query like this with wildcard and > tilde: > > "japa* fukushima"~10 > > instead of "japan fukushima"~10 OR "japanese fukushima"~10, > etc. > > Do we have a solution in Solr 4.0 to work with these kind of > queries? Vadim, two open jira issues: https://issues.apache

Re: Items disappearing from Solr index

2012-09-26 Thread Jack Krupansky
What is the field type for that field - string or text? -- Jack Krupansky -Original Message- From: Kissue Kissue Sent: Wednesday, September 26, 2012 1:43 PM To: solr-user@lucene.apache.org Subject: Re: Items disappearing from Solr index # It is looking for documents with "Emory" in th

Re: Items disappearing from Solr index

2012-09-26 Thread Erik Hatcher
On Sep 26, 2012, at 04:47 , Kissue Kissue wrote: > getSolrServer().deleteByQuery(catalogueId + ":" + Emory Labs) [Notice that > there are no quotes surrounding the catalogueId value - Emory Labs] The best way to do this type of query (where the field type is a string with arbitrary characters t

Re: DIH - importing XML with nested elements that have the same name

2012-09-26 Thread Gora Mohanty
On 26 September 2012 23:47, Billy Newman wrote: > To be a little more specific, the error message I get is: > "forEach cannot start with '//'" > > Cannot really find anything on this except for > https://issues.apache.org/jira/browse/SOLR-1437. Which only talks > about using '//' for the xpath at

Proximity(tilde) combined with wildcard, AutomatonQuery ?

2012-09-26 Thread Vadim Kisselmann
Hi guys, we assume i have a simple query like this with wildcard and tilde: "japa* fukushima"~10 instead of "japan fukushima"~10 OR "japanese fukushima"~10, etc. Do we have a solution in Solr 4.0 to work with these kind of queries? Does the AutomatonQuery/Filter cover this case? Best regards V

Re: DIH - importing XML with nested elements that have the same name

2012-09-26 Thread Billy Newman
To be a little more specific, the error message I get is: "forEach cannot start with '//'" Cannot really find anything on this except for https://issues.apache.org/jira/browse/SOLR-1437. Which only talks about using '//' for the xpath attribute in the field tag, nothing about using '//' in a forE

Re: Items disappearing from Solr index

2012-09-26 Thread Kissue Kissue
# It is looking for documents with "Emory" in the specified field OR "Labs" in the default search field. This does not seem to be the case. For instance issuing a deleteByQuery for catalogueId: "PEARL LINGUISTICS LTD" also deletes the contents of a catalogueId with the value: "Ncl_MacNaughtonMcGre

DIH - importing XML with nested elements that have the same name

2012-09-26 Thread Billy Newman
Hello all, I am running solr 4.0.0-BETA and I am running into an issue when trying to import an XML document in which I want forEach to pull from nested elements with the same element name. doc example: 1 Item 1 2

Error in SolrNet:The remote server returned an error: (400) Bad Request

2012-09-26 Thread mihirhapaliya
Hi Everyone I am using SolNet Api for using Solr in my .Net project.When I am trying to index the data solr throws an *Error:The remote server returned an error: (400) Bad Request.* /* Stacktrace */ at SolrNet.Impl.SolrConnection.Post(String relativeUrl, String s) in c:\prg\SolrNet\svn\SolrNet\Imp

Re: DIH problem

2012-09-26 Thread Gian Marco Tagliani
Here the issue: https://issues.apache.org/jira/browse/SOLR-3896 On Tue, Sep 25, 2012 at 1:41 PM, Gian Marco Tagliani wrote: > Ok, > I'll try to verify if there is the same issue in the 4.0 and I'll open the > issue in Jira. > > thanks > > -- > Gian Marco > > > > > On Sat, Sep 22, 2012 at 9:34

Re: Making a case to migrate from GSA to Solr

2012-09-26 Thread Erik Hatcher
Matthew - I (and others at Lucid) worked with The Motley Fool to convert them from the GSA to Solr a few years ago with great success. They had a variety of data sources (relational databases, XML feeds, etc) that smoothly went into Solr and drastically improved their search relevancy and user

Re: Indexing in Solr: invalid UTF-8

2012-09-26 Thread Michael McCandless
Python's unicode function takes an optional (keyword) "errors" argument, telling it what to do when an invalid UTF8 byte sequence is seen. The default (errors='strict') is to throw the exceptions you're seeing. But you can also pass errors='replace' or errors='ignore'. See http://docs.python.org

Re: How to post atomic updates using xml

2012-09-26 Thread jimtronic
For multi-valued fields, you can use "add" to add a value to the list. If the value already exists, it will be there twice. "set" will replace the entire list with the one value that you specify. There's currently no method to remove a value, although the issue has been logged: https://issues.apa

Re: per-core logfiles?

2012-09-26 Thread Walter Underwood
I expect you could do the routing with syslog-ng rather than changing the Solr code or adding custom logging code. --wunder On Sep 26, 2012, at 8:10 AM, Shawn Heisey wrote: > I have been searching for a way to create per-core logfiles, with information > not specific to a core being logged to a

Re: Items disappearing from Solr index

2012-09-26 Thread Yonik Seeley
On Wed, Sep 26, 2012 at 10:45 AM, Shawn Heisey wrote: > On 9/26/2012 5:47 AM, Kissue Kissue wrote: >> >> getSolrServer().deleteByQuery(catalogueId + ":" + Emory Labs) [Notice >> that >> there are no quotes surrounding the catalogueId value - Emory Labs] > > How did you even get this Java code to

per-core logfiles?

2012-09-26 Thread Shawn Heisey
I have been searching for a way to create per-core logfiles, with information not specific to a core being logged to a "main" log. There has been some discussion on this list in the past, but no apparent resolution. Currently I use 3.5.0 with the default jdk logging. When I upgrade to 4.x, I

Re: Items disappearing from Solr index

2012-09-26 Thread Shawn Heisey
On 9/26/2012 5:47 AM, Kissue Kissue wrote: getSolrServer().deleteByQuery(catalogueId + ":" + Emory Labs) [Notice that there are no quotes surrounding the catalogueId value - Emory Labs] How did you even get this Java code to compile? I would expect the compiler to throw an error, even if Emo

Re: How to retrive value from float field in custom request handler?

2012-09-26 Thread Jack Krupansky
The Javadoc for IndexableField.stringValue says "Non-null if this field has a string value". In your case, a null value should have been returned since the field has a numeric value rather than a string value. Was this not the case? You should call the numericValue method for the numeric field

Re: Access and copy lucene index data

2012-09-26 Thread Bill_78
Thanks Jack for your reply Process the fields was not my first objective but the analysis page helped me. Finally I found a way to modify a field content during the fields process phase processed by Solr. So I have used the 'analysis' code to process my field in this part of code and store the res

Re: How to retrive value from float field in custom request handler?

2012-09-26 Thread Ahmet Arslan
Hi Ravic, You can use : SolrPluginUtils.html#docListToSolrDocumentList --- On Wed, 9/26/12, ravicv wrote: > From: ravicv > Subject: How to retrive value from float field in custom request handler? > To: solr-user@lucene.apache.org > Date: Wednesday, September 26, 2012, 3:19 PM > HI All, > > I

Re: Items disappearing from Solr index

2012-09-26 Thread Travis Low
That makes sense on the surface, but Kissue makes a good point. Shouldn't the delete match the same documents as the search? He said no documents come back when he searches on the phrase, but documents are deleted when he uses the same phrase. cheers, Travis On Wed, Sep 26, 2012 at 9:37 AM, Jac

Re: Problem with post.jar

2012-09-26 Thread Jack Krupansky
Have you set the "df" or "qf" parameter in solrconfig.xml or your query to "title" or are you specifying the "title" field in your query? Which query parser are you using? Try query of "*:*" and see if the document actually got added. -- Jack Krupansky -Original Message- From: Alexan

Re: Items disappearing from Solr index

2012-09-26 Thread Jack Krupansky
It is looking for documents with "Emory" in the specified field OR "Labs" in the default search field. -- Jack Krupansky -Original Message- From: Kissue Kissue Sent: Wednesday, September 26, 2012 7:47 AM To: solr-user@lucene.apache.org Subject: Re: Items disappearing from Solr index

Re: DIH import from MySQL results in garbage text for special chars

2012-09-26 Thread Gora Mohanty
On 21 September 2012 11:19, Pranav Prakash wrote: > I am seeing the garbage text in browser, Luke Index Toolbox and everywhere > it is the same. My servlet container is Jetty which is the out-of-box one. > Many other special chars are getting indexed and stored properly, only few > characters cau

Re: Getting the distribution information of scores from query

2012-09-26 Thread Mikhail Khludnev
I suggest to create a component, put it after QueryComponent. in prepare it should add own PostFilter into list of request filters, your post filter will be able to inject own DelegatingCollector, then you can just add collected histogram into result named list http://searchhub.org/dev/2012/02/10/

Re: Items disappearing from Solr index

2012-09-26 Thread Kissue Kissue
I have just solved this problem. We have a field called catalogueId. One possible value for this field could be "Emory Labs". I found out that when the following delete by query is sent to solr: getSolrServer().deleteByQuery(catalogueId + ":" + Emory Labs) [Notice that there are no quotes surrou

Solr 4 spatial queries, jts and polygons

2012-09-26 Thread Ere Maijala
Hi All, I've been trying to get the brand new spatial search functionality working with Solr 4 snapshot apache-solr-4.1-2012-09-24_05-10-26 and also a trunk build from 22 Sep. I have added the jts and jts-io libraries and defined a field as follows: spatialContextFactory="com.spatial4j.core.

Re: RE: Group.query

2012-09-26 Thread Ingar Hov
Disregard my previous post I think I misunderstood. Johannes is right. Facet is the solution. Where group = Children_sand_toys, Boys_toys, Girls_toys q=bucket&facet=true&facet.field=group&wt=xml Regards, Ingar On Wed, Sep 26, 2012 at 1:00 PM, Ingar Hov wrote: > Looks like you are considerin

Problem with post.jar

2012-09-26 Thread Alexander Troost
Hello *! i am using the post.jar-file to index documents. I made my own XML and wanted to post it with the jar-file to SOLR. It looks like this: add>21GENESISBUCH DER ANFÄNGE22EXODUSBUCH DER ERLÖSUNG23LEVITICUSBUCH DER ANBETUNG24NUMERIBERICHT VON DEN ERFAHRUNGEN

Re: RE: Group.query

2012-09-26 Thread Ingar Hov
Looks like you are considering hierarchical facet of some sort. Haven't looked at it in a while, but if you decide to go that way you may open up a can of worms.. I would reconsider the datastructure first to see if that is really needed. You could perhaps solve this with: Then you get 2 fac

Antwort: RE: Group.query

2012-09-26 Thread Johannes . Schwendinger
I think what you need is facetting, or is this another thing? http://searchhub.org/dev/2009/09/02/faceted-search-with-solr/ Peter Kirk schrieb am 26.09.2012 12:18:32: > Von: > > Peter Kirk > > An: > > "solr-user@lucene.apache.org" > > Datum: > > 26.09.2012 12:19 > > Betreff: > > RE: Gro

RE: Group.query

2012-09-26 Thread Peter Kirk
Thanks. Yes I can do this - but doesn't it mean I need to execute a query per group? What I really want to do (and I'm sorry I'm not so good at explaining) is to execute one query for products, and receive results grouped by the groups - but where a particular product may be found in several gr

Re: DIH import from MySQL results in garbage text for special chars

2012-09-26 Thread Pranav Prakash
I looked at the HEX codes of the texts. The hex code in MySQL is different from that which is stored in the index. The hex code in index is longer than the hex code in MySQL, this leads me to the fact that somewhere in between smething is messing up, *Pranav Prakash* "temet nosce" On Fri, Sep

Re: Group.query

2012-09-26 Thread Ingar Hov
I hope I understood the question, if so this may be a solution: Why don't you make the field group for product multiple? Example: If the product is a member of group1 and group2, just add both for the product document so that each product has an array of group. Then you can easily get all prod

Re: How to post atomic updates using xml

2012-09-26 Thread Akos
jimtronic gmail.com> writes: > > Actually, the correct method appears to be this: > > an atomic update in JSON: > { > "id" : "book1", > "author" : {"set":"Neal Stephenson"} > } > > the same in XML: > > > > book1 > Neal Stephenson > > > > Jim > > --

RE: Group.query

2012-09-26 Thread Peter Kirk
Thanks. Yes, the only solution I could think of was to execute several queries. I would like it to be a single query if at all possible. If anyone has ideas I could look into that would be great. Thanks, Peter -Original Message- From: Aditya [mailto:findbestopensou...@gmail.com] Sent: 2

Re: Group.query

2012-09-26 Thread Aditya
Hi You are doing AND search, so you are getting results prod1 and prod2. I guess, you should query only for group1 and another query for group2. Regards Aditya www.findbestopensource.com On Wed, Sep 26, 2012 at 12:26 PM, Peter Kirk wrote: > Hi > > I have "products" which belong to one or mor