Issue with Facet Query

2009-03-20 Thread dabboo
Hi, I am searching the indexes with facet query. Below is the query. q=Answer&version=2.2&start=0&rows=10&indent=on&qt=dismaxrequest&facet=true&facet.field=productPrice_product_str_s:[0%20TO%2020] It is giving me an exception saying: str name="exception">org.apache.solr.common.SolrException: u

Re: Issue with Facet Query

2009-03-20 Thread Shalin Shekhar Mangar
On Fri, Mar 20, 2009 at 1:14 PM, dabboo wrote: > > Hi, > > I am searching the indexes with facet query. Below is the query. > > > q=Answer&version=2.2&start=0&rows=10&indent=on&qt=dismaxrequest&facet=true&facet.field=productPrice_product_str_s:[0%20TO%2020] > facet.field takes a field name. It d

Re: Issue with Facet Query

2009-03-20 Thread dabboo
Thanks a lot for this information. But is there any way, I can impose the range on the facet. for e.g. If I want to search the data between a specific range, how should I form my query. Do I need to make some entries some where. Thanks, Amit Garg Shalin Shekhar Mangar wrote: > > On Fri, Mar

Re: Problem with UTF-8 and Solr ISOLatin1AccentFilterFactory

2009-03-20 Thread aerox7
==> where are you seeing it as ""Solène" as opposed to the correct way of solène? I have "Solène" in my Mysql DATA BASE ! so i don't know if this is correct or not ? i gess that "Solène" is solène in UTF-8 ?! I'vz tryed analysis in http://localhost:8983/solr/admin/analysis.jsp, so when i

Re: Issue with Facet Query

2009-03-20 Thread dabboo
Shalin, thanks a lot. One quick question: Now, after putting the query in the way, you suggested, I am getting: - - 23315 But it is not returning me records. Do I need to enter this field entry in schema.xml to get the records or anywhere else. Thanks, Amit Garg Shalin She

Search transparently with Solr with multiple cores, different indexes, common response type

2009-03-20 Thread Giovanni De Stefano
Hello all, here I am with another question... :-) I figured that I have to change approach to implement the requirements I have :-( Here it is what I have to index: 1) data "A" in an Oracle DB Table "A" 2) data "B" in an Oracle DB Table "B" 3) data "C" in different files Data "A", "B", and "C"

Re: Issue with Facet Query

2009-03-20 Thread Shalin Shekhar Mangar
On Fri, Mar 20, 2009 at 2:27 PM, dabboo wrote: > > Shalin, thanks a lot. One quick question: > > Now, after putting the query in the way, you suggested, I am getting: > > - > - > 23315 > > > > > > But it is not returning me records. Do I need to enter this field entry in > schema.xml t

Re: Issue with Facet Query

2009-03-20 Thread dabboo
Thanks Shalin, thanks a lot. I appreciate your help in resolving this issue. Thanks, Amit Shalin Shekhar Mangar wrote: > > On Fri, Mar 20, 2009 at 2:27 PM, dabboo wrote: > >> >> Shalin, thanks a lot. One quick question: >> >> Now, after putting the query in the way, you suggested, I am gettin

RE: Special character indexing

2009-03-20 Thread Gargate, Siddharth
Hi Shalin, Thanks for the suggestion. I tried following code, (not sure about the exact usage) CommonsHttpSolrServer ess = new CommonsHttpSolrServer("http://localhost:8983/solr";); ess.setRequestWriter(new BinaryRequestWriter()); SolrInputDocument solrdoc = new So

Re: Problem with UTF-8 and Solr ISOLatin1AccentFilterFactory

2009-03-20 Thread Óscar Marín Miró
Hi, My guess is that *although* your DB is in UTF-8, the database engine sends you the rows in ISO-Latin1, so before doing *anything* after receiving the data, you should transcode from ISO-Latin1 to UTF-8 and then send that to SolR. I'm no Java expert, but in perl (MySQL DB in utf-8) I have to do

Re: Issue with Facet Query

2009-03-20 Thread Shalin Shekhar Mangar
On Fri, Mar 20, 2009 at 1:49 PM, dabboo wrote: > > Thanks a lot for this information. But is there any way, I can impose the > range on the facet. > for e.g. If I want to search the data between a specific range, how should > I > form my query. > Use a filter query, fq=productPrice_product_str_s

Re: Problem with UTF-8 and Solr ISOLatin1AccentFilterFactory

2009-03-20 Thread aerox7
I add : "è" => "e" to mapping-ISOLatin1Accent.txt and add the following fieldType: By still have the same probleme ! it's only work when i store ISO string into UTF-8 data base (ex: store solène not solène) :,( aerox7 wrote: > > ==> where are you see

how can I check field which are indexed but not stored?

2009-03-20 Thread sunnyfr
Hi I've an issue, I've some data which come up but I've applied a filtre on it and it shouldnt, when I check in my database mysql I've obviously the document which has been updated so I will like to see how it is in solr. if I do : /solr/video/select?q=id:8582006 I will just see field which has

FW: Special character indexing

2009-03-20 Thread Gargate, Siddharth
Thanks Shalin, Adding BinaryUpdateRequestHandler solved the issue. Thank you very much. Just one query, shouldn't XmlUpdateRequestHandler also work for these characters? I saw another user mentioning the same issue and it was working with DirectXmlRequest. -Original Message- From:

Re: Combination of solr.xml and solrconfig.xml

2009-03-20 Thread Kraus, Ralf | pixelhouse GmbH
Erik Hatcher schrieb: Unfortunately Solr doesn't offer that kind of reusability (yet). But you could just go old school and use XML entity includes to pull in a fragment of a file, and externalize the common pieces that way. Not as pretty, but oughta work. one last little question ;-) http:/

Re: alternative lucene directories support

2009-03-20 Thread Andrey Klochkov
Otis, The fact is that some code instantiates FSDirectory indirectly by using deprecated constructors. I provided a patch here https://issues.apache.org/jira/browse/SOLR-465 but I don't have rights to re-open the issue. Also there is logic in Solr which is tied to file system usage even if file s

Facet Query Results Issue

2009-03-20 Thread dabboo
Hi, this is my facet query. facet.field=productPrice_product_str_s&facet.query=productPrice_product_str_s:[0%20TO%20100] This is my query and these are results, I am getting: 202 57 14 11 10 9 9 7 6 5 4 2 2 2 2 2 1 1 1 1 1 1

Re: Issue with Facet Query

2009-03-20 Thread dabboo
Hi Shalin, One more thing, facet.field=productPrice_product_str_s&facet.query=productPrice_product_str_s:[0%20TO%20100] This is my query and these are results, I am getting: 202 57 14 11 10 9 9 7 6 5 4 2 2 2 2 2 1 1 1 1 1 1 0

Re: Special character indexing

2009-03-20 Thread Shalin Shekhar Mangar
On Fri, Mar 20, 2009 at 3:19 PM, Gargate, Siddharth wrote: > Hi Shalin, >Thanks for the suggestion. I tried following code, (not sure about > the exact usage) > >CommonsHttpSolrServer ess = new CommonsHttpSolrServer(" > http://localhost:8983/solr";); >ess.setRequestWriter(n

Re: how can I check field which are indexed but not stored?

2009-03-20 Thread Markus Jelsma - Buyways B.V.
On Fri, 2009-03-20 at 03:41 -0700, sunnyfr wrote: > Hi > > I've an issue, I've some data which come up but I've applied a filtre on it > and it shouldnt, when I check in my database mysql I've obviously the > document which has been updated so I will like to see how it is in solr. > > if I do

Re: Problem with UTF-8 and Solr ISOLatin1AccentFilterFactory

2009-03-20 Thread aerox7
I'm using DataImportHandler to send my data to Solr ! so you mean it possible to apply a transformer in db-config.xml with a perl script ? Óscar Marín Miró wrote: > > Hi, > > My guess is that *although* your DB is in UTF-8, the database engine sends > you the rows in ISO-Latin1, so before doin

Re: FW: Special character indexing

2009-03-20 Thread Shalin Shekhar Mangar
On Fri, Mar 20, 2009 at 4:13 PM, Gargate, Siddharth wrote: > Thanks Shalin, > > Adding BinaryUpdateRequestHandler solved the issue. Thank you very much. > > Just one query, shouldn't XmlUpdateRequestHandler also work for these > characters? I saw another user mentioning the same issue and it was w

Re: Issue with Facet Query

2009-03-20 Thread Shalin Shekhar Mangar
On Fri, Mar 20, 2009 at 4:00 PM, dabboo wrote: > > Hi Shalin, > > One more thing, > > > facet.field=productPrice_product_str_s&facet.query=productPrice_product_str_s:[0%20TO%20100] > > This is my query and these are results, I am getting: > > 202 > 57 > 14 > 11 > 10 > 9 > 9 > 7 > 6 > 5 >

Re: Problem with UTF-8 and Solr ISOLatin1AccentFilterFactory

2009-03-20 Thread Óscar Marín Miró
What I mean is that unless "solène" travels to Solr in strict UTF-8, mapping-ISOLatin1Accent won't do anything, and posibly your DB query returns data in ISO-Latin1 (I always have this issue with UTF8-Mysql), so unless you transcode your data from Latin1 to UTF8 before sending it to SolR, mapping-I

Re: Issue with Facet Query

2009-03-20 Thread dabboo
I am using this query only but I am getting the same results. facet=true&facet.field=productPrice_product_str_s&fq=productPrice_product_str_s:[1%20TO%20100] - - 202 57 14 11 10 9 9 7 6 5 4 2 2 2 2 2 1 1 1 1 1 1 0 0 0

Re: Issue with Facet Query

2009-03-20 Thread Shalin Shekhar Mangar
And you'll need to re-index once you make the schema change. On Fri, Mar 20, 2009 at 5:24 PM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > What is the type of the productPrice_product_str field? I'm guessing that > it is a string type. > > Since it is a float value and you need range

Re: Problem with UTF-8 and Solr ISOLatin1AccentFilterFactory

2009-03-20 Thread Óscar Marín Miró
A got you :) Sorry. Correct, I use a Perl client. But sorry to say, I don't use DataImportHandler. I just make the queries to the DB, filter the results, and build the solr XML 'by hand' at the perl script :( On Fri, Mar 20, 2009 at 1:04 PM, aerox7 wrote: > > Yes ! i completely understand t

Re: Problem with UTF-8 and Solr ISOLatin1AccentFilterFactory

2009-03-20 Thread Shalin Shekhar Mangar
On Fri, Mar 20, 2009 at 5:34 PM, aerox7 wrote: > > Yes ! i completely understand the problem. I'm just asking about your > solution to resolvre this problem. > > I gess that you use Solar PERL Client to index your DATABASE. for my case i > use DataImportHandler, so to only solution that i have wi

Re: Facet Query Results Issue

2009-03-20 Thread Erik Hatcher
On Mar 20, 2009, at 6:39 AM, dabboo wrote: this is my facet query. facet .field =productPrice_product_str_s&facet.query=productPrice_product_str_s: [0%20TO%20100] This is my query and these are results, I am getting: It is only returning results, which are having values started with 2, 3

Re: Problem with UTF-8 and Solr ISOLatin1AccentFilterFactory

2009-03-20 Thread aerox7
My DATABASE is already in UTF-8 (Collation and Charset). I already set Tomcat connector to UTF-8, and Mysql default charset to UTF-8 How to force mysql to send on UTF-8 (Or may be i have to do this for TomCat ?) i'm going crazy... :) Shalin Shekhar Mangar wrote: > > On Fri, Mar 20, 2009

Re: Issue with Facet Query

2009-03-20 Thread Shalin Shekhar Mangar
What is the type of the productPrice_product_str field? I'm guessing that it is a string type. Since it is a float value and you need range search, you should change this to a 'sfloat' or 'sdouble' in your schema.xml On Fri, Mar 20, 2009 at 5:11 PM, dabboo wrote: > > I am using this query only

Re: Problem with UTF-8 and Solr ISOLatin1AccentFilterFactory

2009-03-20 Thread aerox7
Yes ! i completely understand the problem. I'm just asking about your solution to resolvre this problem. I gess that you use Solar PERL Client to index your DATABASE. for my case i use DataImportHandler, so to only solution that i have with this is to create a transformer for DataImportHandler an

Error in identifying the primary key

2009-03-20 Thread radha c
Hi, I am new to Solr. I am trying to index SQL table rows. I am getting the below error. Can anyone help me in resolving this issue. Mar 20, 2009 6:03:38 PM org.apache.solr.handler.dataimport.DataImporter verifyWithSchema INFO: id is a required field in SolrSchema . But not found in DataConfig Ma

Re: Problem with UTF-8 and Solr ISOLatin1AccentFilterFactory

2009-03-20 Thread Óscar Marín Miró
Hi, Maybe this info is handy for you: http://dev.mysql.com/doc/refman/5.0/en/charset-connection.html The fact is Mysql can have UTF8 in its storage engine (or defined by database), as you have, but the *connection* to the mysql client, can be set to latin1. In fact, here are my character_set vari

Re: Problem with UTF-8 and Solr ISOLatin1AccentFilterFactory

2009-03-20 Thread Grant Ingersoll
Usually, when I see characters like this, it means you aren't viewing/ handling the UTF-8 correctly when bringing it into Java. I would first check that your DB or JDBC driver is getting the chars out right. It may even be the case that they did not go into the DB correctly in the first pl

Re: solrj : probleme with utf-8 content

2009-03-20 Thread Pascal Dimassimo
Hi, I have that problem to. But I notice that it only happens if I send my data via solrj. If I send it via the solr-ruby gem, everything is fine (http://wiki.apache.org/solr/solr-ruby). Here is my jruby script: --- require 'rubygems' require 'solr' require 'rexml/do

Re: delta-import commit=false doesn't seems to work

2009-03-20 Thread sunnyfr
Thanks I gave more information there : http://www.nabble.com/Problem-for-replication-%3A-segment-optimized-automaticly-td22601442.html thanks a lot Paul Noble Paul നോബിള്‍ नोब्ळ् wrote: > > sorry, the whole thing was commented . I did not notice that. I'll > look into that > > 2009/3/20 Nobl

Unknown FieldType: 'string' used in QueryElevationComponent

2009-03-20 Thread radha c
Hi, I am having below schema.xml, I did not define any string field. But I am getting the below error when I start Tomcat, Can anyone please suggest me what is the issue here. WARNING: No queryConverter defined, using default converter Mar 20, 2009 7:31:55 PM org.apache.solr.core.QuerySenderListe

Re: how can I check field which are indexed but not stored?

2009-03-20 Thread sunnyfr
Cool I was just having a look on it but it doesn't seem to show up field which are not stored just tried : /admin/luke?id=8582006&fl=description but it doesn't seems to work :( It find this id but show up stored field. Did I do a mistake ? thanks a lot Markus Jelsma - Buyways B.V. wrote: > >

q.alt and highlights

2009-03-20 Thread Marc Sturlese
Is there any way to activate highlights using q.alt of dismax? I have hl well configurated and working for normal q in the field "content" (in the solr.xml). For q.alt, I try to do: http://localhost:8080/solr/select/?q=&q.alt=my_id:475836&start=0&rows=10&hl=true But no highlight is showed... Any a

Re: Compound word search (maybe DisMaxQueryPaser problem)

2009-03-20 Thread Tobias Dittrich
Oh my ... thinking even more about it, I have to admit you're right :) But that leaves me somewhat clueless again. So I'll just try and share my thoughts on this. Maybe someone will read this and can point me to a possible solution ... or tell me where I'm wrong. Say we have a schema with fi

Re: Null pointer exception on use of ImportDataHandler (useSolrAddSchema="true")

2009-03-20 Thread Sam Keen
thanks, I applied the patch in SOLR-1077 and this is now fixed for me (i updated the bug w/ a comment) sam keen 2009/3/19 Noble Paul നോബിള്‍ नोब्ळ् : > it is a bug , I have raised an issue > > https://issues.apache.org/jira/browse/SOLR-1077 > > On Fri, Mar 20, 2009 at 4:41 AM, Sam Keen wrote: >

JVM exception_access_violation

2009-03-20 Thread wojtekpia
I'm running Solr on Tomcat 6.0.18 with Java 6 update 7 on Windows 2003 64 bit. Over the past month or so, my JVM has crashed twice with the error below. Has anyone experienced this? My system is not heavily loaded, and the crash seems to coincide with an update (via DIH). I'm running trunk code fr

Re: stop word search

2009-03-20 Thread revas
Hi Erik, I have now commented the query time stopword analyzer .I restarted the server.But now when i search for a stop word ,i am getting results. We had earlier indexed the content with the stop word analyzer.I dont think we need to reindex after commentting the query analyzer,right? This fiel

Re: Error in identifying the primary key

2009-03-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
for all the fields mentioned in data-config.xml there should be a counterpart in schema.xml anyway that is relaxed in the latest nightly On Fri, Mar 20, 2009 at 6:26 PM, radha c wrote: > Hi, > > I am new to Solr. I am trying to index SQL table rows. > I am getting the below error. Can anyone h

Re: delta-import commit=false doesn't seems to work

2009-03-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
just hit the DIH without any command and you may be able to see the status of the last import. It can tell you whether a commit/optimize was performed On Fri, Mar 20, 2009 at 7:07 PM, sunnyfr wrote: > > Thanks I gave more information there : > http://www.nabble.com/Problem-for-replication-%3A-seg

DIH data-config loading

2009-03-20 Thread Rui Pereira
I'm trying to load or delete entities in data-config in runtime, changing the data-config.xml file, reload and delete or full-import as needed.My question is: does data-config gets loaded into memory in runtime an reload only, that is, can I change the file while solr is importing or deleting data?

Re: delta-import commit=false doesn't seems to work

2009-03-20 Thread sunnyfr
Like you can see, I did that and I've no information in my DIH but you can notice in my logs and even my segments that and optimize is fired alone automaticly? Noble Paul നോബിള്‍ नोब्ळ् wrote: > > just hit the DIH without any command and you may be able to see the > status of the last import.

Re: solrj : probleme with utf-8 content

2009-03-20 Thread Ryan McKinley
do you know if your java file is encoded with utf-8? sometimes it will be encoded as something different and that can cause funny problems.. On Mar 18, 2009, at 7:46 AM, Walid ABDELKABIR wrote: when executing this code I got in my index the field "includes" with this value : "?

Re: DIH data-config loading

2009-03-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Fri, Mar 20, 2009 at 10:57 PM, Rui Pereira wrote: > I'm trying to load or delete entities in data-config in runtime, changing > the data-config.xml file, reload and delete or full-import as needed.My > question is: does data-config gets loaded into memory in runtime an reload > only, that is, c

Re: Problem with UTF-8 and Solr ISOLatin1AccentFilterFactory

2009-03-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
May be there is an issue with the recent changes with SOLR-973 I have given a new patch on SOLR-973 aerox ,is it possible to confirm if that is the problem On Fri, Mar 20, 2009 at 6:52 PM, Grant Ingersoll wrote: > Usually, when I see characters like this, it means you aren't > viewing/handling t

Re: solrj : probleme with utf-8 content

2009-03-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
SOLR-973 seems to have caused the problem On Fri, Mar 20, 2009 at 11:01 PM, Ryan McKinley wrote: > do you know if your java file is encoded with utf-8? > > sometimes it will be encoded as something different and that can cause funny > problems.. > > > On Mar 18, 2009, at 7:46 AM, Walid ABDELKABIR

Re: Page-Rank algorithm

2009-03-20 Thread Otis Gospodnetic
Victor, Solr knows nothing about hyperlinks, web pages, and such. Solr doesn't even have a web crawler. You should ask on nutch-u...@lucene... mailing list instead. The answer there will be positive. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Messag

Re: solrj : probleme with utf-8 content

2009-03-20 Thread Pascal Dimassimo
yes, now it works fine with the trunk sources thanks! Noble Paul നോബിള്‍ नोब्ळ् wrote: > > SOLR-973 seems to have caused the problem > > On Fri, Mar 20, 2009 at 11:01 PM, Ryan McKinley wrote: >> do you know if your java file is encoded with utf-8? >> >> sometimes it will be encoded as somet

Re: stop word search

2009-03-20 Thread Erick Erickson
Yes, you do need to reindex after removing the stopword filter from the configuration. When you indexed the first time using the stopword filter, the words were NOT indexed, so they won't be found now that they're getting through the query analyzer. Best Erick On Fri, Mar 20, 2009 at 1:02 PM, rev

Re: Stemming in Solr

2009-03-20 Thread Chris Hostetter
: Can someone please let me know how to implement stemming in solr. I am : particularly looking of the changes, I might need to do in the config files : and also if I need to use some already supplied libraries/factories etc etc. i would start by searching the wiki and email archives for stemmin

Re: Special Characters search in solr

2009-03-20 Thread Chris Hostetter
: Yes, I did and below is my debugQuery result. before you even look at the debug section, look at the params section in the responseHeader... : Colo� the raw value Solr is getting from your servlet container doesn't match what you think you are sending... : It is actually converting "Col

Re: Issue with Facet Query

2009-03-20 Thread Chris Hostetter
: I am using this query only but I am getting the same results. : : : facet=true&facet.field=productPrice_product_str_s&fq=productPrice_product_str_s:[1%20TO%20100] ... : It still is not showing up the other values. Do I need to make any entry in : schema or solrConfig xml files. Do I

Re: Problem with UTF-8 and Solr ISOLatin1AccentFilterFactory

2009-03-20 Thread aerox7
Hi, I've cheked MySql conf with "mysql> SHOW VARIABLES LIKE 'character_set%'; " : all character_set are in UTF-8. I think that dataimporter get data in ISO. so the i just write a custom transformer to change the row's charset from iso to utf and now it work. --> Noble Paul : I use SOLR 1.4 Night

Re: Problem with UTF-8 and Solr ISOLatin1AccentFilterFactory

2009-03-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
I guess you can mention a JdbcDataSource property characterEncoding="UTF8" and it should help On Sat, Mar 21, 2009 at 10:58 AM, aerox7 wrote: > > Hi, > I've cheked MySql conf with "mysql> SHOW VARIABLES LIKE 'character_set%'; " > : all character_set are in UTF-8. > > I think that dataimporter get