Re: SolrJ Collapsable Query Fails

2011-07-15 Thread Kurt Sultana
Hi, Thanks for the information. However, I still have one more problem. I am iterating over the values of the NamedList. I have 2 values, one being 'responseHeader' and the other one being 'grouped'. I would like to access some information stored within the grouped section, which has data structur

POST VS GET and NON English Characters

2011-07-15 Thread Sujatha Arun
Hello, We have implemented solr search in several languages .Intially we used the "GET" method for querying ,but later moved to "POST" method to accomodate lengthy queries . When we moved form GET TO POSt method ,the german characteres could no longer be searched and I had to use the fucntion

Re: POST VS GET and NON English Characters

2011-07-15 Thread pankaj bhatt
Hi Arun, This looks like an Encoding issue to me. Can you change your browser settinsg to UTF-8 and hit the search url via GET method. We faced the similar problem with chienese,korean languages, this solved the problem. / Pankaj Bhatt. 2011/7/15 Sujatha Arun > Hello,

Re: SolrCloud Shardding

2011-07-15 Thread Jamie Johnson
Thanks Shalin. I don't necessarily have an issue running off this patch but before I do that or implement my own shardding logic I wonder if you could let me know your thoughts on the stability of the patch? How well it works basically. On Thu, Jul 14, 2011 at 4:51 PM, Shalin Shekhar Mangar wro

Need Suggestion

2011-07-15 Thread Rohit Gupta
I am facing some performance issues on my Solr Installation (3core server). I am indexing live twitter data based on certain keywords, as you can imagine, the rate at which documents are received is very high and so the updates to the core is very high and regular. Given below are the document

Need Suggestion

2011-07-15 Thread Rohit
I am facing some performance issues on my Solr Installation (3core server). I am indexing live twitter data based on certain keywords, as you can imagine, the rate at which documents are received is very high and so the updates to the core is very high and regular. Given below are the document size

Re: Need Suggestion

2011-07-15 Thread Mohammad Shariq
below are certain things to do for search latency. 1) Do bulk insert. 2) Commit after every ~5000 docs. 3) Do optimization once in a day. 4) in search query use "fq" parameter. What is the size of JVM you are using ??? On 15 July 2011 17:44, Rohit wrote: > I am facing some performance iss

Re: SolrJ Collapsable Query Fails

2011-07-15 Thread Ahmet Arslan
> Thanks for the information. However, I still have one more > problem. I am > iterating over the values of the NamedList. I have 2 > values, one > being 'responseHeader' and the other one being 'grouped'. I > would like to > access some information stored within the grouped section, > which has

Re: deletedPkQuery fails

2011-07-15 Thread Juan Grande
Hi Elaine, I think you have a syntax error in your query. I'd recommend you to first try the query using a SQL client, until you get it right. This part seems strange to me: and pl.deleted='' having count(*)=0 *Juan* On Wed, Jul 13, 2011 at 5:09 PM, Elaine Li wrote: > Hi Folks, > > I am try

High Query Volume

2011-07-15 Thread Sheetal
Hello, I am using solr MoreLikeThis for finding similar result. I have all data indexed into my Solr server. And the indexed data is also too huge. The data ranges to millions. What I am trying to do is, given the "ID", it should check the contents of that respective ID and give me the result si

DIH full-import - when is commit() actally triggered?

2011-07-15 Thread Frank Wesemann
Hello, I am running a full import with a quite plain data-config (a root entity with three sub entities ) from a jdbc datasource. This import is expected to add approximately 10 mio documents What I now see from my logfiles is, that a newSearcher event is fired about every five seconds. This c

Data Import from a Queue

2011-07-15 Thread Brandon Fish
Does anyone know of any existing examples of importing data from a queue into Solr? Thank you.

RE: ' invisible ' words

2011-07-15 Thread Jagdish Vasani
Hi deniz You can use luke ( http://www.getopt.org/luke/) and see how that field is indexed..which words are there in that field. That may help you figure out how you indexed you field. Thanks. Jagdish -Original Message- From: deniz [mailto:denizdurmu...@gmail.com] Sent: Thursday, J

RE: Is it possible to extract all the tokens from solr?

2011-07-15 Thread Jagdish Vasani
Check the LukeRequestHandler at - http://wiki.apache.org/solr/LukeRequestHandler This will give you all you need. Thanks, Jagdish -Original Message- From: pravesh [mailto:suyalprav...@yahoo.com] Sent: Thursday, July 14, 2011 2:50 PM To: solr-user@lucene.apache.org Subject: Re: Is it p

Max Rows

2011-07-15 Thread Alejandro Delgadillo
Hi guys! For the past year I¹ve been using Solr with Coldfusion as a search engine for a Library, so far so good I¹ve managed to index different collections using only the 5 custom fields (category, custom1 ... 5) available, since It has worked so good I decided to use Solr to make something like

Re: Need Suggestion

2011-07-15 Thread Rohit Gupta
I am using -Xms2g and -Xmx6g What would be the ideal JVM size? Regards, Rohit From: Mohammad Shariq To: solr-user@lucene.apache.org Sent: Fri, 15 July, 2011 7:27:38 PM Subject: Re: Need Suggestion below are certain things to do for search latency. 1) Do bul

Re: DIH full-import - when is commit() actally triggered?

2011-07-15 Thread Ahmet Arslan
> I am running a full import with a quite plain data-config > (a root entity with three sub entities ) from a jdbc > datasource. > This import is expected to add approximately 10 mio > documents > What I now see from my logfiles is, that a newSearcher > event is fired about every five seconds. Th

Re: How to use solr.PatternReplaceFilterFactory with ampersand in pattern

2011-07-15 Thread M Singh
That works. Thanks. From: Markus Jelsma To: solr-user@lucene.apache.org Cc: M Singh Sent: Thu, July 14, 2011 4:37:57 PM Subject: Re: How to use solr.PatternReplaceFilterFactory with ampersand in pattern You're in XML so you must escape it properly with & etc.

Re: Solr Ecosystem / Integration wiki pages

2011-07-15 Thread Chris Hostetter
: integrating Solr with other applications. What isn't there is a list of : what web/email/file crawlers exist, data integration pipelines, and there : are some other odds and ends like distributions/forks of Solr (Lucid & : Constellio), and Solandra.So I started to put together this page: :

Re: Extending Solr Highlighter to pull information from external source

2011-07-15 Thread Jamie Johnson
Boy it's been a long time since I first wrote this, sorry for the delay I think I have this working as I expect with a test implementation. I created the following interface public interface SolrExternalFieldProvider extends NamedListInitializedPlugin { public String[] getFieldConten

Re: Solr Ecosystem / Integration wiki pages

2011-07-15 Thread Smiley, David W.
Thanks for offering feedback; if nobody commented I was going to send an FYI post to the dev list. Comments below. On Jul 15, 2011, at 3:39 PM, Chris Hostetter wrote: > > : integrating Solr with other applications. What isn't there is a list of > : what web/email/file crawlers exist, data inte

Re: Extending Solr Highlighter to pull information from external source

2011-07-15 Thread Jamie Johnson
I added the highlighting code I am using to this JIRA (https://issues.apache.org/jira/browse/SOLR-1397). Afterwards I noticed this JIRA (https://issues.apache.org/jira/browse/SOLR-1954) which talks about another solution. I think David's patch would have worked equally well for my problem, just w

Indexing PDF documents with no UniqueKey

2011-07-15 Thread sabman
I want to index PDF (and other rich) documents. I am using the DataImportHandler. Here is how my schema.xml looks: . . link As you can see I have set link as the unique key so that when the indexing happens documents are not duplicated again.

Re: Extending Solr Highlighter to pull information from external source

2011-07-15 Thread Jamie Johnson
I tried the patch at SOLR-1397 but it didn't work as I'd expect. Test subject message 0 29 The start position is right, but the end position seems to be the length of the field. On Fri, Jul 15, 2011 at 4:25 PM, Jamie Johnson wrote: > I a

Re: SolrCloud Shardding

2011-07-15 Thread Shalin Shekhar Mangar
On Fri, Jul 15, 2011 at 4:51 PM, Jamie Johnson wrote: > Thanks Shalin. I don't necessarily have an issue running off this > patch but before I do that or implement my own shardding logic I > wonder if you could let me know your thoughts on the stability of the > patch? How well it works basical

Analysis page output vs. actually getting search matches, a discrepency?

2011-07-15 Thread Robert Petersen
I a problem searching for one mfg name (out of our 10mm product titles) and it is indexed in a text type field having about the same analyzer settings as the solr example text field definition, and most everything works fine but we found this one example which I cannot get a direct hit on. In the

Re: Analysis page output vs. actually getting search matches, a discrepency?

2011-07-15 Thread Chris Hostetter
: Subject: Analysis page output vs. actually getting search matches, : a discrepency? 99% of the time when people ask questions like this, it's because of confusion about how/when QueryParsing comes into play (as opposed to analysis) -- analysis.jsp only shows you part of the equation, it d

Re: Getting the indexed value rather than the stored value

2011-07-15 Thread Chris Hostetter
: However, when I get the value of the field from a Solr query, I get the : original sentence ("some sentence like this") which is not what I want (in : this particular case). the stored field is allways the original stored value -- analysis is only used for producing the indexed terms. : For n

RE: Analysis page output vs. actually getting search matches, a discrepency?

2011-07-15 Thread Robert Petersen
Hi Chris, Well to start from the bottom of your list there, I restrict my testing to one sku while continuously reindexing the sku after every indexer side change, and reload the core every time also. I just search from the admin page using the word in question and the exact match on the sku fie

Index rows with NULL value

2011-07-15 Thread Ruixiang Zhang
Hi It seems that solr does not index a row when some column of this row has NULL value. How can I make solr index these rows? Thanks Ruixiang

how to get one word frequency from a document

2011-07-15 Thread Allen
Hi All, I am trying to use TermVectorComponent to get the word frequency from a particular document. Here is the url I used: "q=someword+id%3A"somedoc"&qt=tvrh&tv.all=true". But the result includes all the words' frequency in that document. Are there any query filters or request parameters that I

Re: POST VS GET and NON English Characters

2011-07-15 Thread Sujatha Arun
It works fine with GET method ,but I am wondering why it does not with POST method. 2011/7/15 pankaj bhatt > Hi Arun, > This looks like an Encoding issue to me. > Can you change your browser settinsg to UTF-8 and hit the search url > via GET method. > >We faced the similar