Regd WSTX EOFException

Hi, Sometimes while indexing to solr, I am getting the following exception. "com.ctc.wstx.exc.WstxEOFException: Unexpected end of input block in end tag" I think its some configuration issue. Kindly suggest. I have a solr working with Tomcat 6 Thanks Pooja

Re: Regd WSTX EOFException

Hi, The client being used is php curl. Could that be a problem? On Wed, Aug 25, 2010 at 7:10 PM, Yonik Seeley wrote: > On Wed, Aug 25, 2010 at 6:41 AM, Pooja Verlani > wrote: >> Hi, >> Sometimes while indexing to solr, I am getting  the following exception. >> "com.

Removing duplicate field at the time of search

Hi, I have a "X" field in my index, which is a feature hash I would like to use to remove the duplicates in my result. I cant keep this as the unique id field. Is there any method or any parameter at the search time to remove the duplicates on a particular field(hash in this case)? Thanks in adva

Re: Removing duplicate field at the time of search

looking for: > http://wiki.apache.org/solr/Deduplication > > Best > Erick > > On Tue, Jun 21, 2011 at 1:40 PM, Pooja Verlani > wrote: > > Hi, > > > > I have a "X" field in my index, which is a feature hash I would like to > use > > to remove

Re: Removing duplicate field at the time of search

Erickson wrote: > Well, in trunk and the soon-to-be-released Solr 3.3, you could use > grouping, > what is the use-case here? Are you going to show all the docs (even > duplicates) > some of the time? > > Best > Erick > > On Tue, Jun 21, 2011 at 1:53 PM, Pooja

Query time noun, verb boosting

Hi, At the query time, I want to make the lucene query such that it should boost only the noun from the query or some concept existing in the index. Are there any possibilities or any possible ideas that can be worked around? Regards, Pooja

Re: Query time noun, verb boosting

ting terms from the Index. > > > -- > Anshum Gupta > http://ai-cafe.blogspot.com > > > On Thu, Jun 23, 2011 at 11:02 AM, Pooja Verlani >wrote: > > > Hi, > > > > At the query time, I want to make the lucene query such that it should > > boost >

Restricting the Solr Posting List (retrieved set)

Hi, We want to search in an index in such a way that even if a clause has a long posting list - Solr should stop collecting documents for the clause after receiving X documents that match the clause. For example, if for query "India",solr can return 5M documents, we would like to restrict the se

Re: Restricting the Solr Posting List (retrieved set)

Thanks for the reply. I am having a very huge index, so to retrieve older documents when not needed definitely wastes time and also at the same time I would need to do recency boosts/ time sort. So, I am looking for a way to avoid that. Thats why I am in need to restrict my docset and recently ad

csv responsewriter and numfound

Hi, Is there anyway to get numFound from csv response format? Some parameter? Or shall I change the code for csvResponseWriter for this? Thanks, Pooja

Same id on two shards

Hi, We have a multicore solr with 6 cores. We merge the results using shards parameter or distrib handler. I have a problem, I might post one document on one of the cores and then post it after some days on another core, as I have a time-sliced multicore setup! The question is if I retrieve a doc

Hierarchical schema design

Hi all, Is there a possibility to have a hierarchical schema in solr, meaning can we have objects under objects. For example, for a doc like: ,b3> . . . . . . . I need to make schema with 3 types of such objects and all of them having different field va

Phrase stopwords

Hi, Is it possible to have a phrase as a stopword in solr? In case, please share how to do so? regards, Pooja

Using recency rord on /distrib

Hi, I have to put recency using recip and rord functions on an app using /distrib requesthandler. Can i put bf param in /distrib directly call the url like: http://localhost:8983/solr/distrib/?q=cable where in /distrib requesthandler bf is defined as: recip(rord(last_sold_date),1,1000,100

Date field being null

Hi, My fieldtype definition is like: I am defining a field: Can I have a null for such a field? or is there a way I can use it as a date field only if the value is null. I cant put the field as a string type as I have to apply recency sort and some filters for that field. Regards, Pooja

Solr Random field

Hi, I want a random sort type in the search results. The scenario is: I want to return random results with no context relation to the query fired, if I am not able to find any results relevant. I want something like: http://localhost:8083/solr/select/?q=*:*&sort=RANDOM. Please suggest. Regards, P

Re: Solr Random field

No I dont have the field with this type and neither do I want to re-index .. is it possible otherwise ? 2009/10/26 Noble Paul നോബിള്‍ नोब्ळ् > do you have a field whose type="random" . If yes then u can sort by that > field > > On Mon, Oct 26, 2009 at 3:35 PM, Pooja Ve

Hierarchical xml

Hi, I want to index an xml like following: John 1979-29-17T28:14:48Z ABC College 1998 PQRS College 2001 XYZ College 2003 I am not able to judge

Dynamic Boosting at query time with boost value as another fieldvalue

Hi all, I have a specific requirement for query time boosting. I have to boost a field on the basis of the value returned from one of the fields of the document. Basically, I have the creationDate for a document and in order to introduce recency factor in the search, i need to give a boost to the

Re: Dynamic Boosting at query time with boost value as another fieldvalue

nctionQuery support in Solr: > > http://wiki.apache.org/solr/FunctionQuery > > http://wiki.apache.org/solr/SolrRelevancyFAQ#head-b1b1cdedcb9cd9bfd9c994709b4d7e540359b1fd > > On Thu, Dec 11, 2008 at 7:01 PM, Pooja Verlani >wrote: > > > Hi all, > > > > I have

Re: Dynamic Boosting at query time with boost value as another fieldvalue

pache.org/solr/SolrRelevancyFAQ#head-b1b1cdedcb9cd9bfd9c994709b4d7e540359b1fd > > On Thu, Dec 11, 2008 at 7:01 PM, Pooja Verlani >wrote: > > > Hi all, > > > > I have a specific requirement for query time boosting. > > I have to boost a field on the basis of the value ret

Re: Dynamic Boosting at query time with boost value as another fieldvalue

e hypen '-' or some other character in the field > name instead of colon. > > On Mon, Dec 15, 2008 at 12:11 PM, Pooja Verlani >wrote: > > > hi, > > Is it possible to have a fieldname with colon for example "source:site"? > I > > want to ap

Fwd: Distributed Searching - Limitations?

Hi, I am planning to use Solr's distributed searching for my project. But while going through http://wiki.apache.org/solr/DistributedSearch, i found a few limitations with it. Can anyone please explain the 2nd and 3rd points in the limitations sections on the page. The points are: - When du

Problem with WT parameter when upgrading from Solr1.2 to solr1.3

Hi, I just upgraded my system from Solr 1.2 to Solr 1.3. I am using the same plugin for the queryResponseWriter that I used in Solr1.2. Problem here is that when I am using *wt* parameter as the plugin name with full package then I don't get the response which I used to get in 1.2 and when I don

Problem with query response writer when upgrading from Solr1.2 to solr1.3

Hi, I just upgraded my system from Solr 1.2 to Solr 1.3. I am using the same plugin for the queryResponseWriter that I used in Solr1.2. Problem here is that when I am using *wt* parameter as the plugin name with full package then I don't get the response which I used to get in 1.2 and when I don

Querying back with top few results in the same XMLWriter!

same reponsewriter? Or is there any functionality provided by solr in either 1.2 or 1.3 version. Thank you. Regards, Pooja Verlani

Re: Problem with WT parameter when upgrading from Solr1.2 to solr1.3

yeah, finally I did it by modifying the required solrDocumentList and using it instead of DocList object as in Solr 1.2 Thanks Pooja On Fri, Jan 9, 2009 at 9:01 AM, Yonik Seeley wrote: > On Thu, Jan 8, 2009 at 9:40 PM, Chris Hostetter > wrote: > > you have a custom response writer you had work

Release of solr 1.4 & autosuggest

Hi All, I am interested in TermComponent addition in solr 1.4 ( http://wiki.apache.org/solr/TermsComponent). When should we expect solr 1.4 to be available for use? Also, can this Termcomponent be made available as a plugin for solr 1.3? Kindly reply if you have any idea. Regards, Pooja

javax.xml.stream.XMLStreamException while posting

Hi, When I posting a valid xml document to solr, its giving the following error: {http--10003-7} javax.xml.stream.XMLStreamException: :2:20 expected '-' at '[' {http--10003-7} at com.caucho.xml.stream.XMLStreamReaderImpl.error(XMLStreamReaderImpl.java:1268) {http--10003-7} at com.c

Re: javax.xml.stream.XMLStreamException while posting

error. --wunder > > On 3/2/09 6:46 AM, "Noble Paul നോബിള്‍ नोब्ळ्" > wrote: > > > the parser you are using is not the standard woodstox one. > > try this http://docs.sun.com/app/docs/doc/819-3672/gfkoy?a=view > > > > On Mon, Mar 2, 2009 at 6:24 PM, Pooja Ve

Regd. Difference check at the time of updation

Hi all, I am looking for a mechanism to check the amount of difference between a document already in the index with the one updated with some new content. Basically, I want to design a criteria to decide whether or not to update the document with the new one. In case solr already has something lik

user feedback in solr

Hi all, I wanted to know if there is any provision to accommodate user feedback in the form of query logs and click logs, to improve the search relevance and ranking. Also, is there a possibility of it being included in the next version ? Thank you, Regards, Pooja

Word frequency count in the index

Hi, Is there any way in SOLR to know the count of each word indexed in the solr ? I want to find out the different word frequencies to figure out ' application specific stop words'. Please let me know if its possible. Thank you, Regards, Pooja

Re: Word frequency count in the index

can use the > LukeRequestHandler to get the top words in each field. > > Alternatively, you may just want to point Luke at your index. > > > On Jul 16, 2009, at 6:29 AM, Pooja Verlani wrote: > > Hi, >> >> Is there any way in SOLR to know the count of each word in

Synonyms from index

Hi, Is there a possible way to generate synonyms from the index ? I have an index with lots of searchable terms turning out to be having synonyms and users too have different synonyms. If not then the only way if to learn from the query logs and click logs but in case there exists one, please s

Dynamic boosting of ids at search time

Hi, I have to boost certain ids at the search time and these ids are not fixed, so i can't keep them in DismaxRequest handler. I mean, if for query x, ids to be boosted are 243452,346563,773567, then for query y the ids to be boosted won't be the same. They are calculated at the search time. Also,

SOLR Multivalued field and length norm

Hi, I understand if I query on a multivalued field, length norm takes the total length of the multivalued field. Is it possible to use the length of only the particular value in the array of multivalued field? It would be easier and more efficient in searching then. Regards, Pooja

Changing term frequency according to value of one of the fields

Hi, I want to modify Similarity class for my app like the following- Right now tf is Math.sqrt(termFrequency) I would like to modify it to Math.sqrt(termFrequncy/solrDoc.getFieldValue("count")) where count is one of the fields in the particular solr document. Is it possible to do so? Can I import s

distributed solr and tf-idf

Hi, How good is the distributed solr shards tf-idf (If at all its working with solr 1.4) ? Is there a chance of it getting better. I have to implement a huge index with many shards. How is it possible to get a global tf-idf for the same, any ideas? Regards, Pooja

numFound:0 when documents exists

Hi, In our search engine, we are getting numFound to be "0" for some queries where documents actually exist and also they are returned too. It randomly sometimes returns numfound="0". Does any one has an idea what can be the possible reason for the same? Regards, Pooja

Long Lucene queries

Hi all, In my web-app, i have to fire a query thats too long due to the various boosts I have to give. The size changes according to the query and many a times I get a blank page as I probably cross lucene's character limit. Is it possible to post it otherwise, to solr. Shall I be using POST inste

Re: Long Lucene queries

suggestions? Regards, Pooja On Fri, May 7, 2010 at 4:39 PM, Erik Hatcher wrote: > > On May 7, 2010, at 6:56 AM, Pooja Verlani wrote: > >> In my web-app, i have to fire a query thats too long due to the various >> boosts I have to give. The size changes according to the query and ma

Too many clauses in lucene query

Hi all, I am forming a query to boost a certain ids, the list of ids can go till 2000 too. I am sometimes getting the error for too many clauses in the boolean query and otherwise i am getting a null page. Can you suggest any config changes regarding this. I am using solr 1.3. Regards, Pooja