Solr highlighter question

2010-11-09 Thread Moazzam Khan
Hey guys, I have 3 fields: FirstName, LastName, Biography. They are all string fields. In schema, I copy them to the default search field which is "text". Is there any way to get Solr to highlight all the fields when someone searches the default search field but when someone searches for FirstNam

Re: Problem with phrase matches in Solr

2010-11-02 Thread Moazzam Khan
I will. Thanks Darren -Moazzam On Mon, Nov 1, 2010 at 1:15 PM, wrote: > Take a look at term proximity and phrase query. > > http://wiki.apache.org/solr/SolrRelevancyCookbook > >> Hey guys, >> >> I have a solr index where i store information about experts from >> various fields. The thing is whe

Problem with phrase matches in Solr

2010-11-01 Thread Moazzam Khan
Hey guys, I have a solr index where i store information about experts from various fields. The thing is when I search for "channel marketing" i get people that have the word channel or marketing in their data. I only want people who have that entire phrase in their bio. I copy the contents of bio

Re: Solr sorting problem

2010-10-22 Thread Moazzam Khan
For anyone who faced the same problem, changing the field to string from text worked! -Moazzam On Fri, Oct 22, 2010 at 8:50 AM, Moazzam Khan wrote: > The field type of the first name and last name is text. Could that be > why it's not sorting properly? I just changed it to string

Re: Solr sorting problem

2010-10-22 Thread Moazzam Khan
n_my_Text_Fields.3F > > On Thu, Oct 21, 2010 at 7:24 PM, Moazzam Khan wrote: > >> Hey guys, >> >> I have a list of people indexed in Solr. I am trying to sort by their >> first names but I keep getting results that are not alphabetically >> sorted (I see the n

Solr sorting problem

2010-10-21 Thread Moazzam Khan
Hey guys, I have a list of people indexed in Solr. I am trying to sort by their first names but I keep getting results that are not alphabetically sorted (I see the names starting with W before the names starting with A). I have a feeling that the results are first being sorted by relevancy then s

Solr 1.4.1 and field collapsing

2010-09-14 Thread Moazzam Khan
Hey guys, Has anyone successfully compiled and used Field Collapsing patch (236) with Solr 1.4.1? I keep getting this exception when I search: null java.lang.NullPointerException at org.apache.solr.search.fieldcollapse.NonAdjacentDocumentCollapser$FloatValueFieldComparator.compare(NonA

Exception in Field Collapsing

2010-09-02 Thread Moazzam Khan
Hi Guys, My index contains 89k documents and I don't store some of the text fields because they are way too big. When I run a normal search without field collapsing everything works but when I enable field collapsing on the same search, it crashes with a 500 error (exception). The URL I call is t

Re: Need help with field collapsing and out of memory error

2010-09-02 Thread Moazzam Khan
gards, Moazzam On Wed, Sep 1, 2010 at 5:13 PM, Moazzam Khan wrote: > Hi, > > > If this is how you configure the field collapsing cache, then I don't > have it setup: > > >   > >              class="solr.FastLRUCache" >      size="512" >

Re: Need help with field collapsing and out of memory error

2010-09-01 Thread Moazzam Khan
issues with field collapsing and I found out that this cache > was responsible for > most of the OOM exceptions. > > Reduce or even remove this cache from your configuration and it should help. > > > On 2010-09-01, at 1:10 PM, Moazzam Khan wrote: > >> Hi guys, >> >>

Need help with field collapsing and out of memory error

2010-09-01 Thread Moazzam Khan
Hi guys, I have about 20k documents in the Solr index (and there's a lot of text in each of them). I have field collapsing enabled on a specific field (AdvisorID). The thing is if I have field collapsing enabled in the search request I don't get correct count for the total number of records that

Re: Need help with facets

2010-08-11 Thread Moazzam Khan
That's awesome. Thanks Ahmet! On Wed, Aug 11, 2010 at 1:50 AM, Ahmet Arslan wrote: > > > --- On Wed, 8/11/10, Moazzam Khan wrote: > >> From: Moazzam Khan >> Subject: Re: Need help with facets >> To: solr-user@lucene.apache.org >> Date: Wednesday, Augu

Re: How to compile nightly build?

2010-08-10 Thread Moazzam Khan
You don't have to download the source. You can just download the binary distribution from their site and run it without compiling it. - Moazzam On Tue, Aug 10, 2010 at 1:48 PM, harrysmith wrote: > > I am attempting to follow the instructions located at: > > http://wiki.apache.org/solr/Extracting

Re: Need help with facets

2010-08-10 Thread Moazzam Khan
Thanks Ahmet that worked! Here's another issues I have : Like I said before, I have these fields in Solr documents FirstName LastName RecruitedDate VolumeDate (just added this in this email) VolumeDone (just added this in this email) Now I have to get sum of all VolumeDone (integer field) for

Re: delete Problem..

2010-08-10 Thread Moazzam Khan
Are you running a commit command after every delete command? I had the same problem with updates. I wasn't committing my updates. - Moazzam Khan http://moazzam-khan.com On Tue, Aug 10, 2010 at 8:52 AM, kenf_nc wrote: > > I'd try 2 things. > First do a query >   q=EMAIL_HEA

Need help with facets

2010-08-10 Thread Moazzam Khan
Hi guys, I have a solr index whose documents have the following fields: FirstName LastName RecruitedDate I update the index when any of the three fields change for that specific person. I need to get facets based on when someone was recruited. The facets are : Recruited within 1 month Recruite

Re: Solr 1.4.1 field collapse

2010-07-31 Thread Moazzam Khan
Thanks, Hoss. I read something about clustering in the config file (and some place that it would be in 1.4.1) so I was curious. - Moazzam On Thu, Jul 29, 2010 at 2:20 PM, Chris Hostetter wrote: > > : I read somewhere that Solr 1.4.1 has field collapse support by default > : (without patching it)

Problem with field collapsing

2010-07-28 Thread Moazzam Khan
Hi All, Whenever I use field collapse, the "numFound" attribute contains exactly as many rows as I put in rows parameter instead of returning total number of documents that matched the query. Is there a way to rectify this? Thanks, Moazzam

Solr 1.4.1 field collapse

2010-07-28 Thread Moazzam Khan
Hi guys, I read somewhere that Solr 1.4.1 has field collapse support by default (without patching it) but I haven't been able to confirm it. Is this true? - Moazzam

Re: Is there a cache for a query?

2010-07-28 Thread Moazzam Khan
As far as I know all searches get cache at least for some time. I am not sure about field collapse results being cached. - Moazzam http://moazzam-khan.com On Mon, Jul 26, 2010 at 9:48 PM, Li Li wrote: > I want a cache to cache all result of a query(all steps including > collapse, highlight and

Re: Field Collapsing SOLR-236

2010-07-09 Thread Moazzam Khan
mind when using one of the patches. >> > >>> >> Does it support features which solr 1.4 normally supports? >> > >>> >>    - As far as I know yes. >> > >>> >> >> > >>> >> am using f

Re: Solr results not updating

2010-07-06 Thread Moazzam Khan
d_.22optimize.22 > > > > Cheers, > > > > -Original message- > From: Moazzam Khan > Sent: Tue 06-07-2010 22:09 > To: solr-user@lucene.apache.org; > Subject: Solr results not updating > > Hi, > > I just successfully inserted a document into SOlr b

Solr results not updating

2010-07-06 Thread Moazzam Khan
Hi, I just successfully inserted a document into SOlr but when I search for it, it doesn't show up. Is it a cache issue or something? Is there a way to make sure it was inserted properly? And, it's there? Thanks, Moazzam

Re: Solr and NLP

2010-07-02 Thread Moazzam Khan
down this path someday myself. > > > Gregg > > > > On 7/2/10 8:15 AM, "Moazzam Khan" wrote: > > Hi guys, > > Is there a way I can make Solr work with an NLP application? Are there > any NLP applications that will work with Solr? Can someone please > point me to a tutorial or something if it's possible. > > Thanks, > > Moazzam > >

Solr and NLP

2010-07-02 Thread Moazzam Khan
Hi guys, Is there a way I can make Solr work with an NLP application? Are there any NLP applications that will work with Solr? Can someone please point me to a tutorial or something if it's possible. Thanks, Moazzam

Re: Field Collapsing SOLR-236

2010-06-17 Thread Moazzam Khan
I knew it wasn't me! :) I found the patch just before I read this and applied it to the trunk and it works! Thanks Mark and martijn for all your help! - Moazzam On Thu, Jun 17, 2010 at 2:16 PM, Martijn v Groningen wrote: > I've added a new patch to the issue, so building the trunk (rev > 95561

Re: Field Collapsing SOLR-236

2010-06-17 Thread Moazzam Khan
D) Thanks, Moazzam On Thu, Jun 17, 2010 at 4:23 AM, Rakhi Khatwani wrote: > Hi Moazzam, >               Yup i hv encountered the same thing. > Build errors after applying the patch. > > Rakhi > > On Thu, Jun 17, 2010 at 3:33 AM, Moazzam Khan wrote: > >> I got the code f

Re: Field Collapsing SOLR-236

2010-06-16 Thread Moazzam Khan
ompiling using jdk 1.5 update 22. Does that have anything to do with the errors? -Moazzam On Wed, Jun 16, 2010 at 4:34 PM, Moazzam Khan wrote: > I did the same thing. And, the code compiles without the patch but > when I apply the patch I get these errors: > >    [javac] > C:\svn\s

Re: Field Collapsing SOLR-236

2010-06-16 Thread Moazzam Khan
inside the > trunk directory. I just did it against the newest checkout and it works fine > still. > > On Wed, Jun 16, 2010 at 11:35 AM, Moazzam Khan wrote: > >> Actually I take that back. I am just as lost as you. I wish there was >> a tutorial on how to do this (altho

Re: Field Collapsing SOLR-236

2010-06-16 Thread Moazzam Khan
Actually I take that back. I am just as lost as you. I wish there was a tutorial on how to do this (although I get the feeling that once I know how to do it I will go "ohh... I can't believe I couldn't figure that out") - Moazzam On Wed, Jun 16, 2010 at 8:25 AM, Moazzam Kha

Re: Field Collapsing SOLR-236

2010-06-16 Thread Moazzam Khan
Hi Rakhi, You are supposed to get the code for solr 1.4 from SVN here: http:/svn.apache.org/repos/asf/lucene/solr/tags/ Then apply the path to it and comppile. It should work. However, you will probably get an error at run time saying some java class is missing. I haven't been able to figure ou

Re: Help patching Solr

2010-06-15 Thread Moazzam Khan
allin wrote: > I'm pretty sure you need to be running the patch against a checkout of the > trunk sources, not a generated .war file. Once you've done that you can use > the build scripts to make a new war. > > -Kallin Nagelberg > > -Original Message

Help patching Solr

2010-06-15 Thread Moazzam Khan
Hey guys, Does anyone know how to patch stuff in Windows? I am trying to patch Solr with patch 238 but it keeps erroring out with this message: C:\solr\example\webapps>patch solr.war ..\..\SOLR-236-trunk.patch patching file solr.war Assertion failed: hunk, file ../patch-2.5.9-src/patch.c, line

Re: need help with multicore dataimport

2010-06-14 Thread Moazzam Khan
in solrconfig go > after that. > >        Erik > > On Jun 14, 2010, at 1:44 PM, Moazzam Khan wrote: > >> Hi, >> >> Does anyone know how to access the dataimport handler on a multicore >> setup? >> >> This is my solr.xml >> >> >>      

need help with multicore dataimport

2010-06-14 Thread Moazzam Khan
Hi, Does anyone know how to access the dataimport handler on a multicore setup? This is my solr.xml I've tried http://localhost:8080/solr/advisors/dataimport but that doesn't work. My solrconfig.xml for advisors looks like this:

Re: Need help with document format

2010-06-10 Thread Moazzam Khan
, Lance Norskog wrote: >> >>> This is what Field Collapsing does. It is a complex feature and is not >>> in the Solr trunk yet. >>> >>> On Tue, Jun 8, 2010 at 9:15 AM, Moazzam Khan wrote: >>> >>>> How would I do a facet searc

Re: Need help with document format

2010-06-10 Thread Moazzam Khan
gt; Hence in this particular scenario, if you have 5 consultants that worked for >>> 4 distinct companies you will have to send 20 documents to Solr >>> >>> On Mon, Jun 7, 2010 at 10:15 AM, Moazzam Khan wrote: >>> >>>> Thanks for the replies guys. >

Re: multiValued using

2010-06-08 Thread Moazzam Khan
The way I did it with SQL Server is like this: Let's say you have a field called "Company" which is multivalued, then you would declare it like this in schema.xml: in your SQL query, you would do this: select table.field1 , (select distinct cast (c.ID AS VARCHAR(10)) + ',' from tab

Re: Need help with document format

2010-06-08 Thread Moazzam Khan
an RDBMS, it is easier to do joins but with Lucene and Solr you have to > denormalize all the relationships. > > Hence in this particular scenario, if you have 5 consultants that worked for > 4 distinct companies you will have to send 20 documents to Solr > > On Mon, Jun 7, 2010

Re: Need help with document format

2010-06-07 Thread Moazzam Khan
t;> >>     1_4 >>     Michael >>     Davis >>     Google >>     2006-02-13T15:26:37Z >>     2009-02-13T15:26:37Z >> >> >> >>     2_3 >>     Tom >>     Anderson >>     Yahoo >>     2001-01-13T15:26:37Z >>

Need help with document format

2010-06-04 Thread Moazzam Khan
Hi guys, I have a list of consultants and the users (people who work for the company) are supposed to be able to search for consultants based on the time frame they worked for, for a company. For example, I should be able to search for all consultants who worked for Bear Stearns in the month of j

Re: Storing different entities in Solr

2010-05-31 Thread Moazzam Khan
t; different document types do collide, you can simply add a prefix or suffix > to make them unique. > > Bill > > On Fri, May 28, 2010 at 1:12 PM, Moazzam Khan wrote: > >> Thanks for all your answers guys. Requests and consultants have a many >> to many relationsh

Re: Storing different entities in Solr

2010-05-28 Thread Moazzam Khan
Thanks for all your answers guys. Requests and consultants have a many to many relationship so I can't store request info in a document with advisorID as the primary key. Bill's solution and multicore solutions might be what I am looking for. Bill, will I be able to have 2 primary keys (so I can u

Storing different entities in Solr

2010-05-28 Thread Moazzam Khan
Hi Guys, Is there a way to store 2 types of things in Solr. We have a list of consultants and a list of consultation requests. and I want to store them as separate documents. Can I do this with one instance of Solr or do I have to have two instances? Thanks, MOazzam