Re: Solr RSS DIH dateTimeFormat does work

2012-08-17 Thread Lance Norskog
Have you checked this date time format in Java code? On Fri, Aug 17, 2012 at 2:42 PM, jayantu wrote: > I have DIH for indexing RSS feeds. the problem is that the date format > expected by solr is 1995-12-31T23:59:59Z while the way i see the date that > comes in rss feed is 'Wed, 15 Aug 2012 14:11

Solr RSS DIH dateTimeFormat does work

2012-08-17 Thread jayantu
I have DIH for indexing RSS feeds. the problem is that the date format expected by solr is 1995-12-31T23:59:59Z while the way i see the date that comes in rss feed is 'Wed, 15 Aug 2012 14:11:27 EDT' so I used the dateTimeFormat transformer like this: The filed "pubDate" is defined as type date in

How to make a server become a replica / leader for a collection at startup

2012-08-17 Thread Jed Glazner
Hello All, I'm working to solve an interesting problem.  The problem that I have is that when I pull a server out of the cloud (to do maintenance say) and then bring it back up, it won't automatically sync up with zookeeper and become a leader or replica for any

Re: SolrCloud issue - accents are not getting removed

2012-08-17 Thread sausarkar
Just found out that this was not an SolrCloud issue but an issue with the Tomcat configuration basically the URIEncoding was missing added it and it fixed the problem. -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-issue-accents-are-not-getting-removed-tp4

SolrCloud issue - accents are not getting removed

2012-08-17 Thread sausarkar
We noticed that when we use SolrCloud the accents are not getting removed when we use the filter. We are using the -Dbootstrap_conf=true to load the conf folder. This filter however is working fine in the standalone solr startup scenario. Did anyone notice the same issue? Do we need to d

Re: Muticore Sharding

2012-08-17 Thread Sujatha Arun
Hi, This is the parsed query string which *returns 3331234 documents* content:elena content:read content:a content:rate content:r content:page content:per content:minut content:a content:total content:m content:minut re and a Boolean "AND " query of the above query takes 410 ms and *returns ju

Re: How to get raw text of a document

2012-08-17 Thread Jack Krupansky
You need a "response writer" that returns only text. The "wt" paramter selects the response writer. You specified "json", so that's what you got. Maybe "csv" would be closer to what you want. -- Jack Krupansky -Original Message- From: Alexander Cougarman Sent: Friday, August 17, 2012

How to get raw text of a document

2012-08-17 Thread Alexander Cougarman
Hi. I asked this on the Tika group and the recommendation was to ask it here. I am using the following C# code to call Tika and would like it to return the raw text without any XML or JSON. So if the Word document contains "Hello World", this should return only that text and no XML or anything e

Re: How to boost score of particular field in a copy field?

2012-08-17 Thread bbarani
Thanks a lot for your reply!! This is the problem I face now when using dismax. I have almost 30 fields (Some are dynamic fields from database) copied in to copy field that is being used for default search. Now when I search using dismax I need to include the boost for all the fields in the searc

Re: sunpot solr function query

2012-08-17 Thread Jack Krupansky
Maybe this may help: https://groups.google.com/forum/?fromgroups#!topic/ruby-sunspot/Y90mcJiIIQc%5B1-25%5D -- Jack Krupansky -Original Message- From: Geek Gamer Sent: Friday, August 17, 2012 11:43 AM To: solr-user@lucene.apache.org Subject: sunpot solr function query Hi All , I am i

Re: How to boost score of particular field in a copy field?

2012-08-17 Thread Jack Krupansky
What you should consider is to use the edismax (or dismax) query parser and then you can boost the individual fields. That's a major part of its reason for existence - to overcome the limitation of copyField that you mention. -- Jack Krupansky -Original Message- From: bbarani Sent: F

How to boost score of particular field in a copy field?

2012-08-17 Thread bbarani
Hi, I have 10 fields copied in to a single copy field for default search. I am trying to boost one particular field in that copy field, but I am not sure how boosting in copy field work. Can someone let me know how boosting works in copy field? Thanks, BB -- View this message in context: http

Re: Muticore Sharding

2012-08-17 Thread Jack Krupansky
First, provide us with the additional info Erik requested in his last reply. Then, can you provide a snippet from your Solr log file that shows a couple of queries. Maybe there is something else going on or some exceptions, or something. Or at least to show us the quey times in context. Final

Re: Muticore Sharding

2012-08-17 Thread Sujatha Arun
Sorry typo ,I meant upwards of 20s at any time. What should I be looking at? Regards Sujatha On Fri, Aug 17, 2012 at 8:09 PM, Sujatha Arun wrote: > Erik, > > What could be the issue Load / I/O ? It seems to shows upwards of 20 ms > at any time > > Regards > Sujatha > > > On Fri, Aug 17, 2012 a

Re: Muticore Sharding

2012-08-17 Thread Sujatha Arun
Erik, What could be the issue Load / I/O ? It seems to shows upwards of 20 ms at any time Regards Sujatha On Fri, Aug 17, 2012 at 6:18 PM, Erik Hatcher wrote: > Sujatha - that query debug output shows only 218ms, so it isn't > representative of the issue you're reporting. > > Also, what's the

Re: Muticore Sharding

2012-08-17 Thread Erik Hatcher
Sujatha - that query debug output shows only 218ms, so it isn't representative of the issue you're reporting. Also, what's the query parse output? I imagine you're doing a boolean OR query across all those terms (include "a"), yes? Maybe you'd rather the operator be AND? Erik On A

Re: Muticore Sharding

2012-08-17 Thread Sujatha Arun
No customization,its the default standard request handler.Solr Version is 1.3 "a" is not there in stop words Server Load ,i presume is not there , but not too sure ,not checked. RAM : TOTAL RAM :48GB RAM to JVM :18 GB ,Permgen =2GB TOTAL INDEX SIZE of all the multicore Instances =23GB Timing

Re: Muticore Sharding

2012-08-17 Thread Erik Hatcher
Just over 4M docs... no need to shard. Both your queries contain what is likely very common terms (content:a in the first one and content:1 in the second). Generally these are "stop words" and removed either during indexing or querying, but I guess not in your case. What's your "standard" req

Re: Muticore Sharding

2012-08-17 Thread Sujatha Arun
Hi Erick, The number of documents is : 4389048 I have given 2 queries below with timing and the number of hits INFO: [ipc_widget_search] webapp=/multicore_5 path=/select/ params={version=2.1&fl=*+score&stylesheet=&qt=standard&fq=&rows=100&start=0&q=content:if+content:elena+content:reads+content:

Re: Prefix (facet.prefix) based auto-suggest on Multi-Valued field do not return results

2012-08-17 Thread Rajani Maski
Hi, I think this is because of the space observed - facet.prefix= "empty string" - Please see below 3 3 3 3 3 ... so on *But why is this space inserted?* If you see below, the list of keywords taken from search results , there is no space. Thanks & Regards Rajani On Fri, Aug

Re: Muticore Sharding

2012-08-17 Thread Erik Hatcher
How many documents do you have? What are the queries? I'd guess your query complexity (or load) is to blame here, not index size. What version of Solr? Until you know what is causing the slow queries, sharding is not something to consider I'd say. But yes, you would want to reindex to dist

Prefix (facet.prefix) based auto-suggest on Multi-Valued field do not return results

2012-08-17 Thread Rajani Maski
Hi All, * When I do facet.prefix on a * KEYWORDS *field(this field is multi valued) , I don't get suggestion for the first key in this field . * Example : I have 2 documents with the field "KEYWORDS" containing multiple values. 偏振式3D成像原理 采用LED边缘发光的新技术 高级降噪运算法及画质增强技术可 紧凑机身,轻松携带 节能低耗,持久续航

RE: Sort on dynamic field

2012-08-17 Thread Peter Kirk
On Thu, Aug 16, 2012 at 8:00 AM, Peter Kirk wrote: >> Hi, a question about sorting and dynamic fields in "Solr Specification >> Version: 3.6.0.2012.04.06.11.34.07". >> >> I have a field defined like >> > multiValued="false"/> >> >> Where type int is >> > omitNorms="true" positionIncrementGap="0"/