pagination with grouping

2014-01-06 Thread Senthilnathan Vijayaraja
Hi, i am using group.query like below, group=true& group.query=_query_:{!frange l=0 u=10 v=$score}& group.query=_query_:{!frange l=10 u=20 v=$score}& group.query=_query_:{!frange l=20 u=30 v=$score} here I want to restrict the overall record counts, start=0&rows=10 is not working here. w

Re: DateField - Invalid JSON String Exception - converting Query Response to JSON Object

2014-01-06 Thread Ahmet Arslan
Hi Amit, If you want json response, Why don't you use wt=json? Ahmet On Tuesday, January 7, 2014 7:34 AM, Amit Jha wrote: Hi, We have index where date field have default value as 'NOW'. We are using solrj to query solr and when we try to convert query response(response.getResponse) to JSON o

Re: DateField - Invalid JSON String Exception - converting Query Response to JSON Object

2014-01-06 Thread Amit Jha
Hi, We have index where date field have default value as 'NOW'. We are using solrj to query solr and when we try to convert query response(response.getResponse) to JSON object in java. The JSON API(org.json) throws 'invalid json string' exception. API say so because date field value i.e. -mm-

Re: Branch/Java questions re: contributing code

2014-01-06 Thread Ryan Cutter
Thanks, everything worked fine after these pointers and I was able to generate a patch properly. Cheers, Ryan On Mon, Jan 6, 2014 at 7:31 AM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > On Mon, Jan 6, 2014 at 8:54 PM, Ryan Cutter wrote: > > 1. Should we be using Java 6 or 7? The

Re: Index for csv-file created successfully, but no data is shown

2014-01-06 Thread Otis Gospodnetic
Hi, This may be a better question for the Cloudera Search mailing list. Otis -- Performance Monitoring * Log Analytics * Search Analytics Solr & Elasticsearch Support * http://sematext.com/ On Mon, Jan 6, 2014 at 11:06 AM, Huynh, Chi-Hao wrote: > Dear solr users, > > I would appreciate if som

Re: SOLR Security - Displaying endpoints to public

2014-01-06 Thread Otis Gospodnetic
Apache url_rewrite can help with this and it's only a few minutes to set up. Otis -- Performance Monitoring * Log Analytics * Search Analytics Solr & Elasticsearch Support * http://sematext.com/ On Mon, Jan 6, 2014 at 12:55 PM, Developer wrote: > Hi, > > We are currently showing the SOLR endpo

Setting max number of connections

2014-01-06 Thread Sir Gilligan
I am trying to increase the max number of connections allowed for query with Solr Cloud. I have searched around and found mention that: max number of connections is 128 max number of connections per host is 32 I start solr in the example directory with some options, but basically it is just:

solr-user@lucene.apache.org

2014-01-06 Thread cwhi
I'm adding dozens of documents every few minutes to a SolrCloud instance with 3 machines and ~ 25 million documents. I'm starting to see issues where adds are throwing these ugly errors that seem to indicate there might be some issues with the nodes communicating to one another. My posts are of t

Re: MergePolicy for append-only indices?

2014-01-06 Thread Michael Sokolov
I think the key optimization when there are no deletions is that you don't need to renumber documents and can bulk-copy blocks of contiguous documents, and that is independent of merge policy. I think :) -Mike On 01/06/2014 01:54 PM, Shawn Heisey wrote: On 1/6/2014 11:24 AM, Otis Gospodnetic

Re: Slowness of Solr search during the replication

2014-01-06 Thread Mikhail Khludnev
Hello Siva, Do you have an idea what make them freeze? Ideally you might be able to take a thread-dump at the moment of freeze, if you can. Also, check SolrIndexSearcher debug logs for autowarming timing. What about specifying few heaviest query in newSearcher listener https://cwiki.apache.org/c

DateField - Invalid JSON String Exception - converting Query Response to JSON Object

2014-01-06 Thread Amit Jha
Hi, "Wish You All a Very Happy New Year". We have index where date field have default value as 'NOW'. We are using solrj to query solr and when we try to convert query response(response.getResponse) to JSON object in java. The JSON API(org.json) throws 'invalid json string' exception. API say

Re: SOLR Security - Displaying endpoints to public

2014-01-06 Thread Raymond Wiker
On 06 Jan 2014, at 19:37 , Shawn Heisey wrote: > On 1/6/2014 11:18 AM, Shawn Heisey wrote: >> Even if you disable admin handlers so that it's impossible to gather full >> information about your schema and other settings, generating legitimate >> queries is probably enough for an attacker to ge

Re: MergePolicy for append-only indices?

2014-01-06 Thread Shawn Heisey
On 1/6/2014 11:24 AM, Otis Gospodnetic wrote: (cross-posting to both Solr and Lucene user lists because while this is a Lucene-level question, I suspect a lot of people who know about this or are interested in this subject are actually on the Solr list) I have a large append-only index and I loo

Re: SOLR Security - Displaying endpoints to public

2014-01-06 Thread Shawn Heisey
On 1/6/2014 11:18 AM, Shawn Heisey wrote: Even if you disable admin handlers so that it's impossible to gather full information about your schema and other settings, generating legitimate queries is probably enough for an attacker to get the information they need. Self-replying on this point:

MergePolicy for append-only indices?

2014-01-06 Thread Otis Gospodnetic
Hi, (cross-posting to both Solr and Lucene user lists because while this is a Lucene-level question, I suspect a lot of people who know about this or are interested in this subject are actually on the Solr list) I have a large append-only index and I looked at merge policies hoping to identify one

Re: Function query matching

2014-01-06 Thread Peter Keegan
: The bottom line for Peter is still the same: using scale() wrapped arround : a function/query does involve a computing hte results for every document, : and that is going to scale linearly as the size of hte index grows -- but : it it is *only* because of the scale function. Another problem with

Re: SOLR Security - Displaying endpoints to public

2014-01-06 Thread Shawn Heisey
On 1/6/2014 10:55 AM, Developer wrote: We are currently showing the SOLR endpoints to the public when using our application (public users would be able to view the SOLR endpoints (/select) and the query in debugging console). I am trying to figure out if there is any security threat in terms of

Re: "delta-import" giving Total Documents Processed = 0

2014-01-06 Thread suren
I think issue was with deltaImportQuery, it is case sensitive. I was using '${dataimporter.delta.clai_idn}' instead of '${dataimporter.delta.CLAI_IDN}' -- View this message in context: http://lucene.472066.n3.nabble.com/delta-import-giving-Total-Documents-Processed-0-tp4089118p4109798.html Se

Re: adding wild card at the end of the text and search(like sql like search)

2014-01-06 Thread suren
by using Q command and passing query parameter defType=unorderedcomplexphrase it worked for me. http://localhost:8999/solr/MACSearch/select?q=LAST_NAM%3A%22DE+PAR*%22%0A&wt=xml&indent=true&defType=unorderedcomplexphrase Thanks. -- View this message in context: http://lucene.472066.n3.nabble.c

SOLR Security - Displaying endpoints to public

2014-01-06 Thread Developer
Hi, We are currently showing the SOLR endpoints to the public when using our application (public users would be able to view the SOLR endpoints (/select) and the query in debugging console). I am trying to figure out if there is any security threat in terms of displaying the endpoints directly in

Re: How to boost documents ?

2014-01-06 Thread Anca Kopetz
Hi, I tried to isolate the problem, so I tested the following query on solr-4.6.0 : http://localhost:8983/solr/collection1/select?q=ipod belkin&wt=xml&debugQuery=true&q.op=AND&defType=edismax&bf=map(query($qq),0,0,0,100.0)&qq={!edismax}power The error is : org.apache.solr.search.SyntaxError: I

Index for csv-file created successfully, but no data is shown

2014-01-06 Thread Huynh, Chi-Hao
Dear solr users, I would appreciate if someone can help me out here. My goal is to index a csv-file. First of all, I am using the CDH 5 beta distribution of Hadoop, which includes solr 4.4.0, on a single node. I am following the hue tutorial to index and search the data from the yelp dataset c

need help on OpenNLP with Solr

2014-01-06 Thread rashi gandhi
Hi, I have applied OpenNLP (LUCENE 2899.patch) patch to SOLR-4.5.1 for nlp searching and it is working fine. Also I have designed an analyzer for this:

Re: need help on OpenNLP with Solr

2014-01-06 Thread rashi gandhi
Hi, Also i wanted know, Is it possible to integrate wordnet with this analyzer? I want to use wordnet as synonym expansion along with OpenNLP filters. What are the changes required in solr schema.xml and solrconfig.xml? Thanks in Advance On Mon, Jan 6, 2014 at 9:37 PM, rashi gandhi wrote: > Hi

RE: Branch/Java questions re: contributing code

2014-01-06 Thread Markus Jelsma
Trunk (5.x) requires Java 1.7, 4.x still works with 1.6. Check the CHANGES.txt, you'll see it near the top. -Original message- > From:Ryan Cutter > Sent: Monday 6th January 2014 16:27 > To: solr-user@lucene.apache.org > Subject: Branch/Java questions re: contributing code > > 1. Sh

Re: Branch/Java questions re: contributing code

2014-01-06 Thread Shalin Shekhar Mangar
On Mon, Jan 6, 2014 at 8:54 PM, Ryan Cutter wrote: > 1. Should we be using Java 6 or 7? The docs say 1.6 ( > http://wiki.apache.org/solr/HowToContribute) but running 'ant test' on > trunk/ yields: > > /lucene/common-build.xml:328: Minimum supported Java version is 1.7. > > I don't get that er

Error from SPLITSHARD that seems to be unrecoverable

2014-01-06 Thread cwhit
I'm using Solr 4.6 with SolrCloud. I tried using the SPLITSHARD command and it threw a series of exceptions, which have put my SolrCloud in a weird state. Here is an image of my SolrCloud setup after a few tries at SPLITSHARD, all of which fail. Here is the log out

Branch/Java questions re: contributing code

2014-01-06 Thread Ryan Cutter
1. Should we be using Java 6 or 7? The docs say 1.6 ( http://wiki.apache.org/solr/HowToContribute) but running 'ant test' on trunk/ yields: /lucene/common-build.xml:328: Minimum supported Java version is 1.7. I don't get that error with branch_4x/ which leads to my next question. 2. Should

Re: Slowness of Solr search during the replication

2014-01-06 Thread sivaprasad
Do we need to set the autowarmCount on Slave or master? As per the Solr WIKI, I found the below information. Solr4.0 autowarmCount can now be specified as a percentage (ie: "90%") which will be evaluated relative to the number of items in the existing cache. This can be an advantageous setting in

Re: monitoring solr system

2014-01-06 Thread Furkan KAMACI
Hi; You can check here: http://sematext.com/spm/ Thanks; Furkan KAMACI 2014/1/6 elmerfudd > hi, > we have a cluster consisting of 6 servers. 3 leaders and 3 replicas. > The system must be alive and working 24X7. We would like to monitor the > system for any troubles or problems that may occur

Re: Slowness of Solr search during the replication

2014-01-06 Thread Erick Erickson
The first thing I'd try would be to up the autowarm counts. Don't go overboard here, I'd suggest, say, 16 of so to start but it depends on your query mix. If that doesn't help, you need to add some more details. Some example queries would be a place to start. Best Erick On Jan 6, 2014 4:19 AM, "s

monitoring solr system

2014-01-06 Thread elmerfudd
hi, we have a cluster consisting of 6 servers. 3 leaders and 3 replicas. The system must be alive and working 24X7. We would like to monitor the system for any troubles or problems that may occur and will demand our immediate support. Currently we are monitoring the servers, the zookeeper and the

Re: Slowness of Solr search during the replication

2014-01-06 Thread Toke Eskildsen
On Mon, 2014-01-06 at 09:18 +0100, sivaprasad wrote: > I have configured Solr salve replication for every 1hr. During this time I > am seeing my search is unresponsive. Unresponsive as in waiting for the updated searcher to be ready or as in very slow while the replication is ongoing? - Toke Eski

Re: Solr -The connection has timed out

2014-01-06 Thread Cihat güzel
Browse to the following URL: http://docs.lucidworks.com/display/solr/IndexConfig+in+SolrConfig#IndexConfiginSolrConfig-IndexLocks 2013/12/31 Furkan KAMACI > Hi; > > Beside the other error lines did you realize that log lines: > > *java.net.BindException: Address already in use* > > Could you c

Re: Exact match on KeywordTokenizer

2014-01-06 Thread André Maldonado
Hi Chris, thanks for your reply and sorry for my poor explained question. Here are some examples of indexed data (fieldname:propertyType): Apartamento Padrão Casa Padrão Loft Terreno And some examples of the queries propertyType:"Apartamento Padrão" propertyType:"apartamento-padrao" propertyTyp

Re: Storing MYSQL DATETIME field in solr as String

2014-01-06 Thread manju16832003
I found a way to store MySQL DateTime as a string in Solr Here is the way in data-config.xml in the SQL query we could convert the date directly to char CAST(l.creation_date as char) as creation_date, CAST(l.modification_date as char) as modification_date, in schema.xml Output would be 20

Slowness of Solr search during the replication

2014-01-06 Thread sivaprasad
Hi, I have configured Solr salve replication for every 1hr. During this time I am seeing my search is unresponsive. Any other architectural changes do we need to do to overcome this? I am giving some cache details which I have in my solrconfig.xml. true false 2 Any sugges

Re: PathHierarchyTokenizerFactory storage for pivot facets

2014-01-06 Thread Ahmet Arslan
Hi Stephan, If you want to populate some fields from Path info, UpdateRequestProcessorFactory is a better fit. You can use URLClassifyProcessor(Factory).java as an example. Ahmet On Monday, January 6, 2014 7:46 AM, Stephan Schubert wrote: I want to store the levels of an path/url in seperat