Re: Maybe a bug for solr 4.6 when create a new core

2013-12-26 Thread YouPeng Yang
Hi Mark I have filed a jira about the NPE: https://issues.apache.org/jira/browse/SOLR-5580 2013/12/27 YouPeng Yang > Hi Mark. > >Thanks for your reply. > > I will file a JIRA issue about the NPE. > >By the way,would you look through the Question 2. After I create a new > core

REYPLAY_ERR: IOException reading log

2013-12-26 Thread YouPeng Yang
Hi users I have build a SolrCloud on tomcat.The cloud contains 22 shards with no replica.Also the the solrcloud is integrated with HDFS. After imported data for oracle to the solrcloud, I restart the tomcat ,it does not comes alive againt. It always give an exceptions. I'm really hav

Re: Solr - Match whole word only in text fields

2013-12-26 Thread Kydryavtsev Andrey
Hi everybody! Ahmet, do I get it correct - if I use this text_char_norm field type, for input "myName=aaa bbb" I'll index terms "myName", "aaa", "bbb"? So I'll match with query like "myName" or query like "bbb", but not match with "myName aaa". I can use this type for query value, so split "my

Re: Maybe a bug for solr 4.6 when create a new core

2013-12-26 Thread YouPeng Yang
Hi Mark. Thanks for your reply. I will file a JIRA issue about the NPE. By the way,would you look through the Question 2. After I create a new core with explicite shard and coreNodeName successfully,I can not create a replica for above new core also with explicite coreNodeName and the

Re: Solr Query Slowliness

2013-12-26 Thread Shawn Heisey
On 12/26/2013 3:38 AM, Jilal Oussama wrote: > Solr was hosted on an Amazon ec2 m1.large (2 vCPU with 4 ECU, 7.5 GB memory > & 840 GB storage) and contained several cores for different usage. > > When I manually executed a query through Solr Admin (a query containing > 10~15 terms, with some of the

Re: Possible memory leak after segment merge? (related to DocValues?)

2013-12-26 Thread Greg Preston
Does anybody with knowledge of solr internals know why I'm seeing instances of Lucene42DocValuesProducer when I don't have any fields that are using DocValues? Or am I misunderstanding what this class is for? -Greg On Mon, Dec 23, 2013 at 12:07 PM, Greg Preston wrote: > Hello, > > I'm loading

RE: Unable to check Solr 4.6 SPLITSHARD command progress

2013-12-26 Thread Craig Christman - US
We ran into this exact scenario and resolved by applying SOLR-5214 (://issues.apache.org/jira/browse/SOLR-5214) From: binit [b.initth...@gmail.com] Sent: Friday, December 13, 2013 10:45 PM To: solr-user@lucene.apache.org Subject: Re: Unable to check Solr 4.

Re: Solr Query Slowliness

2013-12-26 Thread Rafał Kuć
Hello! It seems that the number of queries per second generated by your scripts may be too much for your Solr cluster to handle with the latency you want. Try launching your scripts one by one and see what is the bottle neck with your instance. I assume that for some number of scripts running at

Re: Chaining plugins

2013-12-26 Thread Kydryavtsev Andrey
If I get elmer fudd's question correct, he needs something like creating his own component which will extends SearchComponent and do some logic in prepare method - change input request params probably. Then register this component in solrconfig and set it's for default search handler just before

Excluding terms in grouping results

2013-12-26 Thread Anze
Hello there, The question is: how to group results by some field (text terms), but exclude some term from being grouped by. For example there are few documents with field 'tags': 1. tags: term1 term2 term3 2. tags: term2 term3 term4 3. tags: term1 term2 term4 3. tags: term2 term3 term4 And i wan

Re: adding a node to SolrCloud

2013-12-26 Thread David Santamauro
On 12/26/2013 02:29 PM, Shawn Heisey wrote: On 12/24/2013 8:35 AM, David Santamauro wrote: You may have one or more of the SolrCloud 'bootstrap' options on the startup commandline. The bootstrap options are intended to be used once, in order to bootstrap from a non-SolrCloud setup to a SolrClou

Re: Boosting results on value of field different from query

2013-12-26 Thread Kydryavtsev Andrey
Hi, Puneet I think you can try of provided advice from there : http://wiki.apache.org/solr/SolrRelevancyFAQ Like this one : http://wiki.apache.org/solr/SolrRelevancyFAQ#How_can_I_increase_the_score_for_specific_documents : set index time boos "per document", so set big boos for documents wit

Re: adding a node to SolrCloud

2013-12-26 Thread Shawn Heisey
On 12/24/2013 8:35 AM, David Santamauro wrote: >> You may have one or more of the SolrCloud 'bootstrap' options on the >> startup commandline. The bootstrap options are intended to be used >> once, in order to bootstrap from a non-SolrCloud setup to a SolrCloud >> setup. > > No, no unnecessary op

Re: Questions about integrateing SolrCloud with HDFS

2013-12-26 Thread Mark Miller
1. The exception and change in experience on the move to 4.6 seems like it could be a bug we want to investigate. 2. Solr storing data on hdfs in other ways seems like a different issue / improvement. 3. You shouldn't try and force more than one core to use the same index on hdfs. This would

Re: adding a node to SolrCloud

2013-12-26 Thread David Santamauro
On 12/23/2013 05:43 PM, Greg Preston wrote: I believe you can just define multiple cores: ... (this is the old style solr.xml. I don't know how to do it in the newer style) Yes, that is exactly what I did but somehow, the link between shards and collections gets lost and everything gets

Re: Does Solr fork child processes and result in zombies?

2013-12-26 Thread Shawn Heisey
On 12/26/2013 9:56 AM, Sir Gilligan wrote: > I have three CentOS machines running Solr 4.6.0 cloud without any > replication. That is, numshards is 3 and there is only one Solr instance > running on each of the boxes. > > Also, on the boxes I arm running ZooKeeper. This is a test environment > and

Re: Questions about integrateing SolrCloud with HDFS

2013-12-26 Thread Greg Walters
Mark, I'd be happy to but some clarification first; should this issue be about creating cores with overlapping names and the stack trace that YouPeng initially described, Solr's behavior when storing data on HDFS or YouPeng's other thread (Maybe a bug for solr 4.6 when create a new core) that l

Re: Bad fieldNorm when using morphologic synonyms

2013-12-26 Thread Isaac Hebsh
Attached patch into the JIRA issue. Reviews are welcome. On Thu, Dec 19, 2013 at 7:24 PM, Isaac Hebsh wrote: > Roman, do you have any results? > > created SOLR-5561 > > Robert, if I'm wrong, you are welcome to close that issue. > > > On Mon, Dec 9, 2013 at 10:50 PM, Isaac Hebsh wrote: > >> You

Re: Questions about integrateing SolrCloud with HDFS

2013-12-26 Thread Mark Miller
Cloudera has plans here. I'll be working on further hdfs / Solrcloud options in the near future. - Mark > On Dec 26, 2013, at 11:33 AM, Greg Walters wrote: > > YouPeng, > > While I'm unable to help you with the issue that you're seeing I did want to > comment here and say that I have previo

Re: Questions about integrateing SolrCloud with HDFS

2013-12-26 Thread Mark Miller
Can you file a JIRA issue? - Mark > On Dec 24, 2013, at 2:57 AM, YouPeng Yang wrote: > > Hi users > > Solr supports for writing and reading its index and transaction log files > to the HDFS distributed filesystem. > **I am curious about that there are any other futher improvement about > the

Re: Maybe a bug for solr 4.6 when create a new core

2013-12-26 Thread Mark Miller
If you are seeing an NPE there, sounds like you are on to something. Please file a JIRA issue. - Mark > On Dec 26, 2013, at 1:29 AM, YouPeng Yang wrote: > > Hi > Merry Christmas. > > Before this mail,I am in trouble with a weird problem for a few days > when to create a new core with b

Re: Maybe a bug for solr 4.6 when create a new core

2013-12-26 Thread Shawn Heisey
On 12/25/2013 11:29 PM, YouPeng Yang wrote: > After I fixed this prolem,I can create a core with the request: > http://10.7.23.122:8080/solr/admin/cores?action=CREATE&name=Test&; > *shard=Test* > &collection.configName=myconf&schema=schema.xml&config=solrconfigLocal_default.xml&collection=default

Does Solr fork child processes and result in zombies?

2013-12-26 Thread Sir Gilligan
I have three CentOS machines running Solr 4.6.0 cloud without any replication. That is, numshards is 3 and there is only one Solr instance running on each of the boxes. Also, on the boxes I arm running ZooKeeper. This is a test environment and I would not normally run ZooKeeper on the same box

Re: Chaining plugins

2013-12-26 Thread Paul Libbrecht
I have subclassed the query component to do so. Using params, you can get almost everything thinkable that is not too much documented. paul On 26 déc. 2013, at 15:59, elmerfudd wrote: > I would like to develope a search handler that is doing some logic and then > just sends the query to the de

Re: Questions about integrateing SolrCloud with HDFS

2013-12-26 Thread Greg Walters
YouPeng, While I'm unable to help you with the issue that you're seeing I did want to comment here and say that I have previously brought up the same goal that you're trying to accomplish on this mailing list but received no feedback or input. I think it makes sense that Solr should not try to

Re: org.apache.solr.handler.dataimport.DataImportHandlerException: Unable to execute query

2013-12-26 Thread PeterKerk
Shalin Shekhar Mangar wrote > Can you try using the debug mode and paste its response? Ok, thanks. How do I enabled and use the debug mode? -- View this message in context: http://lucene.472066.n3.nabble.com/org-apache-solr-handler-dataimport-DataImportHandlerException-Unable-to-execute-query-

Chaining plugins

2013-12-26 Thread elmerfudd
I would like to develope a search handler that is doing some logic and then just sends the query to the default search handler so the results will be generated there. It's like it is a transparent plugin and the data will only go through it. How can this be achieved . thanks ahead :) -- View

Re: org.apache.solr.handler.dataimport.DataImportHandlerException: Unable to execute query

2013-12-26 Thread Shalin Shekhar Mangar
I was reading the code and it looks like it could throw an NPE if java.sql.Statement#execute() returns false which can happen if there are no results (although most drivers return an empty resultset instead): if (stmt.execute(query)) { resultSet = stmt.getResultSet(); } L

Re: org.apache.solr.handler.dataimport.DataImportHandlerException: Unable to execute query

2013-12-26 Thread PeterKerk
Solr 4.3.1 When I run the statement in MySQL Workbench or console the statement executes successfully and returns 2 results. FYI: I placed the mysql-connector-java-5.1.27-bin.jar in the \lib folder. Also: it should not throw this error even when 0 results are returned right? -- View this mess

Re: org.apache.solr.handler.dataimport.DataImportHandlerException: Unable to execute query

2013-12-26 Thread Shalin Shekhar Mangar
Which version of Solr are you using? Is it possible that the query you ran returns 0 results? On Thu, Dec 26, 2013 at 5:44 PM, PeterKerk wrote: > I'm trying to setup Solr with a Wordpress database running on MySQL. > > But on trying a full import: > `http://localhost:8983/solr/tv-wordpress/dataim

Re: Configurable collectors for custom ranking

2013-12-26 Thread Peter Keegan
In my case, the final function call looks something like this: sum(product($k1,score()),product($k2,field(x))) This means that all the scores would have to scaled and passed down, not just the top N because even a low score could be offset by a high value in 'field(x)'. Thanks, Peter On Mon, Dec

Re: Solr Query Slowliness

2013-12-26 Thread Jilal Oussama
This an example of a query: http://myip:8080/solr/TestCatMatch_shard12_replica1/select?q=Royal+Cashmere+RC+106+CS+Silk+Cashmere+V+Neck+Moss+Green+Men ^10+s+Sweater+Cashmere^3+Men^3+Sweaters^3+Clothing^3&rows=1&wt=json&indent=true in return : { "responseHeader":{ "status":0, "QTime":191

org.apache.solr.handler.dataimport.DataImportHandlerException: Unable to execute query

2013-12-26 Thread PeterKerk
I'm trying to setup Solr with a Wordpress database running on MySQL. But on trying a full import: `http://localhost:8983/solr/tv-wordpress/dataimport?command=full-import` The error is: org.apache.solr.handler.dataimport.DataImportHandlerException: Unable to execute query **data-config.xml**

Re: Solr Query Slowliness

2013-12-26 Thread Rafał Kuć
Hello! Different queries can have different execution time, that's why I asked about the details. When running the scripts, is Solr CPU fully utilized? To tell more I would like to see what queries are run against Solr from scripts. Do you have any information on network throughput between the se

Re: Solr Query Slowliness

2013-12-26 Thread Jilal Oussama
Thanks Rafal for your reply, My scripts are running on other independent machines so they does not affect Solr, I did mention that the queries are not the same (that is why I removed the query cache from solrconfig.xml), and I only get 1 result from Solr (which is the top scored one so no sorting

Re: Solr Query Slowliness

2013-12-26 Thread Rafał Kuć
Hello! Could you tell us more about your scripts? What they do? If the queries are the same? How many results you fetch with your scripts and so on. -- Regards, Rafał Kuć Performance Monitoring * Log Analytics * Search Analytics Solr & Elasticsearch Support * http://sematext.com/ > Hi all, >

Solr Query Slowliness

2013-12-26 Thread Jilal Oussama
Hi all, I have multiple python scripts querying solr with the sunburnt module. Solr was hosted on an Amazon ec2 m1.large (2 vCPU with 4 ECU, 7.5 GB memory & 840 GB storage) and contained several cores for different usage. When I manually executed a query through Solr Admin (a query containing 10

Re: How to use Solr in my project

2013-12-26 Thread Gora Mohanty
On 26 December 2013 15:44, Fatima Issawi wrote: > Hi, > > I should clarify. We have another application extracting the text from the > document. The full text from each document will be stored in a database > either at the document level or page level (this hasn't been decided yet). We > will a

RE: How to use Solr in my project

2013-12-26 Thread Fatima Issawi
Hi, I should clarify. We have another application extracting the text from the document. The full text from each document will be stored in a database either at the document level or page level (this hasn't been decided yet). We will also be storing word location of each word on the page in the

Re: Solr update document issue

2013-12-26 Thread mohammad
Hello all, in our last project we use solr as search engine to search for assets. we have a functionality to search for product in it's summary text, the product itself is "container for a set of products parent" so each time we add new product under it , the summary of the "parent product" sh

Solr update document issue

2013-12-26 Thread mohammad
Hello all, in our last project we use solr as search engine to search for assets. we have a functionality to search for product in it's summary text, the product itself is "container for a set of products parent" so each time we add new product under it , the summary of the "parent product" should

Re: How to use Solr in my project

2013-12-26 Thread Gora Mohanty
On 26 December 2013 10:54, Fatima Issawi wrote: > Hello, > > First off, I apologize if this was sent twice. I was having issues > subscribing to the list. > > I'm a complete noob in Solr (and indexing), so I'm hoping someone can help me > figure out how to implement Solr in my project. I have go

How to use Solr in my project

2013-12-26 Thread Fatima Issawi
Hello, First off, I apologize if this was sent twice. I was having issues subscribing to the list. I'm a complete noob in Solr (and indexing), so I'm hoping someone can help me figure out how to implement Solr in my project. I have gone through some tutorials online and I was able to import an