/select with 'q' parameter does not work

2013-12-11 Thread Nutan
I have indexed 9 docs. this my* schema.xml* contents id *solrconfig.xml* is: LUCENE_42 ${solr.document.data.dir:} explicit 20 * id

Possible regression for Solr 4.6.0 - commitWithin does not work with replicas

2013-12-11 Thread Elodie Sannier
Hello, I am using SolrCloud 4.6.0 with two shards, two replicas by shard and with two collections. collection fr_blue: - shard1 -> server-01 (replica1), server-01 (replica2) - shard2 -> server-02 (replica1), server-02 (replica2) collection fr_green: - shard1 -> server-01 (replica1), server-01

Re: /select with 'q' parameter does not work

2013-12-11 Thread Amit Aggarwal
Because in your solrconfig ... Against /select ... DirectUpdateHandler is mentioned . It should be solr.searchhanlder .. On 11-Dec-2013 3:11 PM, "Nutan" wrote: > I have indexed 9 docs. > this my* schema.xml* > > > > > multiValued="false"/> > required="true" > multiValued="false"/> > multiVal

Re: Importing/Indexing the DB2 XML FieldType in SOLR

2013-12-11 Thread ravi1984
Hi Shawn, Thanks much for the reply! We have this working through Java layer and facing the issues when integrated with SOLR layer. We tried to tweak the Query itself to return the String - following are the options we tried, and still there was no luck. Do we need to tweak anything in the Schema.

Re: Importing/Indexing the DB2 XML FieldType in SOLR

2013-12-11 Thread ravi1984
Hi Shawn, Thanks much for the reply! We have this working through Java layer and facing the issues when integrated with SOLR layer. We tried to tweak the Query itself to return the String - following are the options we tried, and still there was no luck. Do we need to tweak anything in the Schem

Re: /select with 'q' parameter does not work

2013-12-11 Thread Nutan
But below that i have also defined this, explicit 10 contents Initially it worked,now all of a sudden why no results?? -- View this message in context: http://lucene.472066.n3.nabble.com/select-with-q-parameter-does-not-work-tp4106099p4106128.html Sent from t

Re: Solr hardware memory question

2013-12-11 Thread Toke Eskildsen
On Tue, 2013-12-10 at 17:51 +0100, Hoggarth, Gil wrote: > We're probably going to be building a Solr service to handle a dataset > of ~60TB, which for our data and schema typically gives a Solr index > size of 1/10th - i.e., 6TB. Given there's a general rule about the > amount of hardware memory re

Re: /select with 'q' parameter does not work

2013-12-11 Thread Nutan
explicit 20 * id 2.1 ${solr.document.data.dir:} explicit 10 contents i made changes n this new solrconfig.xml ,but still the query does not work. -- Vi

Re: /select with 'q' parameter does not work

2013-12-11 Thread Amit Aggarwal
When you start solr , do you find any error or exception Java -jar ./start.jar ... Then see if there is any problem ... Otherwise take solr solrconfig.xml and try to run .. it should run On 11-Dec-2013 5:41 PM, "Nutan" wrote: > default="true"> > > >explicit >20 >

Re: Constantly increasing time of full data import

2013-12-11 Thread michallos
I took a few thread dumps and here and the results: - service which are indexing stuck on this stack trace: "cmdDistribExecutor-3-thread-17669" prio=10 tid=0x7f1aae4a6800 nid=0x44a9 runnable [0x7f1a6c0f6000] java.lang.Thread.State: RUNNABLE at java.net.SocketInputStream.socketRe

Fwd: FuzzyLookupFactory fwfsta.bin

2013-12-11 Thread Harun Reşit Zafer
With the configration below: suggest name="classname">org.apache.solr.spelling.suggest.Suggester name="lookupImpl">org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory fuzzy_suggest_analyzing true text_tr suggestions.txt true

Updating shard range in Zookeeper

2013-12-11 Thread michael.boom
Hi, Somehow my Zookeeper clusterstate has gotten messed up and after a restart of both Zookeeper instances and my Solr instances in one of my collections , for one shard, the "range" is now null. Everything else it's fine, but I can't index documents now because i get an error : No active slice s

Cloud graph gone after manually editing clusterstate.json

2013-12-11 Thread michael.boom
HI, Today I changed my ZK config, removing one instance in the quorum and then restarted both all ZKs and all Solr instances. After this operation i noticed that one of the shards in one collection was missing the range ("range":null). Router for that collection was compositeId. So, I proceeded a

Re: Edismax and prefixlen for fuzzy queries

2013-12-11 Thread Ahmet Arslan
Somehow relevant jira : https://issues.apache.org/jira/browse/SOLR-218 On Wednesday, December 11, 2013 2:15 AM, Furkan KAMACI wrote: Hi; I've debugged edismax of Solr 4.5.1 and I see that line: *case FUZZY: return super.getFuzzyQuery(field, val, flt);* it calls that one: * // called from p

Equivalent of SQL JOIN in SOLR across multiple cores

2013-12-11 Thread bijalcm
1, Are the cores join-able? 2. Could you give me an example about how to write a multiple core join? 3. Can we do equivalent of JOIN in SOLR across multiple cores Select T1.*,T2.* FROM Table1 T1,Table2 T2 WHERE T1.id = T2.id -- View this message in context: http://lucene.4720

Re: Equivalent of SQL JOIN in SOLR across multiple cores

2013-12-11 Thread Ahmet Arslan
Hi, There are some join support : 1) Query Time Join (works across cores) https://cwiki.apache.org/confluence/display/solr/Other+Parsers#OtherParsers-JoinQueryParser http://wiki.apache.org/solr/Join 2) Block Joins https://cwiki.apache.org/confluence/display/solr/Other+Parsers#OtherParsers-Bl

RE: Cloud graph gone after manually editing clusterstate.json

2013-12-11 Thread Tim Potter
Hi Michael, Can you /get clusterstate.json again to see the contents? Also, maybe just a typo but you have `cate clusterstate.json` vs. `cat ..` Timothy Potter Sr. Software Engineer, LucidWorks www.lucidworks.com From: michael.boom Sent: Wednesday, Dece

RE: Cloud graph gone after manually editing clusterstate.json

2013-12-11 Thread michael.boom
Thanks for the reply Tim, Yes, that was just a typo, i used "cat" not "cate". As for the checks everything looks fine, my edits were: 1. updating the shard range 2. removed the header which looked log information, as below: * removed header start here* Connecting to solr3:9983 2013-12-11 1

RE: Cloud graph gone after manually editing clusterstate.json

2013-12-11 Thread Tim Potter
I'm not sure at this point as what you're describing seems fine to me ... I'm not too familiar with Solr's UI implementation, but I suspect the cloud graph stuff may be client side, so are you seeing any JavaScript errors in the dev console in your browser? Timothy Potter Sr. Software Engineer,

Re: /select with 'q' parameter does not work

2013-12-11 Thread Nutan
No exception,it works normal. other queries like : http://localhost:8080/solr/document/select?q=author:dgfb works. Only for 'contents' field it does not work. all other functionalities like analysis,indexing etc work fine. But for spell check : http://localhost:8080/solr/document/spell?q=programme

Re: Java heap space:out of memory

2013-12-11 Thread Michael Della Bitta
Just for future reference, I think Tomcat uses CATALINA_OPTS for the server runtime options. Michael Della Bitta Applications Developer o: +1 646 532 3062 | c: +1 917 477 7906 appinions inc. “The Science of Influence Marketing” 18 East 41st Street New York, NY 10017 t: @appinions

RE: Cloud graph gone after manually editing clusterstate.json

2013-12-11 Thread michael.boom
I had a look, but all looks fine there too: [Wed Dec 11 2013 17:04:41 GMT+0100 (CET)] runRoute get #/~cloud GET tpl/cloud.html?_=1386777881244 200 OK 57ms GET /solr/zookeeper?wt=json&_=1386777881308 200 OK 509ms GET /solr/zookeeper?wt=json&path=%2Flive_nodes&_=1386777881822 200 OK 62ms

Re: Importing/Indexing the DB2 XML FieldType in SOLR

2013-12-11 Thread Shawn Heisey
On 12/11/2013 3:09 AM, ravi1984 wrote: > Thanks much for the reply! We have this working through Java layer and > facing the issues when integrated with SOLR layer. > > We tried to tweak the Query itself to return the String - following are the > options we tried, and still there was no luck. Do

Re: /select with 'q' parameter does not work

2013-12-11 Thread Nutan
solrconfig is a xml file,it is not possible to run xml files,you open it in browser and its code gets displayed. -- View this message in context: http://lucene.472066.n3.nabble.com/select-with-q-parameter-does-not-work-tp4106099p4106176.html Sent from the Solr - User mailing list archive at Nab

Ever increasing open searchers

2013-12-11 Thread Manish Kumar
Hi, I am actually struggling with one of my custom search plugins is causing a SolrCore to keep many open searchers. This is causing my slave boxes to run out of disk space in couple of days. Following is the problemm description : My solr set-up comprises a master, a repeater and two slaves. Sl

Re: Configurable collectors for custom ranking

2013-12-11 Thread Joel Bernstein
Peter, It sounds like you could achieve what you want to do in a PostFilter rather then extending the TopDocsCollector. Is there a reason why a PostFilter won't work for you? Joel On Tue, Dec 10, 2013 at 3:24 PM, Peter Keegan wrote: > Quick question: > In the context of a custom collector, how

Re: Configurable collectors for custom ranking

2013-12-11 Thread Peter Keegan
Hi Joel, I thought about using a PostFilter, but the problem is that the 'scale' function must be done after all matching docs have been scored but before adding them to the PriorityQueue that sorts just the rows to be returned. Doing the 'scale' function wrapped in a 'query' is proving to be too

Re: Getting Solr Document Attributes from a Custom Function

2013-12-11 Thread Kydryavtsev Andrey
As I know (not 100% sure actually), function queries don't work with multivalued fields. Why do you need multivalued fields here? Your "price" and "numberOfCities" don't look like multivalued. At least you can try to use, you know, some tricky format like "50;40;20" to index multivalued field a

Re: Configurable collectors for custom ranking

2013-12-11 Thread Peter Keegan
>From the Collector context, I suppose I can access the FileFloatSource directly like this, although it's not generic: SchemaField field = indexSearcher.getSchema().getField(fieldName); dataDir = indexSearcher.getSchema().getResourceLoader().getDataDir(); ExternalFileField eff = (ExternalFileField

Re: Configurable collectors for custom ranking

2013-12-11 Thread Joel Bernstein
Here is one approach to use in a postfilter 1) In the collect() method call score for each doc. Use the scores to create your scaleInfo. 2) Keep a bitset of the hits and a priorityQueue of your top X ScoreDocs. 3) Don't delegate any documents to lower collectors in the collect() method. 4) In the

Re: Replacing Deprecated CachedSqlEntityProcessor with SqlEntityProcessor with a cacheImpl parameter

2013-12-11 Thread O. Olson
Thank you very much Furkan for the detailed explanation. I simply set the processor to SqlEntityProcessor and cacheImpl to SortedMapBackedCache, and it worked for me i.e. from my original post I had/did: Thanks again, O

Re: Configurable collectors for custom ranking

2013-12-11 Thread Peter Keegan
This is what I was looking for, but the DelegatingCollector 'finish' method doesn't exist in 4.3.0 :( Can this be patched in and are there any other PostFilter dependencies on 4.5? Thanks, Peter On Wed, Dec 11, 2013 at 3:16 PM, Joel Bernstein wrote: > Here is one approach to use in a postfil

Solr Profiler

2013-12-11 Thread Monica Skidmore
We're trying to improve the speed of some custom Solr code we've written, and we'd like to use a profiler to help us focus our efforts. However, we've tried both JProfiler and NewRelic, and we've found it challenging to configure them correctly to be able to tell where our bottlenecks really ar

Re: Change Velocity Template Directory in Solr 4.6

2013-12-11 Thread O. Olson
Thank you iorixxx. Yes, when I run: > java -Dsolr.allow.unsafe.resourceloading=true -jar start.jar And I then load the root of my site, I get: ERROR - 2013-12-11 14:36:03.434; org.apache.solr.common.SolrException; null:java.io.IOException: Unable to find resource 'browse.vm' at org.apa

Re: Configurable collectors for custom ranking

2013-12-11 Thread Joel Bernstein
SOLR-5020 has the commit info, it's mainly changes to SolrIndexSearcher I believe. They might apply to 4.3. I think as long you have the finish method that's all you'll need. If you can get this working it would be excellent if you could donate back the Scale PostFilter. On Wed, Dec 11, 2013 at 3

Re: Configurable collectors for custom ranking

2013-12-11 Thread Peter Keegan
Thanks very much for the guidance. I'd be happy to donate a working solution. Peter On Wed, Dec 11, 2013 at 3:53 PM, Joel Bernstein wrote: > SOLR-5020 has the commit info, it's mainly changes to SolrIndexSearcher I > believe. They might apply to 4.3. > I think as long you have the finish metho

RE: SolrCloud with large synonym files

2013-12-11 Thread gf80
Hi all, I have the same exception org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /configs/myconf/synonyms.txt synonyms.txt is greater than 1,5Mb I have tried to set jute.maxbuffer specifying -Djute.maxbuffer=1024M at the solrcloud startup but

Re: SolrCloud with large synonym files

2013-12-11 Thread Jack Krupansky
Note that the synonym filter accepts a comma-separated list of synonym files, so you can split your huge synonym file into two or more smaller files. -- Jack Krupansky -Original Message- From: gf80 Sent: Wednesday, December 11, 2013 5:21 PM To: solr-user@lucene.apache.org Subject: RE

Re: Error when creating collection in Solr 4.6

2013-12-11 Thread dboychuck
Where did you add that directive? I am having the same problem. -- View this message in context: http://lucene.472066.n3.nabble.com/Error-when-creating-collection-in-Solr-4-6-tp4103536p4106248.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Replacing Deprecated CachedSqlEntityProcessor with SqlEntityProcessor with a cacheImpl parameter

2013-12-11 Thread Furkan KAMACI
Hi; Good to hear that I could help you. Thanks; Furkan KAMACI 11 Aralık 2013 Çarşamba tarihinde O. Olson adlı kullanıcı şöyle yazdı: > Thank you very much Furkan for the detailed explanation. I simply set the > processor to SqlEntityProcessor and cacheImpl to SortedMapBackedCache, and > it wor

Re: Edismax and prefixlen for fuzzy queries

2013-12-11 Thread Furkan KAMACI
Hi; I've read the issue. When I have time I will apply a patch for it. Thanks; Furkan KAMACI 11 Aralık 2013 Çarşamba tarihinde Ahmet Arslan adlı kullanıcı şöyle yazdı: > Somehow relevant jira : https://issues.apache.org/jira/browse/SOLR-218 > > > > On Wednesday, December 11, 2013 2:15 AM, Furk

Re: Error when creating collection in Solr 4.6

2013-12-11 Thread Yago Riveiro
Adding genericCoreNodeNames to solr.xml work for me. -- Yago Riveiro Sent with Sparrow (http://www.sparrowmailapp.com/?sig) On Wednesday, December 11, 2013 at 10:47 PM, dboychuck wrote: > Where did you add that directive? I am having the same problem. > > > > -- > View this message in cont

Re: SolrCloud and MoreLikeThis: SOLR-788

2013-12-11 Thread gf80
Hi guys, could you kindly help me to apply patch for MoreLikeThis on solrcloud. I'm using Solr 4.6 and I'm using solrcloud with 10 shards. The problem is described here https://issues.apache.org/jira/browse/SOLR-4414 but I think that it was solved but not already delivered in Solr4.6. Thanks a

Solr Cloud error with shard update

2013-12-11 Thread dboychuck
I am running a data import and it is throwing all kinds of errors. I am upgrading to 4.6 from 4.5.1 with the exact schema and solrconfig and dih configs. Here is the error I am getting: org.apache.solr.common.SolrException: ERROR: [doc=k-690kohler!670614] Error adding field 'weight'='java.math.Bi

Re: SolrCloud with large synonym files

2013-12-11 Thread gf80
Tx a lot Jack tomorrow I split synonyms file. Anyway, do you know how can I set jute.maxbuffer? --giuseppe Inviato da iPhone Il giorno 11/dic/2013, alle ore 22:40, "Jack Krupansky-2 [via Lucene]" ha scritto: > Note that the synonym filter accepts a comma-separated list of synonym > files, s

Re: Solr Cloud error with shard update

2013-12-11 Thread dboychuck
Here is the output from the logs of the server running the import: 598413 [updateExecutor-1-thread-62] ERROR org.apache.solr.update.StreamingSolrServers – error org.apache.solr.common.SolrException: Bad Request request: http://solr-shard-5.sys.id.build.com:8080/solr/productindex/update?update.

Re: Solr Cloud error with shard update

2013-12-11 Thread dboychuck
And here are the logs of one of the replicas: 2286617 [Thread-146] WARN org.apache.solr.cloud.RecoveryStrategy – Stopping recovery for zkNodeName=core_node2core=productindex 2286627 [Thread-147] WARN org.apache.solr.cloud.RecoveryStrategy – Stopping recovery for zkNodeName=core_node2core=prod

Re: Solr Cloud error with shard update

2013-12-11 Thread dboychuck
Also I have tried setting my the schema defintion to float for the offending fields in the schema.xml as well as tried to cast my columns to strings in the query. Both still give the same result. My java version is: java version "1.7.0_10" Java(TM) SE Runtime Environment (build 1.7.0_10-b18) Java

Re: Solr Cloud error with shard update

2013-12-11 Thread Shawn Heisey
On 12/11/2013 5:01 PM, dboychuck wrote: > I am running a data import and it is throwing all kinds of errors. I am > upgrading to 4.6 from 4.5.1 with the exact schema and solrconfig and dih > configs. > > Here is the error I am getting: > > org.apache.solr.common.SolrException: ERROR: [doc=k-690ko

Re: Solr hardware memory question

2013-12-11 Thread Joel Bernstein
Curious how many documents per shard you were planning? The number of documents per shard and field type will drive the amount of a RAM needed to sort and facet. On Wed, Dec 11, 2013 at 7:02 AM, Toke Eskildsen wrote: > On Tue, 2013-12-10 at 17:51 +0100, Hoggarth, Gil wrote: > > We're probably go

solrcloud split problem

2013-12-11 Thread xuke...@gmail.com
hello, i use solr 4.5.1. i use solrcloud and split a collection shard to two shard,then i unload the original shard. when i select the collection, i get a error. { "responseHeader": { "status": 500, "QTime": 15, "params": { "indent": "true", "q": "*:*", "_": "138

solr4.6.0 with Glassfish 3.1.2.2

2013-12-11 Thread Varun Krishna Parthasarathy
Hello I am trying to install solr 4.6.0 under glassfish 3.1.2.2, and have followed the instructions given at http://wiki.apache.org/solr/SolrGlassfish and http://solrwithglassfish.blogspot.in/ But either of the two does not seem to work for me. I am getting the http status 404 the requested resourc

CollapsingQParserPlugin scores incorrectly in Solr 4.6.0 when multiple sort criteria are used

2013-12-11 Thread Umesh Prasad
Hi All, I am using new CollapsingQParserPlugin for Grouping and found that it works incorrectly when I use multiple sort criteria. http://localhost:8080/solr/toys/select/?q=car%20and%20toys&version=2.2&start=0&rows=10&indent=on&sort=score%20desc,floSalesRank%20asc&facet=on&facet.field=store_p

Re: CollapsingQParserPlugin scores incorrectly in Solr 4.6.0 when multiple sort criteria are used

2013-12-11 Thread Umesh Prasad
Issue occurs in Single Segment index also .. sort: "score desc,floSalesRank asc" response: { - numFound: 21461, - start: 0, - maxScore: 4.4415073, - docs: [ - { - floSalesRank: 0, - score: 0.123750895, - [docid]: 9208 - On Thu, Dec 12, 201

Re: Solr hardware memory question

2013-12-11 Thread Otis Gospodnetic
Hi Gil, I'd look at the number and type of fields you sort and facet on (this stuff likes memory). I'd keep in mind heaps over 32 GB use bigger pointers, so maybe more smaller heaps are better than one big one. You didn't mention the # of CPU cores, but keep that in mind when sharding. When a que

Re: Solr Profiler

2013-12-11 Thread Otis Gospodnetic
Hi, Are you looking for a Java profiler? Or a Solr monitoring tool? For a profiler I'd recommend YourKit -- http://www.yourkit.com/ For Solr monitoring I'd recommend our SPM -- http://sematext.com/spm/solr-performance-monitoring/index.html Otis -- Performance Monitoring * Log Analytics * Search

Re: solr4.6.0 with Glassfish 3.1.2.2

2013-12-11 Thread Shawn Heisey
On 12/11/2013 8:54 PM, Varun Krishna Parthasarathy wrote: > I am trying to install solr 4.6.0 under glassfish 3.1.2.2, and have > followed the instructions given at > http://wiki.apache.org/solr/SolrGlassfish and > http://solrwithglassfish.blogspot.in/ > But either of the two does not seem to work

unable to facet range query

2013-12-11 Thread Nutan
My schema has : this is my field which i want to facet: I replaced above fieldtype with this: But now this shows error in elevate component.My elevate.xml is integer elevate.xml *Logs:* Caused by: org.apache.solr.common.SolrException: Error initializing QueryElevationComponent.

Re: Importing/Indexing the DB2 XML FieldType in SOLR

2013-12-11 Thread ravi1984
Thanks again Shawn. The CLOB transformer helped. Thanks Ravi -- View this message in context: http://lucene.472066.n3.nabble.com/Importing-Indexing-the-DB2-XML-FieldType-in-SOLR-tp4105079p4106307.html Sent from the Solr - User mailing list archive at Nabble.com.

Load existing HDFS files into solr?

2013-12-11 Thread cynosure
Folks, Our current data is stored in hive tables. Is there a way to specify solr to index the existing hdfs files directly? or I have to import each hive table to solr? Can any one point to me some reference? Thank you very much! Chen

Re: solr4.6.0 with Glassfish 3.1.2.2

2013-12-11 Thread Varun Krishna Parthasarathy
Shawn Thank you so much. With Regards Varun Krishna. P On Thu, Dec 12, 2013 at 11:47 AM, Shawn Heisey wrote: > On 12/11/2013 8:54 PM, Varun Krishna Parthasarathy wrote: > > I am trying to install solr 4.6.0 under glassfish 3.1.2.2, and have > > followed the instructions given at > > http://w