Re: large text blobs in string field

2012-11-02 Thread Gora Mohanty
On 3 November 2012 00:45, geeky2 wrote: [...] > > we are thinking of doing this to represent a 1:M relationship with the > "Many" being represented as a string in the schema (probably comprised > either of xml or json objects). > > we are looking at the classic part : model scenario, where the cl

Re: Scalability of Solr Result Grouping/Field Collapsing: Millions/Billions of documents?

2012-11-02 Thread ilay
Hello all, I have a similar situation for grouping where I want group my products into top categories for a ecommerce application. The number groups here is less than 10 and total number of docs in the index is 10 Million. Will solr goruping is an issue here, we have seen OOM issue when we tried

Re: trouble instantiating CloudSolrServer

2012-11-02 Thread Lance Norskog
What is the maven repo id & version for this? - Original Message - | From: "Mark Miller" | To: solr-user@lucene.apache.org | Sent: Friday, November 2, 2012 6:52:10 PM | Subject: Re: trouble instantiating CloudSolrServer | | I think the maven jars must be out of whack? | | On Fri, Nov 2,

Re: After adding field to schema, the field is not being returned in results.

2012-11-02 Thread Lance Norskog
If any value is in a bogus format, the entire document batch in that HTTP request fails. That is the right timestamp format. The index may be corrupted somehow. Can you try removing all of the fields in data/ and trying again? - Original Message - | From: "Erick Erickson" | To: solr-use

Re: SolrCloud indexing blocks if node is recovering

2012-11-02 Thread Mark Miller
Doesn't sound right. Still have the logs? - Mark On Fri, Nov 2, 2012 at 9:45 AM, Markus Jelsma wrote: > Hi, > > We just tested indexing some million docs from Hadoop to a 10 node 2 rep > SolrCloud cluster with this week's trunk. One of the nodes gave an OOM but > indexing continued without int

Re: Dynamic core selection

2012-11-02 Thread Amit Nithian
I have done something similar in a search component for our search at Zvents.com. Our use case is where we have a core that invokes searches in other cores and merges the results together Basically we have: 1) FederatedComponent implements SolrCoreAware --> Grab instance of CoreContainer and store

Re: trouble instantiating CloudSolrServer

2012-11-02 Thread Mark Miller
I think the maven jars must be out of whack? On Fri, Nov 2, 2012 at 6:38 AM, Markus Jelsma wrote: > Hi, > > We use trunk but got SolrJ 4.0 from Maven. Creating an instance of > CloudSolrServer fails because its constructor calls a not existing LBServer > constructor, it attempts to create an in

Re: Solr 4.0 error message: "Unsupported ContentType: Content-type:text/xml"

2012-11-02 Thread Tom Burton-West
Thanks Jack, That is exactly the problem. Apparently earlier versions of Solr ignored the extra text, which is why we didn't catch the bug in our code earlier. Thanks for the quick response. Tom On Fri, Nov 2, 2012 at 5:34 PM, Jack Krupansky wrote: > That message makes it sounds as if the lit

Re: DataImport Handler : Transformer Function Eval Failed Error

2012-11-02 Thread Otis Gospodnetic
Would http://wiki.apache.org/solr/Join do anything for you? Otis -- Search Analytics - http://sematext.com/search-analytics/index.html Performance Monitoring - http://sematext.com/spm/index.html On Fri, Nov 2, 2012 at 10:06 AM, Mishra, Shikhar < shikhar.mis...@telcobuy.com> wrote: > We have a s

Re: Solr 4.0 error message: "Unsupported ContentType: Content-type:text/xml"

2012-11-02 Thread Jack Krupansky
That message makes it sounds as if the literal text "Content-type:" is included in your content type. How exactly are you setting/sending the content type? -- Jack Krupansky -Original Message- From: Tom Burton-West Sent: Friday, November 02, 2012 5:30 PM To: solr-user@lucene.apache.o

Solr 4.0 error message: "Unsupported ContentType: Content-type:text/xml"

2012-11-02 Thread Tom Burton-West
Hello all, Trying to get Solr 4.0 up and running with a port of our production 3.6 schema and documents. We are getting the following error message in the logs: org.apache.solr.common.SolrException: Unsupported ContentType: Content-type:text/xml Not in: [app lication/xml, text/csv, text/json, a

Puzzled by search score

2012-11-02 Thread dm_tim
Howdy, I'm reading a table in a db using the following schema: id tag So make the following query http://localhost:8080/apache-solr-4.0.0/core0/select?q=tag%3Aclothes~%2Bcid%3A14&sort=score+de

Re: unable to create new native thread while importing

2012-11-02 Thread Chris Brown
Thanks for that, I didn't know I could see the thread dump so easily. That does appear to have been the problem - I wasn't flushing my input and the underlining api held the connection open-and-not-reusable until garbage collection. Chris... On 12-11-02 1:05 PM, "Alexandre Rafalovitch" wrote: >

Solr-UIMA integration : analyzing multi-fields

2012-11-02 Thread vempap
Hello all, how to analyze multiple fields using UIMA when we add the UIMA update chain to the update handler ? and how to map which field gets analyzed to which field. For instance, lets say there are two text fields, text1 & text2 for which I need to generate pos-tags using UIMA. In the field

Re: unable to create new native thread while importing

2012-11-02 Thread Alexandre Rafalovitch
Have you tried doing a thread dump and seeing how many threads you have and what they are doing. Maybe a connection is not being closed somehow. Regards, Alex. Personal blog: http://blog.outerthoughts.com/ LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch - Time is the quality of natur

large text blobs in string field

2012-11-02 Thread geeky2
hello environment - solr 3.5 i would like to know if anyone is using the technique of placing large text blobs in to a "non-indexed" string field and if so - are there any good/bad aspects to consider? we are thinking of doing this to represent a 1:M relationship with the "Many" being represent

unable to create new native thread while importing

2012-11-02 Thread Chris Brown
I'm having a problem importing data into Solr 4.0 (the same error happens in 3.6.1). Here is the Error I get: 2012-11-02 09:50:07.265:WARN:oejs.AbstractConnector: java.lang.OutOfMemoryError: unable to create new native thread at java.lang.Thread.start0(Native Method) at java.lang.

Re: Dynamic core selection

2012-11-02 Thread Dzmitry Petrushenka
Hi all! Just sharing the solution) I've extended SolrDispatchFilter with my own implementation and did like this: ... String core = determineCore(req); super.doFilter(new CoreRoutingReqWrapper(req, core), response, chain); ... code for the CoreRoutingReqWrapper class: class CoreRoutingRe

How to use (if it is applicable) hibernate inside a solr plugin

2012-11-02 Thread Ricci Gian Maria
Hi to everyone, I'm a .NET developer, so I'm pretty new to java developing. I was able to write a custom filter to use in solr, but I had problem with another filter that should use hibernate to read some data from a database during initialization. First of all I was not able to make it rea

Re: index solr using jquery AJAX

2012-11-02 Thread Luis Cappa Banda
Hello, In that case try again with a JSON array and check if: 1. The request arrives to Solr server. In that case, copy&paste the log traces here. 2. The request is never executed. Analyze with Firebug in your browser. Regards, Luis Cappa. 2012/11/2 amit > Hi Luis > Yes "solr.JsonUpdate

Nested Join Queries

2012-11-02 Thread Gerald Blanck
At a high level, I have a need to be able to execute a query that joins across cores, and that query during its joining may join back to the originating core. Example: Find all Books written by an Author who has written a best selling Book. In Solr query syntax A) against the book core - bestsell

Re: After adding field to schema, the field is not being returned in results.

2012-11-02 Thread Erick Erickson
Well, I'm at my wits end. I tried your field definitions (using the exampledocs XML) and they work just fine. As far as if you mess up the date on the way in, you should be seeing stack traces in your log files. The only way I see not getting the "Sorry, no Term Info available :(" message is if yo

Re: Solr Replication is not Possible on RAMDirectory?

2012-11-02 Thread Michael Della Bitta
> so it is not possible to use RAMdirectory for replication? No, RAMDirectory doesn't work for replication. Use MMapDirectory... it ends up storing the index in RAM and more efficiently so, plus it's backed by disk. Just be sure to not set a big heap because MMapDirectory works outside of heap.

Re: SolrCloud: general questions

2012-11-02 Thread ku3ia
Hi Tomás!!! The first three questions are major for me. Many thanks for your response. About number of shards and documents in it I'll try to test. Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-general-questions-tp4017769p4017836.html Sent from the Solr

Re: SOLR - To point multiple indexes in different folder

2012-11-02 Thread Erick Erickson
That should be OK. The recursive bit happens when you define the shard locations in your config files in the default search handler. On Fri, Nov 2, 2012 at 6:42 AM, ravi.n wrote: > Erick, > > We are forming request something like below for default /select request > handler, will this cause an i

Possible memory leak in recovery

2012-11-02 Thread Markus Jelsma
Hi, We wiped clean the data directories for one node. That node is never able to recover and regularly runs OOM. On another cluster (with an older build, september 10th) memory consumption on recovery is fairly low when recoverign and with only a 250MB heap allocated it's easy to recover two 4G

RE: DataImport Handler : Transformer Function Eval Failed Error

2012-11-02 Thread Mishra, Shikhar
We have a scenario where the same products are available from multiple vendors at different prices. We want to store these prices along with the products in the index (product has many prices), so that we can apply dynamic filtering on the prices at the time of search. Thanks, Shikhar -Or

Re: After adding field to schema, the field is not being returned in results.

2012-11-02 Thread Dotan Cohen
On Thu, Nov 1, 2012 at 9:28 PM, Lance Norskog wrote: > Have you uploaded data with that field populated? Solr is not like a > relational database. It does not automatically populate a new field when you > add it to the schema. If you sort on a field, a document with no data in that > field come

Re: After adding field to schema, the field is not being returned in results.

2012-11-02 Thread Dotan Cohen
On Thu, Nov 1, 2012 at 9:09 PM, Erick Erickson wrote: > What happens if you sort ascending rather than descending? Depending on > what (if anything) you've done with sortMissingFirst/Last on that field, > it's possible that you're just seeing the results of the sort and docs with > your new field

Re: Solr 4.0 admin panel

2012-11-02 Thread Shawn Heisey
On 11/2/2012 7:13 AM, Tannen, Lev (USAEO) [Contractor] wrote: Thank you James. In Solr 3.6 http://localhost:8983/solr/admin links to the admin panel. So the question remains how to invoke an admin panel in Solr 4.0? Does it mean that there is no such a thing as admin panel in Solr 4.0? Try

SolrCloud indexing blocks if node is recovering

2012-11-02 Thread Markus Jelsma
Hi, We just tested indexing some million docs from Hadoop to a 10 node 2 rep SolrCloud cluster with this week's trunk. One of the nodes gave an OOM but indexing continued without interruption. When i restarted the node indexing stopped completely, the node tried to recover - which was unsuccess

RE: Solr 4.0 admin panel

2012-11-02 Thread Tannen, Lev (USAEO) [Contractor]
Thank you Hoss. I am switching from Solr3.6 to Silr 4.0. In Solr 3.6 a link http://localhost:8983/solr/admin or http://localhost:8983/solr/coreName/admin leads to an administration panel page with some useful information. Swapping also is done through the same link http://localhost:8983/solr

Re: index solr using jquery AJAX

2012-11-02 Thread amit
Hi Luis I tried sending an array too, but no luck This is how the request looks like. $.ajax({ url: "http://192.168.10.113:8080/solr/update/json?commit=true";, type: "POST", contentType: "application/json; charset=utf-8", data: [ { "id": "22", "name": "Seatt

Re: solr search issue

2012-11-02 Thread Jack Krupansky
An id field simply uniquely identifies a row or document. It sounds like you are trying to use "id" as if it were a "type" field. Generally, one would not "search in id field" other than to select a specific row/document. It is rather unhelpful to label a column/field as "data" - that conveys n

RE: Solr 4.0 admin panel

2012-11-02 Thread Tannen, Lev (USAEO) [Contractor]
Thank you James. In Solr 3.6 http://localhost:8983/solr/admin links to the admin panel. So the question remains how to invoke an admin panel in Solr 4.0? Does it mean that there is no such a thing as admin panel in Solr 4.0? Lev -Original Message- From: James Ji [mailto:jiayu...@gmail.

RE: Solr 4.0 admin panel

2012-11-02 Thread Tannen, Lev (USAEO) [Contractor]
Thank you Peter, I know this. I cannot access admin in both cases single core and multicore. In the single core case I have had a generic solr page and in the multi core case I got just "NOT FOUND" message. Select works in both cases. Lev -Original Message- From: Péter Király [mailto:ki

Re: SolrCloud Tomcat configuration: problems and doubts.

2012-11-02 Thread Luis Cappa Banda
Hello, Mark! How are you? Thanks a lot for helping me. You were right about jetty.host parameter. My fianl test solr.xml looks like: * * ** * * I´ve noticed that 'hostContext' parameter was also required, so I included it. After that corrections Cloud graph tree looks right, and executing

Re: SolrCloud: general questions

2012-11-02 Thread Tomás Fernández Löbbe
> > My questions are: > 1) Is it true, that I may send data to any of shards [9080, 9081, 9082, > 9083] and don't care about how SolrCloud will distribute data between > shards? What algorithm is used: round robin? > It is true, the document is forwarded to the correct shard automatically. It's not

Re: SOLR - To point multiple indexes in different folder

2012-11-02 Thread ravi.n
Erick, We are forming request something like below for default /select request handler, will this cause an issue? So far we are not facing any recursive issues. http://94.101.147.150:8080/solr/select/?q=*%3A*&version=2.2&start=0&rows=10&indent=on&shards=localhost:8080/solr/coll1,localhost:8080/so

trouble instantiating CloudSolrServer

2012-11-02 Thread Markus Jelsma
Hi, We use trunk but got SolrJ 4.0 from Maven. Creating an instance of CloudSolrServer fails because its constructor calls a not existing LBServer constructor, it attempts to create an instance by only passing a HttpClient. How is LBHttpSolrServer supposed to work without passing a SolrServer U

how to get solr termVectorComponent results using solrj

2012-11-02 Thread cese
I am trying to write this query; *localhost/solr/tvrh/?q=queryString&version=2.2&indent=on&tv.tf_idf=true* I want to get tf and idf values below; / test20508 0.002304147465437788 0.1 1.0 0.005208 0.0 0.00466200

SolrCloud: general questions

2012-11-02 Thread ku3ia
Hi all! We plan to migrate from Solr 3.5 to SolrCloud 4.0. We pass some tests and I want to conform results with you. So, what I have on tests: Ubuntu 12.04 LTS, Oracle JDK 7u7, Jetty 8, SolrCloud 4.0, 4 shards (4 JVM's on the same machine on different ports [9080, 9081, 9082, 9083]), no replicas

Solr Replication is not Possible on RAMDirectory?

2012-11-02 Thread deniz
Hi all, I am trying to set up a master/slave system, by following this page : http://wiki.apache.org/solr/SolrReplication I was able to set up and did some experiments with that, but when i try to set the index for RAMDirectory, i got errors for indexing. While master and slave are both using a n

Re: solr search issue

2012-11-02 Thread Romita Saha
Hi, I am new to solr. Could you kindly explain a bit about defining free text search. In my database I have two columns. One is id another is data. I want my query to spread across multiple fields. When i search for a parameter from id filed, it searches it in both the fields. However whenever

Re: How to migrate index from 3.6 to 4.0 with solrcloud

2012-11-02 Thread Zeng Lames
thanks all for your prompt response. i think i know what should i do now. thank you so much again. On Fri, Nov 2, 2012 at 2:36 PM, Erick Erickson wrote: > It's not clear whether your index is already sharded or not. But it doesn't > matter because: > 1> if it's not sharded, there's no shard-spli