Re: phrase extraction from user paragraph input

Hi Nokos, Can you quote an example for your usecase, I guess that will be helpful for understanding the problem more clearly. Cheers! On Fri, Nov 28, 2014 at 2:31 PM, Nikos Chaliasos wrote: > Hello, > > I am investigating a university project where in a part of it, the user > would give a para

Re: Inconsistent Behavior of Solr Cloud

k Erickson wrote: > It seems like for some reason you have shards that are not reachable. > What does your cloud stat in the admin UI tell you when you don't get > all the docs back? > > Best, > Erick > > On Fri, Jun 13, 2014 at 1:37 AM, Vineet Mishra > wrote: >

Inconsistent Behavior of Solr Cloud

Hi All, I am having a Cloud setup with 3 Shards and 2 Replica running on 3 Tomcats with 3 External Zookeeper, all running on single machine. I have Indexed around 70 Mln Documents that seems to be querying back fine. When I index another 30 Mln to same, the result are vague as with the query *:* i

Re: solr4 optimization

As Otis mentioned, its obviously good to run Optimization once in a while or when you are done with most of your heavy indexing operation. Its not concern with the Disk Capacity rather with the IO and seeking in segements, When comparably it has less segments to query the IO operation will be less

Re: Collection communication internally

t do this, consider cross-core joins if at all > possible, but I don't think this is supported yet for distributed > setups. > > Best, > Erick > > On Mon, Jun 9, 2014 at 7:32 AM, Vineet Mishra > wrote: > > Hi All, > > > > I was curious to know how

Collection communication internally

Hi All, I was curious to know how multiple Collection communication be achieved? If yes then by what means. The use case says, having multiple collection I need to query the first collection and get the unique ids from first collection to query the second one(Foreign Key Relation). Now if the no.

Re: Solr maximum Optimal Index Size per Shard

: > On Fri, 2014-06-06 at 14:05 +0200, Vineet Mishra wrote: > > > Could you state what indexing mechanism are you using, as I started > > with EmbeddedSolrServer but it was pretty slow after a few GB(~30+) of > > indexing. > > I suspect that is due to too-frequ

Re: Solr maximum Optimal Index Size per Shard

6, 2014 at 5:04 PM, Toke Eskildsen wrote: > On Fri, 2014-06-06 at 12:32 +0200, Vineet Mishra wrote: > > *Does that mean for querying smoothly we need to have memory atleast > equal > > or greater to the size of index? > > If you absolutely, positively have to reduce latency

Re: Solr maximum Optimal Index Size per Shard

hing > you need to know. > > > -- Jack Krupansky > > -Original Message- From: Vineet Mishra > Sent: Wednesday, June 4, 2014 2:45 AM > To: solr-user@lucene.apache.org > Subject: Re: Solr maximum Optimal Index Size per Shard > > > Thanks all for your response. >

Re: Solr maximum Optimal Index Size per Shard

appropriate shard directories. Thanks! On Wed, Jun 4, 2014 at 12:43 PM, Shawn Heisey wrote: > On 6/4/2014 12:45 AM, Vineet Mishra wrote: > > Thanks all for your response. > > I presume this conversation concludes that indexing around 1Billion > > documents per shard won'

Re: Solr maximum Optimal Index Size per Shard

Thanks all for your response. I presume this conversation concludes that indexing around 1Billion documents per shard won't be a problem, as I have 10 Billion docs to index, so approx 10 shards with 1 Billion each should be fine with it and how about Memory, what size of RAM should be fine for this

Solr maximum Optimal Index Size per Shard

Hi All, Has anyone came across the maximum threshold document or size wise for each core of solr to hold. As I have indexed some 10 Million Documents of 18Gb and when I index another 5 (9Gb)Million Documents on top of these indexes it responds little slow with Stats query. Considering I have arou

Re: Offline Indexes Update to Shard

, Jun 2, 2014 at 2:24 PM, Wolfgang Hoschek wrote: > Sounds like you should consider using MapReduceIndexerTool. AFAIK, this is > the most scalable indexing (and merging) solution out there. > > Wolfgang. > > On Jun 2, 2014, at 10:33 AM, Vineet Mishra wrote: > > > Hi Eri

Re: Offline Indexes Update to Shard

ck > > > On Thu, May 29, 2014 at 7:22 AM, Otis Gospodnetic < > otis.gospodne...@gmail.com> wrote: > > > Hi, > > > > On Wed, May 28, 2014 at 4:25 AM, Vineet Mishra > >wrote: > > > > > Hi All, > > > > > > Has anyone tried with b

Re: Offline Indexes Update to Shard

, May 29, 2014 at 7:52 PM, Otis Gospodnetic < otis.gospodne...@gmail.com> wrote: > Hi, > > On Wed, May 28, 2014 at 4:25 AM, Vineet Mishra >wrote: > > > Hi All, > > > > Has anyone tried with building Offline indexes with EmbeddedSolrServer > and > &

Offline Indexes Update to Shard

Hi All, Has anyone tried with building Offline indexes with EmbeddedSolrServer and posting it to Shards. FYI, I am done building the indexes but looking out for a way to post these index files on shards. Copying the indexes manually to each shard's replica is possible and is working fine but I don

Indexing Getting Failed

Hi I have setup default cloud cluster 4.6.0 with inbuilt Zookeeper running on Jetty, as I started with indexing till a few thousand it goes fine but soon after some 5000 documents or so it started giving error(please find below) and stopped the indexing too as the Zookeeper Leader selection was in

Re: Inconsistent response from Cloud Query

Hi Shawn, There is no recovery case for me, neither the commit is pending. The case I am talking about is when I restart the Cloud all over again with index already flushed to disk. Thanks! On Sun, May 11, 2014 at 10:17 PM, Shawn Heisey wrote: > On 5/9/2014 11:42 AM, Cool Techi wrote: > > We

Fwd: Inconsistent response from Cloud Query

Copying. Community: Looking forward for your response. -- Forwarded message -- From: Vineet Mishra Date: Mon, May 12, 2014 at 5:57 PM Subject: Re: Inconsistent response from Cloud Query To: solr-user@lucene.apache.org Hi Shawn, There is no recovery case for me, neither the

Inconsistent response from Cloud Query

Hi All, I have setup cloud-4.6.2 with default configuration on single machine with 2 shards and 2 replication through https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud Cloud was up and running and I indexed the example data xml to it, it went fine. Now when I am quer

Re: Indexing Big Data With or Without Solr

I did it with Tomcat and Zookeeper Ensemble, will mail you the steps shortly. Cheers On Sat, Apr 19, 2014 at 9:09 AM, Aman Tandon wrote: > Vineet please share after you setup for solr cloud > Are you using jetty or tomcat.? > > On Saturday, April 19, 2014, Vineet Mishra wrote

Re: Indexing Big Data With or Without Solr

u can ask it here. > > Thanks; > Furkan KAMACI > > > 2014-04-15 13:20 GMT+03:00 Vineet Mishra : > > > Hi All, > > > > I have worked with Solr 3.5 to implement real time search on some 100GB > > data, that worked fine but was little slow on complex queries(Multip

Indexing Big Data With or Without Solr

Hi All, I have worked with Solr 3.5 to implement real time search on some 100GB data, that worked fine but was little slow on complex queries(Multiple group/joined queries). But now I want to index some real Big Data(around 4 TB or even more), can SolrCloud be solution for it if not what could be

Re: SolrCloud with Tomcat

t; > 2014-03-07 9:44 GMT+02:00 Vineet Mishra : > > > Hi > > > > I am installing SolrCloud with 3 External > > Zookeeper(localhost:2181,localhost:2182,localhost:2183) and 2 > > Tomcats(localhost:8181,localhost:8182) all available on a single > > Mach

SolrCloud with Tomcat

Hi I am installing SolrCloud with 3 External Zookeeper(localhost:2181,localhost:2182,localhost:2183) and 2 Tomcats(localhost:8181,localhost:8182) all available on a single Machine(Just for getting started). By Following these links http://myjeeva.com/solrcloud-cluster-single-collection-deployment

Scalability Limit of SolrCloud

Hi All What is the Scalability Limit of CloudSolr, can it reach to index Billions of Documents and each document containing 400-500 Number Field(probably Float or Double). Is it possible and feasible to go with current CloudSolr Architecture or are there some other alternative or replacement. Reg

Re: Fault Tolerant Technique of Solr Cloud

Steffensen wrote: > On 24/02/14 13:04, Vineet Mishra wrote: > >> Can you brief as how to make a direct call to Zookeeper instead of Cloud >> Collection(as currently I was querying the Cloud something like >> *"http://192.168.2.183:8900/solr/collection1/select?q=*:* >&

Re: Fault Tolerant Technique of Solr Cloud

, Per Steffensen wrote: > On 19/02/14 07:57, Vineet Mishra wrote: > >> Thanks for all your response but my doubt is which *Server:Port* should >> the >> >> query be made as we don't know the crashed server or which server might >> crash in the future(as any se

Re: Fault Tolerant Technique of Solr Cloud

t for distributed search might work if any of the shard or replica goes down. Thanks On Tue, Feb 18, 2014 at 11:22 PM, Shawn Heisey wrote: > On 2/18/2014 8:32 AM, Shawn Heisey wrote: > >> On 2/18/2014 6:05 AM, Vineet Mishra wrote: >> >>> *Shard 1

Fault Tolerant Technique of Solr Cloud

Hi All, I want to have clear idea about the Fault Tolerant Capability of SolrCloud Considering I have setup the SolrCloud with a external Zookeeper, 2 shards, each having a replica with single collection as given in the official Solr Documentation. https://cwiki.apache.org/confluence/display/sol

pool-1-thread-4" java.lang.NoSuchMethodError: org.apache.solr.util.SimplePostTool

pool-1-thread-4" java.lang.NoSuchMethodError: org.apache.solr.util.SimplePostTool I am getting this error while posting Data to Solr from XML generated file. Although the Solr post.jar is present in the Library Class Path and I also tried keeping the Source class of the Post Tool. Urgent Call.

Making a Web Request is failing with 403 Request Forbidden

Hi All, I am making web server call to a website for Shortening the links, that is bit.ly but recieving a 403 Request Forbidden. Although if I use their webpage to short the web link its working good. Can any body tell me what might be the reason for such a vague behavior. Here is the code includ

Post Call to Solr RequestHandler

Hi Currently I am working with RequestHandler in Solr, where the user defined query is processed at the class specified by the requesthandler in Solrconfig.xml. But my requirement is that I want to make it a Post call rather than a Get query call. Is it possible or are there some way we can acco

Re: Unexpected character '<' (code 60) expected '='

Management with Lock. On Thu, Aug 1, 2013 at 1:50 PM, Paul Masurel wrote: > You can check for your xml validity with xmllint very simply. > > xmllint > > Does this return an error? > > > > On Thu, Aug 1, 2013 at 9:59 AM, deniz wrote: > > > Vineet Mishra wrot

Re: Unexpected character '<' (code 60) expected '='

I am using Solr 3.5 with the posting XML file size of just 1Mb. On Wed, Jul 31, 2013 at 8:19 PM, Shawn Heisey wrote: > On 7/31/2013 7:16 AM, Vineet Mishra wrote: > > I checked the File. . .nothing is there. I mean the formatting is > correct, > > its a valid XML file. > &

Re: Unexpected character '<' (code 60) expected '='

I checked the File. . .nothing is there. I mean the formatting is correct, its a valid XML file. On Wed, Jul 31, 2013 at 6:38 PM, Markus Jelsma wrote: > This file is malformed: > > *SEVERE: org.apache.solr.common.SolrException: Unexpected character '<' > (code 60) expected '='* > * at [row,col {

Unexpected character '<' (code 60) expected '='

Hi All I am currently stuck in a Solr Issue while Posting some data to Solr Server. I have some record from Hbase which I am posting to Solr, but after posting some 1 Million of data records, it suddenly stopped. Checking the Catalina log trace it showed, *org.apache.solr.common.SolrException: U

Re: SimplePostTool: FATAL: Solr returned an error #400 Bad Request

commit explicitly. > > Does the same document fail every time? What does > it look like? > > You really haven't provided much information > to go on. > > Best > Erick > > On Wed, Jul 31, 2013 at 3:55 AM, Vineet Mishra > wrote: > > Hi All > > >

SimplePostTool: FATAL: Solr returned an error #400 Bad Request

Hi All Currently I am in a mid of a project which Index some data to Solrs multiple instance. I have the Configuration as, on the same machine I have made multiple instances of Solr http://localhost:8080/solr1 http://localhost:8080/solr2 http://localhost:8080/solr3 http://localhost:8080/solr4 ht

Group and performing statistics on groups

Hi This is a urgent call, I am grouping the solr documents by a field name and want to get the Range(Min and Max) value for another field in that group. StatsComponent works fine on all the document as whole rendering the max and min of a field, is it possible to get the StatsComponent per group

Sorting the Solr Document after clubbing them from multiple instances

Hi I have a Master Solr through which I am querying to multiple solr instance and aggregating their response and responding back to the user. Now the requirement is that when I get the data querying multiple solr instance, I want it to be sorted based on some field name. Say I have 3 Slave Solrs

Re: Custom RequestHandlerBase XML Response Issue

ent?) which it doesn't know how to serialize so it just > calls .toString on it and writes it out. > > As long as you stick a known type into the SolrQueryResponse, you should be > fine. > > > On Thu, Jul 18, 2013 at 6:24 PM, Vineet Mishra >wrote: > > > So does

Re: Custom RequestHandlerBase XML Response Issue

So does that mean there is no way that we can write a XML or JSON object to the SolrQueryResponse and expect it to be formatted?

Re: Custom RequestHandlerBase XML Response Issue

.org/repos/asf/lucene/dev/trunk/solr/core/src/java/org/apache/solr/response/TextResponseWriter.java > > > On Thu, Jul 18, 2013 at 4:08 PM, Vineet Mishra >wrote: > > > Thanks for your response Shalin, > > so does that mean that we can't return a XML object in SolrQuer

Re: Custom RequestHandlerBase XML Response Issue

list? > > > On Thu, Jul 18, 2013 at 3:31 PM, Vineet Mishra >wrote: > > > Hi all > > > > I am using a Custom RequestHandlerBase where I am querying from multiple > > different Solr instance and aggregating their output as a XML Document > > using

Custom RequestHandlerBase XML Response Issue

Hi all I am using a Custom RequestHandlerBase where I am querying from multiple different Solr instance and aggregating their output as a XML Document using DOM, now in the RequestHandler's function handleRequestBody(SolrQueryRequest req, SolrQueryResponse resp) I want to output this XML Document