from:"Sathya"

Solr4.7 No live SolrServers available to handle this request

2014-03-19 Thread Sathya

Hi Friends,

I am new to Solr. I have 5 solr node in 5 different machine. When i index
the data, sometimes "*No live SolrServers available to handle this request*"
exception occur in 1 or 2 machines. 

I dont know why its happen and how to solve this. Kindly help me to solve
this issue.



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr4-7-No-live-SolrServers-available-to-handle-this-request-tp4125679.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr4.7 No live SolrServers available to handle this request

2014-03-23 Thread Sathya

Hi Greg,

Where i can find the clusterstate.json.? i have ensemble zookeeper. Can you
please tell me that where i can find it. 

Thanks.



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr4-7-No-live-SolrServers-available-to-handle-this-request-tp4125679p4126452.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr4.7 No live SolrServers available to handle this request

2014-03-24 Thread Sathya

Hi Greg,

This is my Clusterstate.json.

WatchedEvent state:SyncConnected type:None path:null
[zk: 10.10.1.72:2185(CONNECTED) 0] get /clusterstate.json
{"set_recent":{
"shards":{
  "shard1":{
"range":"8000-d554",
"state":"active",
"replicas":{
  "10.10.1.16:4040_solr_set_recent_shard1_replica1":{
"state":"active",
"base_url":"http://10.10.1.16:4040/solr";,
"core":"set_recent_shard1_replica1",
"node_name":"10.10.1.16:4040_solr"},
  "10.10.1.72:2020_solr_set_recent_shard1_replica2":{
"state":"active",
"base_url":"http://10.10.1.72:2020/solr";,
"core":"set_recent_shard1_replica2",
"node_name":"10.10.1.72:2020_solr"},
  "10.10.1.19:3030_solr_set_recent_shard1_replica3":{
"state":"active",
"base_url":"http://10.10.1.19:3030/solr";,
"core":"set_recent_shard1_replica3",
"node_name":"10.10.1.19:3030_solr",
"leader":"true"},
  "10.10.1.21:1010_solr_set_recent_shard1_replica4":{
"state":"active",
"base_url":"http://10.10.1.21:1010/solr";,
"core":"set_recent_shard1_replica4",
"node_name":"10.10.1.21:1010_solr"},
  "10.10.1.14:5050_solr_set_recent_shard1_replica5":{
"state":"active",
"base_url":"http://10.10.1.14:5050/solr";,
"core":"set_recent_shard1_replica5",
"node_name":"10.10.1.14:5050_solr"}}},
  "shard2":{
"range":"d555-2aa9",
"state":"active",
"replicas":{
  "10.10.1.16:4040_solr_set_recent_shard2_replica1":{
"state":"active",
"base_url":"http://10.10.1.16:4040/solr";,
"core":"set_recent_shard2_replica1",
"node_name":"10.10.1.16:4040_solr"},
  "10.10.1.72:2020_solr_set_recent_shard2_replica2":{
"state":"active",
"base_url":"http://10.10.1.72:2020/solr";,
"core":"set_recent_shard2_replica2",
"node_name":"10.10.1.72:2020_solr"},
  "10.10.1.19:3030_solr_set_recent_shard2_replica3":{
"state":"active",
"base_url":"http://10.10.1.19:3030/solr";,
"core":"set_recent_shard2_replica3",
"node_name":"10.10.1.19:3030_solr",
"leader":"true"},
  "10.10.1.21:1010_solr_set_recent_shard2_replica4":{
"state":"active",
"base_url":"http://10.10.1.21:1010/solr";,
"core":"set_recent_shard2_replica4",
"node_name":"10.10.1.21:1010_solr"},
  "10.10.1.14:5050_solr_set_recent_shard2_replica5":{
"state":"active",
"base_url":"http://10.10.1.14:5050/solr";,
"core":"set_recent_shard2_replica5",
"node_name":"10.10.1.14:5050_solr"}}},
  "shard3":{
"range":"2aaa-7fff",
"state":"active",
"replicas":{
  "10.10.1.16:4040_solr_set_recent_shard3_replica1":{
"state":"active",
"base_url":"http://10.10.1.16:4040/solr";,
"core":"set_recent_shard3_replica1",
"node_name":"10.10.1.16:4040_solr"},
  "10.10.1.72:2020_solr_set_recent_shard3_replica2":{
"state":"active",
"base_url":"http://10.10.1.72:2020/solr";,
"core":"set_recent_shard3_replica2",
"node_name":"10.10.1.72:2020_solr"},
  "10.10.1.19:3030_solr_set_recent_shard3_replica3":{
"state":"active",
"base_url":"http://10.10.1.19:3030/solr";,
"core":"set_recent_shard3_replica3",
"node_name":"10.10.1.19:3030_solr",
"leader":"true"},
  "10.10.1.21:1010_solr_set_recent_shard3_replica4":{
"state":"active",
"base_url":"http://10.10.1.21:1010/solr";,
"core":"set_recent_shard3_replica4",
"node_name":"10.10.1.21:1010_solr"},
  "10.10.1.14:5050_solr_set_recent_shard3_replica5":{
"state":"active",
"base_url":"http://10.10.1.14:5050/solr";,
"core":"set_recent_shard3_replica5",
"node_name":"10.10.1.14:5050_solr",
"maxShardsPerNode":"3",
"router":{"name":"compositeId"},
"replicationFactor":"5"}}
cZxid = 0x10014
ctime = Tue Mar 18 13:05:38 IST 2014
mZxid = 0x5027c
mtime = Mon Mar 24 14:22:24 IST 2014
pZxid = 0x10014
cversion = 0
dataVersion = 387
aclVersion = 0
ephemeralOwner = 0x0
dataLength = 4182
numChildren = 0


Kindly let me know for further inputs..



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr4-7-No-live-SolrServers-available-to-handle-this-request-tp4125679p4126478.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr4.7 No live SolrServers available to handle this request

2014-03-24 Thread Sathya

Hi Greg,

This is my Clusterstate.json.

WatchedEvent state:SyncConnected type:None path:null
[zk: 10.10.1.72:2185(CONNECTED) 0] get /clusterstate.json
{"set_recent":{
"shards":{
  "shard1":{
"range":"8000-d554",
"state":"active",
"replicas":{
  "10.10.1.16:4040_solr_set_recent_shard1_replica1":{
"state":"active",
"base_url":"http://10.10.1.16:4040/solr";,
"core":"set_recent_shard1_replica1",
"node_name":"10.10.1.16:4040_solr"},
  "10.10.1.72:2020_solr_set_recent_shard1_replica2":{
"state":"active",
"base_url":"http://10.10.1.72:2020/solr";,
"core":"set_recent_shard1_replica2",
"node_name":"10.10.1.72:2020_solr"},
  "10.10.1.19:3030_solr_set_recent_shard1_replica3":{
"state":"active",
"base_url":"http://10.10.1.19:3030/solr";,
"core":"set_recent_shard1_replica3",
"node_name":"10.10.1.19:3030_solr",
"leader":"true"},
  "10.10.1.21:1010_solr_set_recent_shard1_replica4":{
"state":"active",
"base_url":"http://10.10.1.21:1010/solr";,
"core":"set_recent_shard1_replica4",
"node_name":"10.10.1.21:1010_solr"},
  "10.10.1.14:5050_solr_set_recent_shard1_replica5":{
"state":"active",
"base_url":"http://10.10.1.14:5050/solr";,
"core":"set_recent_shard1_replica5",
"node_name":"10.10.1.14:5050_solr"}}},
  "shard2":{
"range":"d555-2aa9",
"state":"active",
"replicas":{
  "10.10.1.16:4040_solr_set_recent_shard2_replica1":{
"state":"active",
"base_url":"http://10.10.1.16:4040/solr";,
"core":"set_recent_shard2_replica1",
"node_name":"10.10.1.16:4040_solr"},
  "10.10.1.72:2020_solr_set_recent_shard2_replica2":{
"state":"active",
"base_url":"http://10.10.1.72:2020/solr";,
"core":"set_recent_shard2_replica2",
"node_name":"10.10.1.72:2020_solr"},
  "10.10.1.19:3030_solr_set_recent_shard2_replica3":{
"state":"active",
"base_url":"http://10.10.1.19:3030/solr";,
"core":"set_recent_shard2_replica3",
"node_name":"10.10.1.19:3030_solr",
"leader":"true"},
  "10.10.1.21:1010_solr_set_recent_shard2_replica4":{
"state":"active",
"base_url":"http://10.10.1.21:1010/solr";,
"core":"set_recent_shard2_replica4",
"node_name":"10.10.1.21:1010_solr"},
  "10.10.1.14:5050_solr_set_recent_shard2_replica5":{
"state":"active",
"base_url":"http://10.10.1.14:5050/solr";,
"core":"set_recent_shard2_replica5",
"node_name":"10.10.1.14:5050_solr"}}},
  "shard3":{
"range":"2aaa-7fff",
"state":"active",
"replicas":{
  "10.10.1.16:4040_solr_set_recent_shard3_replica1":{
"state":"active",
"base_url":"http://10.10.1.16:4040/solr";,
"core":"set_recent_shard3_replica1",
"node_name":"10.10.1.16:4040_solr"},
  "10.10.1.72:2020_solr_set_recent_shard3_replica2":{
"state":"active",
"base_url":"http://10.10.1.72:2020/solr";,
"core":"set_recent_shard3_replica2",
"node_name":"10.10.1.72:2020_solr"},
  "10.10.1.19:3030_solr_set_recent_shard3_replica3":{
"state":"active",
"base_url":"http://10.10.1.19:3030/solr";,
"core":"set_recent_shard3_replica3",
"node_name":"10.10.1.19:3030_solr",
"leader":"true"},
  "10.10.1.21:1010_solr_set_recent_shard3_replica4":{
"state":"active",
"base_url":"http://10.10.1.21:1010/solr";,
"core":"set_recent_shard3_replica4",
"node_name":"10.10.1.21:1010_solr"},
  "10.10.1.14:5050_solr_set_recent_shard3_replica5":{
"state":"active",
"base_url":"http://10.10.1.14:5050/solr";,
"core":"set_recent_shard3_replica5",
"node_name":"10.10.1.14:5050_solr",
"maxShardsPerNode":"3",
"router":{"name":"compositeId"},
"replicationFactor":"5"}}
cZxid = 0x10014
ctime = Tue Mar 18 13:05:38 IST 2014
mZxid = 0x5027c
mtime = Mon Mar 24 14:22:24 IST 2014
pZxid = 0x10014
cversion = 0
dataVersion = 387
aclVersion = 0
ephemeralOwner = 0x0
dataLength = 4182
numChildren = 0


Kindly let me know for further inputs..



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr4-7-No-live-SolrServers-available-to-handle-this-request-tp4125679p4126479.html
Sent from the Solr - User mailing list archive at Nabble.com.

Solr Cloud Shows the server is down

2014-03-26 Thread Sathya

Hi Friends,

This is sathya. I am new to SolrCloud. I setup a Solrcloud in 5 different
machines. And i indexed the data nearly 5 crores. When i restart the tomcat,
its took more time to start(nearly 20 to 30 min). After starting tomcat, my
solrcloud graph shows the server is down. I dont know why. See the image
below. 

<http://lucene.472066.n3.nabble.com/file/n4127130/Screenshot.png> 



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-Cloud-Shows-the-server-is-down-tp4127130.html
Sent from the Solr - User mailing list archive at Nabble.com.

How to reduce the search speed of solrcloud

2014-04-04 Thread Sathya

Hi All,

Hi All, I am new to Solr. And i dont know how to increase the search speed
of solrcloud. I have indexed nearly 4 GB of data. When i am searching a
document using java with solrj, solr takes more 6 seconds to return a query
result. Any one please help me to reduce the search query time to less than
500 ms. i have allocate the 4 GB ram for solr. Please let me know for
further details about solrcloud config.



--
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-reduce-the-search-speed-of-solrcloud-tp4129067.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: How to reduce the search speed of solrcloud

2014-04-04 Thread Sathya

Hi Alex,

33026985 Component Audio\:A
Shopping List 2012-01-11
09:02:42.96

This is what i am  indexed in solr. I have only 3 fields in index. And
i am just indexing id, subject and date of the news articles. Nearly 5
crore documents. Also i have attached my solrconfig and solr.xml file.
If u need more information, pls let me know.

On Fri, Apr 4, 2014 at 1:15 PM, Alexandre Rafalovitch [via Lucene]
 wrote:
>
> Show a sample query string that does that (takes 6 seconds to return).
> Including all defaults you may have put in solrconfig.xml (if any).
> That might give us a hint which features you are using and what
> possible direction you could go in next. For the bonus points, enable
> debug flag and rows=1 parameter to see how big your documents
> themselves are.
>
> You may have issues with a particular non-cloud-friendly feature, with
> caches, with not reusing parts of your queries as 'fq', returning too
> many fields or a bunch of other things.
>
> Regards,
>Alex.
> Personal website: http://www.outerthoughts.com/
> Current project: http://www.solr-start.com/ - Accelerating your Solr 
> proficiency
>
>
> On Fri, Apr 4, 2014 at 2:31 PM, Sathya <[hidden email]> wrote:
>
> > Hi All,
> >
> > Hi All, I am new to Solr. And i dont know how to increase the search speed
> > of solrcloud. I have indexed nearly 4 GB of data. When i am searching a
> > document using java with solrj, solr takes more 6 seconds to return a query
> > result. Any one please help me to reduce the search query time to less than
> > 500 ms. i have allocate the 4 GB ram for solr. Please let me know for
> > further details about solrcloud config.
> >
> >
> >
> > --
> > View this message in context: 
> > http://lucene.472066.n3.nabble.com/How-to-reduce-the-search-speed-of-solrcloud-tp4129067.html
> > Sent from the Solr - User mailing list archive at Nabble.com.
>
>
> 
> If you reply to this email, your message will be added to the discussion 
> below:
> http://lucene.472066.n3.nabble.com/How-to-reduce-the-search-speed-of-solrcloud-tp4129067p4129068.html
> To unsubscribe from How to reduce the search speed of solrcloud, click here.
> NAML


solrconfig.xml (101K) 
<http://lucene.472066.n3.nabble.com/attachment/4129073/0/solrconfig.xml>
solr.xml (1K) <http://lucene.472066.n3.nabble.com/attachment/4129073/1/solr.xml>




--
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-reduce-the-search-speed-of-solrcloud-tp4129067p4129073.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: How to reduce the search speed of solrcloud

2014-04-04 Thread Sathya

Hi,

I have attached my schema.xml file too.

And you are right. I have 50 million documents. When i use solr
browser to search a document, it will return within 1000 to 2000 ms.

My query looks like this:
http://10.10.1.14:5050/solr/set_recent_shard1_replica5/select?q=subject&indent=true

On 4/4/14, Alexandre Rafalovitch [via Lucene]
 wrote:
>
>
> What does your Solr query looks like (check the Solr backend log if
> you don't know)?
>
> And how many document is that? 50 million? Does not sound like much
> for 3 fields. And what's the definitions (schema.xml rather than
> solr.xml).
>
> And what happens if you issue the query directly to Solr rather than
> through the client? Is the speed much different?
>
> Regards,
>Alex.
>
> Personal website: http://www.outerthoughts.com/
> Current project: http://www.solr-start.com/ - Accelerating your Solr
> proficiency
>
>
> On Fri, Apr 4, 2014 at 3:12 PM, Sathya  wrote:
>> Hi Alex,
>>
>> 33026985 Component Audio\:A
>> Shopping List 2012-01-11
>> 09:02:42.96
>>
>> This is what i am  indexed in solr. I have only 3 fields in index. And
>> i am just indexing id, subject and date of the news articles. Nearly 5
>> crore documents. Also i have attached my solrconfig and solr.xml file.
>> If u need more information, pls let me know.
>>
>> On Fri, Apr 4, 2014 at 1:15 PM, Alexandre Rafalovitch [via Lucene]
>>  wrote:
>>>
>>> Show a sample query string that does that (takes 6 seconds to return).
>>> Including all defaults you may have put in solrconfig.xml (if any).
>>> That might give us a hint which features you are using and what
>>> possible direction you could go in next. For the bonus points, enable
>>> debug flag and rows=1 parameter to see how big your documents
>>> themselves are.
>>>
>>> You may have issues with a particular non-cloud-friendly feature, with
>>> caches, with not reusing parts of your queries as 'fq', returning too
>>> many fields or a bunch of other things.
>>>
>>> Regards,
>>>Alex.
>>> Personal website: http://www.outerthoughts.com/
>>> Current project: http://www.solr-start.com/ - Accelerating your Solr
>>> proficiency
>>>
>>>
>>> On Fri, Apr 4, 2014 at 2:31 PM, Sathya <[hidden email]> wrote:
>>>
>>> > Hi All,
>>> >
>>> > Hi All, I am new to Solr. And i dont know how to increase the search
>>> > speed
>>> > of solrcloud. I have indexed nearly 4 GB of data. When i am searching
>>> > a
>>> > document using java with solrj, solr takes more 6 seconds to return a
>>> > query
>>> > result. Any one please help me to reduce the search query time to less
>>> > than
>>> > 500 ms. i have allocate the 4 GB ram for solr. Please let me know for
>>> > further details about solrcloud config.
>>> >
>>> >
>>> >
>>> > --
>>> > View this message in context:
>>> > http://lucene.472066.n3.nabble.com/How-to-reduce-the-search-speed-of-solrcloud-tp4129067.html
>>> > Sent from the Solr - User mailing list archive at Nabble.com.
>>>
>>>
>>> 
>>> If you reply to this email, your message will be added to the discussion
>>> below:
>>> http://lucene.472066.n3.nabble.com/How-to-reduce-the-search-speed-of-solrcloud-tp4129067p4129068.html
>>> To unsubscribe from How to reduce the search speed of solrcloud, click
>>> here.
>>> NAML
>>
>>
>> solrconfig.xml (101K)
>> <http://lucene.472066.n3.nabble.com/attachment/4129073/0/solrconfig.xml>
>> solr.xml (1K)
>> <http://lucene.472066.n3.nabble.com/attachment/4129073/1/solr.xml>
>>
>>
>>
>>
>> --
>> View this message in context:
>> http://lucene.472066.n3.nabble.com/How-to-reduce-the-search-speed-of-solrcloud-tp4129067p4129073.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
>
>
> ___
> If you reply to this email, your message will be added to the discussion
> below:
> http://lucene.472066.n3.nabble.com/How-to-reduce-the-search-speed-of-solrcloud-tp4129067p4129074.html
>
> To unsubscribe from How to reduce the search speed of solrcloud, visit
> http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4129067&code=c2F0aGlhLmJsYWNrc3RhckBnbWFpbC5jb218NDEyOTA2N3wtMjEyNDcwMTI5OA==


schema.xml (81K) 
<http://lucene.472066.n3.nabble.com/attachment/4129075/0/schema.xml>




--
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-reduce-the-search-speed-of-solrcloud-tp4129067p4129075.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: How to reduce the search speed of solrcloud

2014-04-04 Thread Sathya

Hi,

Sorry, i cant get u alex. Can you please explain me(if you can).  Because
now only i entered into solr.


On Fri, Apr 4, 2014 at 2:20 PM, Alexandre Rafalovitch [via Lucene] <
ml-node+s472066n4129077...@n3.nabble.com> wrote:

> Well, if the direct browser query is 1000ms and your client query is
> 6seconds, then it is not Solr itself you need to worry about first.
> Something must be wrong at the client. Trying timing that bit. Maybe
> it is writing from the client to your ultimate consumer that's the
> problem.
>
> Regards,
>Alex.
> P.s. You should probably trim your schema to get rid of all the
> example fields. Keep _version_ and _root_ but delete all the rest you
> don't actually use. Same with dynamic fields and all fieldType
> definitions you do not actually use. You can always reintroduce them
> later from the example schemas if something is missing.
>
> Personal website: http://www.outerthoughts.com/
> Current project: http://www.solr-start.com/ - Accelerating your Solr
> proficiency
>
>
> On Fri, Apr 4, 2014 at 3:41 PM, Sathya <[hidden 
> email]<http://user/SendEmail.jtp?type=node&node=4129077&i=0>>
> wrote:
>
> > Hi,
> >
> > I have attached my schema.xml file too.
> >
> > And you are right. I have 50 million documents. When i use solr
> > browser to search a document, it will return within 1000 to 2000 ms.
> >
> > My query looks like this:
> >
> http://10.10.1.14:5050/solr/set_recent_shard1_replica5/select?q=subject&indent=true
> >
> > On 4/4/14, Alexandre Rafalovitch [via Lucene]
> > <[hidden email] <http://user/SendEmail.jtp?type=node&node=4129077&i=1>>
> wrote:
> >>
> >>
> >> What does your Solr query looks like (check the Solr backend log if
> >> you don't know)?
> >>
> >> And how many document is that? 50 million? Does not sound like much
> >> for 3 fields. And what's the definitions (schema.xml rather than
> >> solr.xml).
> >>
> >> And what happens if you issue the query directly to Solr rather than
> >> through the client? Is the speed much different?
> >>
> >> Regards,
> >>Alex.
> >>
> >> Personal website: http://www.outerthoughts.com/
> >> Current project: http://www.solr-start.com/ - Accelerating your Solr
> >> proficiency
> >>
> >>
> >> On Fri, Apr 4, 2014 at 3:12 PM, Sathya <[hidden 
> >> email]<http://user/SendEmail.jtp?type=node&node=4129077&i=2>>
> wrote:
> >>> Hi Alex,
> >>>
> >>> 33026985 Component Audio\:A
> >>> Shopping List 2012-01-11
> >>> 09:02:42.96
> >>>
> >>> This is what i am  indexed in solr. I have only 3 fields in index. And
> >>> i am just indexing id, subject and date of the news articles. Nearly 5
> >>> crore documents. Also i have attached my solrconfig and solr.xml file.
> >>> If u need more information, pls let me know.
> >>>
> >>> On Fri, Apr 4, 2014 at 1:15 PM, Alexandre Rafalovitch [via Lucene]
> >>> <[hidden email] <http://user/SendEmail.jtp?type=node&node=4129077&i=3>>
> wrote:
> >>>>
> >>>> Show a sample query string that does that (takes 6 seconds to
> return).
> >>>> Including all defaults you may have put in solrconfig.xml (if any).
> >>>> That might give us a hint which features you are using and what
> >>>> possible direction you could go in next. For the bonus points, enable
> >>>> debug flag and rows=1 parameter to see how big your documents
> >>>> themselves are.
> >>>>
> >>>> You may have issues with a particular non-cloud-friendly feature,
> with
> >>>> caches, with not reusing parts of your queries as 'fq', returning too
> >>>> many fields or a bunch of other things.
> >>>>
> >>>> Regards,
> >>>>Alex.
> >>>> Personal website: http://www.outerthoughts.com/
> >>>> Current project: http://www.solr-start.com/ - Accelerating your Solr
> >>>> proficiency
> >>>>
> >>>>
> >>>> On Fri, Apr 4, 2014 at 2:31 PM, Sathya <[hidden email]> wrote:
> >>>>
> >>>> > Hi All,
> >>>> >
> >>>> > Hi All, I am new to Solr. And i dont know how to increase the
> search
> >>>> > speed
> >>>> > of solrcloud. I have indexed nea

Re: How to reduce the search speed of solrcloud

2014-04-04 Thread Sathya

Hi shawn,

I have indexed 50 million data in 5 servers. 3 servers have 8gb ram. One
have 24gb and another one have 64gb ram. I was allocate 4 gb ram to solr in
each machine. I am using solrcloud. My total index size is 50gb including 5
servers. Each server have 3 zookeepers. Still I didnt check about OS disk
cache and heap memory. I will check and let u know shawn. If anything, pls
let me know.

Thank u shawn.

On Friday, April 4, 2014, Shawn Heisey-4 [via Lucene] <
ml-node+s472066n4129150...@n3.nabble.com> wrote:
> On 4/4/2014 1:31 AM, Sathya wrote:
>> Hi All,
>>
>> Hi All, I am new to Solr. And i dont know how to increase the search
speed
>> of solrcloud. I have indexed nearly 4 GB of data. When i am searching a
>> document using java with solrj, solr takes more 6 seconds to return a
query
>> result. Any one please help me to reduce the search query time to less
than
>> 500 ms. i have allocate the 4 GB ram for solr. Please let me know for
>> further details about solrcloud config.
>
> How much total RAM do you have on the system, and how much total index
> data is on that system (adding up all the Solr cores)?  You've already
> said that you have allocated 4GB of RAM for Solr.
>
> Later you said you had 50 million documents, and then you showed us a
> URL that looks like SolrCloud.
>
> I suspect that you don't have enough RAM left over to cache your index
> effectively -- the OS Disk Cache is too small.
>
> http://wiki.apache.org/solr/SolrPerformanceProblems
>
> Another possible problem, also discussed on that page, is that your Java
> heap is too small.
>
> Thanks,
> Shawn
>
>
>
> 
> If you reply to this email, your message will be added to the discussion
below:
>
http://lucene.472066.n3.nabble.com/How-to-reduce-the-search-speed-of-solrcloud-tp4129067p4129150.html
> To unsubscribe from How to reduce the search speed of solrcloud, click
here.
> NAML




--
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-reduce-the-search-speed-of-solrcloud-tp4129067p4129173.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: How to reduce the search speed of solrcloud

2014-04-06 Thread Sathya

Hi,

I use this link to setup a solrcloud
http://myjeeva.com/solrcloud-cluster-single-collection-deployment.html And
i use 5 different machine to setup this cloud. I use Unique id.


On Sat, Apr 5, 2014 at 6:30 AM, Alexandre Rafalovitch [via Lucene] <
ml-node+s472066n4129333...@n3.nabble.com> wrote:

> And 50 million records of 3 fields each should not become 50Gb of
> data. Something smells wrong there. Do you have unique IDs setup?
>
> Regards,
>Alex.
> Personal website: http://www.outerthoughts.com/
> Current project: http://www.solr-start.com/ - Accelerating your Solr
> proficiency
>
>
> On Sat, Apr 5, 2014 at 12:48 AM, Anshum Gupta <[hidden 
> email]<http://user/SendEmail.jtp?type=node&node=4129333&i=0>>
> wrote:
>
> > I am not sure if you setup your SolrCloud right. Can you also provide me
> > with the version of Solr that you're running.
> > Also, if you could tell me about how did you setup your SolrCloud
> cluster.
> > Are the times consistent? Is this the only collection on the cluster?
> >
> > Also, if I am getting it right, you have 15 ZKs running. Correct me if
> I'm
> > wrong, but if I'm not, you don't need that kind of a zk setup.
> >
> >
> > On Fri, Apr 4, 2014 at 9:39 AM, Sathya <[hidden 
> > email]<http://user/SendEmail.jtp?type=node&node=4129333&i=1>>
> wrote:
> >
> >> Hi shawn,
> >>
> >> I have indexed 50 million data in 5 servers. 3 servers have 8gb ram.
> One
> >> have 24gb and another one have 64gb ram. I was allocate 4 gb ram to
> solr in
> >> each machine. I am using solrcloud. My total index size is 50gb
> including 5
> >> servers. Each server have 3 zookeepers. Still I didnt check about OS
> disk
> >> cache and heap memory. I will check and let u know shawn. If anything,
> pls
> >> let me know.
> >>
> >> Thank u shawn.
> >>
> >> On Friday, April 4, 2014, Shawn Heisey-4 [via Lucene] <
> >> [hidden email] <http://user/SendEmail.jtp?type=node&node=4129333&i=2>>
> wrote:
> >> > On 4/4/2014 1:31 AM, Sathya wrote:
> >> >> Hi All,
> >> >>
> >> >> Hi All, I am new to Solr. And i dont know how to increase the search
> >> speed
> >> >> of solrcloud. I have indexed nearly 4 GB of data. When i am
> searching a
> >> >> document using java with solrj, solr takes more 6 seconds to return
> a
> >> query
> >> >> result. Any one please help me to reduce the search query time to
> less
> >> than
> >> >> 500 ms. i have allocate the 4 GB ram for solr. Please let me know
> for
> >> >> further details about solrcloud config.
> >> >
> >> > How much total RAM do you have on the system, and how much total
> index
> >> > data is on that system (adding up all the Solr cores)?  You've
> already
> >> > said that you have allocated 4GB of RAM for Solr.
> >> >
> >> > Later you said you had 50 million documents, and then you showed us a
> >> > URL that looks like SolrCloud.
> >> >
> >> > I suspect that you don't have enough RAM left over to cache your
> index
> >> > effectively -- the OS Disk Cache is too small.
> >> >
> >> > http://wiki.apache.org/solr/SolrPerformanceProblems
> >> >
> >> > Another possible problem, also discussed on that page, is that your
> Java
> >> > heap is too small.
> >> >
> >> > Thanks,
> >> > Shawn
> >> >
> >> >
> >> >
> >> > 
> >> > If you reply to this email, your message will be added to the
> discussion
> >> below:
> >> >
> >>
> >>
> http://lucene.472066.n3.nabble.com/How-to-reduce-the-search-speed-of-solrcloud-tp4129067p4129150.html
> >> > To unsubscribe from How to reduce the search speed of solrcloud,
> click
> >> here.
> >> > NAML
> >>
> >>
> >>
> >>
> >> --
> >> View this message in context:
> >>
> http://lucene.472066.n3.nabble.com/How-to-reduce-the-search-speed-of-solrcloud-tp4129067p4129173.html
> >> Sent from the Solr - User mailing list archive at Nabble.com.
> >>
> >
> >
> >
> > --
> >
> > Anshum Gupta
> > http://www.anshumgupta.net
>
>
> --
>  If you reply to this email, your message will be added to the discussion
> below:
>
> http://lucene.472066.n3.nabble.com/How-to-reduce-the-search-speed-of-solrcloud-tp4129067p4129333.html
>  To unsubscribe from How to reduce the search speed of solrcloud, click
> here<http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4129067&code=c2F0aGlhLmJsYWNrc3RhckBnbWFpbC5jb218NDEyOTA2N3wtMjEyNDcwMTI5OA==>
> .
> NAML<http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>




--
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-reduce-the-search-speed-of-solrcloud-tp4129067p4129564.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: How to reduce the search speed of solrcloud

2014-04-08 Thread Sathya

Hi Anshum,

I am using Solr 4.7. And i follow this
tutorial<http://myjeeva.com/solrcloud-cluster-single-collection-deployment.html>to
setup a solrcloud. I have only one collection in my solr. Kindly let
me,
if u need more details.


On Fri, Apr 4, 2014 at 11:19 PM, Anshum Gupta [via Lucene] <
ml-node+s472066n4129190...@n3.nabble.com> wrote:

> I am not sure if you setup your SolrCloud right. Can you also provide me
> with the version of Solr that you're running.
> Also, if you could tell me about how did you setup your SolrCloud cluster.
> Are the times consistent? Is this the only collection on the cluster?
>
> Also, if I am getting it right, you have 15 ZKs running. Correct me if I'm
> wrong, but if I'm not, you don't need that kind of a zk setup.
>
>
> On Fri, Apr 4, 2014 at 9:39 AM, Sathya <[hidden 
> email]<http://user/SendEmail.jtp?type=node&node=4129190&i=0>>
> wrote:
>
> > Hi shawn,
> >
> > I have indexed 50 million data in 5 servers. 3 servers have 8gb ram. One
> > have 24gb and another one have 64gb ram. I was allocate 4 gb ram to solr
> in
> > each machine. I am using solrcloud. My total index size is 50gb
> including 5
> > servers. Each server have 3 zookeepers. Still I didnt check about OS
> disk
> > cache and heap memory. I will check and let u know shawn. If anything,
> pls
> > let me know.
> >
> > Thank u shawn.
> >
> > On Friday, April 4, 2014, Shawn Heisey-4 [via Lucene] <
> > [hidden email] <http://user/SendEmail.jtp?type=node&node=4129190&i=1>>
> wrote:
> > > On 4/4/2014 1:31 AM, Sathya wrote:
> > >> Hi All,
> > >>
> > >> Hi All, I am new to Solr. And i dont know how to increase the search
> > speed
> > >> of solrcloud. I have indexed nearly 4 GB of data. When i am searching
> a
> > >> document using java with solrj, solr takes more 6 seconds to return a
> > query
> > >> result. Any one please help me to reduce the search query time to
> less
> > than
> > >> 500 ms. i have allocate the 4 GB ram for solr. Please let me know for
> > >> further details about solrcloud config.
> > >
> > > How much total RAM do you have on the system, and how much total index
> > > data is on that system (adding up all the Solr cores)?  You've already
> > > said that you have allocated 4GB of RAM for Solr.
> > >
> > > Later you said you had 50 million documents, and then you showed us a
> > > URL that looks like SolrCloud.
> > >
> > > I suspect that you don't have enough RAM left over to cache your index
> > > effectively -- the OS Disk Cache is too small.
> > >
> > > http://wiki.apache.org/solr/SolrPerformanceProblems
> > >
> > > Another possible problem, also discussed on that page, is that your
> Java
> > > heap is too small.
> > >
> > > Thanks,
> > > Shawn
> > >
> > >
> > >
> > > 
> > > If you reply to this email, your message will be added to the
> discussion
> > below:
> > >
> >
> >
> http://lucene.472066.n3.nabble.com/How-to-reduce-the-search-speed-of-solrcloud-tp4129067p4129150.html
> > > To unsubscribe from How to reduce the search speed of solrcloud, click
> > here.
> > > NAML
> >
> >
> >
> >
> > --
> > View this message in context:
> >
> http://lucene.472066.n3.nabble.com/How-to-reduce-the-search-speed-of-solrcloud-tp4129067p4129173.html
>
> > Sent from the Solr - User mailing list archive at Nabble.com.
> >
>
>
>
> --
>
> Anshum Gupta
> http://www.anshumgupta.net
>
>
> --
>  If you reply to this email, your message will be added to the discussion
> below:
>
> http://lucene.472066.n3.nabble.com/How-to-reduce-the-search-speed-of-solrcloud-tp4129067p4129190.html
>  To unsubscribe from How to reduce the search speed of solrcloud, click
> here<http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4129067&code=c2F0aGlhLmJsYWNrc3RhckBnbWFpbC5jb218NDEyOTA2N3wtMjEyNDcwMTI5OA==>
> .
> NAML<http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>




--
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-reduce-the-search-speed-of-solrcloud-tp4129067p4129910.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: How to reduce the search speed of solrcloud

2014-04-08 Thread Sathya

Hi All,

I found that which is taking more time. It is *server.query*

 SolrDataDAO dataDao = new SolrDataDAO();
QueryResponse resp = dataDao.queryData(0, 1, subject);
SolrDocumentList data = resp.getResults();
System.out.println("len " + data.size());
System.out.println();

Subject is passed to here:

public QueryResponse queryData(int start, int rows, String query)
throws Exception {
ModifiableSolrParams solrParams = new ModifiableSolrParams();
try {

query = Clean(query);
query = escaping(query);

// String q = "\"";
// query = q + query + q;
// System.out.println("\t\t--");

System.out.println("Checking :" + query);
solrParams.set("q", escaping(query));
solrParams.set("start", start);
solrParams.set("rows", rows);

// solrParams.set("facet", facet); // Facets if required

} catch (Exception e) {
e.printStackTrace();
// System.err.println("Error subject :"+query);
}
//return is taking more time...
return server.query(solrParams);
}


Here i am sending the subject to Solr for searching and it is searched
within 200 to 300 ms. But while returning the search result
to QueryResponse, Its getting delay. I dont know why and how to solve this.
Please help me friends. My project is nearly completing stage. Please help
me to complete. Also let me know more details.



On Tue, Apr 8, 2014 at 10:48 PM, Sathya Narayanan <
sathia.blacks...@gmail.com> wrote:

> Hi Anshum,
>
> I am using Solr 4.7. And i follow this 
> tutorial<http://myjeeva.com/solrcloud-cluster-single-collection-deployment.html>to
>  setup a solrcloud. I have only one collection in my solr. Kindly let me,
> if u need more details.
>
>
> On Fri, Apr 4, 2014 at 11:19 PM, Anshum Gupta [via Lucene] <
> ml-node+s472066n4129190...@n3.nabble.com> wrote:
>
>> I am not sure if you setup your SolrCloud right. Can you also provide me
>> with the version of Solr that you're running.
>> Also, if you could tell me about how did you setup your SolrCloud
>> cluster.
>> Are the times consistent? Is this the only collection on the cluster?
>>
>> Also, if I am getting it right, you have 15 ZKs running. Correct me if
>> I'm
>> wrong, but if I'm not, you don't need that kind of a zk setup.
>>
>>
>> On Fri, Apr 4, 2014 at 9:39 AM, Sathya <[hidden 
>> email]<http://user/SendEmail.jtp?type=node&node=4129190&i=0>>
>> wrote:
>>
>> > Hi shawn,
>> >
>> > I have indexed 50 million data in 5 servers. 3 servers have 8gb ram.
>> One
>> > have 24gb and another one have 64gb ram. I was allocate 4 gb ram to
>> solr in
>> > each machine. I am using solrcloud. My total index size is 50gb
>> including 5
>> > servers. Each server have 3 zookeepers. Still I didnt check about OS
>> disk
>> > cache and heap memory. I will check and let u know shawn. If anything,
>> pls
>> > let me know.
>> >
>> > Thank u shawn.
>> >
>> > On Friday, April 4, 2014, Shawn Heisey-4 [via Lucene] <
>> > [hidden email] <http://user/SendEmail.jtp?type=node&node=4129190&i=1>>
>> wrote:
>> > > On 4/4/2014 1:31 AM, Sathya wrote:
>> > >> Hi All,
>> > >>
>> > >> Hi All, I am new to Solr. And i dont know how to increase the search
>> > speed
>> > >> of solrcloud. I have indexed nearly 4 GB of data. When i am
>> searching a
>> > >> document using java with solrj, solr takes more 6 seconds to return
>> a
>> > query
>> > >> result. Any one please help me to reduce the search query time to
>> less
>> > than
>> > >> 500 ms. i have allocate the 4 GB ram for solr. Please let me know
>> for
>> > >> further details about solrcloud config.
>> > >
>> > > How much total RAM do you have on the system, and how much total
>> index
>> > > data is on that system (adding up all the Solr cores)?  You've
>> already
>> > > said that you have allocated 4GB of RAM for Solr.
>> > >
>> > > Later you said you had 50 million documents, and then you showed us a
>> > > URL that looks like SolrCloud.
>> > >
>> > > I suspect that you don't have enough RAM left over to cache your
>> index
>> > > effectively -- the OS Disk Cache is too small.
>> > >
>> > > http://wiki.apache.org/solr/SolrPerformanceProblems
>> > >
>> > > Another possible problem, also discussed on that page, is that your
>> Java
>> &

How to index the data from db using Solandra

2014-02-04 Thread Sathya

Hi Guys...
 I am new to solandra. How to index the data from database using solandra..
I was configure the Solandra by following this link  
https://github.com/tjake/Solandra    and
i dont know how to index the data using solandra.. Please help me...



--
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-index-the-data-from-db-using-Solandra-tp4115192.html
Sent from the Solr - User mailing list archive at Nabble.com.

Solr Searching Issue

2014-02-04 Thread Sathya

Hi Friends,

I am working in Solr 4.6.0 from last 2 months. i have indexed the data in
solr. Indexing size is 8.3GB which is increasing day by day. While im
searching in this index using java programming with multiple instance( more
than 15 instance), the solr is not responding to the search query. Its
getting too slow. Its taking more than 8 hours to search the 7lac data. I am
Using Ubuntu machine with 24GB ram and 1TB HD. Kindly tell me the solution
to solve this issue.



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-Searching-Issue-tp4115207.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr Searching Issue

2014-02-04 Thread Sathya

Hi Furkan,

I have index the subjects that containing only 1 to 10 words per subject.
And query rate is minimum 7 seconds for one searching. And i have single
solr instance only.



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-Searching-Issue-tp4115207p4115234.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr Searching Issue

2014-02-04 Thread Sathya

Hi,

Yes all the instances are reading the same 8GB data at a time. The java
search programs(> 15 instances) are running in different machines, different
JVM and they accessing the solr server machine(Ubuntu 64 bit). And the solr
Index is not shard. The query rates  are too poor(more than 5 seconds per
search in single instance). 



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-Searching-Issue-tp4115207p4115445.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr Searching Issue

2014-02-04 Thread Sathya

Hi Shawn,

 I am running single instance solr and the JVM heap space is minimum 6.3gb
and maximum 24.31gb. Nothing is running to complete the 24gb except tomcat
server. I have only 2 copyField entries only.


On Wed, Feb 5, 2014 at 11:49 AM, Shawn Heisey-4 [via Lucene] <
ml-node+s472066n4115455...@n3.nabble.com> wrote:

> On 2/4/2014 9:49 PM, Sathya wrote:
> > Yes all the instances are reading the same 8GB data at a time. The java
> > search programs(> 15 instances) are running in different machines,
> different
> > JVM and they accessing the solr server machine(Ubuntu 64 bit). And the
> solr
> > Index is not shard. The query rates  are too poor(more than 5 seconds
> per
> > search in single instance).
>
> How many instances of Solr itself (not your client application that does
> searches) are you running?  How much java heap is allocated to Solr?  If
> you don't know, open the admin UI dashboard and look at the "JVM-Memory"
> bar graph.  The number at the far right is the one you need.  What else
> is running on the same box and competing for that 24GB of RAM?  The
> answers to those questions will determine what to look at next.
>
> http://wiki.apache.org/solr/SolrPerformanceProblems
>
> If I read your first message right, "7lac" means that you have 70
> documents.  The lac or lakh is not a common unit of measurement outside
> of South Asia, which means that a lot of people on this list have no
> idea what it is.  In order to get an 8GB index out of 70 documents,
> each one must be quite large, or you've done something that amplifies
> the data, like aggressive tokenization or a LOT of copyField entries.
>
> Thanks,
> Shawn
>
>
>
> --
>  If you reply to this email, your message will be added to the discussion
> below:
>
> http://lucene.472066.n3.nabble.com/Solr-Searching-Issue-tp4115207p4115455.html
>  To unsubscribe from Solr Searching Issue, click 
> here<http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4115207&code=c2F0aGlhLmJsYWNrc3RhckBnbWFpbC5jb218NDExNTIwN3wtMjEyNDcwMTI5OA==>
> .
> NAML<http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>




--
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-Searching-Issue-tp4115207p4115464.html
Sent from the Solr - User mailing list archive at Nabble.com.

Solr4.7 No live SolrServers available to handle this request

Re: Solr4.7 No live SolrServers available to handle this request

Re: Solr4.7 No live SolrServers available to handle this request

Re: Solr4.7 No live SolrServers available to handle this request

Solr Cloud Shows the server is down

How to reduce the search speed of solrcloud

Re: How to reduce the search speed of solrcloud

Re: How to reduce the search speed of solrcloud

Re: How to reduce the search speed of solrcloud

Re: How to reduce the search speed of solrcloud

Re: How to reduce the search speed of solrcloud

Re: How to reduce the search speed of solrcloud

Re: How to reduce the search speed of solrcloud

How to index the data from db using Solandra

Solr Searching Issue

Re: Solr Searching Issue

Re: Solr Searching Issue

Re: Solr Searching Issue

18 matches

Site Navigation

Mail list logo

Footer information