Re: How to do a Data sharding for data in a database table

f the search > index from memory to disk by OS. > > Does Solr automatically loads search index into memory after the index is > built? Otherwise, is there any tool or command that can accomplish this > task. > > Regards > > > > > -- > View this message in conte

Re: How to do a Data sharding for data in a database table

index is built? Otherwise, is there any tool or command that can accomplish this task. Regards -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-do-a-Data-sharding-for-data-in-a-database-table-tp4212765p4215398.html Sent from the Solr - User mailing list archi

Re: How to do a Data sharding for data in a database table

aking too long (70 ms)to > process? > > Thanks > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/How-to-do-a-Data-sharding-for-data-in-a-database-table-tp4212765p4215019.html > Sent from the Solr - User mailing list archive at Nabble.com.

Re: How to do a Data sharding for data in a database table

aking too long (70 ms)to process? Thanks -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-do-a-Data-sharding-for-data-in-a-database-table-tp4212765p4215019.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: How to do a Data sharding for data in a database table

Test_results_round_2.doc <http://lucene.472066.n3.nabble.com/file/n4215016/Test_results_round_2.doc> -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-do-a-Data-sharding-for-data-in-a-database-table-tp4212765p4215016.html Sent from the Solr - User mailin

Re: How to do a Data sharding for data in a database table

quest > scenario, the performance will be in a much better shape with all the cache > and warming setting during a load test scenario. > > Thanks, > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/How-to-do-a-Data-sharding-for-data-in-a-database-table-tp4212765p4214968.html > Sent from the Solr - User mailing list archive at Nabble.com.

Re: How to do a Data sharding for data in a database table

://lucene.472066.n3.nabble.com/How-to-do-a-Data-sharding-for-data-in-a-database-table-tp4212765p4214968.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: How to do a Data sharding for data in a database table

Hmmm, indeed it does. Never mind ;) I guess the thing I'd be looking at is garbage collection, here's a very good writeup: http://lucidworks.com/blog/garbage-collection-bootcamp-1-0/ Kind of a shot in the dark, but it's possible. Good luck! Erick On Thu, Jun 25, 2015 at 3:26 PM, Wenbin Wang wro

Re: How to do a Data sharding for data in a database table

Hi Guys, I have no problem changing it to 2. However, we are talking about two different applications. The Solr 4.7 has two applications: example and example-DIH. The application example-DIH is the one I started with since it works with database. The example-DIH has the default setting to 4. Re

Re: How to do a Data sharding for data in a database table

On 6/25/2015 10:27 AM, Wenbin Wang wrote: > To clarify the work: > > We are very early in the investigative phase, and the indexing is NOT done > continuously. > > I indexed the data once through Admin UI, and test the query. If I need to > index again, I can use curl or through the Admin UI. > > T

Re: How to do a Data sharding for data in a database table

aches. > >> > >> Your autowarming numbers in filterCache and queryResultCache are, on the > >> face of it, far too large. > >> > >> Best, > >> Erick > >> > >> On Thu, Jun 25, 2015 at 8:12 AM, wwang525 wrote: > >> > schema.xml < > http://lucene.472066.n3.nabble.com/file/n4213864/schema.xml> > >> > solrconfig.xml > >> > <http://lucene.472066.n3.nabble.com/file/n4213864/solrconfig.xml> > >> > > >> > > >> > > >> > -- > >> > View this message in context: > >> > http://lucene.472066.n3.nabble.com/How-to-do-a-Data-sharding-for-data-in-a-database-table-tp4212765p4213864.html > >> > Sent from the Solr - User mailing list archive at Nabble.com. > >> >

Re: How to do a Data sharding for data in a database table

terCache and queryResultCache are, on the >> face of it, far too large. >> >> Best, >> Erick >> >> On Thu, Jun 25, 2015 at 8:12 AM, wwang525 wrote: >> > schema.xml <http://lucene.472066.n3.nabble.com/file/n4213864/schema.xml> >> > solrconfig.xml >> > <http://lucene.472066.n3.nabble.com/file/n4213864/solrconfig.xml> >> > >> > >> > >> > -- >> > View this message in context: >> http://lucene.472066.n3.nabble.com/How-to-do-a-Data-sharding-for-data-in-a-database-table-tp4212765p4213864.html >> > Sent from the Solr - User mailing list archive at Nabble.com. >>

Re: How to do a Data sharding for data in a database table

;http://lucene.472066.n3.nabble.com/file/n4213864/solrconfig.xml> > > > > > > > > -- > > View this message in context: > http://lucene.472066.n3.nabble.com/How-to-do-a-Data-sharding-for-data-in-a-database-table-tp4212765p4213864.html > > Sent from the Solr - User mailing list archive at Nabble.com. >

Re: How to do a Data sharding for data in a database table

ene.472066.n3.nabble.com/file/n4213864/solrconfig.xml> > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/How-to-do-a-Data-sharding-for-data-in-a-database-table-tp4212765p4213864.html > Sent from the Solr - User mailing list archive at Nabble.com.

Re: How to do a Data sharding for data in a database table

schema.xml <http://lucene.472066.n3.nabble.com/file/n4213864/schema.xml> solrconfig.xml <http://lucene.472066.n3.nabble.com/file/n4213864/solrconfig.xml> -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-do-a-Data-sharding-for-data-in-a-da

Re: How to do a Data sharding for data in a database table

at business need. Previously, I was testing the > data size of 6 M and no faceted search, the typical response time at single > request scenario was around 200 ms. > > Please let me know if additional information is needed. > > Thanks > > > > -- > View this message in contex

Re: How to do a Data sharding for data in a database table

t single request scenario was around 200 ms. Please let me know if additional information is needed. Thanks -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-do-a-Data-sharding-for-data-in-a-database-table-tp4212765p4213648.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: How to do a Data sharding for data in a database table

@lucene.apache.org Subject: RE: How to do a Data sharding for data in a database table Also, since you are tuning for relative times, you can tune on the smaller index. Surely, you will want to test at scale. But tuning query, analyzer or schema options is usually easier to do on a smaller index. If you

RE: How to do a Data sharding for data in a database table

-user@lucene.apache.org Subject: Re: How to do a Data sharding for data in a database table Do be aware that turning on &debug=query adds a load. I've seen the debug component take 90% of the query time. (to be fair it usually takes a much smaller percentage). But you'll see a sectio

Re: How to do a Data sharding for data in a database table

ms while the grouping queries take 60-80ms in a test >> environment (< 1M docs). >> > >> > This is ok for us, since we wrote our app to take the grouping queries >> out of the critical path (async query in parallel with two primary queries >> and some work in middle ti

Re: How to do a Data sharding for data in a database table

ork for > most cases. > > > > -----Original Message- > > From: Reitzel, Charles [mailto:charles.reit...@tiaa-cref.org] > > Sent: Friday, June 19, 2015 9:52 AM > > To: solr-user@lucene.apache.org > > Subject: RE: How to do a Data sharding for data in a database

Re: How to do a Data sharding for data in a database table

orting steps, but > which? Sometime the schema details matter for performance. Folks on this > list can help with that. > > -Charlie > > -Original Message----- > From: Wenbin Wang [mailto:wwang...@gmail.com] > Sent: Friday, June 19, 2015 7:55 AM > To: solr-u

RE: How to do a Data sharding for data in a database table

ang [mailto:wwang...@gmail.com] Sent: Friday, June 19, 2015 7:55 AM To: solr-user@lucene.apache.org Subject: Re: How to do a Data sharding for data in a database table I have enough RAM (30G) and Hard disk (1000G). It is not I/O bound or computer disk bound. In addition, the Solr was started w

RE: How to do a Data sharding for data in a database table

] Sent: Friday, June 19, 2015 7:55 AM To: solr-user@lucene.apache.org Subject: Re: How to do a Data sharding for data in a database table I have enough RAM (30G) and Hard disk (1000G). It is not I/O bound or computer disk bound. In addition, the Solr was started with maximal 4G for JVM, and

Re: How to do a Data sharding for data in a database table

range, but that is pretty dynamic, and we could shard > data > > by some other properties, but if the data is not evenly distributed, you > may > > not be able shard it anymore. > > > > > > > > -- > > View this message in context: > http://lucene.472066.n3.nabble.com/How-to-do-a-Data-sharding-for-data-in-a-database-table-tp4212765p4212803.html > > Sent from the Solr - User mailing list archive at Nabble.com. >

Re: How to do a Data sharding for data in a database table

data? for example, we could shard > the data by date range, but that is pretty dynamic, and we could shard data > by some other properties, but if the data is not evenly distributed, you may > not be able shard it anymore. > > > > -- > View this message in context: > http:

Re: How to do a Data sharding for data in a database table

-Data-sharding-for-data-in-a-database-table-tp4212765p4212803.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: How to do a Data sharding for data in a database table

d in a single > request > scenario. > > I have not done any data sharding before. What are some recommended way to > do data sharding. For example, may be by a criteria with a list of specific > values? > > > > > > -- > View this message in context: > http

How to do a Data sharding for data in a database table

with a list of specific values? -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-do-a-Data-sharding-for-data-in-a-database-table-tp4212765.html Sent from the Solr - User mailing list archive at Nabble.com.