That sounds like a good idea. I will check my schema configuration, and see what I can do.
Thanks Mark and Siva for all the information, and see what I can do, and update the result here. Spark 2011/12/9 Siva Kommuri <snv.komm...@gmail.com> > Hi Spark, > > Is it possible to store a modified time on the database record which would > help you to get the updated documents? > > That way you can avoid reindexing the documents that have not been updated. > > Best wishes, > Siva on 3GS > > On Dec 8, 2011, at 15:40, yu shen <shenyu...@gmail.com> wrote: > > > Hi Mark, > > > > I did not fully catch you. > > I have a dataImportHandler which import data from a database. Are you > > suggesting autoCommit/autoSoftCommit can automaticall pull data from > > database using dataImportHandler? > > > > Otherwise, how can I commit user modification of search result from my > web > > page back to solr? > > > > Spark > > > > 2011/12/8 Mark Miller <markrmil...@gmail.com> > > > >> Lets please keep the conversation on list. > >> > >> If you are using auto commit and soft auto commit, it makes no sense to > be > >> committing with solrj. The commits happen automatically. You couldn't > >> measure them with solrj. > >> > >> - mark > >> > >> On Dec 8, 2011, at 12:44 AM, yu shen wrote: > >> > >>> Thanks for the help. > >>> > >>> For the measurement part, I record system time before commit using > >> solrj, and also after. And calculate the delta. > >>> > >>>>>> System.currentTimeMillis() - startTime <<< > >>> > >>> I also notice there is a new admin console with some monitoring > feature. > >> Unfortunately, seems the monitoring part is not 100% complete yet. So, a > >> little bit hard for me to ping down the issue. > >>> > >>> Spark > >>> > >>> > >>> 2011/12/8 Mark Miller <markrmil...@gmail.com> > >>> Hmmm...that sounds pretty odd... > >>> > >>> How are you measuring the commit time? > >>> > >>> You likely want to turn off any caches, as they will be expired every > >> second, but that should not cause this... > >>> > >>> I can try and duplicate your setup tomorrow and see what i can spot. > >>> > >>> - Mark > >>> > >>> On Dec 7, 2011, at 8:13 PM, yu shen wrote: > >>> > >>>> Hi Mark, and all > >>>> > >>>> I now use commit configuration exactly as below: > >>>> > >>>> <autoCommit> > >>>> <maxTime>100000</maxTime> > >>>> </autoCommit> > >>>> <autoSoftCommit> > >>>> <maxTime>1000</maxTime> > >>>> </autoSoftCommit> > >>>> > >>>> But the commit time takes about 60 seconds. > >>>> > >>>> I have around 1200000 - 1300000 documents in my server. And each day, > >> the number will increase about 6000. My symptom is if solr server is > just > >> started, the commit time is about 3-5 seconds. But after one day time, > the > >> commit time increase substantially to about 1 min. > >>>> > >>>> Do I missed anything or had any mis-configuration? > >>>> Thanks very much for any help in advance. > >>>> > >>>> Spark > >>>> > >>>> 2011/12/7 yu shen <shenyu...@gmail.com> > >>>> Thanks for the correction, I did not notice that <344.gif> > >>>> > >>>> Spark > >>>> > >>>> > >>>> 2011/12/7 Mark Miller <markrmil...@gmail.com> > >>>> Well, if that is exactly what you put, it's wrong. That second one > >> should > >>>> be softAutoCommit. > >>>> > >>>> On Wednesday, December 7, 2011, yu shen <shenyu...@gmail.com> wrote: > >>>>> Hi All, > >>>>> > >>>>> I tried using solr 4 nightly build: > >> apache-solr-4.0-2011-12-06_08-52-46. > >>>>> And try to enable autoSoftCommit like below in solrconfig.xml > >>>>> <autoCommit> > >>>>> <maxTime>100000</maxTime> > >>>>> </autoCommit> > >>>>> <autoCommit> > >>>>> <maxTime>1000</maxTime> > >>>>> </autoCommit> > >>>>> > >>>>> I try to add a document to this solr instance using solrj client in > >> the > >>>>> nightly build. I do saw a commit time boost. Single document commit > >> will > >>>>> basically take around 10 - 15 seconds. > >>>>> > >>>>> My question is, my configuration mean to do the commitment within 1 > >>>> second, > >>>>> why solr still takes 10 seconds. > >>>>> > >>>>> Spark > >>>>> > >>>> > >>>> -- > >>>> - Mark > >>>> > >>>> http://www.lucidimagination.com > >>>> > >>>> > >>> > >>> - Mark Miller > >>> lucidimagination.com > >>> > >>> > >>> > >>> > >>> > >>> > >>> > >>> > >>> > >>> > >>> > >>> > >> > >> - Mark Miller > >> lucidimagination.com > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> >
