I don't know about DataImportHandler. But the whole point of AutoCommit and AutoSoftCommit is that they happen 'Auto'matically. You couldn't measure how long they take from solrj, and if you are using solrj to do the commit, it has nothing to do with auto commit.
If you want to commit from solrj and make it soft, you have to add the param softCommit = true on the update request On Thu, Dec 8, 2011 at 7:23 PM, yu shen <shenyu...@gmail.com> wrote: > That sounds like a good idea. I will check my schema configuration, and see > what I can do. > > Thanks Mark and Siva for all the information, and see what I can do, and > update the result here. > > Spark > > 2011/12/9 Siva Kommuri <snv.komm...@gmail.com> > > > Hi Spark, > > > > Is it possible to store a modified time on the database record which > would > > help you to get the updated documents? > > > > That way you can avoid reindexing the documents that have not been > updated. > > > > Best wishes, > > Siva on 3GS > > > > On Dec 8, 2011, at 15:40, yu shen <shenyu...@gmail.com> wrote: > > > > > Hi Mark, > > > > > > I did not fully catch you. > > > I have a dataImportHandler which import data from a database. Are you > > > suggesting autoCommit/autoSoftCommit can automaticall pull data from > > > database using dataImportHandler? > > > > > > Otherwise, how can I commit user modification of search result from my > > web > > > page back to solr? > > > > > > Spark > > > > > > 2011/12/8 Mark Miller <markrmil...@gmail.com> > > > > > >> Lets please keep the conversation on list. > > >> > > >> If you are using auto commit and soft auto commit, it makes no sense > to > > be > > >> committing with solrj. The commits happen automatically. You couldn't > > >> measure them with solrj. > > >> > > >> - mark > > >> > > >> On Dec 8, 2011, at 12:44 AM, yu shen wrote: > > >> > > >>> Thanks for the help. > > >>> > > >>> For the measurement part, I record system time before commit using > > >> solrj, and also after. And calculate the delta. > > >>> > > >>>>>> System.currentTimeMillis() - startTime <<< > > >>> > > >>> I also notice there is a new admin console with some monitoring > > feature. > > >> Unfortunately, seems the monitoring part is not 100% complete yet. > So, a > > >> little bit hard for me to ping down the issue. > > >>> > > >>> Spark > > >>> > > >>> > > >>> 2011/12/8 Mark Miller <markrmil...@gmail.com> > > >>> Hmmm...that sounds pretty odd... > > >>> > > >>> How are you measuring the commit time? > > >>> > > >>> You likely want to turn off any caches, as they will be expired every > > >> second, but that should not cause this... > > >>> > > >>> I can try and duplicate your setup tomorrow and see what i can spot. > > >>> > > >>> - Mark > > >>> > > >>> On Dec 7, 2011, at 8:13 PM, yu shen wrote: > > >>> > > >>>> Hi Mark, and all > > >>>> > > >>>> I now use commit configuration exactly as below: > > >>>> > > >>>> <autoCommit> > > >>>> <maxTime>100000</maxTime> > > >>>> </autoCommit> > > >>>> <autoSoftCommit> > > >>>> <maxTime>1000</maxTime> > > >>>> </autoSoftCommit> > > >>>> > > >>>> But the commit time takes about 60 seconds. > > >>>> > > >>>> I have around 1200000 - 1300000 documents in my server. And each > day, > > >> the number will increase about 6000. My symptom is if solr server is > > just > > >> started, the commit time is about 3-5 seconds. But after one day time, > > the > > >> commit time increase substantially to about 1 min. > > >>>> > > >>>> Do I missed anything or had any mis-configuration? > > >>>> Thanks very much for any help in advance. > > >>>> > > >>>> Spark > > >>>> > > >>>> 2011/12/7 yu shen <shenyu...@gmail.com> > > >>>> Thanks for the correction, I did not notice that <344.gif> > > >>>> > > >>>> Spark > > >>>> > > >>>> > > >>>> 2011/12/7 Mark Miller <markrmil...@gmail.com> > > >>>> Well, if that is exactly what you put, it's wrong. That second one > > >> should > > >>>> be softAutoCommit. > > >>>> > > >>>> On Wednesday, December 7, 2011, yu shen <shenyu...@gmail.com> > wrote: > > >>>>> Hi All, > > >>>>> > > >>>>> I tried using solr 4 nightly build: > > >> apache-solr-4.0-2011-12-06_08-52-46. > > >>>>> And try to enable autoSoftCommit like below in solrconfig.xml > > >>>>> <autoCommit> > > >>>>> <maxTime>100000</maxTime> > > >>>>> </autoCommit> > > >>>>> <autoCommit> > > >>>>> <maxTime>1000</maxTime> > > >>>>> </autoCommit> > > >>>>> > > >>>>> I try to add a document to this solr instance using solrj client in > > >> the > > >>>>> nightly build. I do saw a commit time boost. Single document commit > > >> will > > >>>>> basically take around 10 - 15 seconds. > > >>>>> > > >>>>> My question is, my configuration mean to do the commitment within 1 > > >>>> second, > > >>>>> why solr still takes 10 seconds. > > >>>>> > > >>>>> Spark > > >>>>> > > >>>> > > >>>> -- > > >>>> - Mark > > >>>> > > >>>> http://www.lucidimagination.com > > >>>> > > >>>> > > >>> > > >>> - Mark Miller > > >>> lucidimagination.com > > >>> > > >>> > > >>> > > >>> > > >>> > > >>> > > >>> > > >>> > > >>> > > >>> > > >>> > > >>> > > >> > > >> - Mark Miller > > >> lucidimagination.com > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > > -- - Mark http://www.lucidimagination.com
