Hi Mark,
My question inline.
2011/12/9 Mark Miller <markrmil...@gmail.com>
> I don't know about DataImportHandler.
>
> But the whole point of AutoCommit and AutoSoftCommit is that they happen
> 'Auto'matically. You couldn't measure how long they take from solrj, and if
> you are using solrj to do the commit, it has nothing to do with auto
> commit.
>
> If you want to commit from solrj and make it soft, you have to add the
> param softCommit = true on the update request
>
How to specify the parameter when doing solrj commit? My code snippet is
like this:
SOLR_SERVER.add(solrDocs);
SOLR_SERVER.commit();
> On Thu, Dec 8, 2011 at 7:23 PM, yu shen <shenyu...@gmail.com> wrote:
>
> > That sounds like a good idea. I will check my schema configuration, and
> see
> > what I can do.
> >
> > Thanks Mark and Siva for all the information, and see what I can do, and
> > update the result here.
> >
> > Spark
> >
> > 2011/12/9 Siva Kommuri <snv.komm...@gmail.com>
> >
> > > Hi Spark,
> > >
> > > Is it possible to store a modified time on the database record which
> > would
> > > help you to get the updated documents?
> > >
> > > That way you can avoid reindexing the documents that have not been
> > updated.
> > >
> > > Best wishes,
> > > Siva on 3GS
> > >
> > > On Dec 8, 2011, at 15:40, yu shen <shenyu...@gmail.com> wrote:
> > >
> > > > Hi Mark,
> > > >
> > > > I did not fully catch you.
> > > > I have a dataImportHandler which import data from a database. Are you
> > > > suggesting autoCommit/autoSoftCommit can automaticall pull data from
> > > > database using dataImportHandler?
> > > >
> > > > Otherwise, how can I commit user modification of search result from
> my
> > > web
> > > > page back to solr?
> > > >
> > > > Spark
> > > >
> > > > 2011/12/8 Mark Miller <markrmil...@gmail.com>
> > > >
> > > >> Lets please keep the conversation on list.
> > > >>
> > > >> If you are using auto commit and soft auto commit, it makes no sense
> > to
> > > be
> > > >> committing with solrj. The commits happen automatically. You
> couldn't
> > > >> measure them with solrj.
> > > >>
> > > >> - mark
> > > >>
> > > >> On Dec 8, 2011, at 12:44 AM, yu shen wrote:
> > > >>
> > > >>> Thanks for the help.
> > > >>>
> > > >>> For the measurement part, I record system time before commit using
> > > >> solrj, and also after. And calculate the delta.
> > > >>>
> > > >>>>>> System.currentTimeMillis() - startTime <<<
> > > >>>
> > > >>> I also notice there is a new admin console with some monitoring
> > > feature.
> > > >> Unfortunately, seems the monitoring part is not 100% complete yet.
> > So, a
> > > >> little bit hard for me to ping down the issue.
> > > >>>
> > > >>> Spark
> > > >>>
> > > >>>
> > > >>> 2011/12/8 Mark Miller <markrmil...@gmail.com>
> > > >>> Hmmm...that sounds pretty odd...
> > > >>>
> > > >>> How are you measuring the commit time?
> > > >>>
> > > >>> You likely want to turn off any caches, as they will be expired
> every
> > > >> second, but that should not cause this...
> > > >>>
> > > >>> I can try and duplicate your setup tomorrow and see what i can
> spot.
> > > >>>
> > > >>> - Mark
> > > >>>
> > > >>> On Dec 7, 2011, at 8:13 PM, yu shen wrote:
> > > >>>
> > > >>>> Hi Mark, and all
> > > >>>>
> > > >>>> I now use commit configuration exactly as below:
> > > >>>>
> > > >>>> <autoCommit>
> > > >>>> <maxTime>100000</maxTime>
> > > >>>> </autoCommit>
> > > >>>> <autoSoftCommit>
> > > >>>> <maxTime>1000</maxTime>
> > > >>>> </autoSoftCommit>
> > > >>>>
> > > >>>> But the commit time takes about 60 seconds.
> > > >>>>
> > > >>>> I have around 1200000 - 1300000 documents in my server. And each
> > day,
> > > >> the number will increase about 6000. My symptom is if solr server is
> > > just
> > > >> started, the commit time is about 3-5 seconds. But after one day
> time,
> > > the
> > > >> commit time increase substantially to about 1 min.
> > > >>>>
> > > >>>> Do I missed anything or had any mis-configuration?
> > > >>>> Thanks very much for any help in advance.
> > > >>>>
> > > >>>> Spark
> > > >>>>
> > > >>>> 2011/12/7 yu shen <shenyu...@gmail.com>
> > > >>>> Thanks for the correction, I did not notice that <344.gif>
> > > >>>>
> > > >>>> Spark
> > > >>>>
> > > >>>>
> > > >>>> 2011/12/7 Mark Miller <markrmil...@gmail.com>
> > > >>>> Well, if that is exactly what you put, it's wrong. That second
> one
> > > >> should
> > > >>>> be softAutoCommit.
> > > >>>>
> > > >>>> On Wednesday, December 7, 2011, yu shen <shenyu...@gmail.com>
> > wrote:
> > > >>>>> Hi All,
> > > >>>>>
> > > >>>>> I tried using solr 4 nightly build:
> > > >> apache-solr-4.0-2011-12-06_08-52-46.
> > > >>>>> And try to enable autoSoftCommit like below in solrconfig.xml
> > > >>>>> <autoCommit>
> > > >>>>> <maxTime>100000</maxTime>
> > > >>>>> </autoCommit>
> > > >>>>> <autoCommit>
> > > >>>>> <maxTime>1000</maxTime>
> > > >>>>> </autoCommit>
> > > >>>>>
> > > >>>>> I try to add a document to this solr instance using solrj client
> in
> > > >> the
> > > >>>>> nightly build. I do saw a commit time boost. Single document
> commit
> > > >> will
> > > >>>>> basically take around 10 - 15 seconds.
> > > >>>>>
> > > >>>>> My question is, my configuration mean to do the commitment
> within 1
> > > >>>> second,
> > > >>>>> why solr still takes 10 seconds.
> > > >>>>>
> > > >>>>> Spark
> > > >>>>>
> > > >>>>
> > > >>>> --
> > > >>>> - Mark
> > > >>>>
> > > >>>> http://www.lucidimagination.com
> > > >>>>
> > > >>>>
> > > >>>
> > > >>> - Mark Miller
> > > >>> lucidimagination.com
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>
> > > >> - Mark Miller
> > > >> lucidimagination.com
> > > >>
> > > >>
> > > >>
> > > >>
> > > >>
> > > >>
> > > >>
> > > >>
> > > >>
> > > >>
> > > >>
> > > >>
> > >
> >
>
>
>
> --
> - Mark
>
> http://www.lucidimagination.com
>
