[?], thanks. Try in a minute.
Spark
2011/12/9 Mark Miller <markrmil...@gmail.com>
> pseudo code:
>
> SolrServer client = ...
>
> UpdateRequest ureq = new UpdateRequest();
> ureq.add(doc);
> ureq.setParam("param", "value");
> ureq.setAction( UpdateRequest.ACTION.COMMIT, waitFlush, waitSearcher);
> ureq.process(client);
>
> It will say setAction is deprecated, but internal SolrServer code still
> uses it, so meh.
>
> On Dec 8, 2011, at 7:49 PM, yu shen wrote:
>
> > Hi Mark,
> >
> > My question inline.
> >
> > 2011/12/9 Mark Miller <markrmil...@gmail.com>
> > I don't know about DataImportHandler.
> >
> > But the whole point of AutoCommit and AutoSoftCommit is that they happen
> > 'Auto'matically. You couldn't measure how long they take from solrj, and
> if
> > you are using solrj to do the commit, it has nothing to do with auto
> commit.
> >
> > If you want to commit from solrj and make it soft, you have to add the
> > param softCommit = true on the update request
> >
> > How to specify the parameter when doing solrj commit? My code snippet is
> like this:
> > SOLR_SERVER.add(solrDocs);
> > SOLR_SERVER.commit();
> >
> >
> > On Thu, Dec 8, 2011 at 7:23 PM, yu shen <shenyu...@gmail.com> wrote:
> >
> > > That sounds like a good idea. I will check my schema configuration,
> and see
> > > what I can do.
> > >
> > > Thanks Mark and Siva for all the information, and see what I can do,
> and
> > > update the result here.
> > >
> > > Spark
> > >
> > > 2011/12/9 Siva Kommuri <snv.komm...@gmail.com>
> > >
> > > > Hi Spark,
> > > >
> > > > Is it possible to store a modified time on the database record which
> > > would
> > > > help you to get the updated documents?
> > > >
> > > > That way you can avoid reindexing the documents that have not been
> > > updated.
> > > >
> > > > Best wishes,
> > > > Siva on 3GS
> > > >
> > > > On Dec 8, 2011, at 15:40, yu shen <shenyu...@gmail.com> wrote:
> > > >
> > > > > Hi Mark,
> > > > >
> > > > > I did not fully catch you.
> > > > > I have a dataImportHandler which import data from a database. Are
> you
> > > > > suggesting autoCommit/autoSoftCommit can automaticall pull data
> from
> > > > > database using dataImportHandler?
> > > > >
> > > > > Otherwise, how can I commit user modification of search result
> from my
> > > > web
> > > > > page back to solr?
> > > > >
> > > > > Spark
> > > > >
> > > > > 2011/12/8 Mark Miller <markrmil...@gmail.com>
> > > > >
> > > > >> Lets please keep the conversation on list.
> > > > >>
> > > > >> If you are using auto commit and soft auto commit, it makes no
> sense
> > > to
> > > > be
> > > > >> committing with solrj. The commits happen automatically. You
> couldn't
> > > > >> measure them with solrj.
> > > > >>
> > > > >> - mark
> > > > >>
> > > > >> On Dec 8, 2011, at 12:44 AM, yu shen wrote:
> > > > >>
> > > > >>> Thanks for the help.
> > > > >>>
> > > > >>> For the measurement part, I record system time before commit
> using
> > > > >> solrj, and also after. And calculate the delta.
> > > > >>>
> > > > >>>>>> System.currentTimeMillis() - startTime <<<
> > > > >>>
> > > > >>> I also notice there is a new admin console with some monitoring
> > > > feature.
> > > > >> Unfortunately, seems the monitoring part is not 100% complete yet.
> > > So, a
> > > > >> little bit hard for me to ping down the issue.
> > > > >>>
> > > > >>> Spark
> > > > >>>
> > > > >>>
> > > > >>> 2011/12/8 Mark Miller <markrmil...@gmail.com>
> > > > >>> Hmmm...that sounds pretty odd...
> > > > >>>
> > > > >>> How are you measuring the commit time?
> > > > >>>
> > > > >>> You likely want to turn off any caches, as they will be expired
> every
> > > > >> second, but that should not cause this...
> > > > >>>
> > > > >>> I can try and duplicate your setup tomorrow and see what i can
> spot.
> > > > >>>
> > > > >>> - Mark
> > > > >>>
> > > > >>> On Dec 7, 2011, at 8:13 PM, yu shen wrote:
> > > > >>>
> > > > >>>> Hi Mark, and all
> > > > >>>>
> > > > >>>> I now use commit configuration exactly as below:
> > > > >>>>
> > > > >>>> <autoCommit>
> > > > >>>> <maxTime>100000</maxTime>
> > > > >>>> </autoCommit>
> > > > >>>> <autoSoftCommit>
> > > > >>>> <maxTime>1000</maxTime>
> > > > >>>> </autoSoftCommit>
> > > > >>>>
> > > > >>>> But the commit time takes about 60 seconds.
> > > > >>>>
> > > > >>>> I have around 1200000 - 1300000 documents in my server. And each
> > > day,
> > > > >> the number will increase about 6000. My symptom is if solr server
> is
> > > > just
> > > > >> started, the commit time is about 3-5 seconds. But after one day
> time,
> > > > the
> > > > >> commit time increase substantially to about 1 min.
> > > > >>>>
> > > > >>>> Do I missed anything or had any mis-configuration?
> > > > >>>> Thanks very much for any help in advance.
> > > > >>>>
> > > > >>>> Spark
> > > > >>>>
> > > > >>>> 2011/12/7 yu shen <shenyu...@gmail.com>
> > > > >>>> Thanks for the correction, I did not notice that <344.gif>
> > > > >>>>
> > > > >>>> Spark
> > > > >>>>
> > > > >>>>
> > > > >>>> 2011/12/7 Mark Miller <markrmil...@gmail.com>
> > > > >>>> Well, if that is exactly what you put, it's wrong. That second
> one
> > > > >> should
> > > > >>>> be softAutoCommit.
> > > > >>>>
> > > > >>>> On Wednesday, December 7, 2011, yu shen <shenyu...@gmail.com>
> > > wrote:
> > > > >>>>> Hi All,
> > > > >>>>>
> > > > >>>>> I tried using solr 4 nightly build:
> > > > >> apache-solr-4.0-2011-12-06_08-52-46.
> > > > >>>>> And try to enable autoSoftCommit like below in solrconfig.xml
> > > > >>>>> <autoCommit>
> > > > >>>>> <maxTime>100000</maxTime>
> > > > >>>>> </autoCommit>
> > > > >>>>> <autoCommit>
> > > > >>>>> <maxTime>1000</maxTime>
> > > > >>>>> </autoCommit>
> > > > >>>>>
> > > > >>>>> I try to add a document to this solr instance using solrj
> client in
> > > > >> the
> > > > >>>>> nightly build. I do saw a commit time boost. Single document
> commit
> > > > >> will
> > > > >>>>> basically take around 10 - 15 seconds.
> > > > >>>>>
> > > > >>>>> My question is, my configuration mean to do the commitment
> within 1
> > > > >>>> second,
> > > > >>>>> why solr still takes 10 seconds.
> > > > >>>>>
> > > > >>>>> Spark
> > > > >>>>>
> > > > >>>>
> > > > >>>> --
> > > > >>>> - Mark
> > > > >>>>
> > > > >>>> http://www.lucidimagination.com
> > > > >>>>
> > > > >>>>
> > > > >>>
> > > > >>> - Mark Miller
> > > > >>> lucidimagination.com
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>
> > > > >> - Mark Miller
> > > > >> lucidimagination.com
> > > > >>
> > > > >>
> > > > >>
> > > > >>
> > > > >>
> > > > >>
> > > > >>
> > > > >>
> > > > >>
> > > > >>
> > > > >>
> > > > >>
> > > >
> > >
> >
> >
> >
> > --
> > - Mark
> >
> > http://www.lucidimagination.com
> >
>
> - Mark Miller
> lucidimagination.com
>
>
>
>
>
>
>
>
>
>
>
>
