Hi Noble,
I have updated my entity specs, by having a separate entity for
selecting rows which are not deleted for and ones that are deleted, so
I am sure now that the document is not getting added in the same
import.
I read in the tutorial that the deletes are not taken out until the
commit is done. Is there a way I can force a commit? I don't have the
post.jar on the machine in question.
So whats next, I can now safely say that the documents are not getting
added again, and they should be getting deleted... but they not,
unless its not committing and I have to do it manually.
Any other ideas?
Thanks for your help so far!
Regards
Mark
On 11/17/09, Noble Paul നോബിള് नोब्ळ् <noble.p...@corp.aol.com> wrote:
> why don't you add a new timestamp field . you can use the
> TemplateTransformer with the formatDate() function
>
> On Tue, Nov 17, 2009 at 5:49 PM, Mark Ellul <m...@catalystic.com> wrote:
>> Hi Noble,
>>
>> Excellent Question... should the field that does the deleting be in a
>> different entity to the one that does the addition and updating?
>>
>> If so that could be the issue, I have the field that does the
>> DeleteByQuery command inside of the entity that does the adding.
>>
>> Is there some kind of document metadata where the create date and
>> update date is show?
>>
>> How would I see this meta data if it exists?
>>
>> Regards
>>
>> Mark
>>
>> On 11/17/09, Noble Paul നോബിള് नोब्ळ् <noble.p...@corp.aol.com> wrote:
>>> The question is, did your new delta-import created the doc again?
>>>
>>> On Tue, Nov 17, 2009 at 4:41 PM, Mark Ellul <m...@catalystic.com> wrote:
>>>> The doc already existed before the delta-import has been run.
>>>>
>>>> And it exists afterwards... even though it says its deleting it.
>>>>
>>>> Any ideas of what I can try?
>>>>
>>>> On 11/17/09, Noble Paul നോബിള് नोब्ळ् <noble.p...@corp.aol.com> wrote:
>>>>> are you sure that the doc w/ the same id was not created after that?
>>>>>
>>>>> On Mon, Nov 16, 2009 at 11:12 PM, Mark Ellul <m...@catalystic.com>
>>>>> wrote:
>>>>>> Hi,
>>>>>>
>>>>>> I have added a deleted field in my database, and am using the
>>>>>> Dataimporthandler to add rows to the index...
>>>>>>
>>>>>> I am using solr 1.4
>>>>>>
>>>>>> I have added my the deleted field to the query and the
>>>>>> RegexTransformer...
>>>>>> and the field definition below
>>>>>>
>>>>>> <field column="$deleteDocByQuery"
>>>>>> regex="^true$"
>>>>>> replaceWith="id:${List.id}" sourceColName="deleted"/>
>>>>>>
>>>>>> When I run the deltaImport command... I see the below output
>>>>>>
>>>>>> INFO: [] webapp=/solr path=/dataimport
>>>>>> params={command=delta-import&debug=true&expungeDeletes=true} status=0
>>>>>> QTime=1
>>>>>> Nov 16, 2009 5:29:10 PM
>>>>>> org.apache.solr.handler.dataimport.DataImporter
>>>>>> doDeltaImport
>>>>>> INFO: Starting Delta Import
>>>>>> Nov 16, 2009 5:29:10 PM org.apache.solr.handler.dataimport.SolrWriter
>>>>>> readIndexerProperties
>>>>>> INFO: Read dataimport.properties
>>>>>> Nov 16, 2009 5:29:10 PM org.apache.solr.handler.dataimport.DocBuilder
>>>>>> doDelta
>>>>>> INFO: Starting delta collection.
>>>>>> Nov 16, 2009 5:29:10 PM org.apache.solr.handler.dataimport.DocBuilder
>>>>>> collectDelta
>>>>>> INFO: Running ModifiedRowKey() for Entity: List
>>>>>> Nov 16, 2009 5:29:10 PM
>>>>>> org.apache.solr.handler.dataimport.JdbcDataSource$1
>>>>>> call
>>>>>> INFO: Creating a connection for entity List with URL:
>>>>>> jdbc:postgresql://localhost:5432/tlists
>>>>>> Nov 16, 2009 5:29:10 PM
>>>>>> org.apache.solr.handler.dataimport.JdbcDataSource$1
>>>>>> call
>>>>>> INFO: Time taken for getConnection(): 4
>>>>>> Nov 16, 2009 5:29:10 PM org.apache.solr.handler.dataimport.DocBuilder
>>>>>> collectDelta
>>>>>> INFO: Completed ModifiedRowKey for Entity: List rows obtained : 1
>>>>>> Nov 16, 2009 5:29:10 PM org.apache.solr.handler.dataimport.DocBuilder
>>>>>> collectDelta
>>>>>> INFO: Completed DeletedRowKey for Entity: List rows obtained : 0
>>>>>> Nov 16, 2009 5:29:10 PM org.apache.solr.handler.dataimport.DocBuilder
>>>>>> collectDelta
>>>>>> INFO: Completed parentDeltaQuery for Entity: List
>>>>>> Nov 16, 2009 5:29:10 PM org.apache.solr.handler.dataimport.SolrWriter
>>>>>> deleteByQuery
>>>>>> INFO: Deleting documents from Solr with query: id:api__list__365522
>>>>>> Nov 16, 2009 5:29:10 PM org.apache.solr.core.SolrDeletionPolicy onInit
>>>>>> INFO: SolrDeletionPolicy.onInit: commits:num=1
>>>>>> commit{dir=/mnt/solr-index/index,segFN=segments_r,version=1257863009839,generation=27,filenames=[_bg.fdt,
>>>>>> _bg.tii, segments_r, _bg.fnm, _bg.nrm, _bg.fdx, _bg.prx, _bg.tis,
>>>>>> _bg.frq]
>>>>>> Nov 16, 2009 5:29:10 PM org.apache.solr.core.SolrDeletionPolicy
>>>>>> updateCommits
>>>>>> INFO: newest commit = 1257863009839
>>>>>> Nov 16, 2009 5:29:10 PM org.apache.solr.handler.dataimport.DocBuilder
>>>>>> doDelta
>>>>>> INFO: Delta Import completed successfully
>>>>>>
>>>>>> It says its deleting the document... but when I do the search its
>>>>>> still
>>>>>> showing up....
>>>>>>
>>>>>> Any Ideas?
>>>>>>
>>>>>> Regards
>>>>>>
>>>>>> Mark
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> -----------------------------------------------------
>>>>> Noble Paul | Principal Engineer| AOL | http://aol.com
>>>>>
>>>>
>>>
>>>
>>>
>>> --
>>> -----------------------------------------------------
>>> Noble Paul | Principal Engineer| AOL | http://aol.com
>>>
>>
>
>
>
> --
> -----------------------------------------------------
> Noble Paul | Principal Engineer| AOL | http://aol.com
>
