dataimport handler

2013-05-07 Thread Eric Myers
In the  data import handler  I have multiple entities.  Each one
generates a date in the
dataimport.properties i.e. entityname.last_index_time.

How do I reference the specific entity time in my delta queries?

Thanks

Eric


Strange Error

2013-03-05 Thread Eric Myers
|

I am getting the following error when I try to use a stats.facet for a date 
field. Anyone know how to fix this?

Invalid Date String:' #1;#0;#0;#0;oT$#0;'

||I have checked the values of the date and they are all fine.  
I am not sure where this is coming from. 

The really odd thing is that this worked fine, and then all of a sudden went 
crazy. I tried both date and tdate (it worked with date for a while).

|the query string
http://hidden/solr/activity/select?q=*%3A*&wt=xml&indent=true&stats=true&stats.field=amount&stats.facet=date_facet

field data
2013-03-05T05:00:00Z

schema 
   






dataimporthandler large dataset

2011-08-12 Thread Eric Myers
Recently started looking into solr to solve a problem created before my
time.  We have a dataset consisting of 390,000,000+ records that had a
search written for it using a simple query.  The problem is that the
dataset needs additional indices to keep operating.  The DBA says no go,
too large a dataset. 

I came to the very quick conclusion that they needed a search engine,
preferably one that can return some data. 

My problem lies in the initial index creation.  Using the
DataImportHandler with JDBC to import 390m records will, I am guessing
take far longer than I would like, and use up quite a few resources. 

Is there any way to chunk this data, with the DataImportHandler?  If not
I will just write some code to handle the initial import.

Thanks

-- 
Eric Myers