Re: DIH: Indexing multiple datasources with the same schema

[alexei]

Sorry about bringing an old thread back, I thought my solution could be
useful.
 
I also had to deal with multiple data sources. If the data source number
could be queried for in one of your parent entities then you could get it
using a variable as follows:

<entity name="ChildEntity" dataSource="db${YourParentEntity.DbId}" ... 

For the above to work I had to modify the 
org.apache.solr.handler.dataimport.ContextImpl.getDataSource()
Here is the replacement code for getDataSource: 


  public DataSource getDataSource() { 
    if (ds != null) return ds; 
    if(entity == null) return  null; 
    
    String dataSourceResolved =
this.getResolvedEntityAttribute("dataSource"); 
  
    if (entity.dataSrc == null) {       
        entity.dataSrc = dataImporter.getDataSourceInstance(entity,
dataSourceResolved, this); 
        entity.dataSource = dataSourceResolved; 
    } else if (!dataSourceResolved.equals(entity.dataSource)) { 
    entity.dataSrc.close(); 
        entity.dataSrc = dataImporter.getDataSourceInstance(entity,
dataSourceResolved, this); 
        entity.dataSource = dataSourceResolved; 
    } 
    if (entity.dataSrc != null && docBuilder != null &&
docBuilder.verboseDebug && 
             Context.FULL_DUMP.equals(currentProcess())) { 
      //debug is not yet implemented properly for deltas 
      entity.dataSrc =
docBuilder.writer.getDebugLogger().wrapDs(entity.dataSrc); 
    } 
    return entity.dataSrc; 
  } 


Cheers,
Alexei

--
View this message in context: 
http://lucene.472066.n3.nabble.com/DIH-Indexing-multiple-datasources-with-the-same-schema-tp877781p2786599.html
Sent from the Solr - User mailing list archive at Nabble.com.