Any comments .. please I am able to do the bulkimport without nested query but with nested query it just keeps working on it and never seems to end ..
I would appreciate any help Thanks Adeel On Sat, Oct 22, 2011 at 11:12 AM, Adeel Qureshi <adeelmahm...@gmail.com>wrote: > yup that was it .. my data import files version was not the same as solr > war .. now I am having another problem though > > I tried doing a simple data import > > <document> > <entity name="p" query="SELECT ID, Status, Title FROM project"> > <field column="ID" name="id" /> > <field column="Status" name="status_s" /> > <field column="Title" name="title_t" /> > </entity> > </document> > > simple in terms of just pulling up three fields from a table and adding to > index and this worked fine but when I add a nested or joined table .. > > <document> > <entity name="project" query="SELECT ID, Status, Title FROM project"> > <field column="ID" name="id" /> > <field column="Status" name="status_s" /> > <field column="Title" name="title_t" /> > <entity name="related" query="select last_name FROM person per inner > join project proj on proj.pi_pid = per.pid where proj.ID = ${project.ID}"> > <field column="last_name" name="pi_s" /> > </entity> > </entity> > </document> > > this data import doesnt seems to end .. it just keeps going .. i only have > about 15000 records in the main table and about 22000 in the joined table .. > but the Fetch count in dataimport handler status indicator thing shows that > it has fetched close to half a million records or something .. i m not sure > what those records are .. is there a way to see exactly what queries are > being run by dataimport handler .. is there something wrong with my nested > query .. > > THanks > Adeel > > > On Fri, Oct 21, 2011 at 3:05 PM, Alireza Salimi > <alireza.sal...@gmail.com>wrote: > >> So to me it heightens the probability of classloader conflicts, >> I haven't worked with Solr 4.0, so I don't know if set of JAR files >> are the same with Solr 3.4. Anyway, make sure that there is only >> ONE instance of apache-solr-dataimporthandler-***.jar in your >> whole tomcat+webapp. >> >> Maybe you have this jar file in CATALINA_HOME\lib folder. >> >> On Fri, Oct 21, 2011 at 3:06 PM, Adeel Qureshi <adeelmahm...@gmail.com >> >wrote: >> >> > its deployed on a tomcat server .. >> > >> > On Fri, Oct 21, 2011 at 12:49 PM, Alireza Salimi >> > <alireza.sal...@gmail.com>wrote: >> > >> > > Hi, >> > > >> > > How do you start Solr, through start.jar or you deploy it to a web >> > > container? >> > > Sometimes problems like this are because of different class loaders. >> > > I hope my answer would help you. >> > > >> > > Regards >> > > >> > > >> > > On Fri, Oct 21, 2011 at 12:47 PM, Adeel Qureshi < >> adeelmahm...@gmail.com >> > > >wrote: >> > > >> > > > Hi I am trying to setup the data import handler with solr 4.0 and >> > having >> > > > some unexpected problems. I have a multi-core setup and only one >> core >> > > > needed >> > > > the dataimport handler so I have added the request handler to it and >> > > added >> > > > the lib imports in config file >> > > > >> > > > <lib dir="../../dist/" >> regex="apache-solr-dataimporthandler-\d.*\.jar" >> > /> >> > > > <lib dir="../../dist/" >> > > > regex="apache-solr-dataimporthandler-extras-\d.*\.jar" /> >> > > > >> > > > for some reason this doesnt works .. it still keeps giving me >> > > ClassNoFound >> > > > error message so I moved the jars files to the shared lib folder and >> > then >> > > > atleast I was able to see the admin screen with the dataimport >> plugin >> > > > loaded. But when I try to do the import its throwing this error >> message >> > > > >> > > > INFO: Starting Full Import >> > > > Oct 21, 2011 11:35:41 AM org.apache.solr.core.SolrCore execute >> > > > INFO: [DW] webapp=/solr path=/select >> > > params={command=status&qt=/dataimport} >> > > > status=0 QTime=0 >> > > > Oct 21, 2011 11:35:41 AM >> org.apache.solr.handler.dataimport.SolrWriter >> > > > readIndexerProperties >> > > > WARNING: Unable to read: dataimport.properties >> > > > Oct 21, 2011 11:35:41 AM >> > org.apache.solr.handler.dataimport.DataImporter >> > > > doFullImport >> > > > SEVERE: Full Import failed >> > > > java.lang.NoSuchMethodError: >> > org.apache.solr.update.DeleteUpdateCommand: >> > > > method <init>()V not found >> > > > at >> > > > >> > > > >> > > >> > >> org.apache.solr.handler.dataimport.SolrWriter.doDeleteAll(SolrWriter.java:193) >> > > > at >> > > > >> > > > >> > > >> > >> org.apache.solr.handler.dataimport.DocBuilder.cleanByQuery(DocBuilder.java:1012) >> > > > at >> > > > >> > > >> > >> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:183) >> > > > at >> > > > >> > > > >> > > >> > >> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:335) >> > > > at >> > > > >> > > > >> > > >> > >> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:393) >> > > > at >> > > > >> > > > >> > > >> > >> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:374) >> > > > Oct 21, 2011 11:35:41 AM >> org.apache.solr.handler.dataimport.SolrWriter >> > > > rollback >> > > > SEVERE: Exception while solr rollback. >> > > > java.lang.NoSuchMethodError: >> > > org.apache.solr.update.RollbackUpdateCommand: >> > > > method <init>()V not found >> > > > at >> > > > >> > > >> > >> org.apache.solr.handler.dataimport.SolrWriter.rollback(SolrWriter.java:184) >> > > > at >> > > > >> > > >> > >> org.apache.solr.handler.dataimport.DocBuilder.rollback(DocBuilder.java:249) >> > > > at >> > > > >> > > > >> > > >> > >> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:340) >> > > > at >> > > > >> > > > >> > > >> > >> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:393) >> > > > at >> > > > >> > > > >> > > >> > >> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:374) >> > > > Oct 21, 2011 11:35:43 AM org.apache.solr.core.SolrCore execute >> > > > INFO: [DW] webapp=/solr path=/select >> > > params={command=status&qt=/dataimport} >> > > > status=0 QTime=0 >> > > > >> > > > Any ideas whats going on .. its complaining about a missing method >> in >> > > > dataimport classes which doesnt makes sense. Is this some kind of >> > version >> > > > mismatch or what is going on. >> > > > >> > > > I would appreciate any comments. >> > > > Thanks >> > > > Adeel >> > > > >> > > >> > > >> > > >> > > -- >> > > Alireza Salimi >> > > Java EE Developer >> > > >> > >> >> >> >> -- >> Alireza Salimi >> Java EE Developer >> > >