Hi
I too having the same doubt. I would like to check How Solr is index and
search the data which is there in database.
For example, lets say we have a table called PRODUCTS, and within that
table, we have the following columns:
NUMBER (product number)
NAME (product name)
PRICE
How would weindex all this information? Here is an example (from the links
you provided) of xml (data-config.xml)
<entity name="item" pk="ID" query="select * from item"
-------> deltaQuery="select id from item where last_modified >
'${dataimporter.last_index_time}'">
<field column="NAME" name="name" />
<field column="NAME" name="nameSort" />
<field column="NAME" name="alphaNameSort" />
Need Help in this.
Noble Paul നോബിള് नोब्ळ् wrote:
>
> delta query is for incremental imports
>
> us ethe 'query' attribute to import data
>
>
> On Tue, Apr 21, 2009 at 7:35 PM, ahammad <ahmed.ham...@gmail.com> wrote:
>>
>> Thanks for the link...
>>
>> I'm still a bit unclear as to how it goes. For example, lets say i have a
>> table called PRODUCTS, and within that table, I have the following
>> columns:
>> NUMBER (product number)
>> NAME (product name)
>> PRICE
>>
>> How would I index all this information? Here is an example (from the
>> links
>> you provided) of xml that confuses me:
>>
>> <entity name="item" pk="ID" query="select * from item"
>> -------> deltaQuery="select id from item where last_modified >
>> '${dataimporter.last_index_time}'">
>> <field column="NAME" name="name" />
>> <field column="NAME" name="nameSort" />
>> <field column="NAME" name="alphaNameSort" />
>>
>> What is that deltaQuery (or even if it was a regular "query" expression)
>> line for? It seems to me like a sort of filter. What if I don't want to
>> filter anything and just want to index all the rows?
>>
>> Cheers
>>
>>
>>
>>
>> Noble Paul നോബിള് नोब्ळ् wrote:
>>>
>>> On Mon, Apr 20, 2009 at 7:15 PM, ahammad <ahmed.ham...@gmail.com> wrote:
>>>>
>>>> Hello,
>>>>
>>>> I've never used Solr before, but I believe that it will suit my current
>>>> needs with indexing information from a database.
>>>>
>>>> I downloaded and extracted Solr 1.3 to play around with it. I've been
>>>> looking at the following tutorials:
>>>> http://www.ibm.com/developerworks/java/library/j-solr-update/index.html
>>>> http://www.ibm.com/developerworks/java/library/j-solr-update/index.html
>>>> http://wiki.apache.org/solr/DataImportHandler
>>>> http://wiki.apache.org/solr/DataImportHandler
>>>>
>>>> There are a few things I don't understand. For example, the IBM article
>>>> sometimes refers to directories that aren't there, or a little
>>>> different
>>>> from what I have in my extracted copy of Solr (ie
>>>> solr-dw/rss/conf/solrconfig.xml). I tried to follow the steps as best I
>>>> can,
>>>> but as soon as I put the following in solrconfig.xml, the whole thing
>>>> breaks:
>>>>
>>>> <requestHandler name="/dataimport"
>>>> class="org.apache.solr.handler.dataimport.DataImportHandler">
>>>> <lst name="defaults">
>>>> <str name="config">rss-data-config.xml</str>
>>>> </lst>
>>>> </requestHandler>
>>>>
>>>> Obviously I replace with my own info...One thing I don't quite get is
>>>> the
>>>> data-config.xml file. What exactly is it? I've seen examples of what it
>>>> contains but since I don't know enough, I couldn't really adjust it. In
>>>> any
>>>> case, this is the error I get, which may be because of a misconfigured
>>>> data-config.xml...
>>> the data-config.xml describes how to fetch data from various data
>>> sources and index them into Solr.
>>>
>>> The stacktrace says that your xml is invalid.
>>>
>>> The best bet is to take one of the sample dataconfig xml files and make
>>> changes.
>>>
>>> http://svn.apache.org/viewvc/lucene/solr/trunk/example/example-DIH/solr/db/conf/db-data-config.xml?revision=691151&view=markup
>>>
>>> http://svn.apache.org/viewvc/lucene/solr/trunk/example/example-DIH/solr/rss/conf/rss-data-config.xml?revision=691151&view=markup
>>>
>>>
>>>>
>>>> org.apache.solr.handler.dataimport.DataImportHandlerException:
>>>> Exception
>>>> occurred while initializing context at
>>>> org.apache.solr.handler.dataimport.DataImporter.loadDataConfig(DataImporter.java:165)
>>>> at
>>>> org.apache.solr.handler.dataimport.DataImporter.<init>(DataImporter.java:99)
>>>> at
>>>> org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportHandler.java:96)
>>>> at
>>>> org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:388)
>>>> at org.apache.solr.core.SolrCore.<init>(SolrCore.java:571) at
>>>> org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:122)
>>>> at
>>>> org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:69)
>>>> at
>>>> org.apache.catalina.core.ApplicationFilterConfig.getFilter(ApplicationFilterConfig.java:221)
>>>> at
>>>> org.apache.catalina.core.ApplicationFilterConfig.setFilterDef(ApplicationFilterConfig.java:302)
>>>> at
>>>> org.apache.catalina.core.ApplicationFilterConfig.<init>(ApplicationFilterConfig.java:78)
>>>> at
>>>> org.apache.catalina.core.StandardContext.filterStart(StandardContext.java:3635)
>>>> at
>>>> org.apache.catalina.core.StandardContext.start(StandardContext.java:4222)
>>>> at
>>>> org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:760)
>>>> at
>>>> org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:740)
>>>> at
>>>> org.apache.catalina.core.StandardHost.addChild(StandardHost.java:544)
>>>> at
>>>> org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:831)
>>>> at
>>>> org.apache.catalina.startup.HostConfig.deployWARs(HostConfig.java:720)
>>>> at
>>>> org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:490)
>>>> at
>>>> org.apache.catalina.startup.HostConfig.start(HostConfig.java:1150) at
>>>> org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:311)
>>>> at
>>>> org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:120)
>>>> at
>>>> org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1022)
>>>> at
>>>> org.apache.catalina.core.StandardHost.start(StandardHost.java:736) at
>>>> org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1014)
>>>> at
>>>> org.apache.catalina.core.StandardEngine.start(StandardEngine.java:443)
>>>> at
>>>> org.apache.catalina.core.StandardService.start(StandardService.java:448)
>>>> at
>>>> org.apache.catalina.core.StandardServer.start(StandardServer.java:700)
>>>> at
>>>> org.apache.catalina.startup.Catalina.start(Catalina.java:552) at
>>>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
>>>> sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at
>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at
>>>> java.lang.reflect.Method.invoke(Unknown Source) at
>>>> org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:295) at
>>>> org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:433) Caused
>>>> by:
>>>> org.xml.sax.SAXParseException: The element type "document" must be
>>>> terminated by the matching end-tag "</document>". at
>>>> com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(Unknown
>>>> Source)
>>>> at
>>>> com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(Unknown
>>>> Source) at
>>>> org.apache.solr.handler.dataimport.DataImporter.loadDataConfig(DataImporter.java:153)
>>>>
>>>>
>>>> It's unclear to me what I need to be using, as in what
>>>> directories/files
>>>> I
>>>> need to implement this. Can someone please point me in the right
>>>> direction?
>>>>
>>>> BTW, I'm using Tomcat 5.5 because the prepackaged Jetty simply doesn't
>>>> work
>>>> for me. It shows that it "started" in the command line, but it hangs,
>>>> and
>>>> doesn't actually work when I try to hit the Solr admin page (page not
>>>> found
>>>> type error). Jetty itself does start but the project doesn't seem to
>>>> deploy...
>>>>
>>>> I apologize for the long post and if I didn't provide as much
>>>> information
>>>> as
>>>> I should. Let me know if you need clarification with anything I said.
>>>>
>>>> Thank you very much.
>>>> --
>>>> View this message in context:
>>>> http://www.nabble.com/Using-Solr-to-index-a-database-tp23136944p23136944.html
>>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>>
>>>>
>>>
>>>
>>>
>>> --
>>> --Noble Paul
>>>
>>>
>>
>> --
>> View this message in context:
>> http://www.nabble.com/Using-Solr-to-index-a-database-tp23136944p23156850.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>>
>
>
>
> --
> --Noble Paul
>
>
--
View this message in context:
http://www.nabble.com/Using-Solr-to-index-a-database-tp23136944p23403314.html
Sent from the Solr - User mailing list archive at Nabble.com.
