Yes, you are correct. But the documentation for DIH says the column names are case insensitive. That should be fixed. Here is what it says:
============= A shorter data-config In the above example, there are mappings of fields to Solr fields. It is possible to totally avoid the field entries in entities if the names of the fields are same (case does not matter) as those in Solr schema. ============ Noble Paul നോബിള് नोब्ळ् wrote: > > it is very expensive to do a case insensitive lookup. It must first > convert all the keys to lower case and try looking up there. because > it may not be always in uppercase it can be in mixed case as well > > On Sat, Apr 4, 2009 at 12:58 AM, ashokc <ash...@qualcomm.com> wrote: >> >> Happy to report that it is working. Looks like we have to use UPPER CASE >> for >> all the column names. When I examined the map 'aRow', it had the column >> names in upper case, where as my config had lower case. No match was >> found >> so nothing happened. Changed my config and it works now. Thanks for your >> help. Perhaps this transformer can be modified to be case-insensitive for >> the column names. If you had written it perhaps it is a quick change for >> you? >> >> Noble Paul നോബിള് नोब्ळ् wrote: >>> >>> I guess u can write a custom transformer which gets a String out of >>> the oracle.sql.CLOB. I am just out of clue, why this may happen. I >>> even wrote a testcase and it seems to work fine >>> --Noble >>> >>> On Fri, Apr 3, 2009 at 10:23 PM, ashokc <ash...@qualcomm.com> wrote: >>>> >>>> I downloaded the nightly build yesterday (2nd April), modified the >>>> ClobTransformer.java file with some prints, compiled it all (ant dist). >>>> It >>>> produced a war file, "apache-solr-1.4-dev.war". That is what I am >>>> using. >>>> My >>>> modification & compilation has not affected the results. I was getting >>>> the >>>> same behavior with the 'war' that download came with. Thanks Noble. >>>> >>>> Noble Paul നോബിള് नोब्ळ् wrote: >>>>> >>>>> and which version of Solr are u using? >>>>> >>>>> On Fri, Apr 3, 2009 at 10:09 PM, ashokc <ash...@qualcomm.com> wrote: >>>>>> >>>>>> Sure: >>>>>> >>>>>> data-config Xml >>>>>> =============== >>>>>> >>>>>> <dataConfig> >>>>>> <dataSource driver="oracle.jdbc.driver.OracleDriver" >>>>>> url="jdbc:oracle:thin:@xxxxx" user="remedy" password="yyyyy"/> >>>>>> <document name="remedy"> >>>>>> <entity name="log" transformer="ClobTransformer" >>>>>> query="SELECT >>>>>> mylog_ato, name_char, dsc FROM log_tbl"> >>>>>> <field column="mylog_ato" name="log_no" /> >>>>>> <field column="name_char" name="short_desc" /> >>>>>> <field column="dsc" clob="true" name="description" /> >>>>>> </entity> >>>>>> </document> >>>>>> </dataConfig> >>>>>> >>>>>> =========== >>>>>> >>>>>> A search result on the field short_desc: >>>>>> -------------------------------------- >>>>>> >>>>>> <doc> >>>>>> <float name="score">1.8670129</float> >>>>>> <str name="description">oracle.sql.c...@155e3ab</str> >>>>>> <int name="log_no">4486</int> >>>>>> <str name="short_desc">Develop Rating functionality for QIN</str> >>>>>> <date name="timestamp">2009-04-03T11:47:32.635Z</date> >>>>>> </doc> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> Noble Paul നോബിള് नोब्ळ् wrote: >>>>>>> >>>>>>> There is something else wrong with your setup. >>>>>>> >>>>>>> can you just paste the whole data-config.xml >>>>>>> >>>>>>> --Noble >>>>>>> >>>>>>> On Fri, Apr 3, 2009 at 5:39 PM, ashokc <ash...@qualcomm.com> wrote: >>>>>>>> >>>>>>>> Noble, >>>>>>>> I put in a few 'System.out.println' statements in the >>>>>>>> ClobTransformer.java >>>>>>>> file & remade the war. But I see none of these prints coming up in >>>>>>>> my >>>>>>>> 'catalina.out' file. Is that the right file to be looking at? >>>>>>>> >>>>>>>> As an aside, is 'catalina.out' the ONLY log file for SOLR? I turned >>>>>>>> on >>>>>>>> the >>>>>>>> logging to 'FINE' for everything. Also, these settings seem to go >>>>>>>> away >>>>>>>> when >>>>>>>> Tomcat is restarted. >>>>>>>> - ashok >>>>>>>> >>>>>>>> Noble Paul നോബിള് नोब्ळ् wrote: >>>>>>>>> >>>>>>>>> yeah, ant dist will give you the .war file you may need . just >>>>>>>>> drop >>>>>>>>> it >>>>>>>>> in and you are set to go. or if you can hook up a debugger to a >>>>>>>>> running Solr that is the easiest >>>>>>>>> --Noble >>>>>>>>> >>>>>>>>> On Fri, Apr 3, 2009 at 9:35 AM, ashokc <ash...@qualcomm.com> >>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>> That would require me to recompile (with ant/maven scripts?) the >>>>>>>>>> source >>>>>>>>>> and >>>>>>>>>> replace the jar for DIH, right? I can try - for the first time. >>>>>>>>>> - ashok >>>>>>>>>> >>>>>>>>>> Noble Paul നോബിള് नोब्ळ् wrote: >>>>>>>>>>> >>>>>>>>>>> This looks strange. Apparently the Transformer did not get >>>>>>>>>>> applied. >>>>>>>>>>> Is >>>>>>>>>>> it possible for you to debug ClobTransformer >>>>>>>>>>> adding(System.out.println >>>>>>>>>>> into ClobTransformer may help) >>>>>>>>>>> >>>>>>>>>>> On Fri, Apr 3, 2009 at 6:04 AM, ashokc <ash...@qualcomm.com> >>>>>>>>>>> wrote: >>>>>>>>>>>> >>>>>>>>>>>> Correcting my earlier post. It lost some lines some how. >>>>>>>>>>>> >>>>>>>>>>>> Hi, >>>>>>>>>>>> >>>>>>>>>>>> I have set up to import some oracle clob columns with DIH. I am >>>>>>>>>>>> using >>>>>>>>>>>> the >>>>>>>>>>>> latest nightly release. My config says, >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> <entity name="log" transformer="ClobTransformer" >>>>>>>>>>>> ... >>>>>>>>>>>> >>>>>>>>>>>> <field column="description" clob="true" name="description" >>>>>>>>>>>> /> >>>>>>>>>>>> .... >>>>>>>>>>>> >>>>>>>>>>>> </entity> >>>>>>>>>>>> >>>>>>>>>>>> But it does not seem to turn this clob into a String. The >>>>>>>>>>>> search >>>>>>>>>>>> results >>>>>>>>>>>> show: >>>>>>>>>>>> >>>>>>>>>>>> <doc> >>>>>>>>>>>> <float name="score">1.8670129</float> >>>>>>>>>>>> <str name="description">oracle.sql.c...@aed3a5</str> >>>>>>>>>>>> <int name="log_no">4486</int> >>>>>>>>>>>> </doc> >>>>>>>>>>>> >>>>>>>>>>>> Any pointers on why I do not get the 'string' out of the clob >>>>>>>>>>>> for >>>>>>>>>>>> indexing? >>>>>>>>>>>> Is the nightly war NOT the right one to use? >>>>>>>>>>>> >>>>>>>>>>>> Thanks for your help. >>>>>>>>>>>> >>>>>>>>>>>> - ashok >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> ashokc wrote: >>>>>>>>>>>>> >>>>>>>>>>>>> Hi, >>>>>>>>>>>>> >>>>>>>>>>>>> I have set up to import some oracle clob columns with DIH. I >>>>>>>>>>>>> am >>>>>>>>>>>>> using >>>>>>>>>>>>> the >>>>>>>>>>>>> latest nightly release. My config says, >>>>>>>>>>>>> >>>>>>>>>>>>> <entity name="description" transformer="ClobTransformer" ... >>>>>>>>>>>>> <field >>>>>>>>>>>>> column="description" clob="true" /> >>>>>>>>>>>>> .... >>>>>>>>>>>>> >>>>>>>>>>>>> </entity> >>>>>>>>>>>>> >>>>>>>>>>>>> But it does not seem to turn this clob into a String. The >>>>>>>>>>>>> search >>>>>>>>>>>>> results >>>>>>>>>>>>> show: >>>>>>>>>>>>> >>>>>>>>>>>>> <doc> >>>>>>>>>>>>> <float name="score">1.8670129</float> >>>>>>>>>>>>> <str name="description">oracle.sql.c...@aed3a5</str> >>>>>>>>>>>>> <int name="log_no">4486</int> >>>>>>>>>>>>> </doc> >>>>>>>>>>>>> >>>>>>>>>>>>> Any pointers on why I do not get the 'string' out of the clob >>>>>>>>>>>>> for >>>>>>>>>>>>> indexing? Is the nightly war NOT the right one to use? >>>>>>>>>>>>> >>>>>>>>>>>>> Thanks for your help. >>>>>>>>>>>>> >>>>>>>>>>>>> - ashok >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>>> View this message in context: >>>>>>>>>>>> http://www.nabble.com/Oracle-Clob-column-with-DIH-does-not-turn-to-String-tp22859837p22859865.html >>>>>>>>>>>> Sent from the Solr - User mailing list archive at Nabble.com. >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> --Noble Paul >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> View this message in context: >>>>>>>>>> http://www.nabble.com/Oracle-Clob-column-with-DIH-does-not-turn-to-String-tp22859837p22861630.html >>>>>>>>>> Sent from the Solr - User mailing list archive at Nabble.com. >>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> --Noble Paul >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> View this message in context: >>>>>>>> http://www.nabble.com/Oracle-Clob-column-with-DIH-does-not-turn-to-String-tp22859837p22867161.html >>>>>>>> Sent from the Solr - User mailing list archive at Nabble.com. >>>>>>>> >>>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> --Noble Paul >>>>>>> >>>>>>> >>>>>> >>>>>> -- >>>>>> View this message in context: >>>>>> http://www.nabble.com/Oracle-Clob-column-with-DIH-does-not-turn-to-String-tp22859837p22872184.html >>>>>> Sent from the Solr - User mailing list archive at Nabble.com. >>>>>> >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> --Noble Paul >>>>> >>>>> >>>> >>>> -- >>>> View this message in context: >>>> http://www.nabble.com/Oracle-Clob-column-with-DIH-does-not-turn-to-String-tp22859837p22872440.html >>>> Sent from the Solr - User mailing list archive at Nabble.com. >>>> >>>> >>> >>> >>> >>> -- >>> --Noble Paul >>> >>> >> >> -- >> View this message in context: >> http://www.nabble.com/Oracle-Clob-column-with-DIH-does-not-turn-to-String-tp22859837p22874217.html >> Sent from the Solr - User mailing list archive at Nabble.com. >> >> > > > > -- > --Noble Paul > > -- View this message in context: http://www.nabble.com/Oracle-Clob-column-with-DIH-does-not-turn-to-String-tp22859837p22883573.html Sent from the Solr - User mailing list archive at Nabble.com.
