it depends on what the search requirements are, so without knowing the details here are some vague pointers
you may only need to have fields for the columns you are going to be categorizing and searching on, this may be a small subset of the 800 and the rest can go into one large field to fulfil the full text search another thing to look into is the multi value fields, this can sometimes replace the one-to-many relationships in database also it may sometimes be worth while going to the original data source rather than the warehouse table, as this is already flattened and denormalised, the flattening and denormalizing will most likely be done a different way when solr indexing database type data, highly likely you will end up with less rows and less columns in the solr index, as each solr document can be seen as "multi-dimensional" ----- Original Message ----- From: "caman" <aboxfortheotherst...@gmail.com> To: solr-user@lucene.apache.org Sent: Tuesday, 2 February, 2010 1:23:01 AM Subject: Indexing an oracle warehouse table Hello all, hope someone can point me to right direction. I am trying to index an oracle warehouse table(TableA) with 850 columns. Out of the structure about 800 fields are CLOBs and are good candidate to enable full-text searching. Also have few columns which has relational link to other tables. I am clean on how to create a root entity and then pull data from other relational link as child entities. Most columns in TableA are named as field1,field2...field800. Now my question is how to organize the schema efficiently: First option: if my query is 'select * from TableA', Do I define <field name="attr1" column="FIELD1" /> for each of those 800 columns? Seems cumbersome. May be can write a script to generate XML instead of handwriting both in data-config.xml and schema.xml. OR Dont define any <field name="attr1" column="FIELD1" /> so that column in SOLR will be same as in the database table. But questions are 1)How do I define unique field in this scenario? 2) How to copy all the text fields to a common field for easy searching? Any helpful is appreciated. Please feel free to suggest any alternative way. Thanks -- View this message in context: http://old.nabble.com/Indexing-an-oracle-warehouse-table-tp27414263p27414263.html Sent from the Solr - User mailing list archive at Nabble.com.
