Re:
Hi We are using solr 4.4 . Please let me know the possible solutions to address my requirement. We have to fetch data from two tables Product , Order table. Product Table id Name P1ipad P2iphone 4 P3iphone 5 Order Table id order date product_id O1 1-Dec-2012 P1 O2 1-Dec-2012P2 O3 2-Dec-2012 P2 I want to show the details in UI as below O101-Dec-2012 On Sat, Nov 30, 2013 at 12:13 AM, subacini Arunkumar wrote: > Hi > > We are using solr 4.4 . Please let me know the possible solutions to > address my requirement. > > We have to fetch data from two tables Product , Order table. > > Product Table > > id Name > P1ipad > P2iphone 4 > P3iphone 5 > > > Order Table > > id order date product_id > O1 > >
Error integrating opennlp in solr
Hi Team , I am getting the stack of errors given below while integrating solr with OpenNLP. Please help. Caused by: org.apache.solr.common.SolrException: Plugin init failure for [schema.xml] fieldType "text_opennlp": Plugin init failure for [schema.xml] a nalyzer/tokenizer: Error loading class 'solr.OpenNLPTokenizerFactory' at org.apache.solr.util.plugin.AbstractPluginLoader.load(AbstractPluginLoader.j ava:177) at org.apache.solr.schema.IndexSchema.readSchema(IndexSchema.java:467) ... 15 more Caused by: org.apache.solr.common.SolrException: Plugin init failure for [schema.xml] analyzer/tokenizer: Error loading class 'solr.OpenNLPTokenizerFa ctory' With Regards, Arti Lamba Dainik Jagran - Dainik Jagran - Largest Read Daily of India with 56.5 Million Readers. (Source: Indian Readership Survey 2012 Q4)
single solr document with all fields from two different document types
Hi
Please let me know the possible solutions to address my requirement.
* Two tables might have millions of records with 50 columns in each table
* Expected output is same as what we get in SQL inner join
say For Eg, I have two tables Product , Order table.
*Product Table *
id Name
P1ipad
P2iphone 4
P3iphone 5
*Order Table*
id order date product_id
O1 1-Dec-2012 P1
O2 1-Dec-2012P2
O3 2-Dec-2012 P2
*Expected Output: *I want to show the details in UI as below [SQL inner
join ]
O101-Dec-2012 ipad
O2 1-Dec-2012 iPhone 4
O3 2-Dec-2012 iPhone 5
I tried setting up two solr cores , Product core & Order Core
*Option 1: Using Solr Join*
I got expected result but i was able to get columns only from one core (ie)
total 3 records but only product table columns
http://<….>/product/select?q=*&fq={!join from=product_id to=id
fromIndex=order}*
*Option 2: Using shards*
Created third core, but number of records is sum of(Product core + Order
Core) as documents are of different types and they are all unique(ie) 6
records
So how could i generate a single document with all fields from two
different document types in different cores.
Re:
1. Flatten the data into a single table. 2. Solr does not seem like a good solution for order data, especially live orders that need to be transactional. That is a great match to a standard relational DB. wunder On Nov 30, 2013, at 12:15 AM, subacini Arunkumar wrote: > Hi > > We are using solr 4.4 . Please let me know the possible solutions to > address my requirement. > > We have to fetch data from two tables Product , Order table. > > Product Table > > id Name > P1ipad > P2iphone 4 > P3iphone 5 > > > Order Table > > id order date product_id > O1 1-Dec-2012 P1 > O2 1-Dec-2012P2 > O3 2-Dec-2012 P2 > > I want to show the details in UI as below > > O101-Dec-2012 > > > On Sat, Nov 30, 2013 at 12:13 AM, subacini Arunkumar > wrote: > >> Hi >> >> We are using solr 4.4 . Please let me know the possible solutions to >> address my requirement. >> >> We have to fetch data from two tables Product , Order table. >> >> Product Table >> >> id Name >> P1ipad >> P2iphone 4 >> P3iphone 5 >> >> >> Order Table >> >> id order date product_id >> O1 >> >> -- Walter Underwood wun...@wunderwood.org
Migration from old solr.xml to the new solr.xml style
Hi, There is some way to automatically migrate from old solr.xml style to the new? /Yago - Best regards -- View this message in context: http://lucene.472066.n3.nabble.com/Migration-from-old-solr-xml-to-the-new-solr-xml-style-tp4104154.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Migration from old solr.xml to the new solr.xml style
Did you read here: https://cwiki.apache.org/confluence/display/solr/Moving+to+the+New+solr.xml+Format 2013/11/30 yriveiro > Hi, > > There is some way to automatically migrate from old solr.xml style to the > new? > > /Yago > > > > - > Best regards > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Migration-from-old-solr-xml-to-the-new-solr-xml-style-tp4104154.html > Sent from the Solr - User mailing list archive at Nabble.com. >
Re: Migration from old solr.xml to the new solr.xml style
Furkan, If I understand, I must change the solr.xml to new style and add an empty file in each core with the name core.properties, right? -- Yago Riveiro Sent with Sparrow (http://www.sparrowmailapp.com/?sig) On Saturday, November 30, 2013 at 7:36 PM, Furkan KAMACI wrote: > Did you read here: > https://cwiki.apache.org/confluence/display/solr/Moving+to+the+New+solr.xml+Format > > > 2013/11/30 yriveiro mailto:yago.rive...@gmail.com)> > > > Hi, > > > > There is some way to automatically migrate from old solr.xml style to the > > new? > > > > /Yago > > > > > > > > - > > Best regards > > -- > > View this message in context: > > http://lucene.472066.n3.nabble.com/Migration-from-old-solr-xml-to-the-new-solr-xml-style-tp4104154.html > > Sent from the Solr - User mailing list archive at Nabble.com > > (http://Nabble.com). > > > > >
Re: Migration from old solr.xml to the new solr.xml style
Right, there is no auto-migration tool. The empty core.properties file trick _assumes_ that all the default are acceptable. If you've done any custom stuff in your tags in old-style solr.xml, you'll have to create an equivalent entry in core.properties. Best, Erick On Sat, Nov 30, 2013 at 2:49 PM, Yago Riveiro wrote: > Furkan, > > If I understand, I must change the solr.xml to new style and add an empty > file in each core with the name core.properties, right? > > -- > Yago Riveiro > Sent with Sparrow (http://www.sparrowmailapp.com/?sig) > > > On Saturday, November 30, 2013 at 7:36 PM, Furkan KAMACI wrote: > > > Did you read here: > > > https://cwiki.apache.org/confluence/display/solr/Moving+to+the+New+solr.xml+Format > > > > > > 2013/11/30 yriveiro yago.rive...@gmail.com)> > > > > > Hi, > > > > > > There is some way to automatically migrate from old solr.xml style to > the > > > new? > > > > > > /Yago > > > > > > > > > > > > - > > > Best regards > > > -- > > > View this message in context: > > > > http://lucene.472066.n3.nabble.com/Migration-from-old-solr-xml-to-the-new-solr-xml-style-tp4104154.html > > > Sent from the Solr - User mailing list archive at Nabble.com ( > http://Nabble.com). > > > > > > > > > > > >
Re: Migration from old solr.xml to the new solr.xml style
Erick, I have no custom stuff: // all cores created with COLLECTION API here. This new method scans the folder where the cores are, is fast with boxes with high number of cores? -- Yago Riveiro Sent with Sparrow (http://www.sparrowmailapp.com/?sig) On Saturday, November 30, 2013 at 7:52 PM, Erick Erickson wrote: > Right, there is no auto-migration tool. > > The empty core.properties file trick _assumes_ > that all the default are acceptable. If you've > done any custom stuff in your tags > in old-style solr.xml, you'll have to create an > equivalent entry in core.properties. > > Best, > Erick > > > On Sat, Nov 30, 2013 at 2:49 PM, Yago Riveiro (mailto:yago.rive...@gmail.com)>wrote: > > > Furkan, > > > > If I understand, I must change the solr.xml to new style and add an empty > > file in each core with the name core.properties, right? > > > > -- > > Yago Riveiro > > Sent with Sparrow (http://www.sparrowmailapp.com/?sig) > > > > > > On Saturday, November 30, 2013 at 7:36 PM, Furkan KAMACI wrote: > > > > > Did you read here: > > https://cwiki.apache.org/confluence/display/solr/Moving+to+the+New+solr.xml+Format > > > > > > > > > 2013/11/30 yriveiro > > (mailto:yago.rive...@gmail.com) (mailto: > > yago.rive...@gmail.com (mailto:yago.rive...@gmail.com))> > > > > > > > Hi, > > > > > > > > There is some way to automatically migrate from old solr.xml style to > > the > > > > new? > > > > > > > > /Yago > > > > > > > > > > > > > > > > - > > > > Best regards > > > > -- > > > > View this message in context: > > > > > > > > > > > http://lucene.472066.n3.nabble.com/Migration-from-old-solr-xml-to-the-new-solr-xml-style-tp4104154.html > > > > Sent from the Solr - User mailing list archive at Nabble.com > > > > (http://Nabble.com) ( > > > > > > > http://Nabble.com). > > > > > > > > > > > > > >
Re: Migration from old solr.xml to the new solr.xml style
There is no automatic tool that help you migrate. Besides the Erick's answer if you have any problems you can ask it. Thanks; Furkan KAMACI 2013/11/30 Erick Erickson > Right, there is no auto-migration tool. > > The empty core.properties file trick _assumes_ > that all the default are acceptable. If you've > done any custom stuff in your tags > in old-style solr.xml, you'll have to create an > equivalent entry in core.properties. > > Best, > Erick > > > On Sat, Nov 30, 2013 at 2:49 PM, Yago Riveiro >wrote: > > > Furkan, > > > > If I understand, I must change the solr.xml to new style and add an empty > > file in each core with the name core.properties, right? > > > > -- > > Yago Riveiro > > Sent with Sparrow (http://www.sparrowmailapp.com/?sig) > > > > > > On Saturday, November 30, 2013 at 7:36 PM, Furkan KAMACI wrote: > > > > > Did you read here: > > > > > > https://cwiki.apache.org/confluence/display/solr/Moving+to+the+New+solr.xml+Format > > > > > > > > > 2013/11/30 yriveiro > yago.rive...@gmail.com)> > > > > > > > Hi, > > > > > > > > There is some way to automatically migrate from old solr.xml style to > > the > > > > new? > > > > > > > > /Yago > > > > > > > > > > > > > > > > - > > > > Best regards > > > > -- > > > > View this message in context: > > > > > > > http://lucene.472066.n3.nabble.com/Migration-from-old-solr-xml-to-the-new-solr-xml-style-tp4104154.html > > > > Sent from the Solr - User mailing list archive at Nabble.com ( > > http://Nabble.com). > > > > > > > > > > > > > > > > > > > >
Re:
Thanks Walter for the reply. Here is my complete requirement.
Please let me know the possible solutions to address my requirement.
* Two tables might have millions of records with 50 columns in each table
* Expected output is same as what we get in SQL inner join
say For Eg, I have two tables Product , Order table.
*Product Table *
id Name
P1ipad
P2iphone 4
P3iphone 5
*Order Table*
id order date product_id
O1 1-Dec-2012 P1
O2 1-Dec-2012P2
O3 2-Dec-2012 P2
*Expected Output: *I want to show the details in UI as below [SQL inner
join ]
O101-Dec-2012 ipad
O2 1-Dec-2012 iPhone 4
O3 2-Dec-2012 iPhone 5
I tried setting up two solr cores , Product core & Order Core
*Option 1: Using Solr Join*
I got expected result but i was able to get columns only from one core (ie)
total 3 records but only product table columns
http://<….>/product/select?q=*&fq={!join from=product_id to=id
fromIndex=order}*
*Option 2: Using shards*
Created third core, but number of records is sum of(Product core + Order
Core) as documents are of different types and they are all unique(ie) 6
records
So how could i generate a single document with all fields from two
different document types in different cores.
On Sat, Nov 30, 2013 at 8:04 AM, Walter Underwood wrote:
> 1. Flatten the data into a single table.
>
> 2. Solr does not seem like a good solution for order data, especially live
> orders that need to be transactional. That is a great match to a standard
> relational DB.
>
> wunder
>
> On Nov 30, 2013, at 12:15 AM, subacini Arunkumar
> wrote:
>
> > Hi
> >
> > We are using solr 4.4 . Please let me know the possible solutions to
> > address my requirement.
> >
> > We have to fetch data from two tables Product , Order table.
> >
> > Product Table
> >
> > id Name
> > P1ipad
> > P2iphone 4
> > P3iphone 5
> >
> >
> > Order Table
> >
> > id order date product_id
> > O1 1-Dec-2012 P1
> > O2 1-Dec-2012P2
> > O3 2-Dec-2012 P2
> >
> > I want to show the details in UI as below
> >
> > O101-Dec-2012
> >
> >
> > On Sat, Nov 30, 2013 at 12:13 AM, subacini Arunkumar >wrote:
> >
> >> Hi
> >>
> >> We are using solr 4.4 . Please let me know the possible solutions to
> >> address my requirement.
> >>
> >> We have to fetch data from two tables Product , Order table.
> >>
> >> Product Table
> >>
> >> id Name
> >> P1ipad
> >> P2iphone 4
> >> P3iphone 5
> >>
> >>
> >> Order Table
> >>
> >> id order date product_id
> >> O1
> >>
> >>
>
> --
> Walter Underwood
> wun...@wunderwood.org
>
>
>
>
Re:
Several million rows is not a big deal for Solr, especially if you don't need
really fast response. Lots of columns are also not a big problem.
Join the tables, like you would to make a view, and store that in Solr.
But again, do not use Solr for transactional data.
wunder
On Nov 30, 2013, at 5:04 PM, subacini Arunkumar wrote:
> Thanks Walter for the reply. Here is my complete requirement.
>
>
> Please let me know the possible solutions to address my requirement.
>
> * Two tables might have millions of records with 50 columns in each table
>
> * Expected output is same as what we get in SQL inner join
>
> say For Eg, I have two tables Product , Order table.
>
> *Product Table *
>
> id Name
>
> P1ipad
>
> P2iphone 4
>
> P3iphone 5
>
> *Order Table*
>
> id order date product_id
>
> O1 1-Dec-2012 P1
>
> O2 1-Dec-2012P2
>
> O3 2-Dec-2012 P2
>
>
> *Expected Output: *I want to show the details in UI as below [SQL inner
> join ]
>
> O101-Dec-2012 ipad
>
> O2 1-Dec-2012 iPhone 4
>
> O3 2-Dec-2012 iPhone 5
>
>
> I tried setting up two solr cores , Product core & Order Core
>
> *Option 1: Using Solr Join*
>
> I got expected result but i was able to get columns only from one core (ie)
> total 3 records but only product table columns
>
>
> http://<….>/product/select?q=*&fq={!join from=product_id to=id
> fromIndex=order}*
>
>
> *Option 2: Using shards*
>
> Created third core, but number of records is sum of(Product core + Order
> Core) as documents are of different types and they are all unique(ie) 6
> records
>
> So how could i generate a single document with all fields from two
> different document types in different cores.
>
>
> On Sat, Nov 30, 2013 at 8:04 AM, Walter Underwood
> wrote:
>
>> 1. Flatten the data into a single table.
>>
>> 2. Solr does not seem like a good solution for order data, especially live
>> orders that need to be transactional. That is a great match to a standard
>> relational DB.
>>
>> wunder
>>
>> On Nov 30, 2013, at 12:15 AM, subacini Arunkumar
>> wrote:
>>
>>> Hi
>>>
>>> We are using solr 4.4 . Please let me know the possible solutions to
>>> address my requirement.
>>>
>>> We have to fetch data from two tables Product , Order table.
>>>
>>> Product Table
>>>
>>> id Name
>>> P1ipad
>>> P2iphone 4
>>> P3iphone 5
>>>
>>>
>>> Order Table
>>>
>>> id order date product_id
>>> O1 1-Dec-2012 P1
>>> O2 1-Dec-2012P2
>>> O3 2-Dec-2012 P2
>>>
>>> I want to show the details in UI as below
>>>
>>> O101-Dec-2012
>>>
>>>
>>> On Sat, Nov 30, 2013 at 12:13 AM, subacini Arunkumar >> wrote:
>>>
Hi
We are using solr 4.4 . Please let me know the possible solutions to
address my requirement.
We have to fetch data from two tables Product , Order table.
Product Table
id Name
P1ipad
P2iphone 4
P3iphone 5
Order Table
id order date product_id
O1
>>
>> --
>> Walter Underwood
>> wun...@wunderwood.org
>>
>>
>>
>>
--
Walter Underwood
wun...@wunderwood.org
Re:
I have product core, order core ,Is there a way in solr to fetch all
fields from two cores in a single query?Solr join can fetch fields from
only 1 core.
If we cant , how to achieve this??, is the only option is to index
denormalize data??
On Sat, Nov 30, 2013 at 8:08 PM, Walter Underwood wrote:
> Several million rows is not a big deal for Solr, especially if you don't
> need really fast response. Lots of columns are also not a big problem.
>
> Join the tables, like you would to make a view, and store that in Solr.
>
> But again, do not use Solr for transactional data.
>
> wunder
>
> On Nov 30, 2013, at 5:04 PM, subacini Arunkumar
> wrote:
>
> > Thanks Walter for the reply. Here is my complete requirement.
> >
> >
> > Please let me know the possible solutions to address my requirement.
> >
> > * Two tables might have millions of records with 50 columns in each table
> >
> > * Expected output is same as what we get in SQL inner join
> >
> > say For Eg, I have two tables Product , Order table.
> >
> > *Product Table *
> >
> > id Name
> >
> > P1ipad
> >
> > P2iphone 4
> >
> > P3iphone 5
> >
> > *Order Table*
> >
> > id order date product_id
> >
> > O1 1-Dec-2012 P1
> >
> > O2 1-Dec-2012P2
> >
> > O3 2-Dec-2012 P2
> >
> >
> > *Expected Output: *I want to show the details in UI as below [SQL inner
> > join ]
> >
> > O101-Dec-2012 ipad
> >
> > O2 1-Dec-2012 iPhone 4
> >
> > O3 2-Dec-2012 iPhone 5
> >
> >
> > I tried setting up two solr cores , Product core & Order Core
> >
> > *Option 1: Using Solr Join*
> >
> > I got expected result but i was able to get columns only from one core
> (ie)
> > total 3 records but only product table columns
> >
> >
> > http://<….>/product/select?q=*&fq={!join from=product_id to=id
> > fromIndex=order}*
> >
> >
> > *Option 2: Using shards*
> >
> > Created third core, but number of records is sum of(Product core + Order
> > Core) as documents are of different types and they are all unique(ie) 6
> > records
> >
> > So how could i generate a single document with all fields from two
> > different document types in different cores.
> >
> >
> > On Sat, Nov 30, 2013 at 8:04 AM, Walter Underwood >wrote:
> >
> >> 1. Flatten the data into a single table.
> >>
> >> 2. Solr does not seem like a good solution for order data, especially
> live
> >> orders that need to be transactional. That is a great match to a
> standard
> >> relational DB.
> >>
> >> wunder
> >>
> >> On Nov 30, 2013, at 12:15 AM, subacini Arunkumar
> >> wrote:
> >>
> >>> Hi
> >>>
> >>> We are using solr 4.4 . Please let me know the possible solutions to
> >>> address my requirement.
> >>>
> >>> We have to fetch data from two tables Product , Order table.
> >>>
> >>> Product Table
> >>>
> >>> id Name
> >>> P1ipad
> >>> P2iphone 4
> >>> P3iphone 5
> >>>
> >>>
> >>> Order Table
> >>>
> >>> id order date product_id
> >>> O1 1-Dec-2012 P1
> >>> O2 1-Dec-2012P2
> >>> O3 2-Dec-2012 P2
> >>>
> >>> I want to show the details in UI as below
> >>>
> >>> O101-Dec-2012
> >>>
> >>>
> >>> On Sat, Nov 30, 2013 at 12:13 AM, subacini Arunkumar <
> subac...@gmail.com
> >>> wrote:
> >>>
> Hi
>
> We are using solr 4.4 . Please let me know the possible solutions to
> address my requirement.
>
> We have to fetch data from two tables Product , Order table.
>
> Product Table
>
> id Name
> P1ipad
> P2iphone 4
> P3iphone 5
>
>
> Order Table
>
> id order date product_id
> O1
>
>
> >>
> >> --
> >> Walter Underwood
> >> wun...@wunderwood.org
> >>
> >>
> >>
> >>
>
> --
> Walter Underwood
> wun...@wunderwood.org
>
>
>
>
Re: solr as a service for multiple projects in the same environment
The risk is if you buy mistake mess up a cluster while doing maintenance on one of the systems, you can affect the other system. Its a pretty amorfic risk. Aside from having multiple systems share the same hardware resources, I don't see any other real risk. Are your collections share the same topology in terms of shards and replicas? Do you manually configure the nodes on which each collection is created so that you'll still have some level of seperation between the systems? michael.boom wrote > Hi, > > There's nothing unusual in what you are trying to do, this scenario is > very common. > > To answer your questions: >> 1. as I understand I can separate the configs of each collection in >> zookeeper. is it correct? > Yes, that's correct. You'll have to upload your configs to ZK and use the > CollectionAPI to create your collections. > >>2.are there any solr operations that can be performed on collection A and somehow affect collection B? > No, I can't think of any cross-collection operation. Here you can find a > list of collection related operations: > https://cwiki.apache.org/confluence/display/solr/Collections+API > >>3. is the solr cache separated for each collection? > Yes, separate and configurable in solrconfig.xml for each collection. > >>4. I assume that I'll encounter a problem with the os cache, when the different indices will compete on the same memory, right? how severe is this issue? > Hardware can be a bottleneck. If all your collection will face the same > load you should try to give solr a RAM amount equal to the index size (all > indexes) > >>5. any other advice on building such an architecture? does the maintenance overhead of maintaining multiple clusters in production really overwhelm the problems and risks of using the same cluster for multiple systems? > I was in the same situation as you, and putting everything in multiple > collections in just one cluster made sense for me : it's easier to manage > and has no obvious downside. As for "risks of using the same cluster for > multiple systems" they are pretty much the same in both scenarios. Only > that with multiple clusters you'll have much more machines to manage. -- View this message in context: http://lucene.472066.n3.nabble.com/solr-as-a-service-for-multiple-projects-in-the-same-environment-tp4103523p4104206.html Sent from the Solr - User mailing list archive at Nabble.com.
