multi core join and simple indexed join

2013-09-30 Thread Marcelo Elias Del Valle
Comparing indexed joins on multiple core or on the same core... Which one would be faster? I am guessing doing it on multiple cores would be faster, as the index on each core would be smaller... Any thoughts on that? []s

Re: Hello and help :)

2013-09-30 Thread Marcelo Elias Del Valle
Socratees, You wrote: "Or, What if you can facet by the field, and group by the field count, then *apply facet filtering to exclude all filters with count less than 5?*" That's exactly what I want, I just couldn't figure how to do it! Any idea how could I write this query? Best regards, Marcelo.

Re: Hello and help :)

2013-09-30 Thread Marcelo Elias Del Valle
Upayavira, First of all, thanks for the answers. We have considerer the possibily of doing several queries, however in hour case we want a count to show to the user (should take less than 2 seconds) and we could have millions of rows (being million of queries) to get this count. Isn't

Re: Hello and help :)

2013-09-27 Thread Marcelo Elias Del Valle
Ssami, I work with Matheus and I am helping him to take a look at this problem. We took a look at result grouping, thinking it could help us, but it has two drawbacks: - We cannot have multivalued fields, if I understood it correctly. But ok, we could manage that... - Suppose some qu

Re: amount of values in a multi value field - is denormalization always the best option?

2013-07-11 Thread Marcelo Elias Del Valle
well as the full document. And, there is no > > way to address or synchronize individual elements of multivalued fields. > > > > Joins are great... if used in moderation. Heavy use of joins is not a > > great idea. > > > > -- Jack Krupansky > > >

nested queries + joins performance

2013-07-11 Thread Marcelo Elias Del Valle
rd"); doc2.addField("acessory2", "Mouse"); doc2.addField("root_id", "room2"); solr.add(doc2); doc2 = new SolrInputDocument(); doc2.addField("id", "computer6"); doc2.addField("acessory1", "Monitor"); doc2.addField("acessory2", "Tablet"); doc2.addField("root_id", "room2"); solr.add(doc2); UpdateResponse response = solr.add(doc); if (response.getStatus() != 0) throw new DGIndexException("Could not insert document to solr!"); solr.commit(); } Best regards, -- Marcelo Elias Del Valle http://mvalle.com - @mvallebr

Re: amount of values in a multi value field - is denormalization always the best option?

2013-07-10 Thread Marcelo Elias Del Valle
f used in moderation. Heavy use of joins is not a > great idea. > > -- Jack Krupansky > > -Original Message- From: Marcelo Elias Del Valle > Sent: Wednesday, July 10, 2013 5:37 PM > To: solr-user@lucene.apache.org > Subject: amount of values in a multi value field - is

amount of values in a multi value field - is denormalization always the best option?

2013-07-10 Thread Marcelo Elias Del Valle
ossible in an extreme case like this? Would you share my thoughts if I said denormalization is not always the right option? Best regards, -- Marcelo Elias Del Valle http://mvalle.com - @mvallebr

Re: more than 1 join on the same query

2013-07-10 Thread Marcelo Elias Del Valle
Got puzzled now! If instead of AND I use &, it works: fq = {!join from=root_id to=id}type:leg & {!join from=root_id to=id}type:arm I am definitly missing something, I don't know what... Shouldn't both be the same? []s 2013/7/10 Marcelo Elias Del Valle > Dominique,

Re: more than 1 join on the same query

2013-07-10 Thread Marcelo Elias Del Valle
guess in your sample &attr1 applies to > the body, not the legs, that could explain your problem > > > 2013/7/10 Marcelo Elias Del Valle > > > This > > fq = {!join from=root_id to=id}type:leg&attr1=right OR {!join > from=root_id > > to=id}type:arm&attr1

Re: more than 1 join on the same query

2013-07-10 Thread Marcelo Elias Del Valle
lleux > try fq = {!join from=root_id to=id}type:leg&attr1=right OR {!join > from=root_id to=id}type:arm&attr1=left > > Dom > > > 2013/7/10 Marcelo Elias Del Valle > > > Hello, > > > > I am playing with joins here just to test what I can do wi

more than 1 join on the same query

2013-07-10 Thread Marcelo Elias Del Valle
= *:* - fq = {!join from=root_id to=id}type:arm&attr1=left To select the body based on the right leg: - q = *:* - fq = {!join from=root_id to=id}type:leg&attr1=right But what if I need both left arm AND right leg? Should I do 2 joins? Best regards, -- Marcelo Elias Del Va

Re: join not working with UUIDs

2013-07-10 Thread Marcelo Elias Del Valle
Worked :D Thanks a lot! 2013/7/10 Marcelo Elias Del Valle > root_id is a dynamic field... But should the type of the field change > according to the values? Because using the same configuration but using > "room1" as value, it works. > > Let me c

Re: join not working with UUIDs

2013-07-10 Thread Marcelo Elias Del Valle
te a fixed field root_id and check if it works... Thanks for the hint! 2013/7/10 Erick Erickson > What kind of field is root_id? If it's tokenized or not the > same type as id, that could account for it. > > Best > Erick > > On Tue, Jul 9, 2013 at 7:34 PM, Marcelo

join not working with UUIDs

2013-07-09 Thread Marcelo Elias Del Valle
1:Teclado"); QueryResponse response = DGSolrServer.get().query(query); long numFound = response.getResults().getNumFound(); it returns zero results. However, if I use "room1" for first document's id and for root_id field on second document, it works. Any idea why? What am I missing? Best regards, -- Marcelo Elias Del Valle http://mvalle.com - @mvallebr

Re: joins in solr cloud - good or bad idea?

2013-07-08 Thread Marcelo Elias Del Valle
t inside this: > http://code4lib.org/files/2ndOrderOperatorsv2.pdf > > roman > > > On Mon, Jul 8, 2013 at 4:03 PM, Marcelo Elias Del Valle > wrote: > > > Hello all, > > > > I am using Solr Cloud today and I have the following need: > > > >- My queri

joins in solr cloud - good or bad idea?

2013-07-08 Thread Marcelo Elias Del Valle
enormalize data in this case. Is the join my best option here? Best regards, -- Marcelo Elias Del Valle http://mvalle.com - @mvallebr

Re: Solr limitations

2013-07-08 Thread Marcelo Elias Del Valle
t "going wild" > with dynamic fields, it is common that they start "going wild" with their > names as well, using spaces, colons, slashes, etc. that cannot be parsed in > the "fl" and "qf" parameters, for example. Please don't go there! > >

Solr limitations

2013-07-08 Thread Marcelo Elias Del Valle
Hello everyone, I am trying to search information about possible solr limitations I should consider in my architecture. Things like max number of dynamic fields, max number o documents in SolrCloud, etc. Does anyone know where I can find this info? Best regards, -- Marcelo Elias Del

Best architecture - mixing more than 1 instance of the same index

2013-02-26 Thread Marcelo Elias Del Valle
Hello all, I am facing a problem on how to structure Sol cluster and indexes. Current problem: We developed an DMP (Data Management Platform) for online advertisement purposes... and we are currently using Solr in order to index all the data we collect and provide "ultra-fast user segmentation"

Re: If we Open Source our platform, would it be interesting to you?

2013-02-22 Thread Marcelo Elias Del Valle
at building a topic map > of all your resources. > > Jack > > On Thu, Feb 21, 2013 at 11:54 AM, Marcelo Elias Del Valle > wrote: > > Hello David, > > > > First of all, thanks for answering! > > > > 2013/2/21 David Quarterman > > >

Re: If we Open Source our platform, would it be interesting to you?

2013-02-21 Thread Marcelo Elias Del Valle
Hello David, First of all, thanks for answering! 2013/2/21 David Quarterman > Looked through your site and the framework looks very powerful as an > aggregator. We do a lot of data aggregation from many different sources in > many different formats (XML, JSON, text, CSV, etc) using RDBMS a

Re: If we Open Source our platform, would it be interesting to you?

2013-02-20 Thread Marcelo Elias Del Valle
Hello Alexandre, 2013/2/20 Alexandre Rafalovitch > How does this compare to Pentaho Kettle? http://kettle.pentaho.com/ > > I am not terribly familiar with this space, so - if the question is stupid, > feel free to address it appropriately. :-) Don't worry, it's not stupid. I will make my best

Re: If we Open Source our platform, would it be interesting to you?

2013-02-20 Thread Marcelo Elias Del Valle
Hello James, First of all, thanks for your feedback. I will try to clarify some questions bellow. 2013/2/20 Dyer, James > I only looked at your link super fast, but this seems like a very viable > alternative to Solr's DIH. DIH does the job fairly well but we've > struggled to have develo

If we Open Source our platform, would it be interesting to you?

2013-02-20 Thread Marcelo Elias Del Valle
Hello All, I’m sending this email because I think it may be interesting for Solr users, as this project have a strong usage of Solr platform. We are strongly considering opening the source of our DMP (Data Management Platform), if it proves to be technically interesting to other developers / comp

Re: is it possible to index

2012-10-24 Thread Marcelo Elias Del Valle
This is gold info for me! Thanks! 2012/10/24 Martin Koch > In my experience, about as fast as you can push the new data :) Depending > on the size of your records, this should be a matter of seconds. > > /Martin Koch > > On Wed, Oct 24, 2012 at 9:01 PM, Marcelo Elias D

Re: is it possible to index

2012-10-24 Thread Marcelo Elias Del Valle
r/vendor you indexed and false (or just left out) for all the > rest and q=blahblah&fq=cust_filter:true. > > Hope that helps > Erick > > On Wed, Oct 24, 2012 at 12:01 PM, Marcelo Elias Del Valle > wrote: > > Hello, > > > > I am new to Solr and I have a scenario

is it possible to index

2012-10-24 Thread Marcelo Elias Del Valle
frequency I update vendors, but have vendor + customers in a single document would obly me to do the full update. Does anyone have a good solution for this I am not being able to see? I might be missing some basic concept here... Thanks, -- Marcelo Elias Del Valle http://mvalle.com - @mvallebr

Re: help with solritas config

2012-10-24 Thread Marcelo Elias Del Valle
write another email with my current doubts, but I think I understood the joins now, they just were not what I was expecting. Maybe I am misunderstanding some concepts... Best regards, Marcelo. 2012/10/24 Marcelo Elias Del Valle > Shawn, > > First of all, thanks a lot for your a

Re: help with solritas config

2012-10-24 Thread Marcelo Elias Del Valle
eady installed in solr 4? Sorry for the amount of questions. ;-) Thanks, Marcelo Valle. 2012/10/24 Shawn Heisey > On 10/24/2012 8:05 AM, Marcelo Elias Del Valle wrote: > >> I saw there is some documentation in solr wiki for SearchHandler and >> VelocityResponseWri