Re: CDCR: Help With Tlog Growth Issues

2016-12-02 Thread Renaud Delbru
ormed, the source cluster should buffer updates until the whole-index replication is completed, otherwise we might miss some updates.. [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=62687462#CrossDataCenterReplication(CDCR)-TheBufferElement Kind Regards -- Renaud Delbru On

Re: CDCR: Help With Tlog Growth Issues

2016-12-01 Thread Renaud Delbru
should run the command `/cdcr?action=DISABLEBUFFER`. Kind Regards -- Renaud Delbru On 10/11/2016 23:09, Thomas Tickle wrote: I am having an issue with cdcr that I could use some assistance in resolving. I followed the instructions found here: https://cwiki.apache.org/confluence/pages

Re: how to sampling search result

2016-09-30 Thread Renaud Delbru
straightforward to implement. [1] https://www.elastic.co/guide/en/elasticsearch/guide/current/random-scoring.html -- Renaud Delbru On 27/09/16 15:57, googoo wrote: Hi, Is it possible I can sampling based on "search result"? Like run query first, and search result return 1 million documents. W

Re: CDCR (Solr6.x) does not start

2016-07-05 Thread Renaud Delbru
queues is empty The empty queue seems to indicate there is an issue, and that cdcr was unable to instantiate the replicator for the target cluster. Just to be sure, your source cluster has 4 shards, but not replica ? If it has replicas, can you ensure that you execute these command on the shard leader. Kind Regards -- Renaud Delbru

Re: Solr6 CDCR issue with a 3 cloud design

2016-07-05 Thread Renaud Delbru
curl 'http://target_cluster:8983/solr/collection_name/update?commit=true' You can also try to configure an autocommit on your target cluster [1] [1] https://cwiki.apache.org/confluence/display/solr/UpdateHandlers+in+SolrConfig#UpdateHandlersinSolrConfig-autoCommit Kind regards -- Renaud Delbru -

Re: Regarding CDCR SOLR 6

2016-06-21 Thread Renaud Delbru
cation is going. In the cwiki [1], there are also some recommendations on how to monitor the system [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=62687462 Kind Regards -- Renaud Delbru | | |Thanks again, your inputs were very helpful.| On Tue, Jun 14, 2016 at 7:10 PM, B

Re: Encryption to Solr indexes – Using Custom Codec

2016-06-21 Thread Renaud Delbru
e the lib directives in your solrconfig.xml [1] [1] https://cwiki.apache.org/confluence/display/solr/Lib+Directives+in+SolrConfig -- Renaud Delbru On 20/06/16 15:42, Sidana, Mohit wrote: Hello, As Part of my studies I am exploring the solutions which can be used for Lucene/Solr Index encr

Re: Solr6 CDCR issue with a 3 cloud design

2016-06-14 Thread Renaud Delbru
size not equal to 0 ? -- Renaud Delbru On 09/06/16 08:55, dmitry.medve...@barclays.com wrote: I've set up a 3 cloud CDCR: Source => Target1-Source2 => Target2 CDCR environment, and the replication process works perfectly, but: when I shutdown Target1-Source2 cloud (the mediator, for

Re: Regarding CDCR SOLR 6

2016-06-14 Thread Renaud Delbru
. -- Renaud Delbru On 14/06/16 06:41, Bharath Kumar wrote: Hi, I have setup cross data center replication using solr 6, i want to know why the buffer needs to be enabled on the source cluster? Even if the buffer is not enabled, i am able to replicate the data between source and target sites. What

Re: Need Help with Solr 6.0 Cross Data Center Replication

2016-06-08 Thread Renaud Delbru
Hi, unfortunately no, I haven't had the time to reproduce your settings with separated zookeeper instances. I'll update if I have something. -- Renaud Delbru On 07/06/16 16:55, Satvinder Singh wrote: Hi, Any updates on this?? Thanks Satvi

Re: Solr 6 CDCR does not work

2016-05-30 Thread Renaud Delbru
send a commit command on the target to ensure that the latest replicated documents are visible. [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=62687462#CrossDataCenterReplication%28CDCR%29-Monitoringcommands -- Renaud Delbru On 29/05/16 12:10, Adam Majid Sanjaya wrote: I’m

Re: Inconsistent Solr document count on Target clouds when replicating data in Solr6 CDCR

2016-05-19 Thread Renaud Delbru
visible. Cdcr does not replicate commit operations, and let the target cluster handle the refresh. You can try to manually execute a commit operation on the target cluster and see if all the documents appears. Kind Regards -- Renaud Delbru On 19/05/16 17:39, dmitry.medve...@barclays.com wrote: I&#x

Re: Need Help with Solr 6.0 Cross Data Center Replication

2016-05-19 Thread Renaud Delbru
Hi Abdel, have you reloaded the collection [1] after uploading the configuration to zookeeper ? [1] https://cwiki.apache.org/confluence/display/solr/Collections+API#CollectionsAPI-api2 -- Renaud Delbru On 16/05/16 17:29, Abdel Belkasri wrote: Thanks Renaud. Here is my setup: 1- I have

Re: Need Help with Solr 6.0 Cross Data Center Replication

2016-05-16 Thread Renaud Delbru
Thanks Satvinder, Tomorrow, I'll try to reproduce the issue with your steps and will let you know. Regards -- Renaud Delbru On 16/05/16 16:53, Satvinder Singh wrote: Hi, So the way I am doing it is, for both for the Target and Source side, I took a copy of the sample_techproducts_c

Re: Need Help with Solr 6.0 Cross Data Center Replication

2016-05-16 Thread Renaud Delbru
prior to the CDCR configuration ? @Erik: I have noticed a small issue in the CDCR page of the reference guide. In the code snippet in Configuration -> Source Configuration, the element is nested within the . Thanks Regards -- Renaud Delbru On 15/05/16 23:13, Abdel Belkasri wrote: Erick,

Re: Cross Data Center Replication - ERROR

2016-05-12 Thread Renaud Delbru
Hi Abdel, Your configuration looks ok regarding the cdcr update log. Could you tell us a bit more about your Solr installation ? More specifically, does the solr instances, both source and target, contain one collection that was created prior the configuration of cdcr ? Best, -- Renaud

Re: SolrCloud - Fails to delete documents when some shard is down

2016-03-21 Thread Renaud Delbru
fundamental problem here... As Erick said, what would be the cause to have a full shard and all its replicas going down at the same time ? Usually, if a shard has multiple replicas, and one node goes down, the replicas on the other nodes should take the lead for this shard, and the delete querie

Re: Solr 6.0

2016-02-25 Thread Renaud Delbru
running now for months in a large production deployment without any known issues. Erick, who took care of committing it into the trunk, was planning to release it as part of 6.0. -- Renaud Delbru

Re: Index complex JSON data in SOLR

2014-11-20 Thread Renaud Delbru
Elasticsearch). It also index the full json into a SIREn's field to support nested queries. [1] http://siren.solutions/siren/downloads/ [2] http://siren.solutions/manual/solr-configuration-update-handler.html -- Renaud Delbru On 11/15/2014 10:05 PM, David Lee wrote: Hi All, How do I index complex

[ANN] SIREn, a Lucene/Solr plugin for rich JSON data search

2014-07-23 Thread Renaud Delbru
[4] https://github.com/sindicetech/siren -- Renaud Delbru CTO SIREn Solutions

Re: Obtaining query AST?

2011-05-31 Thread Renaud Delbru
processors). One time you have your own query parser, then it is straightforward to plug it into Solr. [1] http://lucene.apache.org/java/3_1_0/api/contrib-queryparser/index.html -- Renaud Delbru On 31/05/11 19:24, dar...@ontrenet.com wrote: Hi, I want to write my own query expander. It needs to

Resolved- Re: Replication Error - Index fetch failed - File Not Found & OverlappingFileLockException

2011-05-30 Thread Renaud Delbru
the ml, -- Renaud Delbru On 30/05/11 21:52, Renaud Delbru wrote: Hi, For months, we were using apache solr 3.1.0 snapshots without problems. Recently, we have upgraded our index to apache solr 3.1.0, and also moved to a multi-core infrastructure (4 core per nodes, each core having its own index

Replication Error - Index fetch failed - File Not Found & OverlappingFileLockException

2011-05-30 Thread Renaud Delbru
problem occurring again. Have you some idea on what can be the cause ? Or a solution to avoid such problem ? [1] http://pastebin.com/vbnyrUgJ Thanks in advance -- Renaud Delbru

Re: Indexing documents with "complex multivalued fields"

2011-05-23 Thread Renaud Delbru
Hi, you could look at this recent thread [1], it is similar to your problem. [1] http://search.lucidimagination.com/search/document/33ec1a98d3f93217/search_across_related_correlated_multivalue_fields_in_solr#1f66876c782c78d5 -- Renaud Delbru On 23/05/11 14:40, anass talby wrote: Hi, I&#

Re: Support for huge data set?

2011-05-13 Thread Renaud Delbru
for indexing semi-structured data. This plugin is adding much more data to the index than plain Solr. So you can expect even better performance by using plain solr (with respect to indexing performance). [1] http://sindice.com -- Renaud Delbru On 12/05/11 17:59, atreyu wrote: Hi, I have about

Re: Search across related/correlated multivalue fields in Solr

2011-04-27 Thread Renaud Delbru
On 27/04/11 19:50, Walter Underwood wrote: This kind of thing is really easy in an XML database. That is an XPath expression, not even a search. Indeed, in fact SIREn is based on a XML IR technique, i.e., a simplified node-based indexing scheme. -- Renaud Delbru

Re: Search across related/correlated multivalue fields in Solr

2011-04-27 Thread Renaud Delbru
On 27/04/11 19:37, Renaud Delbru wrote: Hi Jason, On 27/04/11 19:25, Jason Rutherglen wrote: Renaud, Can you provide a brief synopsis of how your system works? SIREn provides a new "field type" for Solr. In this particular SIREn field, the data is not a piece of text, but is orga

Re: Search across related/correlated multivalue fields in Solr

2011-04-27 Thread Renaud Delbru
understand (maybe in private). Regards, -- Renaud Delbru

Re: Search across related/correlated multivalue fields in Solr

2011-04-27 Thread Renaud Delbru
+Tabular+Data Kind Regards, -- Renaud Delbru On 27/04/11 18:30, ronotica wrote: The nature of my project is such that search is needed and specifically search across related entities. We want to perform several queries involving a correlation between two or more properties of a given entity in a

Re: Queries with undetermined field count

2011-04-07 Thread Renaud Delbru
Hi, SIREn [1], a Lucene/Solr plugin, allows you perform queries across an undetermined number of fields, even if you have hundred of thousands of fields. It might be helpful for your scenario. [1] http://siren.sindice.com -- Renaud Delbru On 07/04/11 19:18, jisenhart wrote: I have a

Re: Matching on a multi valued field

2011-04-05 Thread Renaud Delbru
Hi, you could try the SIREn plugin [1] which supports multi-valued fields. [1] http://siren.sindice.com -- Renaud Delbru On 29/03/11 21:57, Brian Lamb wrote: Hi all, I have a field set up like this: And I have some records: RECORD1 man's best friend pooch RECORD2 man&#x

Re: Triggering optimise based on time interval

2011-02-16 Thread Renaud Delbru
start up solr. -- Renaud Delbru On 16/02/11 13:15, Stefan Matheis wrote: Renaud, just because i'm interested in .. what are your concerns about using cron for that? Stefan On Wed, Feb 16, 2011 at 2:12 PM, Renaud Delbru wrote: Hi, We would like to trigger an optimise every x hours.

Triggering optimise based on time interval

2011-02-16 Thread Renaud Delbru
regular time interval. Is this a good approach ? Or is there other solutions to achieve this ? Thanks, -- Renaud Delbru

Re: Filter Query, Filter Cache and Hit Ratio

2011-01-29 Thread Renaud Delbru
Thanks a lot, this totally makes sense but it was hard to figure this out. cheers -- Renaud Delbru On 28/01/11 20:39, cbenn...@job.com wrote: Ooops, I meant NOW/DAY -Original Message- From: cbenn...@job.com [mailto:cbenn...@job.com] Sent: Friday, January 28, 2011 3:37 PM To: solr

Filter Query, Filter Cache and Hit Ratio

2011-01-28 Thread Renaud Delbru
amp;fq=domain:my.wordpress.com&fsv=true} hits=0 status=0 QTime=139 INFO: [] webapp=/siren path=/select params={wt=javabin&rows=0&version=2&fl=id,score&start=0&q=*:*&isShard=true&fq=timestamp:[2011-01-21T00:00:00Z+TO+NOW]&fq=domain:syours.wordpress.com&fsv=true} hits=0 status=0 QTime=138 -- Renaud Delbru

Re: Specifying an AnalyzerFactory in the schema

2011-01-25 Thread Renaud Delbru
ady handle letting the schema.xml specify the positionIncrementGap (which you could happily ignore if you wanted) Thanks for the trick, I haven't thought about doing that. This should work indeed. cheers -- Renaud Delbru

Specifying an AnalyzerFactory in the schema

2011-01-19 Thread Renaud Delbru
implementation, and I think this requires a simple fix. Do I open an issue about it ? Regards, -- Renaud Delbru

Re: Why does Solr commit block indexing?

2010-12-17 Thread Renaud Delbru
Hi Grant, looking forward for a fix ;o). Such a fix would improve quite a lot the performance of Solr update throughput (even if its performance is already quite impressive). cheers -- Renaud Delbru On 17/12/10 13:05, Grant Ingersoll wrote: I'm not sure if there is a issue open, but I

Re: Why does Solr commit block indexing?

2010-12-17 Thread Renaud Delbru
Hi Michael, thanks for your answer. Do the Solr team is aware of the problem ? Is there an issue opened about this, or ongoing work about that ? Regards, -- Renaud Delbru On 16/12/10 16:45, Michael McCandless wrote: Unfortunately, (I think?) Solr currently commits by closing the IndexWriter

Why does Solr commit block indexing?

2010-12-16 Thread Renaud Delbru
/KPkusyVb Regards -- Renaud Delbru

Re: How to Transmit and Append Indexes

2010-11-21 Thread Renaud Delbru
Have you looked at Apache Nutch [1]. It is a distributed web crawl and search system, based on Lucene/Solr and Hadoop. [1] http://nutch.apache.org/ -- Renaud Delbru On 19/11/10 16:52, Bing Li wrote: Hi, all, I am working on a distributed searching system. Now I have one server only. It has

Re: How to extend IndexSchema and SchemaField

2010-10-09 Thread Renaud Delbru
Hi Chris, I have opened an issue (SOLR-2146 [1]) following that discussion. [1] https://issues.apache.org/jira/browse/SOLR-2146 cheers -- Renaud Delbru On 14/09/10 01:06, Chris Hostetter wrote: : Yes, I have thought of that, or even extending field type. But this does not : work for my use

Re: How to extend IndexSchema and SchemaField

2010-09-10 Thread Renaud Delbru
can have multiple fields of a same type (therefore with the same field type, and same analyzer), but each one of them needs specific information. Therefore, I think the only "nice" way to achieve this is to have the possibility to add attributes to any field definition. cheers -- Renaud Delbru

Re: How to extend IndexSchema and SchemaField

2010-09-10 Thread Renaud Delbru
u want our code as an example. So, do you mean you are duplicating part of the code for reading the schema and parse on your own way the schema in your request handler ? If you could share the code to have a look, it could be helpful and inspiring. cheers. -- Renaud Delbru

Re: How to extend IndexSchema and SchemaField

2010-09-09 Thread Renaud Delbru
Hi, so I suppose there is no solution. Is there a chance that SchemaField becomes extensible in the future ? Because, at the moment, all the field attributes (indexed, stored, etc.) are hardcoded inside SchemaField. Do you think it is worth opening an issue about it ? -- Renaud Delbru On

How to extend IndexSchema and SchemaField

2010-09-07 Thread Renaud Delbru
? Is there any other solutions ? thanks, -- Renaud Delbru

Re: determine which value produced a hit in multivalued field type

2010-01-26 Thread Renaud Delbru
http://siren.sindice.com/ -- Renaud Delbru On 22/01/10 22:52, Harsch, Timothy J. (ARC-TI)[PEROT SYSTEMS] wrote: Hi, If I have a multiValued field type of text, and I put values [cat,dog,green,blue] in it. Is there a way to tell when I execute a query against that field for dog, that it was in th

Re: Best wasy to solve Parent-Child relationship without Denormalizing?

2010-01-19 Thread Renaud Delbru
://siren.sindice.com/ -- Renaud Delbru On 19/01/10 13:14, karthi_1986 wrote: Hi, Here is an extract of my data schema in which my user should be able to issue the following search: company_description:pharmaceutical AND product_description:cosmetic [Company profile] Company name Company url

Re: how to scan dynamic field without specifying each field in query

2009-09-03 Thread Renaud Delbru
s not yet available, and therefore you will have to write your own query syntax and parser for this task. Regards, [1] http://siren.sindice.com -- Renaud Delbru gdeconto wrote: thx for the reply. you mean into a multivalue field? possible, but was wondering if there was something more flexible

Re: Indexing arbitrary RDF resources

2009-03-26 Thread Renaud Delbru
team (or send me directly an email). Maybe, it could be a good idea to join our efforts. [1] http://www.deri.ie/ [2] http://www.sindice.com/ -- Regards, Renaud Delbru re...@gmx.net wrote: Hey, all! I'm planning a project where I want to write software that takes an RDF class and uses

Re: Store content out of solr

2009-02-17 Thread Renaud Delbru
than a SQL database). The counterpart is that it is slightly slower than a local database. [1] http://hadoop.apache.org/hbase/ -- Renaud Delbru roberto wrote: Hello, We are indexing information from diferent sources so we would like to centralize the information content so i can retrieve us

Re: [ANN] Lucid Imagination

2009-02-09 Thread Renaud Delbru
Gaze features look quite nice and useful. Thanks for your reply, Regards -- Renaud Delbru

Re: [ANN] Lucid Imagination

2009-02-06 Thread Renaud Delbru
Hi, I don't find any documentation about Solr Gaze. How can I use it ? Thanks, Regards -- Renaud Delbru Grant Ingersoll wrote: Hi Lucene and Solr users, As some of you may know, Yonik, Erik, Sami, Mark and I teamed up with Marc Krellenstein to create a company to provide commercial su

Re: Solr 1.3 Maven Artifact Problem

2008-10-23 Thread Renaud Delbru
Hi, About the second point, it was my mistake (source dependencies problem in eclipse). -- Renaud Delbru Renaud Delbru wrote: Hi, I am using the Solr 1.3 mave nartifacts from [1]. It seems that these artifacts are not correct. I have noticed that: 1) solr-core artifact contains

Solr 1.3 Maven Artifact Problem

2008-10-23 Thread Renaud Delbru
does not match the compiled class: I found different method fingerprints in EmbeddedSolr and in CoreDescriptor Do someone encounter the same problem ? [1] http://repo1.maven.org/maven2/org/apache/solr/ Regards, -- Renaud Delbru

Re: Slow deleteById request

2008-07-15 Thread Renaud Delbru
Hi, I think the reason was indeed maxPendingDeletes which was configured to 1000. After having updated to a solr nightly build with Lucene 2.4, the issue seems to have disappeared. Thanks for your advices. -- Renaud Delbru Mike Klaas wrote: On 1-Jul-08, at 10:44 PM, Chris Hostetter wrote

Re: Slow deleteById request

2008-07-01 Thread Renaud Delbru
swers, Yonik. -- Renaud Delbru

Re: Slow deleteById request

2008-07-01 Thread Renaud Delbru
ent requests will be handled by the other searcher. -- Renaud Delbru Yonik Seeley wrote: That's very strange... are you sending a commit with the delete perhaps? If so, the whole request would block until a new searcher is registered. -Yonik On Tue, Jul 1, 2008 at 8:54 AM, Renaud Delbru

Re: Slow deleteById request

2008-07-01 Thread Renaud Delbru
Small precision, we are using a nightly build of Solr 1.3 (one of the nightly build just before the integration of Lucene 2.4). -- Renaud Delbru Renaud Delbru wrote: Hi, We experience very slow delete, taking more than 10 seconds. A delete is executed using deleteById (from Solrj or from

Slow deleteById request

2008-07-01 Thread Renaud Delbru
0.71,cumulative_inserts=689823,cumulative_evictions=411577} [11:32:02.894]Opening [EMAIL PROTECTED] DirectUpdateHandler2 [11:32:03.566]DirectUpdateHandler2 docs deleted=0 [11:32:03.566]Closing [EMAIL PROTECTED] DirectUpdateHandler2 -- Renaud Delbru

Re: How to get incrementPositionGap value from IndexSchema ?

2008-03-12 Thread Renaud Delbru
do you want/need this information in your custom code? -Hoss -- Renaud Delbru, E.C.S., Ph.D. Student, Semantic Information Systems and Language Engineering Group (SmILE), Digital Enterprise Research Institute, National University of Ireland, Galway. http://smile.deri.ie/

How to get incrementPositionGap value from IndexSchema ?

2008-03-10 Thread Renaud Delbru
Hi, I am looking for a way to access the incrementPositionGap value defined for a field type in the schema.xml. There is a getArgs method in FieldType class, but it is protected and I am not able to access it. Is there another solution ? Regards. -- Renaud Delbru, E.C.S., Ph.D. Student

Re: SpanQuery support

2008-02-05 Thread Renaud Delbru
r to the defaults for your handler). You can also override the current query type via q=my query -Yonik -- Renaud Delbru, E.C.S., Ph.D. Student, Semantic Information Systems and Language Engineering Group (SmILE), Digital Enterprise Research Institute, National University of Ireland, Galway. http://smile.deri.ie/

Re: Querying multiple dynamicField

2008-02-05 Thread Renaud Delbru
directive to copy all 'sentence_*' fields into one indexed field. You then have a named field that you can search against. Lance Norskog -Original Message- From: Renaud Delbru [mailto:[EMAIL PROTECTED] Sent: Friday, February 01, 2008 6:48 PM To: solr-user@lucene.apache.o

Re: SpanQuery support

2008-02-04 Thread Renaud Delbru
Yonik Seeley wrote: On Feb 2, 2008 3:43 PM, Renaud Delbru <[EMAIL PROTECTED]> wrote: I was looking at the discussion of SOLR-281. If I understand correctly, the task would be to write my own search component class, SpanQueryComponent that extends the SearchComponent class, then overw

Re: SpanQuery support

2008-02-04 Thread Renaud Delbru
Hi Yonik, Yonik Seeley wrote: On Feb 2, 2008 3:43 PM, Renaud Delbru <[EMAIL PROTECTED]> wrote: I was looking at the discussion of SOLR-281. If I understand correctly, the task would be to write my own search component class, SpanQueryComponent that extends the SearchComponent class

Re: SpanQuery support

2008-02-02 Thread Renaud Delbru
ml: Then, I will be able to use directly my own query syntax and query component ? Is it correct ? Regards. Yonik Seeley wrote: Solr 1.3 will have query parser plugins... so you could write your own parser that utilized span queries. -Yonik On Feb 2, 2008 2:48 PM, Renaud Delbru <[EM

SpanQuery support

2008-02-02 Thread Renaud Delbru
Hi, Do you know if it is currently possible to use the SpanQuery feature of Lucene in Solr 1.3. We would like to use nested span queries such as (("A B") near ("C D")). Do a request handler support such feature ? Or, any idea how could we perform ? Regards. -- Renaud Delbru

Querying multiple dynamicField

2008-02-01 Thread Renaud Delbru
ere a way to execute such queries on Solr 1.3 / Lucene 2.3 ? Regards. -- Renaud Delbru

Re: LSA Implementation

2007-11-26 Thread Renaud Delbru
ts: http://wiki.apache.org/lucene-java/BasicsOfPerformance http://wiki.apache.org/lucene-java/LuceneFAQ -- Renaud Delbru, E.C.S., M.Sc. Student, Semantic Information Systems and Language Engineering Group (SmILE), Digital Enterprise Research Institute, National University of Ireland, Galway. http://smile.deri.ie/