Thanks Jack.
I finally managed to replicate the external files with my own replication
handler.
But now, there's an issue with Solr in the Update Log replay process.
The default processor chain is not used, this means that my processor which
manage the external files is not used...
I have creat
is needed to support EFF in SolrCloud.
-- Jack Krupansky
-Original Message-
From: lboutros
Sent: Sunday, March 17, 2013 10:13 AM
To: solr-user@lucene.apache.org
Subject: Re: Mark document as hidden
Oh, I see :) I did not catch well what you said.
Well, my index could contain 80
Oh, I see :) I did not catch well what you said.
Well, my index could contain 80 millions of elements and a big amount of
them could be hidden.
As you already said, I don't think that ZooKeeper is the right place to
store these files, they are too big.
Thank you again, that gave me some ideas I w
ansky
-Original Message-
From: lboutros
Sent: Sunday, March 17, 2013 7:25 AM
To: solr-user@lucene.apache.org
Subject: Re: Mark document as hidden
Thanks Jack for your answers.
All files in the index directory are replicated ? I thought that only the
lucene index files were replicated.
If y
Thanks Jack for your answers.
All files in the index directory are replicated ? I thought that only the
lucene index files were replicated.
If you are right, that's great, because I could create an ExternalFileField
type which could get its input file from the index directory and not from
the data
"conf" to the index dir.
-- Jack Krupansky
-Original Message-
From: lboutros
Sent: Saturday, March 16, 2013 7:05 PM
To: solr-user@lucene.apache.org
Subject: Re: Mark document as hidden
Hi Jack,
the external files involved in External File Fields are not stored in the
con
Hi Jack,
the external files involved in External File Fields are not stored in the
configuration directory and cannot be replicated this way, furthermore in
Solr Cloud, additional files are not replicated anymore.
There is something like that in the code:
/ if (confFileNameAlias.size() < 1 ||
ansky
-Original Message-
From: lboutros
Sent: Saturday, March 16, 2013 6:46 PM
To: solr-user@lucene.apache.org
Subject: Re: Mark document as hidden
Ok, I have created a processor which manages to update the external file.
Basically,
until a commit request, the hidden document IDs are stored
Ok, I have created a processor which manages to update the external file.
Basically,
until a commit request, the hidden document IDs are stored in a Set and when
a commit is requested, a new file is created by copying the last one, then
the additional IDs are appended to the external file.
Now
Seems like that technique would work, as long as the file is saved and flushed
before the actual commit occurs.
Erik
On Mar 8, 2013, at 12:17 , lboutros wrote:
> I could create an UpdateRequestProcessorFactory that could update this file,
> it seems to be better ?
>
>
>
> -
> Jou
I could create an UpdateRequestProcessorFactory that could update this file,
it seems to be better ?
-
Jouve
France.
--
View this message in context:
http://lucene.472066.n3.nabble.com/Mark-document-as-hidden-tp4045756p4045842.html
Sent from the Solr - User mailing list archive at Nabble.co
Ok, thanks Erik.
Do you see any problem in modifying the Update handler in order to append
some values to this file ?
Ludovic
-
Jouve
France.
--
View this message in context:
http://lucene.472066.n3.nabble.com/Mark-document-as-hidden-tp4045756p4045839.html
Sent from the Solr - User maili
The external file is maintained externally. Solr only reads it, and does not
have a facility to write to it, if that is what you're asking.
Erik
On Mar 8, 2013, at 10:43 , lboutros wrote:
> One more question, is there already a way to update the external file (add
> values) in Solr ?
Ludovic -
Yes, this query would be cached (unless you say cache=false).
Erik
On Mar 8, 2013, at 10:26 , lboutros wrote:
> Excellent Erik ! It works perfectly.
>
> "Normal" filter queries are cached. Is it the same for frange filter queries
> like this one ? :
>
> fq={!frange l=0 u=1
One more question, is there already a way to update the external file (add
values) in Solr ?
Ludovic.
-
Jouve
France.
--
View this message in context:
http://lucene.472066.n3.nabble.com/Mark-document-as-hidden-tp4045756p4045823.html
Sent from the Solr - User mailing list archive at Nabble.
Excellent Erik ! It works perfectly.
"Normal" filter queries are cached. Is it the same for frange filter queries
like this one ? :
fq={!frange l=0 u=10}removed_revision
Thanks to both for your answers.
Ludovic.
-
Jouve
France.
--
View this message in context:
http://lucene.472066.n3.na
External file fields, via function queries, are still usable for filtering.
Consider using the frange function query to filter out hidden documents.
Erik
On Mar 8, 2013, at 6:40, lboutros wrote:
> Dear all,
>
> I would like to mark documents as hidden.
> I could add a field "hidden" and
Without java coding, you cannot filter on things that aren't in your
index. You would need to re-index the document, but maybe you could make
use of atomic updates to just change the hidden field without needing to
push the whole document again.
Upayavira
On Fri, Mar 8, 2013, at 11:40 AM, lboutro
18 matches
Mail list logo
