Sean, Ahmet,
thanks for response:)
I use Solr 4.0 from trunk.
In my solrconfig.xml is only one maxFieldLength param.
I think it is deprecated in Solr Versions 3.5+...
But LimitTokenCountFilterFactory works in my case :)
Thanks!
Regards
Vadim
2012/1/26 Ahmet Arslan :
>> i want to decrea
Vadim,
Is it possible that your solrconfig.xml is using maxFieldLength in both the
and ?
If so the mainIndex config overwrites the other. See this issue:
http://lucene.472066.n3.nabble.com/Solr-ignoring-maxFieldLength-td473263.html
Sean
On Thu, Jan 26, 2012 at 10:15 AM, Vadim Kisselmann
> i want to decrease the max. number of terms for my fields to
> 500.
> I thought what the maxFieldLength parameter in
> solrconfig.xml is
> intended for this.
> In my case it doesn't work.
>
> The half of my text fields includes longer text(about 1
> words).
&
P.S.:
i use Solr 4.0 from trunk.
Is maxFieldLength deprecated in Solr 4.0 ?
If so, do i have an alternative to decrease the number of terms during indexing?
Regards
Vadim
2012/1/26 Vadim Kisselmann :
> Hello Folks,
> i want to decrease the max. number of terms for my fields to 500.
>
Hello Folks,
i want to decrease the max. number of terms for my fields to 500.
I thought what the maxFieldLength parameter in solrconfig.xml is
intended for this.
In my case it doesn't work.
The half of my text fields includes longer text(about 1 words).
With 100 docs in my index i h
:1. is the maxFieldLength parameter deprecated?
:2. what is maxFieldLength counting? I understood it's counting tokens
:per document (not per field)
:3. what if I simply remove the maxFieldLength setting from the
:solrconfig?
1. it has been deprecated and will not be us
Lewis,
A large maxFieldLength may not necessarily result in OOM - it depends on -Xmx
you are using, the number of concurrent documents being processed, and such.
So the first thing I'd look would be my machine's RAM, then -Xmx I can afford,
then based on that set maxFieldLength
Thank you Erick
Lewis
-Original Message-
From: Erick Erickson [mailto:erickerick...@gmail.com]
Sent: 03 February 2011 13:25
To: solr-user@lucene.apache.org
Subject: Re: value for maxFieldLength
This is not really vary large, Solr should handle this easily (assuming
you've giv
t
Erick
On Wed, Feb 2, 2011 at 10:20 AM, McGibbney, Lewis John <
lewis.mcgibb...@gcu.ac.uk> wrote:
> Hello list,
>
> I am aware that setting the value of maxFieldLength in solrconfig.xml too
> high may/will result in out-of-mem errors. I wish to provide content
> extraction on
Hello list,
I am aware that setting the value of maxFieldLength in solrconfig.xml too high
may/will result in out-of-mem errors. I wish to provide content extraction on a
number of pdf documents which are large, by large I mean 8-11MB (occasionally
more), and I am also not sure how many terms
2:34 PM
To: solr-user@lucene.apache.org
Subject: Re: how to set maxFieldLength to unlimitd
I don't know about upload limitations, but for sure there are some in
the default settings, this could explain the limit of 20MB. Which
upload mechanism on solr side do you use? I guess this is no
> solr-user-...@lucene.apache.org
> Subject: RE: how to set maxFieldLength to unlimitd
>
> You just can't set it to "unlimited". What you could do, is ignoring
> the positions and put a filter in, that sets the token for all but
> the first token to 0 (means the field l
.kure...@nokia.com [mailto:jan.kure...@nokia.com]
Sent: Wednesday, December 01, 2010 11:30 AM
To: solr-user@lucene.apache.org; solr-user-i...@lucene.apache.org;
solr-user-...@lucene.apache.org
Subject: RE: how to set maxFieldLength to unlimitd
You just can't set it to "unlimited". W
>'solr-user-...@lucene.apache.org'
>Subject: how to set maxFieldLength to unlimitd
>
>I need index and search some pdf files which are very big (around 1000 pages
>each). How can I set maxFieldLength to unlimited?
>
>Thanks so much for your help in advance,
>Xiaohui
Does anyone know how to index a pdf file with very big size (more than 100MB)?
Thanks so much,
Xiaohui
-Original Message-
From: Ma, Xiaohui (NIH/NLM/LHC) [C]
Sent: Tuesday, November 30, 2010 4:22 PM
To: 'solr-user@lucene.apache.org'
Subject: RE: how to set maxFieldLength to u
I set maxFieldLength to 2147483647, restarted tomcat and re-indexed pdf files
again. I also commented out the one in the section. Unfortunately
the files are still chopped out if the size of file is more than 20MB.
Any suggestions? I really appreciate your help!
Xiaohui
-Original Message
Thanks so much for your help!
Xiaohui
-Original Message-
From: Erick Erickson [mailto:erickerick...@gmail.com]
Sent: Tuesday, November 30, 2010 2:01 PM
To: solr-user@lucene.apache.org
Subject: Re: how to set maxFieldLength to unlimitd
Set the value in solrconfig.xml to, say
Set the value in solrconfig.xml to, say, 2147483647
Also, see this thread for a common gotcha:
http://lucene.472066.n3.nabble.com/Solr-ignoring-maxFieldLength-td473263.html
,
it appears you can just comment out the one in the section.
Best
Erick
On Tue, Nov 30, 2010 at 1:48 PM, Ma, Xiaohui
I need index and search some pdf files which are very big (around 1000 pages
each). How can I set maxFieldLength to unlimited?
Thanks so much for your help in advance,
Xiaohui
lse
> 10
> 2147483647
> 2147483647
> 1000
> 1
> single
>
>
>
>
> If the big overnight indexing job fails with these settings, I'll let you
> know.
>
> Cheers,
>
> Andrew.
>
> --
> View this message in context:
> http://www.nabble.com/Solr-ignoring-maxFieldLength--tp26057808p26062113.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
ntext:
http://www.nabble.com/Solr-ignoring-maxFieldLength--tp26057808p26062113.html
Sent from the Solr - User mailing list archive at Nabble.com.
On Mon, Oct 26, 2009 at 11:00 AM, Andrew Clegg wrote:
> Yonik Seeley-2 wrote:
>>
>> Sorry Andrew, this is something that's bitten people before.
>> search for maxFieldLength and you will see *2* of them in your config
>> - one for indexDefaults and one for mainI
Yonik Seeley-2 wrote:
>
> Sorry Andrew, this is something that's bitten people before.
> search for maxFieldLength and you will see *2* of them in your config
> - one for indexDefaults and one for mainIndex.
> The one in mainIndex is set at 1 and hence overrides the on
Sorry Andrew, this is something that's bitten people before.
search for maxFieldLength and you will see *2* of them in your config
- one for indexDefaults and one for mainIndex.
The one in mainIndex is set at 1 and hence overrides the one in
indexDefaults.
-Yonik
solr-issue-example.tar.gz
That should be enough to reproduce it with.
Thanks!
Andrew.
Yonik Seeley-2 wrote:
>
> Yes, please show us your solrconfig.xml, and verify that you reindexed
> the document after changing maxFieldLength and restarting solr.
>
> I'll also see if
Yes, please show us your solrconfig.xml, and verify that you reindexed
the document after changing maxFieldLength and restarting solr.
I'll also see if I can reproduce a problem with maxFieldLength being ignored.
-Yonik
http://www.lucidimagination.com
On Mon, Oct 26, 2009 at 7:11 AM, A
Morning,
Last week I was having a problem with terms visible in my search results in
large documents not causing query hits:
http://www.nabble.com/Result-missing-from-query%2C-but-match-shows-in-Field-Analysis-tool-td26029040.html#a26029351
Erick suggested it might be related to maxFieldLength
8 1:09:37 PM
> Subject: Units for maxFieldLength
>
> Hi,
>
> I'd love to get more details about the maxFieldLength attribute in the
> solrConfig.xml.
>
> Is this length in characters or bytes or some other measure? If chars, how
> are double byte characters h
Hi,
I'd love to get more details about the maxFieldLength attribute in the
solrConfig.xml.
Is this length in characters or bytes or some other measure? If chars, how
are double byte characters handled? If an add request is sent with a field
that exceeds this limit what is the behavior? (
Dan A. Dickey wrote:
I just came across the maxFieldLength setting for the mainIndex
in solrconfig.xml and have a question or two about it.
The default value is 1.
I'm extracting text from pdf documents and
storing them into a text field. Is the length of this text field limited
to
I believe it's 10,000 tokens, not characters, but that's a quibble.
Yes, you need to change maxFieldLength to be greater than
any doc you expect to index. It can be made huge, I don't
think there's a penalty for making this number, say, 100,000,000
and indexing documents
I just came across the maxFieldLength setting for the mainIndex
in solrconfig.xml and have a question or two about it.
The default value is 1.
I'm extracting text from pdf documents and
storing them into a text field. Is the length of this text field limited
to 1 characters? Man
32 matches
Mail list logo
