from:"Matheo Software"

Solr8.7 How to increase JVM-Memory ?

2020-11-18 Thread Matheo Software

Hi All,



Since several years I work with a old version of Solr on Ubuntu, version
5.4.

Today I test the 8.7 version.

But Im not able to change the JVM-Memory like in my 5.4 version.



Many answers on the web tell to modify the solr.in.sh file but in my case I
have only /opt/solr/solr.in.sh.orig.

And if I change the SOLR_HEAP to a new value like 8g Dashboard shows
always 512MB.

I try also to change SOLR_JAVA_MEM without success.



Of course, I restart solr each time. (service solr restart). No error in
log. All work fine but no 8g of memory.



I also try to copie solr.in.sh.orig to solr.in.sh, the result is always the
same.



Could you help me ?



Cordialement, Best Regards

Bruno Mannina

 <http://www.matheo-software.com> www.matheo-software.com

 <http://www.patent-pulse.com> www.patent-pulse.com

Tél. +33 0 970 738 743

Mob. +33 0 634 421 817

 <https://www.facebook.com/PatentPulse> facebook (1)
<https://twitter.com/matheosoftware> 1425551717
<https://www.linkedin.com/company/matheo-software> 1425551737
<https://www.youtube.com/user/MatheoSoftware> 1425551760





--
L'absence de virus dans ce courrier électronique a été vérifiée par le logiciel 
antivirus Avast.
https://www.avast.com/antivirus

Solr8.7 Munin ?

2020-11-21 Thread Matheo Software

Hello,



I would like to use Munin to check my Solr 8.7 but it dont work. I try to
configure munin plugins without success.



Is somebody use Munin with a recent version of Solr ? (version > 5.4)



Thanks a lot,



Cordialement, Best Regards

Bruno Mannina

 <http://www.matheo-software.com> www.matheo-software.com

 <http://www.patent-pulse.com> www.patent-pulse.com

Tél. +33 0 970 738 743

Mob. +33 0 634 421 817

 <https://www.facebook.com/PatentPulse> facebook (1)
<https://twitter.com/matheosoftware> 1425551717
<https://www.linkedin.com/company/matheo-software> 1425551737
<https://www.youtube.com/user/MatheoSoftware> 1425551760





--
L'absence de virus dans ce courrier électronique a été vérifiée par le logiciel 
antivirus Avast.
https://www.avast.com/antivirus

Solr8.7 - How to optmize my index ?

2020-12-01 Thread Matheo Software

Hi All,



With Solr5.4, I used the UI button but in Solr8.7 UI this button is missing.



So I decide to use the command line:

curl http://xxx:8983/solr/my_core/update?optimize=true



My collection my_core exists of course.



The answer of the command line is:

{

  "responseHeader":{

"status":0,

"QTime":18}

}



But nothing change.

I always have 38M deleted docs in my collection and directory size no change
like with solr5.4.

The size of the collection stay always at : 466.33Go



Could you tell me how can I purge deleted docs ?



Cordialement, Best Regards

Bruno Mannina

 <http://www.matheo-software.com> www.matheo-software.com

 <http://www.patent-pulse.com> www.patent-pulse.com

Tél. +33 0 970 738 743

Mob. +33 0 634 421 817

 <https://www.facebook.com/PatentPulse> facebook (1)
<https://twitter.com/matheosoftware> 1425551717
<https://www.linkedin.com/company/matheo-software> 1425551737
<https://www.youtube.com/user/MatheoSoftware> 1425551760





--
L'absence de virus dans ce courrier électronique a été vérifiée par le logiciel 
antivirus Avast.
https://www.avast.com/antivirus

RE: Solr8.7 - How to optmize my index ?

2020-12-02 Thread Matheo Software

Hi Erick,
Hi Walter,

Thanks for these information,

I will learn seriously about the solr article you gave me.
I thought it was important to always delete and optimize collection.

More information concerning my collection,
Index size is about 390Go for 130M docs (3-5ko / doc), around 25 fields 
(indexed, stored)
All Tuesday I do an update of around 1M docs and all Thusday I do an add new 
docs (around 50 000).

Many thanks !

Regards,
Bruno

-Message d'origine-
De : Erick Erickson [mailto:erickerick...@gmail.com]
Envoyé : mercredi 2 décembre 2020 14:07
À : solr-user@lucene.apache.org
Objet : Re: Solr8.7 - How to optmize my index ?

expungeDeletes is unnecessary, optimize is a superset of expungeDeletes.
The key difference is commit=true. I suspect if you’d waited until your 
indexing process added another doc and committed, you’d have seen the index 
size drop.

Just to check, you send the command to my_core but talk about collections.
Specifying the collection is sufficient, but I’ll assume that’s a typo and 
you’re really saying my_collection.

I agree with Walter like I always do, you shouldn’t be running optimize without 
some proof that it’s helping. About the only time I think it’s reasonable is 
when you have a static index, unless you can demonstrate improved performance. 
The optimize button was removed precisely because it was so tempting. In much 
earlier versions of Lucene, it made a demonstrable difference so was put front 
and center. In more recent versions of Solr optimize doesn’t help nearly as 
much so it was removed.

You say you have 38M deleted documents. How many documents total? If this is 
50% of your index, that’s one thing. If it’s 5%, it’s certainly not worth the 
effort. You’re rewriting 466G of index, if you’re not seeing demonstrable 
performance improvements, that’s a lot of wasted effort…

See: https://lucidworks.com/post/solr-and-optimizing-your-index-take-ii/
and the linked article for what happens in pre 7.5 solr versions.

Best,
Erick

> On Dec 1, 2020, at 2:31 PM, Info MatheoSoftware  
> wrote:
>
> Hi All,
>
>
>
> I found the solution, I must do :
>
> curl ‘http://xxx:8983/solr/my_core/update?
> <http://xxx:8983/solr/my_core/update?optimize=true>
> commit=true&expungeDeletes=true’
>
>
>
> It works fine
>
>
>
> Thanks,
>
> Bruno
>
>
>
>
>
>
>
> De : Matheo Software [mailto:i...@matheo-software.com] Envoyé : mardi
> 1 décembre 2020 13:28 À : solr-user@lucene.apache.org Objet : Solr8.7
> - How to optmize my index ?
>
>
>
> Hi All,
>
>
>
> With Solr5.4, I used the UI button but in Solr8.7 UI this button is missing.
>
>
>
> So I decide to use the command line:
>
> curl http://xxx:8983/solr/my_core/update?optimize=true
>
>
>
> My collection my_core exists of course.
>
>
>
> The answer of the command line is:
>
> {
>
>  "responseHeader":{
>
>"status":0,
>
>"QTime":18}
>
> }
>
>
>
> But nothing change.
>
> I always have 38M deleted docs in my collection and directory size no
> change like with solr5.4.
>
> The size of the collection stay always at : 466.33Go
>
>
>
> Could you tell me how can I purge deleted docs ?
>
>
>
> Cordialement, Best Regards
>
> Bruno Mannina
>
> <http://www.matheo-software.com> www.matheo-software.com
>
> <http://www.patent-pulse.com> www.patent-pulse.com
>
> Tél. +33 0 970 738 743
>
> Mob. +33 0 634 421 817
>
> <https://www.facebook.com/PatentPulse> facebook (1)
> <https://twitter.com/matheosoftware> 1425551717
> <https://www.linkedin.com/company/matheo-software> 1425551737
> <https://www.youtube.com/user/MatheoSoftware> 1425551760
>
>
>
>
>
>  _
>
>
> <https://www.avast.com/antivirus> Avast logo
>
> L'absence de virus dans ce courrier électronique a été vérifiée par le
> logiciel antivirus Avast.
> www.avast.com <https://www.avast.com/antivirus>
>
>
>
>
>
>
>
> --
> L'absence de virus dans ce courrier électronique a été vérifiée par le 
> logiciel antivirus Avast.
> https://www.avast.com/antivirus

--
L'absence de virus dans ce courrier électronique a été vérifiée par le logiciel 
antivirus Avast.
https://www.avast.com/antivirus

[Solr8.7] Performance of group.ngroups ?

2021-01-14 Thread Matheo Software

Hi All,



I have more than 130 million documents, with an index size of more than
400GB on Solr8.7.



I do a simple query and it takes around 1400ms, its ok but when I use
ngroups=true, I get an answer in 88sec.

I know its because Solr calculates the number of groups on a specific field
but is exist a solution to improve that? An alternate solution?



Many thanks,



Cordialement, Best Regards

Bruno Mannina

 <http://www.matheo-software.com> www.matheo-software.com

 <http://www.patent-pulse.com> www.patent-pulse.com

Tél. +33 0 970 738 743

Mob. +33 0 634 421 817

 <https://www.facebook.com/PatentPulse> facebook (1)
<https://twitter.com/matheosoftware> 1425551717
<https://www.linkedin.com/company/matheo-software> 1425551737
<https://www.youtube.com/user/MatheoSoftware> 1425551760





--
L'absence de virus dans ce courrier électronique a été vérifiée par le logiciel 
antivirus Avast.
https://www.avast.com/antivirus

Is Solr can do that ?

2019-06-21 Thread Matheo Software Info

Dear Solr User,



My question is very simple J I would like to know if Solr can process around
30To of data (Pdf, Text, Word, etc) ?



What is the best way to index this huge data ? several servers ? several
shards ? other ?



Many thanks for your information,





Cordialement, Best Regards

Bruno Mannina

 <http://www.matheo-software.com> www.matheo-software.com

 <http://www.patent-pulse.com> www.patent-pulse.com

Tél. +33 0 970 738 743

Mob. +33 0 634 421 817

 <https://www.facebook.com/PatentPulse> facebook (1)
<https://twitter.com/matheosoftware> 1425551717
<https://www.linkedin.com/company/matheo-software> 1425551737
<https://www.youtube.com/user/MatheoSoftware> 1425551760





---
L'absence de virus dans ce courrier électronique a été vérifiée par le logiciel 
antivirus Avast.
https://www.avast.com/antivirus

Solr8.7 How to increase JVM-Memory ?

Solr8.7 Munin ?

Solr8.7 - How to optmize my index ?

RE: Solr8.7 - How to optmize my index ?

[Solr8.7] Performance of group.ngroups ?

Is Solr can do that ?

6 matches

Site Navigation

Mail list logo

Footer information