[
https://issues.apache.org/jira/browse/LUCENE-9930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alan Woodward resolved LUCENE-9930.
-----------------------------------
Fix Version/s: main (9.0)
Resolution: Fixed
> UkrainianMorfologikAnalyzer reloads its Dictionary for every new
> TokenStreamComponents instance
> -----------------------------------------------------------------------------------------------
>
> Key: LUCENE-9930
> URL: https://issues.apache.org/jira/browse/LUCENE-9930
> Project: Lucene - Core
> Issue Type: Bug
> Reporter: Alan Woodward
> Assignee: Alan Woodward
> Priority: Major
> Fix For: main (9.0)
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Large static data structures should be loaded in Analyzer constructors and
> shared between threads, but the UkrainianMorfologikAnalyzer is loading its
> dictionary in `createComponents`, which means it is reloaded and stored on
> every new analysis thread. If you have a large dictionary and highly
> concurrent indexing then this can lead to you running out of memory as
> multiple copies of the dictionary are held in thread locals.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]