Re: solr1.3からsolr8.4へのデータ移行について

2020-10-14 Thread Kayak28
Hi, Replacing fils under the data directory won't work as you expected. Solr has changed its index format, so whenever you consider upgrading, you are strongly recommended to re-index all of your documents for your safety. FYI: not only index format, but also other things have been changed from S

Re: What does current mean?

2020-09-28 Thread Kayak28
Hello, Wei-san Thank you for answering my question. That pretty makes sense to me. Sincerely, Kaya 2020年9月27日(日) 9:16 Wei : > My understanding is that current means whether there is data pending to be > committed. > > Best, > Wei > > On Sat, Sep 26, 2020 at 5:09 PM Kayak2

What does current mean?

2020-09-26 Thread Kayak28
Hello, Solr community: I would like to ask a question about the current icon on the core-overview under statistics. I thought previously that the current tag tells users whether it is searchable or not (commit or not commit) because if I send a commit request, it becomes an OK-ish icon from NG-ish

Re: About solr.HyphenatedWordsFilter

2020-08-26 Thread Kayak28
not good ...) I apologize for confusing you, but "!" is not important at all. I will consider WordDelimiterGraphFilter. Again, thank you for your response. Sincerely, Kaya Ota 2020年8月26日(水) 15:57 Shawn Heisey : > On 8/26/2020 12:05 AM, Kayak28 wrote: > > I would like to tokeniz

About solr.HyphenatedWordsFilter

2020-08-25 Thread Kayak28
Hello, Solr community: I would like to tokenize the following sentence. I do want to tokens that remain hyphens. So, for example, original text: This is a new abc-edg and xyz-abc is coming soon! desired output tokens: this/is/a/new/abc-edg/and/xyz-abc/is/coming/soon/! Is there any way that I do

SolrCould Atomic Update

2020-07-23 Thread Kayak28
Hello, Solr Community I am currently using Solr 8.3.0 with SolrCloud mode. When I took the following steps, I happened to have super-large index(approx ), and the process got stopped. 1. indexed hundred of thousands of documents 1.5 one of solrcloud servers had around 650GB. 2. updated(indexed) m

Re: Tokenizing managed synonyms

2020-07-08 Thread Kayak28
Hello, Solr Community: Actually, you can set up a tokenizer for the managed synonyms. But, the configuration is not on the reference guide, and I do not know how to add a Tokenizer via API-call. So, you might need to manually edit a JSON file below the config directory. In the _schema_analysis_s

Master Slave Terminology

2020-06-16 Thread Kayak28
Hello, Community: As the Github and Python will replace terminologies that relative to slavery, why don't we replace master-slave for Solr as well? https://developers.srad.jp/story/18/09/14/0935201/ https://developer-tech.com/news/2020/jun/15/github-replace-slavery-terms-master-whitelist/ -- S

Re: Faster Vector Highlight

2020-06-08 Thread Kayak28
gt; > Thanks, > Yasufumi > > > 2020/06/06 午後5:56、Kayak28 のメール: > > > > Hello, Solr Community: > > > > I have a question about FasterVectorHighlight. > > I know Solr highlight does not return highlighted text if the text in the > > highlighted field is t

Faster Vector Highlight

2020-06-06 Thread Kayak28
Hello, Solr Community: I have a question about FasterVectorHighlight. I know Solr highlight does not return highlighted text if the text in the highlighted field is too long. What is the good way to treat long text highlights? -- Sincerely, Kaya github: https://github.com/28kayak

Question for SOLR-14471

2020-05-26 Thread Kayak28
Hello, Solr community members: I am working on translating Solr's release note every release. Now, I am not clear about what SOLR-14471 actually fixes. URL for SOLR-14471: https://issues.apache.org/jira/browse/SOLR-14471 My questions are the following. - what does "all inherently equivalent grou

ManagedSynonymFilter

2020-04-30 Thread Kayak28
Hello, Community: I have a simple question about a managed resources and managed synonyms. I use ManagedSynonymGraphFilter and its managed resource is named as english. I do put several synonyms from URL below. Now I want to delete all of the registered synonyms at one command. I thought that th

Re: Cause of java.io.IOException: No space left on device Error

2020-04-27 Thread Kayak28
ased more > space > > on the filesystem, couple of time solr didn't release all space. > > > > > > > > Il giorno gio 23 apr 2020 alle ore 10:23 Kayak28 > > > ha scritto: > > > >> Hello, Community: > >> > >> I am currently

Re: Defaults Merge Policy

2020-04-27 Thread Kayak28
o your index > might have a higher percentage temporarily. > > Best, > Erick > > > On Apr 23, 2020, at 4:01 AM, Kayak28 wrote: > > > > Hello, Erick Erickson: > > > > Thank you for answering my questions. > > > > Deleted docs in Solr 8.3.0 has

Cause of java.io.IOException: No space left on device Error

2020-04-23 Thread Kayak28
Hello, Community: I am currently using Solr 5.3.1. on CentOS. The other day, I faced an error message that shows " java.io.IOException: No space left on device" My disk for Solr has empty space about 35GB and the total amount of the disk is 581GB. I doubted there was no enough space for Linux in

Re: Defaults Merge Policy

2020-04-23 Thread Kayak28
; until you’ve indexed a _lot_ of docs. > > Oh, and I kind of dislike numDocs as the trigger and > tend to use time on the theory that it’s easier to explain, > whereas when commits happen when using maxDocs > varies depending on the throughput rate. > > Best, > Erick >

Defaults Merge Policy

2020-04-15 Thread Kayak28
Hello, Solr Community: I would like to ask about Default's Merge Policy for Solr 8.3.0. My client (SolrJ) makes a commit every 10'000 doc. I have not explicitly configured Merge Policy via solrconfig.xml For each indexing time, some documents are updated or deleted. I think the Default Merge Polic

Re: a new CLI tool bin/postlogs

2020-03-28 Thread Kayak28
ng only log > files. > > > > Joel Bernstein > http://joelsolr.blogspot.com/ > > > On Fri, Mar 27, 2020 at 5:18 AM Kayak28 wrote: > > > Hello, Community: > > > > Thank you for releasing Solr 8.5.0, which contains several interesting > > tools. > > Especial

a new CLI tool bin/postlogs

2020-03-27 Thread Kayak28
Hello, Community: Thank you for releasing Solr 8.5.0, which contains several interesting tools. Especially, bin/postlogs is interesting one. So, I have tried to run it on my computer (not-production use) as the following. bin/postlogs http://localhost:8983/solr/logs ./server/logs/solr The resul

Recommended Java Distribution

2020-03-19 Thread Kayak28
Hello, Solr Community: My customer would like to use Amazon Corretto JDK instead of OpenJDK. I wonder if it is ok to say, "yes, you can use" or I should not recommend it at all. Is anyone in the Community using Amazon Corretto for your Solr? Have you ever had any problems with that? If you sha

Atomic Update and Optimization and segments

2020-03-10 Thread Kayak28
Hello, Community: Currently, my index grows up to almost 1T, and I would like to minimize my index. I know I have a few fields that are not used or rarely used, so I want to delete them. I have tried to delete these fields by the atomic update, sending the following JSON for example. { "id":"1",

Question About Solr Query Parser

2020-03-02 Thread Kayak28
Hello, Community: I have a question about interpreting a parsed query from Debug Query. I used Solr 8.4.1 and LuceneQueryParser. I was learning the behavior of ManagedSynonymFilter because I was curious about how "ManagedSynonymGraphFilter" fails to generate a graph. So, I try to interpret the par

Re: Rule of thumb for determining maxTime of AutoCommit

2020-02-26 Thread Kayak28
tune your warming strategy to make sure it > does not take as much time as period between two commits. > > HTH, > Emir > -- > Monitoring - Log Management - Alerting - Anomaly Detection > Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > &g

Rule of thumb for determining maxTime of AutoCommit

2020-02-25 Thread Kayak28
Hello, Solr Community: Another day, I had an error "exceeded limit of maxWarmingSearchers=2." I know this error causes when multiple commits(which opens a new searcher) are requested too frequently. As far as I read Solr wiki, it recommends for me to have more interval between each commit, and ma

the options of ManagedSynonym(Graph)Filter

2020-02-05 Thread Kayak28
Hello, Comunity Members: I use Solr8.4.1 and the primary language of documents in the Solr is Japanese. I have a question about ManagedSynonymFilters. Before that, let me introduce my story first. I would like to use ManagedSynonymGraphFilter, and ManagedSynonymFilter, for my synonym expansion.

Re: Backup v.s. Snapshot API for Solr

2019-11-27 Thread Kayak28
. Maybe I'm not able to > understand your query so I'll appreciate if someone else helps. > > On Mon, 25 Nov 2019 at 12:21, Kayak28 wrote: > > > Hello, Mr. Paras: > > > > Thank you for your response, and I apologize for confusing you. > > > > Actua

Re: Backup v.s. Snapshot API for Solr

2019-11-24 Thread Kayak28
Hello, Mr. Paras: Thank you for your response, and I apologize for confusing you. Actually, I can do restore by /replication hander. What I did not get the idea is, how to use the following URLs, which are from the "Making And Restoring Backups" section of the Solr Reference Guide. 1. http://lo

Backup v.s. Snapshot API for Solr

2019-11-21 Thread Kayak28
Hello, Community Members: I have tested the behaviors of Backup API and Snapshot API, which are written in the URL below. https://lucene.apache.org/solr/guide/7_4/making-and-restoring-backups.html#making-and-restoring-backups () As far as I observed the behavior of Backup API, I now know the foll

Re: About Snapshot API and Backup for Solr Index

2019-11-21 Thread Kayak28
I was not clear in the last email. I mean "For me, it is impossible to "backup" or "restore" Solr's index by taking a snapshot." If I make you confuse, I am sorry about that. Sincerely, Kaya Ota 2019年11月21日(木) 19:50 Kayak28 : > Hello, Community Members

About Snapshot API and Backup for Solr Index

2019-11-21 Thread Kayak28
Hello, Community Members: I am using Solr 7.7.4 I have a question about a Snapshot API. https://lucene.apache.org/solr/guide/7_4/making-and-restoring-backups.html#create-snapshot-api I have tested basic of snapshot APIs, create snapshot, list snapshot, delete snapshot. As far as I know, when I d

Question about Luke

2019-11-11 Thread Kayak28
Hello, Community: I am using Solr7.4.0 currently, and I was testing how Solr actually behaves when it has a corrupted index. And I used Luke to fix the broken index from GUI. I just came up with the following questions. Is it possible to use the repair index tool from CLI? (in the case, Solr was o

Printing NULL character in log files.

2019-11-10 Thread Kayak28
Hello, Solr Community: I am using Solr7.4.0 which uses log4j (version 2.11 from Solr's Chanes.txt) as its component. Some of the log files that Solr generated contain <0x00> (null characters) in log files (like below) Because of this issue, it is difficult for me to trace what actually happened t

Re: Questions about corrupted Segments files.

2019-11-05 Thread Kayak28
.apache.org/jira/browse/LUCENE-5924 > > Best, > Erick > > > On Nov 5, 2019, at 8:24 PM, Kayak28 wrote: > > > > Hello, Community members: > > > > I am using Solr 7.7.2. > > On the other day, while indexing to the Solr, my computer powered off. >

Questions about corrupted Segments files.

2019-11-05 Thread Kayak28
Hello, Community members: I am using Solr 7.7.2. On the other day, while indexing to the Solr, my computer powered off. As a result, there are corrupted segment files. Is there any way to fix the corrupted segment files without re-indexing? I have read a blog post (in Japanese) writing about che

Re: Problem of Shutdown Process for Windows Server

2019-08-28 Thread Kayak28
* taskkill /f /PID %%N* ) ) ) ) ) I need to check my Java version later, but I wonder why Java version should be at least 1.8.0_40? Again, thank you for your response. Sincerely, Kaya Ota 2019年8月29日(木) 0:33 Sha

Problem of Shutdown Process for Windows Server

2019-08-28 Thread Kayak28
Hello, Community: I use Solr with Windows servers, and cannot shutdown Solr successfully. When I try to stop Solr using solr.cmd, which is kicked from Windows Task Manager, it "looks" like Solr stops without any problem. Here "looks" means that at least log file that Solr wrote does not seem to ha

Re: Solr8.0.0 Performance Test

2019-05-22 Thread Kayak28
日(火) 19:13 Toke Eskildsen : > Kayak28 wrote: > > For the next opportunity to share table-formatted data, > > what is the best way to share data with all of you? > > There's no hard recommendations, so anything where you can just click on a > link and see the data: Google D

Re: Solr8.0.0 Performance Test

2019-05-20 Thread Kayak28
Hello, Shawn, Toke Eskildsen and Solr Community: > Since version 7.5, optimize with TieredMergePolicy (the default policy) > respects the maximum segment size, which defaults to 5GB. Thank you for your reply. Indeed, there was approximately a total of 9GB index size. So, as you tell me, TieredMer

Re: Solr8.0.0 Performance Test

2019-05-19 Thread Kayak28
; Hi Kaya, > > Can you tell more about your setup? Are you using SolrCloud (with how many > shards and replicas)? > Since the inter communications between nodes are using HTTP/2 as default > now. > > On Sun, 19 May 2019 at 07:29, Kayak28 wrote: > > > Hello, Apache Solr

Solr8.0.0 Performance Test

2019-05-18 Thread Kayak28
Hello, Apache Solr community members: I have a few questions about the load test of Solr8. - for Solr8, optimization command merge segment to 2, but not 1. Is that ok behavior? When indexing Wikipedia data, Solr8 generated multiple segments. So, I executed command from the Admin UI. Solr8 did re