Re: Help with uploading files to a core.

2020-10-11 Thread Walter Underwood
Solr is not a database. You can make a huge mess pretending it is a DB. Also, it doesn’t store files. What is your use case? wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Oct 11, 2020, at 1:28 PM, Guilherme dos Reis Meneguello > wrote: > > Hell

Re: Help with uploading files to a core.

2020-10-11 Thread Shawn Heisey
On 10/11/2020 2:28 PM, Guilherme dos Reis Meneguello wrote: Hello! My name is Guilherme and I'm a new user of Solr. Basically, I'm developing a database to help a research team in my university, but I'm having some problems uploading the files to the database. Either using curl commands or throu

Re: Help using Noggit for streaming JSON data

2020-10-07 Thread Christopher Schultz
Yonic, Thanks for the reply, and apologies for the long delay in this reply. Also apologies for top-posting, I’m writing from my phone. :( Oh, of course... simply subclass the CharArr. In my case, I should be able to immediately base64-decode the value (saves 1/4 in-memory representation) and,

Re: Help using Noggit for streaming JSON data

2020-09-17 Thread Yonik Seeley
See this method: /** Reads a JSON string into the output, decoding any escaped characters. */ public void getString(CharArr output) throws IOException And then the idea is to create a subclass of CharArr to incrementally handle the string that is written to it. You could overload write method

Re: Help for importing large data (approx. 8GB) from old solr version to new solr version

2020-01-09 Thread Paras Lehana
Hi Ken, I also recommend at least reading if not following "Taking Solr to Production": https://lucene.apache.org/solr/guide/8_4/taking-solr-to-production.html. Following this cleared my doubts regarding upgradation and core referencing while made upgradation very easy and fast. While starting S

Re: Help for importing large data (approx. 8GB) from old solr version to new solr version

2019-12-25 Thread David Hastings
Exactly. Although I’m a bit curious why your going a .1 version up, I always wait until an x2, so I won’t be upgrading until 9.3 > On Dec 25, 2019, at 9:45 AM, Erick Erickson wrote: > > Should work. At any rate, just try it. Since all you’re doing is copying > data, even if the new installat

Re: Help for importing large data (approx. 8GB) from old solr version to new solr version

2019-12-25 Thread Erick Erickson
Should work. At any rate, just try it. Since all you’re doing is copying data, even if the new installation doesn’t work you still have the original. > On Dec 25, 2019, at 1:35 AM, Ken Walker wrote: > > Hello Erick, > > Thanks for your reply! > > You mean that, we should follow below steps ri

Re: Help for importing large data (approx. 8GB) from old solr version to new solr version

2019-12-24 Thread Ken Walker
Hello Erick, Thanks for your reply! You mean that, we should follow below steps right? Here is the data directory path : solr/solr-8.2.0/server/solr/product/item_core/data STEPS :- 1. Stop old solr-8.2.0 server 2. Copy data directory (from old solr version to new solr version) copy solr/solr-8.2

Re: Help for importing large data (approx. 8GB) from old solr version to new solr version

2019-12-24 Thread Erick Erickson
Here’s the very simplest way: 1> shut down your 8.2 Solr instance 2> install your 8.3.1 instance on the same machine 3> when you start your 8.3.1 instance, specify the environment variable SOLR_HOME to point to the same one you used in 8.2 If you don’t know what SOLR_HOME used to point to, bring

Re: Help for importing large data (approx. 8GB) from old solr version to new solr version

2019-12-24 Thread Ken Walker
Hello Jörn, Thanks for your reply! As per Shawn "Why not just copy the index and use it directly rather than importing it? Solr 8.x can directly use indexes built by versions back to 7.0.0." in previous mail comment. Is it possible and how we can do that ? Thanks in advance - Ken On Tue, Dec

Re: Help for importing large data (approx. 8GB) from old solr version to new solr version

2019-12-24 Thread Jörn Franke
It seems that you got this handed over with little documentation. You have to explore what the import handler does. This is a custom configuration that you need to check how it works. Then as already said. You can simply install another version of Solr if you are within a Solr major version 8.x

Re: Help for importing large data (approx. 8GB) from old solr version to new solr version

2019-12-24 Thread Ken Walker
Hello Shawn, Thanks for your reply! Actually we don't know how its works ( just copy the index ) so could you please give us some reference urls or any steps for it? Thanks in advance - Ken On Tue, Dec 24, 2019 at 11:56 AM Shawn Heisey wrote: > > On 12/23/2019 9:58 PM, Ken Walker wrote: > > We

Re: Help for importing large data (approx. 8GB) from old solr version to new solr version

2019-12-23 Thread Shawn Heisey
On 12/23/2019 9:58 PM, Ken Walker wrote: We are upgrading solr version from solr 8.2.0 version to solr 8.3.1 version but we have faced out of memory error while importing data and then we have extended memory in our server and then again start importing process but it has work too slowy for 8GB d

Re: Help to learn synonymQueryStyle and FieldTypeSimilarity

2019-10-22 Thread Paras Lehana
Please care to explain more about what you need to understand, what you had understood and what are your requirements. On Fri, 18 Oct 2019 at 12:19, Shubham Goswami wrote: > Hi Community > > I am a beginner in solr and i am trying to understand the working of > synonymQueryStyle and FieldTypeSim

Re: Help with Stream Graph

2019-10-20 Thread Rajeswari Natarajan
Thanks Joel. That fixed the problem. Regards, Rajeswari On Fri, Oct 18, 2019 at 12:50 PM Joel Bernstein wrote: > The query that is created to me looks looked good but it returns no > results. Let's just do a basic query using the select handler: > > product_s:product1 > > If this brings back z

Re: Help with Stream Graph

2019-10-18 Thread Joel Bernstein
The query that is created to me looks looked good but it returns no results. Let's just do a basic query using the select handler: product_s:product1 If this brings back zero results then we know we have a problem with the data. Joel Bernstein http://joelsolr.blogspot.com/ On Fri, Oct 18, 2019

Re: Help with Stream Graph

2019-10-18 Thread Rajeswari Natarajan
Hi Joel, Do you see anything wrong in the config or data . I am using 7.6. Thanks, Rajeswari On Thu, Oct 17, 2019 at 8:36 AM Rajeswari Natarajan wrote: > My config is from > > > https://github.com/apache/lucene-solr/tree/branch_7_6/solr/solrj/src/test-files/solrj/solr/configsets/streaming/conf

Re: Help with Stream Graph

2019-10-17 Thread Rajeswari Natarajan
My config is from https://github.com/apache/lucene-solr/tree/branch_7_6/solr/solrj/src/test-files/solrj/solr/configsets/streaming/conf Thanks, Rajeswari On Thu, Oct 17, 2019 at 8:16 AM Rajeswari Natarajan wrote: > I tried below query and it returns o results > > > http://localho

Re: Help with Stream Graph

2019-10-17 Thread Rajeswari Natarajan
I tried below query and it returns o results http://localhost:8983/solr/knr/export?{!terms+f%3Dproduct_s}product1&distrib=false&fl=basket_s,product_s&sort=basket_s+asc,product_s+asc&wt=json&version=2.2 { "responseHeader":{"status":0}, "response":{ "numFound":0, "docs":[]}} Regards,

Re: Help with Stream Graph

2019-10-17 Thread Rajeswari Natarajan
Thanks Joel. Here is the logs for below request curl --data-urlencode 'expr=gatherNodes(knr,walk="product1->product_s",gather="basket_s")' http://localhost:8983/solr/knr/stream 2019-10-17 15:02:06.969 INFO (qtp952486988-280) [c:knr s:shard1 r:core_node2 x:knr_shard1_replica_n1] o.a.s.c.S.Reques

Re: Help with Stream Graph

2019-10-17 Thread Joel Bernstein
Can you show the logs from this request. There will be a Solr query that gets sent with product1 searched against the product_s field. Let's see how many documents that query returns. Joel Bernstein http://joelsolr.blogspot.com/ On Thu, Oct 17, 2019 at 1:41 AM Rajeswari Natarajan wrote: > Hi,

Re: Help with slow retrieving data

2019-03-26 Thread Wendy2
Hi Eric, Thank you for your response! On the old system, I changed to use docValues=true, and had better performance. But the searcher was not warmed before I measured it. Also the local disk was too small so I used an attached volume which turned out was a big cause of the slow retrieve. On t

Re: Help with slow retrieving data

2019-03-25 Thread Erick Erickson
Glad it’s working out for you. There are a couple of things here that bear a bit more investigation. Using SSDs shouldn’t materially affect the response if: 1> the searcher is warmed. Before trying your query, execute a few queries like “q="some search that hits a log of docs"&sort=myfield asc”

Re: Help with slow retrieving data

2019-03-25 Thread Wendy2
Hi Eric, Thank you very much for your response! I tried "Try this: 1> insure docValues=true for the field. You’ll have to re-index all your docs. " I tried the above approach as you recommended, the performance was getting better, reduced about 3 seconds. Then I tested on a new cloud server w

Re: Help with slow retrieving data

2019-03-25 Thread Wendy2
Hi Eric, Thank you very much for your response! "Try this: 1> insure docValues=true for the field. You’ll have to re-index all your docs." I tried use docValues and reduced about 3 seconds. Now I am going to "try 2> if that doesn’t make much of a difference, try adding useDocValuesAsStored for

Re: Help with slow retrieving data

2019-03-24 Thread Erick Erickson
If the fields you’re returning have to be pulled from the store=“true” parts of the index, then each value returned requires 1> a disk read 2> decompressing 16K minimum which is what Shawn was getting at. Try this: 1> insure docValues=true for the field. You’ll have to re-index all your docs. 2>

Re: Help with slow retrieving data

2019-03-24 Thread Wendy2
Hi Shawn,Thanks for your response. I have several Solr cores on the same Solr instance. The particular core with slow retrieve response has 6 gb data. Sorry for the confusion.I restart Solr and ran same query with rows=0 vs 1, QTime for both are OK, so I guess it is the retrieving slow? I also

Re: Help with slow retrieving data

2019-03-24 Thread Shawn Heisey
On 3/24/2019 12:11 PM, Wendy2 wrote: Thank you very much for your response! Here is a screen shot. Is the CPU an issue? You said that your index is 6GB, but the process listing is saying that you have more than 30GB of index data being managed by Solr. There's a discrepancy somewhere. Thi

Re: Help with slow retrieving data

2019-03-24 Thread Wendy2
Hi Shawn, Thank you very much for your response! Here is a screen shot. Is the CPU an issue? -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Help with slow retrieving data

2019-03-24 Thread Shawn Heisey
On 3/24/2019 7:16 AM, Wendy2 wrote: Hi Solr users:I use Solr 7.3.1 and 150,000 documents and about 6GB in total. When I try to retrieve 2 ids (4 letter code, indexed and stored), it took 17s to retrieve 1.14M size data. I tried to increase RAM and cache, but Can you get the screenshot descr

Re: Help with a DIH config file

2019-03-16 Thread Jörn Franke
You have to specify the option recursive=true on the entity files On Fri, Mar 15, 2019 at 7:59 PM wclarke wrote: > One last question. > > I have everything running as it should finally. However, when I pull out > of > testing to do the entire directory it's just cycling through. The > director

Re: Help with a DIH config file

2019-03-16 Thread Jörn Franke
https://lucene.apache.org/solr/guide/6_6/uploading-structured-data-store-data-with-the-data-import-handler.html#the-filelistentityprocessor On Sun, Mar 17, 2019 at 1:32 AM Jörn Franke wrote: > You have to specify the option recursive=true on the entity files > > On Fri, Mar 15, 2019 at 7:59 PM w

Re: Help with a DIH config file

2019-03-15 Thread wclarke
One last question. I have everything running as it should finally. However, when I pull out of testing to do the entire directory it's just cycling through. The directory is full of folders that have the documents in them. Do I need an html or other file sitting in there randomly to get it to s

Re: Help with a DIH config file

2019-03-15 Thread wclarke
Thanks! that fixed it. -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Help with a DIH config file

2019-03-15 Thread Tim Allison
configuration, but it doesn't > seem to help in this instance). > > Any suggestions would be greatly appreciated! > > thanks, > Demian > > -Original Message- > From: Jörn Franke > Sent: Friday, March 15, 2019 4:18 AM > To: solr-user@lucene.apache.org > Subject:

Re: Help with a DIH config file

2019-03-15 Thread Jörn Franke
Demian > > -Original Message- > From: Jörn Franke > Sent: Friday, March 15, 2019 4:18 AM > To: solr-user@lucene.apache.org > Subject: Re: Help with a DIH config file > > Do you have an exception? > It could be that the pdf is broken - can you open it on your computer with a

RE: Help with a DIH config file

2019-03-15 Thread Demian Katz
arch 15, 2019 4:18 AM To: solr-user@lucene.apache.org Subject: Re: Help with a DIH config file Do you have an exception? It could be that the pdf is broken - can you open it on your computer with a pdfreader? If the exception is related to Tika and pdf then file an issue with the pdfbox project.

Re: Help with a DIH config file

2019-03-15 Thread Jörn Franke
Do you have an exception? It could be that the pdf is broken - can you open it on your computer with a pdfreader? If the exception is related to Tika and pdf then file an issue with the pdfbox project. If there is an issue with Tika and MsOffice documents then Apache poi is the right project to

Re: Help with a DIH config file

2019-03-15 Thread wclarke
Thank you so much. You helped a great deal. I am running into one last issue where the Tika DIH is stopping at a specific language and fails there (Malayalam). Do you know of a work around? -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Help with a DIH config file

2019-03-14 Thread Jörn Franke
sorry for my late reply. thanks for sharing yes this is possible. maybe my last mail were confusing. I hope the examples below help Alternative 1 - Use only DIH without update processor tika-data-config-2xml - add transformer in entity and the transformation in field (here done for id and for fu

Re: Help with a DIH config file

2019-03-13 Thread wclarke
Got each one working individually, but not multiples. Is it possible? Please see attached files. Thanks!!! tika-data-config-2.xml solrconfig.xml -- Sen

Re: Help with a DIH config file

2019-03-13 Thread wclarke
I didn't know I could do an updateProcessorChain and call it in the config file. I tried doing it in the solrconfig, but it just wouldn't take. I will try this though! Thanks The value is the file path in id/url. -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Help with a DIH config file

2019-03-13 Thread wclarke
Absolutely! I attached it to the original message, But I can post here too. I am VERY new to Solr and am winging it and while the documentation has been a little helpful, I just need more complex examples. tika-data-config-2.xml

Re: Help with a DIH config file

2019-03-12 Thread Jörn Franke
Some addition: You can also strip HTML in DIH using the HTML Strip transformer: https://wiki.apache.org/solr/DataImportHandler#HTMLStripTransformer In that way you can probably live without a UpdateRequestProcessorChain On Tue, Mar 12, 2019 at 10:24 PM Jörn Franke wrote: > Would it be possible

Re: Help with a DIH config file

2019-03-12 Thread Jörn Franke
Would it be possible to share the DIH config file? I am not sure if I get all your points correctly. Ad 1) is this about a value in a field? Then use the regex transformer: https://wiki.apache.org/solr/DataImportHandler#RegexTransformer Alternatively, use a RegexReplaceProcessorFactoryin solrconf

Re: Help needed with Solrcloud error messages

2019-02-07 Thread Erick Erickson
Your solr logs on the server should have more details than just the bare error in the full stack trace. Those would help figure out what's happening. Best, Erick On Mon, Feb 4, 2019 at 3:14 PM Webster Homer wrote: > > We have a number of collections in a Solrcloud. > > The cloud has 2 shards eac

Re: Help with multi-lang searches

2018-10-22 Thread Tim Casey
Hi Sambhav, Calculate the percentage of letter pairs per language in the index. Given the letter pairs in the incoming token, find the closest "match" for the languages in the indexes. Even on a small number of tokens you will get close to the intended language. You can also calculate the "sourc

Re: Help with multi-lang searches

2018-10-22 Thread Alexandre Rafalovitch
Additional possibilities: 1) omitNorms and maybe omitTermFreqAndPositions for the fields to avoid frequency of term mattering http://lucene.apache.org/solr/guide/7_5/defining-fields.html#optional-field-type-override-properties 2) Constant score: http://lucene.apache.org/solr/guide/7_5/the-standard-

Re: [help!] java.lang.NoSuchMethodError: org.apache.solr.client.solrj.request.schema.SchemaRequest

2018-08-27 Thread Steve Rowe
Thanks for letting us know about the source of the problem. -- Steve www.lucidworks.com > On Aug 27, 2018, at 3:15 PM, yx zhou wrote: > > i found the root cause, it is my setting > > >org.noggit >noggit > > > It's has duplicate (version conflict) in my

Re: [help!] java.lang.NoSuchMethodError: org.apache.solr.client.solrj.request.schema.SchemaRequest

2018-08-27 Thread yx zhou
i found the root cause, it is my setting org.noggit noggit It's has duplicate (version conflict) in my dependency. On Mon, Aug 27, 2018 at 11:22 AM yx zhou wrote: > Hi Steve > > Thank your reply. > My solr server is from > http://archive.apach

Re: [help!] java.lang.NoSuchMethodError: org.apache.solr.client.solrj.request.schema.SchemaRequest

2018-08-27 Thread yx zhou
Hi Steve Thank your reply. My solr server is from http://archive.apache.org/dist/lucene/solr/7.0.1/, and my SolrJ client is org.apache.solr solr-solrj 7.0.1 org.slf4j jcl-over-slf4j org.nog

Re: [help!] java.lang.NoSuchMethodError: org.apache.solr.client.solrj.request.schema.SchemaRequest

2018-08-24 Thread Steve Rowe
Hi, SchemaRequestJSONWriter class was removed in SOLR-12455[1], but this change has not been released yet (will be released with Solr 7.5). I’m guessing you’re using code built against branch_7x or master? If so, then one solution is to build against the released source for any 7.x version.

Re: Help with error on indexing mongoDB document by Solr DataImportHandler

2018-08-14 Thread Wendy2
H Shawn, Thank you very much for your response! Solr DataImportHandler "could not" directly index MongoDB collections. I used open source SolrMongoImporter project (https://github.com/james75/SolrMongoImporter) on top of Solr DIH to to directly index data of MongoDB collections. What I did was

Re: Help with error on indexing mongoDB document by Solr DataImportHandler

2018-08-13 Thread Shawn Heisey
On 8/13/2018 8:56 AM, Wendy2 wrote: Hi Solr users:I encountered the following error when indexing MongoDB data by using Solr DataImportHandler:org.apache.solr.common.SolrException: TransactionLog doesn't know how to serialize class org.bson.types.ObjectId; try implementing ObjectResolver? The b

Re: Help with error on indexing mongoDB document by Solr DataImportHandler

2018-08-13 Thread Wendy2
Update: I resolved this issue by checking key:value to convert ObjectId to String: if(value instanceof ObjectId) { map.put(key, (String) value.toString()); } else { .. } A Solr happy user :-) -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-

Re: Help Needed - Indexing Related

2018-03-27 Thread Shawn Heisey
On 3/27/2018 6:08 AM, YELESWARAPU, VENKATA BHAN wrote: > Hope you are doing well. I have been struggling with indexing for a week now. > Yesterday I deleted all indexing files and tried re-indexing. It failed > saying unable to open a new searcher. Also that _0.si file is missing. > Today I redepl

RE: Help Needed - Indexing Related

2018-03-27 Thread YELESWARAPU, VENKATA BHAN
Information Classification: ** Limited Access Team, Fyi..Deleting the indexing job queue table resolved the issue and it generated the index files. Thank you, Dutt _ From: YELESWARAPU, VENKATA BHAN Sent: Tuesday, March 27, 2018 8:08 AM To: 'solr-user

RE: Help Needed - Indexing Related

2018-03-27 Thread YELESWARAPU, VENKATA BHAN
@lucene.apache.org Subject: Re: Help Needed - Indexing Related Since this is a scheduled job I think you can get rid of commits and optimize which are invoked from scheduled job. On Tue, Mar 27, 2018 at 6:13 PM, YELESWARAPU, VENKATA BHAN < vyeleswar...@statestreet.com> wrote: > Information Classific

Re: Help Needed - Indexing Related

2018-03-27 Thread Sujay Bawaskar
run in min intervals. > > Thank you, > Dutt > > > -Original Message- > From: Sujay Bawaskar [mailto:sujaybawas...@gmail.com] > Sent: Tuesday, March 27, 2018 8:32 AM > To: solr-user@lucene.apache.org > Subject: Re: Help Needed - Indexing Related > > Few question

RE: Help Needed - Indexing Related

2018-03-27 Thread YELESWARAPU, VENKATA BHAN
have the option to schedule it to run in min intervals. Thank you, Dutt -Original Message- From: Sujay Bawaskar [mailto:sujaybawas...@gmail.com] Sent: Tuesday, March 27, 2018 8:32 AM To: solr-user@lucene.apache.org Subject: Re: Help Needed - Indexing Related Few questions here, Ar

Re: Help Needed - Indexing Related

2018-03-27 Thread Sujay Bawaskar
Few questions here, Are you using solrj client from java application? What is version of solr? How frequently commit and optimize operation is called from solr client? If commit and optimize are not called from client what is value for solr.autoCommit.maxTime and solr.autoSoftCommit.maxTime? What

Re: Help required with SolrJ

2018-02-21 Thread Aakanksha Gupta
Thanks Shawn! That was just a small fix from my side. Thanks for your help! On Tue, Feb 20, 2018 at 1:43 AM, Shawn Heisey wrote: > On 2/19/2018 8:49 AM, Aakanksha Gupta wrote: > > Thanks for the quick solution. It works. I just had to replace %20 to > space > > in query.addFilterQuery("timestamp

Re: Help required with SolrJ

2018-02-21 Thread Aakanksha Gupta
Thanks Erick. On Tue, Feb 20, 2018 at 1:11 AM, Erick Erickson wrote: > Aakanksha: > > Be a little careful here, filter queries with timestamps can be > tricky. The example you have is fine, but for end-points with finer > granularity may be best if you don't cache them, see: > https://lucidworks

Re: Help required with SolrJ

2018-02-19 Thread Shawn Heisey
On 2/19/2018 8:49 AM, Aakanksha Gupta wrote: > Thanks for the quick solution. It works. I just had to replace %20 to space > in query.addFilterQuery("timestamp:[151890840 TO 151891200]"); > > Thanks a ton! :) Right, I didn't even really look closely at what was in the fq parameter, I just

Re: Help required with SolrJ

2018-02-19 Thread Erick Erickson
Aakanksha: Be a little careful here, filter queries with timestamps can be tricky. The example you have is fine, but for end-points with finer granularity may be best if you don't cache them, see: https://lucidworks.com/2012/02/23/date-math-now-and-filter-queries/ Best, Erick On Mon, Feb 19, 201

Re: Help required with SolrJ

2018-02-19 Thread Aakanksha Gupta
Hi Shawn, Thanks for the quick solution. It works. I just had to replace %20 to space in query.addFilterQuery("timestamp:[151890840 TO 151891200]"); Thanks a ton! :) On Mon, Feb 19, 2018 at 11:43 PM, Shawn Heisey wrote: > On 2/19/2018 6:44 AM, Aakanksha Gupta wrote: > >> http://localhos

Re: Help required with SolrJ

2018-02-19 Thread Shawn Heisey
On 2/19/2018 6:44 AM, Aakanksha Gupta wrote: http://localhost:8983/solr/geoloc/select/?q=*:*&fq={!geofilt}&sfield=latlong&pt=-6.08165,145.8612430&d=100&wt=json&fq=timestamp:[151890840%20TO%20151891200]&fl=*,_dist_:geodist() But I'm not sure how to build the SolrJ equivalent of this query

Re: Help with Boolean search using Solr parser edismax

2018-02-02 Thread Wendy2
Hi Erick, Yes. Currently I re-index the database on a weekly basis because we only have weekly release. As part of the Solr weekly re-index, the batch job will delete the /solr/core/data folder, restart Solr server, then re-index. We use Luigi to build/control pipelines of Solr re-index batch jobs

Re: Help with Boolean search using Solr parser edismax

2018-02-02 Thread Wendy2
Hi Erick, Thank you very much for the clarification. I will keep it in my mind since we are now in the process of migrating MySQL database to mongoDB. Best Regards, Wendy a happy Solr user -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Help with Boolean search using Solr parser edismax

2018-02-02 Thread Erick Erickson
>From the ref guide: "Field names should consist of alphanumeric or underscore characters only and not start with a digit. This is not currently strictly enforced, but other field names will not have first class support from all components and back compatibility is not guaranteed." You need to _c

Re: Help with Boolean search using Solr parser edismax

2018-02-02 Thread Wendy2
Good morning, Emir, Thanks for letting me know that. I used dots to add tableName. as a field prefix because several columns from different tables have the same names. In your opinion, what will be the best way to replace dots? Happy Friday! Wendy -- Sent from: http://lucene.472066.n3.nabbl

Re: Help with Boolean search using Solr parser edismax

2018-02-02 Thread Erick Erickson
>From the reference guide: Field names should consist of alphanumeric or underscore characters only and not start with a digit. This is not currently strictly enforced, but other field names will not have first class support from all components and back compatibility is not guaranteed. Best, Eric

Re: Help with Boolean search using Solr parser edismax

2018-02-02 Thread Emir Arnautović
Hi Wendy, A bit off-topic, but forgot to mention in previous mail: dots in field names are not recommended. Even it obviously works for you, I think I’ve seen people reporting some issues caused by dot in field names (I cannot find some reference now). So, if you plan some system upgrade in the

Re: Help with Boolean search using Solr parser edismax

2018-02-01 Thread Wendy2
And the coupon has no expiration date on it (LOL). Thank you again, Emir! Best Regards, Wendy -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Help with Boolean search using Solr parser edismax

2018-02-01 Thread Emir Arnautović
Hi Wendy, You are welcome! I’ll put your lunch coupon in my wallet, just in case I get hungry around NJ ;) Regards, Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > On 1 Feb 2018, at 16:26, Wendy2 wrot

Re: Help with Boolean search using Solr parser edismax

2018-02-01 Thread Wendy2
Excellent!!! Thank you so much for all your help, Emir! Both worked now and I got 997 result counts back as the expected number :-) /rcsb/search?q=method:"x-ray*" "Solution NMR"&mm=1 /rcsb/search?q=+method:"x-ray*" +"Solution NMR"&mm=1 I will keep this in my mind regarding query with multiple p

Re: Help with Boolean search using Solr parser edismax

2018-02-01 Thread Emir Arnautović
Hi Wendy, Query now looks as expected but you are not getting results as expected. The reason for that is edismax’s mm parameter is what matters. You are setting it to 7 and you have two parts to match so it is always AND and you don’t have such documents. You can set it to 1 and it will be OR.

Re: Help with Boolean search using Solr parser edismax

2018-02-01 Thread Wendy2
Good morning, Emir, Here are the debug output for case 1f-a (q=method:"x-ray*" "Solution NMR"), 1f-b (q=+method:"x-ray*" +"Solution NMR"). both returned zero counts. It looks that the querystrings are the same. Thanks for following up on my post and your help! -- Wendy *=De

Re: Help with Boolean search using Solr parser edismax

2018-01-31 Thread Emir Arnautović
Hi Wendy, I was thinking of query q=method:“x-ray*” “Solution NMR” This should be equivalent to one with OR between them. If you want to put AND between those two, query would be q=+method:”x-ray*” +”Solution NMR” Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticse

Re: Help with Boolean search using Solr parser edismax

2018-01-31 Thread Wendy2
Hi Emir, Listed below are the debugQuery outputs from query without "OR" operator. I really appreciate your help! --Wendy ===DebugQuery Outputs for case 1f-a, 1f-b without "OR" operator= *1f-a (/search?q=+method:"x-ray*" +method:"Solution NMR") result counts = 0: *

Re: Help with Boolean search using Solr parser edismax

2018-01-31 Thread Emir Arnautović
Hi Wendy, With OR with spaces OR is interpreted as another search term. Can you try without or - just a space between two parts. If you need and, use + before each part. HTH, Emir On Jan 31, 2018 6:24 PM, "Wendy2" wrote: Hi Emir, Thank you so much for following up with your ticket. Listed belo

Re: Help with Boolean search using Solr parser edismax

2018-01-31 Thread Wendy2
Hi Emir, Thank you so much for following up with your ticket. Listed below are the parts of debugQuery outputs via /search request handler. The reason I used * in the query term is that there are a couple of methods starting with "x-ray". When I used space surrounding the "OR" boolean search opera

Re: Help with Boolean search using Solr parser edismax

2018-01-31 Thread Emir Arnautović
Hi Wendy, I see several issues, but not sure if any of them is the reason why you are not getting what you expect: * there are no spaces around OR and that results in query being parsed sometimes with OR, e.g. (pdb_id:OR\”Solution)^5 * wildcard in quotes - it is not handled as you expected - the

Re: Help with Boolean search using Solr parser edismax

2018-01-30 Thread Wendy2
Hi Emlr, Thank you for reading my post and for your reply. I updated my post with debug info and a better view of the definition of /search request handler. Any suggestion on what I should try? Thanks, Wendy -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Help with Boolean search using Solr parser edismax

2018-01-30 Thread Wendy2
Hi Emir, Thank you so much for your response. I updated my post with an image which display the configuration of the /search request handler. Any suggestions? Thanks, Wendy -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Help with Boolean search using Solr parser edismax

2018-01-30 Thread Emir Arnautović
Hi Wendy, It is most likely that you need to list fields that can appear in query using uf. The best way to see what is going on is to use debugQuery and you can see more details how your query is parsed. HTH, Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearc

Re: help on implicit routing

2017-12-26 Thread Erick Erickson
copyField is _much_ too late. That only happens _after_ the doc lands on a shard, i.e. after it's been routed. The routing field must be populated before that stage. Why are you bothering with the _route_ field anyway? It's unnecessary. First of all, the name of the shard must match the value in

RE: help on implicit routing

2017-12-25 Thread hemanth
I am trying here implicit routing and want to create a collection with 3 shards with names Active,Inactive and Terminated. I created a _route_ field in schema and copied my status field which contains Active or Inactive or Terminated. I used copyfield in schema.xml to copy from status to _route_.

Re: help get 'count of distinct' using solr via cql against datastax?

2017-11-26 Thread Shawn Heisey
On 11/26/2017 7:45 AM, lamelylounges wrote: I have a datastax (DSE) server with cassandra. I am running the node in "search" mode, which means solr is enabled and working. I want to use CQL to write a query against my core/table. I'm fairly certain that CQL is not something created by the Sol

Re: Help with complex boolean search queries

2017-11-20 Thread Gajendra Dadheech
Hey Ankit, Try this tool for a better view of your debug output, and then if you have any specific question, do let me know : http://splainer.io/ On Sun, Oct 29, 2017 at 2:34 AM, Ankit Shah wrote: > Hi, > I am new to the solr community, and have this weird problem with the search > results > h

Re: Help with Query/Function for conditional boost

2017-08-16 Thread Ahmet Arslan
Hi Shamik, I belive 5-args map function can be used here. Here is a link which may inspire you. http://www.cominvent.com/2012/01/25/super-flexible-autocomplete-with-solr/ Ahmet On Wednesday, August 16, 2017, 11:06:28 PM GMT+3, Shamik Bandopadhyay wrote: Hi,   I'm trying to create a fun

Re: Help with updateHandler commit stats

2017-07-17 Thread Amrit Sarkar
Antonio, I think it is itself suggesting what it is. Meanwhile in official documentation: autocommits Total number of auto-commits executed. so yeah, total number of commits executed in the core's lifetime. Look into: https://cwiki.apache.org/confluence/display/solr/Performance+Statistics+Refe

RE: help on implicit routing

2017-07-09 Thread imran
Thanks for the reference, I am guessing this feature is not available through the post utility inside solr/bin Regards, Imran Sent from Mail for Windows 10 From: Jan Høydahl Sent: Friday, July 7, 2017 1:51 AM To: solr-user@lucene.apache.org Subject: Re: help on implicit routing http

Re: help on implicit routing

2017-07-07 Thread Jan Høydahl
http://lucene.apache.org/solr/guide/6_6/shards-and-indexing-data-in-solrcloud.html -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 6. jul. 2017 kl. 03.15 skrev im...@elogic.pk: > >

RE: help on implicit routing

2017-07-07 Thread imran
Thanks that was helpful, can this be done without modifying the document also when posting data through the post utility or a java client? Regards, Imran Sent from Mail for Windows 10 From: Susheel Kumar Sent: Thursday, July 6, 2017 7:52 AM To: solr-user@lucene.apache.org Subject: Re: help on

Re: help on implicit routing

2017-07-06 Thread Susheel Kumar
Eric has provided the details on other email. See below Use the _route_ field and put in "day_1" or "day_2". You've presumably named the shards (the "shard" parameter) when you added them with the CREATESHARD command so use the value you specified there. Best, Erick On Wed, Jul 5, 2017 at

Re: help on implicit routing

2017-07-05 Thread Erick Erickson
Use the _route_ field and put in "day_1" or "day_2". You've presumably named the shards (the "shard" parameter) when you added them with the CREATESHARD command so use the value you specified there. Best, Erick On Wed, Jul 5, 2017 at 6:15 PM, wrote: > I am trying out the document routing featur

Re: help with troubleshooting apache solr 6.3.0

2017-05-25 Thread Susheel Kumar
Can you describe little more about your setup like how many shards and if shard replicas are there, and how many zookeeper nodes etc. How often and does solr logs shows any sign of error/exceptions when this is happening. How do you know if it is creating new index and deleting old one. Do you se

Re: Help with facet.limit

2017-04-27 Thread alessandro.benedetti
In addition to what Erick mentioned, (if) you can use Json faceting and sort your facets according to your preferences using the stats integration [1]. Cheers [1] https://cwiki.apache.org/confluence/display/solr/Faceted+Search - --- Alessandro Benedetti Search Consultant, R&D S

Re: Help with facet.limit

2017-04-26 Thread Erick Erickson
The only two canned orderings are "index" which means lexically ordered and the default frequency, the top 500 most frequent facets will be returned. You can always specify facet.query=XXX and I think they are returned in the order you define the facets. If you have a small number of facets you re

  1   2   3   4   5   6   7   >