Re: Difference in q.op param behavior between Solr 6.3 and Solr 8.5.2

2020-09-23 Thread Erik Hatcher
ucene query parser syntax and be able to stably rely on AND/OR. Relevancy tuning on q and friends, tweaking those parameters, shouldn't affect fq's, to say it a little differently. One can fq={!lucene q.op=AND}id:(1 2 3) Erik > On Sep 23, 2020, at 4:23 PM, gnandre wro

Re: Best field definition which is only use for filter query.

2020-07-22 Thread Erik Hatcher
> On Jul 22, 2020, at 08:52, raj.yadav wrote: > > Erik Hatcher-4 wrote >> Wouldn’t a “string” field be as good, if not better, for this use case? > > What is the rationale behind this type change to 'string'. How will it speed > up search/filtering? W

Re: Best field definition which is only use for filter query.

2020-07-22 Thread Erik Hatcher
Wouldn’t a “string” field be as good, if not better, for this use case? > On Jul 22, 2020, at 08:02, Erick Erickson wrote: > > fq clauses are just like the q clause except for two things: > 1> no scoring is done > 2> the entire result set _can_ be stored in the filterCache. > > so if a value i

Re: Solr heap Old generation grows and it is not recovered by G1GC

2020-07-14 Thread Erik Hatcher
What kind of statistics?Are these stats that you could perhaps get from faceting or the stats component instead of gathering docs and accumulating stats yourself? > On Jul 14, 2020, at 8:51 AM, Odysci wrote: > > Hi Erick, > > I agree. The 300K docs in one search is an anomaly. > But we

Re: 'velocity' does not exist . Do an 'create-queryresponsewriter' , if you want to create it

2020-05-19 Thread Erik Hatcher
Need to also make sure the velocity writer and dependencies are ’d in in solrconfig.xml > On May 19, 2020, at 02:30, Prakhar Kumar > wrote: > > Hello Team, > > I am using Solr 8.5.0 and here is the full log for the error which I am > getting: > > SolrConfigHandler Error checking plugin : =

Re: solr payloads performance

2020-05-11 Thread Erik Hatcher
Wei - Here's some details on the various payload capabilities and short-comings: https://lucidworks.com/post/solr-payloads/ SOLR-10541 is the main functional constraint (range faceting over functions). Erik > On May 8, 2020, at 7:26 PM, Wei wrote: > > Hi everyon

Re: 'velocity' does not exist . Do an 'create-queryresponsewriter' , if you want to create it

2020-04-28 Thread Erik Hatcher
Try add-queryresponsewriter instead of "update" - it's not currently defined so there's nothing to update. Add it first, but also make sure you've got the Velocity contrib and dependencies wired into your configset as well. Erik > On Apr 28, 2020, at 9:15

Re: ResourceManager : unable to find resource 'custom.vm' in any resource loader.

2020-04-22 Thread Erik Hatcher
What's the full request that is logged? You're using the Velocity response writer (wt=velocity) and a request is being made to render a custom.vm template (v.template=custom, or a template is #parse'ing("custom.vm")) that doesn't exist. Erik > On

Re: Query is taking a time in Solr 6.1.0

2020-03-13 Thread Erik Hatcher
Looks like you have two, maybe three, wildcard/prefix clauses in there. Consider tokenizing differently so you can optimize the queries to not need wildcards - thats my first observation and suggestion. Erik > On Mar 13, 2020, at 05:56, vishal patel wrote: > > Some query

Re: Re: Anyone have experience with Query Auto-Suggestor?

2020-01-23 Thread Erik Hatcher
riate tokenization to match the partial words as the user types, like ngramming) Erik > On Jan 20, 2020, at 11:54 AM, Audrey Lorberfeld - audrey.lorberf...@ibm.com > wrote: > > David, > > Thank you, that is useful. So, would you recommend using a (clean) fi

[CVE-2019-17558] Apache Solr RCE through VelocityResponseWriter

2019-12-30 Thread Erik Hatcher
[CVE-2019-17558] Apache Solr RCE through VelocityResponseWriter Severity: High Vendor: The Apache Software Foundation Versions Affected: 5.0.0 to 8.3.1 Description: The affected versions are vulnerable to a Remote Code Execution through the VelocityResponseWriter. A Velocity template can be pr

Re: How to tell which core was used based on Json or XML response from Solr

2019-11-24 Thread Erik Hatcher
add &core=&echoParams=all and the parameter will be in the response header. Erik > On Nov 22, 2019, at 13:27, rhys J wrote: > > I'm implementing an autocomplete search box for Solr. > > I'm using JSON as my response style, and this is the jquery code. &g

Re: using fq means no results

2019-11-12 Thread Erik Hatcher
g/ (my blog) > >>> On Nov 12, 2019, at 9:08 AM, Erik Hatcher wrote: >>> >>> >>> >>>> On Nov 12, 2019, at 12:01 PM, rhys J wrote: >>> >>> On Tue, Nov 12, 2019 at 11:57 AM Erik Hatcher >>> wrote: >>> >

Re: using fq means no results

2019-11-12 Thread Erik Hatcher
> On Nov 12, 2019, at 12:01 PM, rhys J wrote: > > On Tue, Nov 12, 2019 at 11:57 AM Erik Hatcher > wrote: > >> fq is a filter query, and thus narrows the result set provided by the q >> down to what also matches all specified fq's. >> >>

Re: using fq means no results

2019-11-12 Thread Erik Hatcher
me, and your fq should probably also have a value for that field (say fq=cat_ref_no=owl-2924-8) Use debug=true to see how your q and fq's are parsed, and that should shed some light on the issue. Erik > On Nov 12, 2019, at 11:33 AM, rhys J wrote: > > If I

Re: Good Open Source Front End for Solr

2019-11-07 Thread Erik Hatcher
Blacklight: http://projectblacklight.org/ ;) > On Nov 6, 2019, at 11:16 PM, Java Developer wrote: > > Hi, > > What is the best open source front-end for Solr > > Thanks

Re: Security Vulnerability Consultation

2019-11-01 Thread Erik Hatcher
> No Solr API, including the Admin UI, is designed to be exposed to >> non-trusted parties. Turning on authentication is the first step I'd recommend. Erik > On Oct 31, 2019, at 11:45 PM, Huawei PSIRT wrote: > > Dear, > > > >This is Huawei P

Re: Solr Paryload example

2019-10-21 Thread Erik Hatcher
#L130 <https://github.com/o19s/payload-component/blob/master/src/main/java/com/o19s/payloads/Payloader.java#L130> I think that code could probably be slightly enhanced to leverage PayloadUtils.getPayloadDecoder(fieldType) and use bytes if the field type doesn't have a better decoder.

Re: Solr Paryload example

2019-10-21 Thread Erik Hatcher
like maybe a DocTransformer? Erik > On Oct 21, 2019, at 9:59 AM, Vincenzo D'Amore wrote: > > Hi Erick, > > thanks for getting back to me. We started to use payloads because we have > the classical per-store pricing problem. > Thousands of stores across and di

Re: solr.HTMLStripCharFilterFactory issue

2019-09-02 Thread Erik Hatcher
Analysis has no effect on the stored (what you get back from fl) value. The html stripping is happening behind the scenes on the indexed/searchable terms. Erik > On Sep 2, 2019, at 09:30, Big Gosh wrote: > > Hi, > > I've configured in solr 8.2.0 a f

Re: modify query response plugin

2019-08-06 Thread Erik Hatcher
I think you’re looking for the Solr Tagger, described here: https://lucidworks.com/post/solr-tagger-improving-relevancy/ > On Aug 6, 2019, at 16:04, Maria Muslea wrote: > > Hi, > > I am trying to implement a plugin that will modify my query response. For > example, I would like to execute a qu

Re: Ranking

2019-07-27 Thread Erik Hatcher
The details of the scoring can be seen by setting &debug=true Erik > On Jul 27, 2019, at 15:40, Steven White wrote: > > Hi everyone, > > I have 2 files like so: > > FA has the letter "i" only 2 times, and the file size is 54,246 bytes > FB has the

Re: Boosting using Range

2019-05-31 Thread Erik Hatcher
Sachin - that’s a confusing name for a field that represents a price and not a “range”, but ok use the first one but with your field name: &bq=price_range:[10 TO 25] My bad below saying “boost” (takes a function, not a raw query). Use “bq”, which takes a regular query. Erik

Re: Boosting using Range

2019-05-30 Thread Erik Hatcher
The simplest given your example, with edismax add &boost=price:[10 TO 25] Or you literally have a price_range field?&boost=price_range:10_25 (assuming that's how you indexed it). What type of field is price_range? What did you index into it? Erik > On May 30,

Re: Retrieving docs in the same order as provided in the query

2019-05-09 Thread Erik Hatcher
So yeah, this constant score trick isn't meant for a "large" list, of course. For bigger result sets, the ExternalFileField feature would be one way to go. Or maybe the QueryElevationComponent. And I suppose also, the LTR feature could be abused for this? Erik &

Re: Retrieving docs in the same order as provided in the query

2019-05-09 Thread Erik Hatcher
Atita - You mean something like q=id:(X Y Z) to be able to order them arbitrarily? Yes, you can use the constant score query syntax to set the score, e.g.: q=id:Z^=3 OR id:Y^=2 OR id:X^=1 Hope that helps. Erik > On May 9, 2019, at 8:55 AM, Atita Arora wrote: > > Hi

Re: Custom post filter with support for 'OR' queries

2019-05-05 Thread Erik Hatcher
, with nesting qparsers, the curly brackets need to fully enclose the query, not leaving the expression to outside the brackets ambiguously.Use {!myparser v=$my_q} where &my_q=the expression. Erik > On May 5, 2019, at 11:07, alexpusch wrote: > > Hi, > > I'

Re: Term Freq Vector with SOLR cell?

2019-05-01 Thread Erik Hatcher
q=doc_content?Try q=id:"" Solr Cell and DIH are comparable (in that they are about getting content into Solr) but "unrelated" to TVRH. TVRH is about inspecting indexed content, regardless of how it got in. Erik > On May 1, 2019, at 3:14 PM, Geoffrey Will

Re: bin/post command not working when run from crontab

2019-04-18 Thread Erik Hatcher
27;s there now. But it's obviously weirdly broken, sorry. Erik > On Apr 14, 2019, at 8:30 AM, Jason Gerlowski wrote: > > Hi Carsten, > > I think this is probably worth a jira. I'm not familiar enough with > bin/post to say definitively whether the

Re: Understanding Performance of Function Query

2019-04-09 Thread Erik Hatcher
maybe something like q= ({!edismax v=$q1} OR {!edismax v=$q2} OR {!edismax ... v=$q3}) and setting q1, q2, q3 as needed (or all to the same maybe with different qf’s and such) Erik > On Apr 9, 2019, at 09:12, sidharth228 wrote: > > I did infact use "bf&

Re: Understanding Performance of Function Query

2019-04-09 Thread Erik Hatcher
Function queries in ‘q’ score EVERY DOCUMENT. Use ‘bf’ or ‘boost’ for the function part, so its only computed on main query matching docs. Erik > On Apr 9, 2019, at 03:29, Sidharth Negi wrote: > > Hi, > > I'm working with "edismax" and "funct

Re: Behavior of Function Query

2019-03-19 Thread Erik Hatcher
Try adding fl=* into the request. There’s an oddity with fl, iirc, where it can skip functions if * isn’t there (or maybe a concrete non-score field?) Erik > On Mar 18, 2019, at 10:19, Ashish Bisht wrote: > > Please see the below requests and response > > http://Sol:89

Re: Different behavior when using function queries

2019-03-18 Thread Erik Hatcher
If you have no documents in the results, there’s nothing to attach the function result to.`fl` is field list of fields to show in matched documents. You have no matches documents. Erik > On Mar 18, 2019, at 07:55, Ashish Bisht wrote: > > Can someone please explain

Re: Is it possible to force solr show all facet values for the field with an enum type?

2019-01-06 Thread Erik Hatcher
How about &facet.query=-field:[* TO *] as a way to see a count of docs that don’t have field? Erik > On Jan 5, 2019, at 04:45, Arvydas Silanskas > wrote: > > Hello, > I have an enum solr fieldtype. When I do a facet search, I want that all > the enum values appe

Re: boost query

2018-12-07 Thread Erik Hatcher
Only way to know is to try! ;) You have a typo on “noika”.I’d use ‘bf’ instead of bq so as to specify the function without the _val_ stuff. Erik > On Dec 7, 2018, at 02:19, Midas A wrote: > > Thanks Erik. > Please confirm > if keyword = "nokia" > *bq=_va

Re: boost query

2018-12-06 Thread Erik Hatcher
This blog I wrote will help. Let us know how it goes. https://lucidworks.com/2017/09/14/solr-payloads/ Erik > On Dec 7, 2018, at 01:31, Midas A wrote: > > I have a field at my schema named *val_dpf* . I want that *val_dpf* should > have payloaded values. i.e. >

Re: Date Query Using Local Params

2018-09-10 Thread Erik Hatcher
range1} OR {!field f=collection_date_range op=Within v=$range2} &range1=[2013-07-08 TO 2013-07-09] &range2=[2013-07-21 TO 2013-07-25] Erik > On Sep 10, 2018, at 3:59 PM, Antelmo Aguilar wrote: > > Hi Shawn, > > Thank you. So just to confirm, there is

Re: How long does a query?q=field1:2312 should cost? exactly hit one document.

2018-09-03 Thread Erik Hatcher
Add debug=true and see where the time goes, in which components? Highlighting is my culprit guess. Or faceting? > On Sep 3, 2018, at 07:45, zhenyuan wei wrote: > > Hi , > I am curious “How long does a query q=field1:2312 cost , which > exactly match only one document? ”, Of course we j

Re: Can I use RegEx function?

2018-07-23 Thread Erik Hatcher
this is best done at index-time. (it seems like you're trying to avoid doing that though) > On Jul 23, 2018, at 5:36 AM, Peter Sh wrote: > > I want to be able to parse "KEY:VALUE" pairs from my text and have a facet > representing distribution of VALUES > > On Mon, Jul 23, 2018 at 12:25 PM

Re: How to avoid join queries

2018-06-13 Thread Erik Hatcher
> On Jun 13, 2018, at 4:24 PM, root23 wrote: ... > But i > know use of join is discouraged in solr and i do not want to use it. … Why do you say that? I, for one, find great power and joy using `{!join}`. Erik

Re: How to find out which search terms have matches in a search

2018-06-12 Thread Erik Hatcher
of search results like that. An oldie but a goodie: https://www.slideshare.net/lucenerevolution/hatcher-erik-rapid-prototyping-with-solr/12 <https://www.slideshare.net/lucenerevolution/hatcher-erik-rapid-prototyping-with-solr/12> 4.10.4? woah Erik Hatcher Senior Solut

Re: indexer used in solr

2018-06-11 Thread Erik Hatcher
Vivek - Can you provide us specific examples of what you’re sending in (and how you are doing so) and how you are querying and what you expect? Erik > On Jun 11, 2018, at 7:34 AM, Vivek Singh wrote: > > HI Team , > I am new to solr ,wanted to know which indexer is us

Re: sharding guidelines

2018-06-04 Thread Erik Hatcher
I’d say that 100M/shard is in the smallest doc use case possible, such as straight up log items with only a timestamp, id, and short message kind of thing. In other contexts, big full text docs, 10M/shard is kind of a max. How many documents do you have in your collection? Erik

Re: Three Indexing Questions

2018-03-29 Thread Erik Hatcher
there’s no reason it couldn’t be evolved to handle those things. Erik > > I note this message that's displayed when I begin indexing: "Entering > auto mode. File endings considered are > xml,json,jsonl,csv,pdf,doc,docx,ppt,pptx,xls,xlsx,odt,odp,ods,ott,otp,ot

Re: query regarding Solr partial search

2018-03-27 Thread Erik Hatcher
This is as much about your schema as it is about your query parser usage. What’s parsed_query say in your debug=true output? What query parser are you using? If edismax, check qf/pf/mm settings, etc. Erik > On Mar 27, 2018, at 9:56 AM, Paul, Lulu wrote: > > Hi , >

Re: Solr Expression Slow

2018-02-12 Thread Erik Hatcher
I suggest applying that logic at index time and build yourself a SORT_CRITERIA field and use that rather than that sophisticated function that looks like it could collapse down to a single index-time field. Erik > On Feb 12, 2018, at 10:32 AM, ~$alpha` wrote: > > In the b

Re: Post-processing of Solr responses in Velocity templates by calling external Java methods

2018-01-25 Thread Erik Hatcher
/velocity/MockTool.java Again, though - I wouldn’t advise using Velocity trickery to do Solr searches internal to template rendering (even though you can). Erik > On Jan 24, 2018, at 9:50 AM, Ravindra Soni wrote: > > Hi, > > *Quick context of the application first.* >

Re: trivia question: why q=*:* doesn't return same result as q.alt=*:*

2018-01-07 Thread Erik Hatcher
. Erik > On Jan 6, 2018, at 22:48, Erick Erickson wrote: > > As Chris explained, this is special: > q=*:* > in terms of scoring or anything of the like. It's just match-all-docs > > It makes no sense to distribute *:* among "pf" fields. The whole poin

Re: Solr - how does faceting returned unstored values?

2018-01-05 Thread Erik Hatcher
Facets return the *indexed* value. This is an important, ahem, facet to facets. Field analysis matters, so tokenized fields will have tokenized facets. Erik > On Jan 5, 2018, at 10:17 AM, ruby wrote: > > The Solr document states that the purpose of the stored attrib

Re: Solr - custom ordering

2018-01-05 Thread Erik Hatcher
Vineet - Solr’s QueryElevationComponent can do this. Or you could use a query like: q=id:C^=300 id:B^=200 id:A^=100 The ^= is a constant score syntax, so you can assign a “score” to a clause (in this case a single document with a unique id). Erik > On Jan 4, 2018, at 11

Re: Deliver static html content via solr

2018-01-05 Thread Erik Hatcher
https://lucidworks.com/2015/12/08/browse-new-improved-solr-5/ Erik > On Jan 5, 2018, at 4:19 AM, Rick Leir wrote: > > Using Velocity, you can have some results-driven HTML served by Solr and all > your JS, CSS etc 'assets' served by Apache from /var/www/html. Wa

Re: Personalized search parameters

2018-01-05 Thread Erik Hatcher
the same :) Erik > On Jan 5, 2018, at 6:10 AM, marco wrote: > > Hi, first of all I want to say that i'm a beginner with the whole Lucene/Solr > environment. > I'm trying to create a simple personalized search engine, and to do so i was > thinking about adding a paramet

Re: trivia question: why q=*:* doesn't return same result as q.alt=*:*

2018-01-04 Thread Erik Hatcher
defType=??? Probably dismax. It doesn’t do *:* like edismax or lucene. > On Jan 4, 2018, at 20:39, Nawab Zada Asad Iqbal wrote: > > Thanks Erik > Here is the output, > > http://localhost:8983/solr/filesearch/select?fq=id:1193&q.alt=*:*&debugQuery=tr

Re: Deliver static html content via solr

2018-01-04 Thread Erik Hatcher
All judgements aside on whether this is a preferred way to go, have a look at /browse and the VelocityResponseWriter (wt=velocity). It can serve static resources. I’ve built several prototypes this way that have been effective and business generating. Erik > On Jan 4, 2018, at 11

Re: DIH XPathEntityProcessor XPath subset?

2018-01-03 Thread Erik Hatcher
Stefan - If you pre-transform the XML, I’d personally recommend either transforming it into straight up Solr XML (docs/fields/values) or some other format or posting directly to Solr. Avoid this DIH thing when things get complicated. Erik > On Jan 3, 2018, at 11:40 AM, Stefan Moi

Re: does the payload_check query parser have support for simple query parser operators?

2017-11-30 Thread Erik Hatcher
No it doesn’t. The payload parsers currently just simple tokenize with no special syntax supported. Erik > On Nov 30, 2017, at 02:41, John Anonymous wrote: > > I would like to use wildcards and fuzzy search with the payload_check query > parser. Are these supported? > &g

Re: Analyse Fieldname API

2017-11-15 Thread Erik Hatcher
Turn on your browsers developer mode and check out the HTTP requests behind the scenes of that page. Yes! ;) > On Nov 15, 2017, at 07:19, kumar gaurav wrote: > > Hi > > Solr has panel to Analyse Fieldname i.e. > > http://localhost:8983/solr/#/corename/analysis > > I need an API which w

Re: tf function query

2017-10-05 Thread Erik Hatcher
How about the query() function? Just be clever about the query you specify ;) > On Oct 5, 2017, at 06:14, Dmitry Kan wrote: > > Hi, > > According to > https://lucene.apache.org/solr/guide/6_6/function-queries.html#FunctionQueries-AvailableFunctions > > tf(field, term) requires a term as a sec

Re: Solr fields for Microsoft files, image files, PDF, text files

2017-09-25 Thread Erik Hatcher
you’ve asked about, mapping content types to more friendly human types (“image” instead of the whole gamut of image/* content-types). Erik > On Sep 24, 2017, at 10:55 PM, Phillip Wu wrote: > > > Hi, > I'm starting out with Solr on a Windows box. > > I w

Re: Boost by Integer value on top of query

2017-07-20 Thread Erik Hatcher
yees,num_locations)` Erik > On Jul 20, 2017, at 6:35 AM, marotosg wrote: > > Hi, > > I have a use where I need to boost documents based on two integer values. > Basically I need to retrieve companies using specific criteria like Company > name, nationality etc. >

Re: Multiple Field Search on Solr

2017-07-10 Thread Erik Hatcher
fair bit of HTML, JavaScript, and Solr know-how needed to do what you’re asking. A first step would be to try using `fq` instead of appending to `q` for things you want to “AND" to the query that aren’t relevancy related. Erik > On Jul 10, 2017, at 6:20 AM, Clare Le

Re: Slowly running OOM due to Query instances?!

2017-07-07 Thread Erik Hatcher
-7481 Erik > On Jul 7, 2017, at 7:01 AM, Markus Jelsma wrote: > > Hello, > > This morning i spotted our QTime suddenly go up. This has been going on for a > few hours by now and coincides with a serious increase in heap consumption. > No node ran out of memory so f

Re: Boosting Documents using the field Value

2017-06-24 Thread Erik Hatcher
With dismax use bf=domain_ct. you can also use boost=domain_ct with edismax. > On Jun 23, 2017, at 23:01, govind nitk wrote: > > Hi Solr, > > My Index Data: > > id name category domain domain_ct > 1 Banana Fruits Home > Fruits > Banana 2 > 2 Orange Fruits Home > Fruits > Orange 4 > 3 Samsung

Re: Indexing PDF files with Solr 6.6 while allowing highlighting matched text with context

2017-06-19 Thread Erik Hatcher
Ziyuan - You may be interested in the example/files that ships with Solr too. It’s got schema and config and even UI for file indexing and searching. Check it out README.txt under example/files in your Solr install. Erik > On Jun 19, 2017, at 6:52 AM, ZiYuan wrote: > >

Re: CSV output

2017-06-15 Thread Erik Hatcher
Is it the proxy affecting the output?What do you get going directly to Solr's endpoint? Erik > On Jun 14, 2017, at 22:13, Phil Scadden wrote: > > If I try > /getsolr? > fl=id,title,datasource,score&hl=true&hl.maxAnalyzedChars=9000&hl.method=un

Re: Odd Boolean Query behavior in SOLR 3.6

2017-06-13 Thread Erik Hatcher
:29096) Erik > On Jun 13, 2017, at 3:15 AM, abhi Abhishek wrote: > > Hi Everyone, > >I have hit a weird behavior of Boolean Query, when I am > running the query with below param’s it’s not behaving as expected. can > you please help me underst

Re: Phrase Query only forward direction

2017-06-12 Thread Erik Hatcher
ers-ComplexPhraseQueryParser> Something like: q=({!edismax … ps=0 v=$qq}) OR {!complexphrase df=nameSearch v=$qq} where &qq=12345 masitha Erik > On Jun 12, 2017, at 9:57 AM, Aman Deep Singh > wrote: > > Yes Erik I can use ps=0 but, my problem is that I want ph

Re: Phrase Query only forward direction

2017-06-12 Thread Erik Hatcher
Using ps=5 causes the phrase matching to be unordered matching. You’ll have to set ps=0, if using edismax, to get exact order phrase matches. Erik > On Jun 12, 2017, at 1:09 AM, Aman Deep Singh > wrote: > > Hi, > I'm using a phrase query ,but it was applying

Re: Proximity Search using edismax parser.

2017-06-12 Thread Erik Hatcher
Adding &debug=true to your search requests will give you the parsing details, so you can see how edismax interprets the query string and parameters to turn it into the underlying dismax and phrase queries. Erik > On Jun 12, 2017, at 3:22 AM, abhi Abhishek wrote: >

Re: I want "john smi" to find "john smith" in my custom "fullname_s" field

2017-06-06 Thread Erik Hatcher
. Even better, IMO, is to separate the query string from the query parser: q={!prefix f=fullname_s v=$qq}&qq=john smi Erik Amrit - the issue with your example below is that q=fullname_s:john smi* parses “john” against fullname_s and “smi” as a prefix query against the def

Re: Velocity UI with Analyzing Infix Suggester?

2017-06-06 Thread Erik Hatcher
If you want to open a JIRA and hack through it together I’m game. Erik > On Jun 5, 2017, at 4:14 PM, Walter Underwood wrote: > > Does anyone have the new suggester working in the Velocity browse UI? In > 6.5.1, it uses the terms component. > > I could probably figure ou

Re: Long string in fq value parameter, more than 2000000 chars

2017-05-27 Thread Erik Hatcher
Another technique to consider is {!join}. Index the cross ref id "sets" to another core and use a short and sweet join, if there are stable sets of id's. Erik > On May 27, 2017, at 11:39, Alexandre Rafalovitch wrote: > > On top of Shawn's analysis, I am also

Re: knowing which fields were successfully hit

2017-05-16 Thread Erik Hatcher
Is this the equivalent of facet.query’s? or maybe rather, group.query? Erik > On May 16, 2017, at 1:16 PM, Dorian Hoxha wrote: > > Something like elasticsearch named-queries, right > https://www.elastic.co/guide/en/elasticsearch/reference/current/search-request-named

Re: Solr Features 6.5.1 v/s 6.1

2017-05-12 Thread Erik Hatcher
r your other questions, not quite sure exactly what you mean on those. What features/improvements are you looking for specifically here? Erik > On May 12, 2017, at 8:39 AM, Sweta Parekh wrote: > > Hi Team, > Can you please help me with new features, enhancements and improvements

Re: Dynamic facets during runtime

2017-05-12 Thread Erik Hatcher
Use "appends" instead of "defaults". > On May 11, 2017, at 23:23, Jeyaprakash Singarayar > wrote: > > Hi, > > Our application has a facet select admin screen UI that would allow the > users to add/update/delete the facets that has to be returned from Solr. > > Right now we have the facet fie

Re: Automatic conversion to Range Query

2017-05-07 Thread Erik Hatcher
Fair enough indeed. And as you've experienced, that other functionality includes syntax that needs escaping. If you're using SolrJ then there's a utility method to escape characters. Erik > On May 6, 2017, at 20:53, Aman Deep Singh wrote: > > Hi Erik, >

Re: Automatic conversion to Range Query

2017-05-06 Thread Erik Hatcher
What about dismax instead of edismax?It might do the righter thing here without escaping. > On May 6, 2017, at 12:57, Shawn Heisey wrote: > >> On 5/6/2017 7:09 AM, Aman Deep Singh wrote: >> After escaping the square bracket the query is working fine, Is their >> any way in the parser to av

Re: Import Handler using shell scripts

2017-04-28 Thread Erik Hatcher
Yes, via the HTTP API (via curl or other tool). See the commands and URL examples here: https://cwiki.apache.org/confluence/display/solr/Uploading+Structured+Data+Store+Data+with+the+Data+Import+Handler#UploadingStructuredDataStoreDatawiththeDataImportHandler-DataImportHandlerCommands

Re: Modify solr score

2017-04-22 Thread Erik Hatcher
). You could index documents in this way: id, weighted_terms_dpf 1, A|5.0 B|95.0 2,A|88.7 B|0.1 And then search for “A” and use the 88.7 value to factor into the score or sorting. Erik > On Apr 21, 2017, at 12:35 PM, tstusr wrote: > > Since we report the score,

Re: Filter if Field Exists

2017-04-17 Thread Erik Hatcher
what you’re asking for though. Erik > On Apr 17, 2017, at 7:18 AM, Furkan KAMACI wrote: > > Btw, what is the difference between > > +name:test +(type:research (*:* -type:[* TO *])) > > and > > +name:test +(type:research -type:[* TO *]) > > On Mon

Re: Filter if Field Exists

2017-04-17 Thread Erik Hatcher
research=({!field f=name v=$qq} type:research) &q={!lucene}${q_no_type) OR ${q_research} Sorry, that’s just how my brain thinks, above - in splitting this stuff out. But in one line it’s really: q=(name:test -type:*) OR (name:test AND type:research) Erik > On Apr 17, 2

Re: Solr/ Velocity dont show full field value

2017-04-11 Thread Erik Hatcher
s and slick, to just do #field(“field_name”). But it does rely on highlighting working - so try the json or xml response until you get the highlighting configured as needed. Erik > On Apr 11, 2017, at 6:14 AM, Hamso wrote: > > Hey guys, > I have a problem: > > In

Re: Pagination bug? when sorting by a field (not unique field)

2017-03-29 Thread Erik Hatcher
Certainly not intended behavior. Can you show us a way to replicate the issue? > On Mar 29, 2017, at 8:35 AM, Pablo Anzorena wrote: > > Hey, > > I was paginating the results of a query and noticed that some documents > were repeated across pagination buckets of 100 rows. > When I sort by the

Re: I want to contribute custom made NLP based solr filters but dont know how.

2017-03-07 Thread Erik Hatcher
Nice use of the VelocityResponseWriter :) (and looks like, at quick glance, several other goodies under there too) Erik > On Mar 5, 2017, at 7:40 AM, Avtar Singh Mehra wrote: > > Hello everyone, > I have developed project called WiseOwl which is basically a fact base

Re: Using parameter values in a sort

2017-03-01 Thread Erik Hatcher
FYI - I recalled, and located, a solr-user thread from 2015 with subject “Parameter Substitution” with this same issue. Tricky issue - overloaded `${` usage and interpretation time. Erik > On Mar 1, 2017, at 1:41 PM, Erik Hatcher wrote: > > I just found a workaround, check

Re: Using parameter values in a sort

2017-03-01 Thread Erik Hatcher
I just found a workaround, check out this trick: ${sort_field:${sort_field}} desc when the core is loaded, it looks for a system property “sort_field”, doesn’t find it, and defaults the value to ${sort_field} and voila: /browse?q=*:*&wt=xml&sort_field=id Erik &g

Re: Using parameter values in a sort

2017-03-01 Thread Erik Hatcher
rt_field=id @Yonik or others - is this a known/filed issue?Workarounds or escaping that could make it work? Erik > On Feb 27, 2017, at 10:39 PM, Walter Underwood wrote: > > No, I tried that before adding the default. > > But the solrconfig.xml is rejected before

Re: Using parameter values in a sort

2017-02-27 Thread Erik Hatcher
us seasoned pros, simplification is often the root of problem solving in frustrating times; get back to what works) and let’s see the request (and echoParam=all output when the request is successful). Erik > On Feb 27, 2017, at 9:48 PM, Walter Underwood wrote: > > I added

Re: Using parameter values in a sort

2017-02-27 Thread Erik Hatcher
but there’s always the fun aspect of whitespace and escaping and quoting and such, so it is tricky business. A browser, some trial-and-error, and hopefully some tips and tricks like these that emerge online will be helpful in demystifying this and making it more accessible and useful/usable. Erik

Re: Using parameter values in a sort

2017-02-27 Thread Erik Hatcher
`scores` (plural), you’ve got this below: Remove that, and like my previous e-mail, and use `scores` (plural) from the request and _should_ work? Erik > On Feb 27, 2017, at 9:42 PM, Walter Underwood wrote: > > I’ve passed in a score parameter, but the solrconfig.xml is

Re: Using parameter values in a sort

2017-02-27 Thread Erik Hatcher
&sort=sum(${scores}) desc > On Feb 27, 2017, at 9:35 PM, Erik Hatcher wrote: > > You have an empty “scores” parameter in there. You’re not showing your full > search request, but did you provide that in the request? Have you perhaps > turned off parameter s

Re: Using parameter values in a sort

2017-02-27 Thread Erik Hatcher
You have an empty “scores” parameter in there. You’re not showing your full search request, but did you provide that in the request? Have you perhaps turned off parameter substitutions? Erik > On Feb 27, 2017, at 9:26 PM, Walter Underwood wrote: > > With this in t

Re: Using parameter values in a sort

2017-02-27 Thread Erik Hatcher
aram as needed from that. Erik > On Feb 27, 2017, at 7:17 PM, Walter Underwood wrote: > > We have documents with parameterized features. For a school subject > (calculus, accounting), we have three sets of features. So for subject=4 and > subject=186, we have: &g

Re: Issues with uniqueKey != id?

2017-02-06 Thread Erik Hatcher
Personally I'd leave it as "id" - and adjust your other domain specific field name to something else. Why? Keep Solr and other potential tools from having issues. I don't know exactly what may break, but I'd rather keep things straightforward. Erik > On Feb

Re: Search for ISBN-like identifiers

2017-01-05 Thread Erik Hatcher
Sebastian - There’s some precedent out there for ISBN’s. Bill Dueber and the UMICH/code4lib folks have done amazing work, check it out here - https://github.com/mlibrary/umich_solr_library_filters <https://github.com/mlibrary/umich_solr_library_filters> - Erik > On Ja

Re: Solr ACL Plugin Windows

2017-01-04 Thread Erik Hatcher
Thanks, Mike, for emphasizing that point. I put that point in the blog post as well - the recommended approach if it's sufficient for sure. Erik > On Jan 4, 2017, at 07:36, Mike Thomsen wrote: > > I didn't see a real Java project there, but the directions to com

Re: How to solve?

2016-12-28 Thread Erik Hatcher
I'll have to not be mobile and thumbing a reply to give a concrete example but you'll need to use the nested query parsing facility to make a boolean AND query of two geofilts or bboxes, each with local params. Erik > On Dec 28, 2016, at 02:12, William Bell wrote: > &

Re: Easy way to preserve Solr Admin form input

2016-12-27 Thread Erik Hatcher
How's /browse fare for you? What params are you adjusting regularly? > On Dec 27, 2016, at 06:09, Sebastian Riemer wrote: > > Hi, > > is there an easy way to preserve the query data I input in SolrAdmin? > > E.g. when debugging a query, I often have the desire to reopen the current > query

Re: prefix query help

2016-12-08 Thread Erik Hatcher
or q={!terms f=metadata.date}2016-06,2014-04 Erik > On Dec 8, 2016, at 11:34 AM, KRIS MUSSHORN wrote: > > yes I did attach rather than paste sorry. > > Ok heres an actual, truncated, example of the metatag.date field contents in > solr. > NONE-NN-NN is the defa

Re: prefix query help

2016-12-08 Thread Erik Hatcher
that the dash didn’t work as you expected? or… not sure. What’s the parsed_query output in debug on that one? Erik p.s. did you really just send a Word doc to the list that could have been inlined in text? :) > On Dec 8, 2016, at 7:18 AM, KRIS MUSSHORN wrote: > > Im

  1   2   3   4   5   6   7   8   9   10   >