Re: Use case for the Shingle Filter

2017-03-05 Thread Ryan Josal
I thought new versions of solr didn't split on whitespace at the query parser anymore, so this should work? That being said, I think I remember it having a problem coming after a synonym filter. IIRC, if your input is "Foo Bar" and you have a synonym "foo <=> baz" you would get foobaz bazbar inst

Re: Forking Solr

2015-10-16 Thread Ryan Josal
questions should go the Lucene Dev list instead. This > > one is more for those who build on top of standard Solr. > > > > Regards, > > Alex. > > > > > > Solr Analyzers, Tokenizers, Filters, URPs and even a newsletter: > > http://www.solr-start.com/ &g

Forking Solr

2015-10-16 Thread Ryan Josal
Hi guys, I'd like to get your tips on how to run a Solr fork at my company. I know Yonik has a "heliosearch" fork, and I'm sure many others have a fork. There have been times where I want to add features to an existing core plugin, and subclassing isn't possible so I end up copying the source cod

Re: Solr cross core join special condition

2015-10-07 Thread Ryan Josal
I developed a join transformer plugin that did that (although it didn't flatten the results like that). The one thing that was painful about it is that the TextResponseWriter has references to both the IndexSchema and SolrReturnFields objects for the primary core. So when you add a SolrDocument f

Bug in query elevation transformers SOLR-7953

2015-08-20 Thread Ryan Josal
Hey guys, I just logged this bug and I wanted to raise awareness. If you use the QueryElevationComponent, and ask for fl=[elevated], you'll get only false if solr is using LazyDocuments. This looks even stranger when you request exclusive=true and you only get back elevated documents, and they al

Re: rq breaks wildcard search?

2015-04-22 Thread Ryan Josal
.org/jira/browse/SOLR-6323. >>> >>> Solr 4.10.3 >>> >>> Joel Bernstein >>> http://joelsolr.blogspot.com/ >>> >>>> On Wed, Apr 15, 2015 at 6:23 PM, Ryan Josal wrote: >>>> >>>> Using edismax, supplying a rq=

rq breaks wildcard search?

2015-04-15 Thread Ryan Josal
Using edismax, supplying a rq= param, like {!rerank ...} is causing an UnsupportedOperationException because the Query doesn't implement createWeight. This is for WildcardQuery in particular. From some preliminary debugging it looks like without rq, somehow the qf Queries might turn into Constant

Re: omitTermFreqAndPositions issue

2015-04-09 Thread Ryan Josal
that returns whatever you > want (1.0 comes to mind) from the tf() method. > > Best, > Erick > > On Wed, Apr 8, 2015 at 4:50 PM, Ryan Josal wrote: > > Thanks for your thought Shawn, I don't think fq will be helpful here. > The > > field for which I want to tu

Re: Group by score

2015-04-09 Thread Ryan Josal
You can use Result Grouping by a function using query(), but you'll need a version of Lucene with this bug fixed: https://issues.apache.org/jira/browse/SOLR-7046 Ryan On Thursday, April 9, 2015, Jens Mayer wrote: > Hey everybody, > I have the following situation in my search application: I've

Re: omitTermFreqAndPositions issue

2015-04-08 Thread Ryan Josal
t's fine as long as it doesn't try to build a phrase query against a no TF no pos field. Ryan On Wednesday, April 8, 2015, Shawn Heisey wrote: > On 4/8/2015 5:06 PM, Ryan Josal wrote: > > The error: > > IllegalStateException: field "foo" indexed without positi

omitTermFreqAndPositions issue

2015-04-08 Thread Ryan Josal
Hey guys, it seems that omitTermFreqAndPositions is not very usable with edismax, and I'm wondering if this is intended behavior, and how I can get around the problem. The setup: define field "foo" with omitTermFreqAndPositions=true The query: q="ground coffee"&qf=foo bar baz The error: IllegalS

Re: sort on facet.index?

2015-04-02 Thread Ryan Josal
Awesome, I didn't know this feature was going to add so much power! Looking forward to using it. On Thursday, April 2, 2015, Yonik Seeley wrote: > On Thu, Apr 2, 2015 at 10:25 AM, Ryan Josal > wrote: > > Sorting the result set or the facets? For the facets there is >

Re: sort on facet.index?

2015-04-02 Thread Ryan Josal
Sorting the result set or the facets? For the facets there is facet.sort=index (lexicographically) and facet.sort=count. So maybe you are asking if you can sort by index, but reversed? I don't think this is possible, and it's a good question. I wanted to chime in on this one because I wanted my

DocTransformer#setContext

2015-03-20 Thread Ryan Josal
Hey guys, I wanted to ask if I'm using the DocTransformer API as intended. There is a setContext( TransformerContext c ) method which is called by the TextResponseWriter before it calls transform on any docs. That context object contains a DocIterator reference. I want to use a DocTransformer to

Re: rankquery usage bug?

2015-02-24 Thread Ryan Josal
Ticket filed, thanks! https://issues.apache.org/jira/browse/SOLR-7152 On Fri, Feb 20, 2015 at 9:29 PM, Joel Bernstein wrote: > Ryan, > > This looks like a good jira ticket to me. > > Joel Bernstein > Search Engineer at Heliosearch > > On Fri, Feb 20, 2015 at 6:

Re: Solr synonyms logic

2015-02-21 Thread Ryan Josal
What you are describing is hyponymy. Pastry is the hypernym. You can accomplish this by not using expansion, for example: cannelloni => cannelloni, pastry This has the result of adding pastry to the index. Ryan On Saturday, February 21, 2015, Mikhail Khludnev wrote: > Hello, > > usually debu

rankquery usage bug?

2015-02-20 Thread Ryan Josal
Hey guys, I put a rq in defaults but I can't figure out how to override it with no rankquery. Looks like one option might be checking for empty string before trying to use it in QueryComponent? I can work around it in the prep method of an earlier searchcomponent for now. Ryan

Custom facet.sort

2015-02-16 Thread Ryan Josal
Hey guys, I have a desire to order (field) facets by their order of appearance in the search results. When I first thought about it, I figured there would be some way to plug a custom Comparator into FacetComponent and link it to facet.sort=rank or something like that, but not only is there no rea

Re: An interesting approach to grouping

2015-01-27 Thread Ryan Josal
are not mixed as you expect: > > > >"If true, the result of the last field grouping command is used as the > >main result list in the response, using group.format=simple” > > > >https://wiki.apache.org/solr/FieldCollapsing > > > > > >Jim > >

Re: An interesting approach to grouping

2015-01-27 Thread Ryan Josal
t, numGroups, maxDoc); > } > > > I¹ll search for a Jira issue and open if I can¹t find one. > > Jim Musil > > > > On 1/26/15, 6:34 PM, "Ryan Josal" > wrote: > > >I have an index of products, and these products have a "category" which

An interesting approach to grouping

2015-01-26 Thread Ryan Josal
I have an index of products, and these products have a "category" which we can say for now is a good approximation of its location in the store. I'm investigating altering the ordering of the results so that the categories aren't interlaced as much... so that the results are a little bit more grou

Re: Dynamically loaded core.properties file

2014-08-21 Thread Ryan Josal
erties file you have whatever you need to define to make the prod/dev distinction you need. WARNING: I'm not entirely sure that relative pathing works here, which just means I haven't tried it. Best, Erick On Wed, Aug 20, 2014 at 3:11 PM, Ryan Josal wrote: Thanks Erick, that mi

Re: Dynamically loaded core.properties file

2014-08-20 Thread Ryan Josal
alues with variables in them, vs the values after evaluating variables. Best, Erick On Wed, Aug 20, 2014 at 11:36 AM, Ryan Josal wrote: Hi all, I have a question about dynamically loading a core properties file with the new core discovery method of defining cores. The concept is that I can have

Dynamically loaded core.properties file

2014-08-20 Thread Ryan Josal
Hi all, I have a question about dynamically loading a core properties file with the new core discovery method of defining cores. The concept is that I can have a dev.properties file and a prod.properties file, and specify which one to load with -Dsolr.env=dev. This way I can have one file whi

RE: Correct way for getting SolrCore?

2013-02-06 Thread Ryan Josal
rface? - Mark On Feb 5, 2013, at 5:42 PM, Ryan Josal wrote: > By way of the deprecated SolrCore.getSolrCore method, > > SolrCore.getSolrCore().getCoreDescriptor().getCoreContainer().getCores() > > Solr starts up in an infinite recursive loop of loading cores. I unders

RE: Correct way for getting SolrCore?

2013-02-05 Thread Ryan Josal
using SolrCore.getSearcher().get().getIndexReader() to get the IndexReader, but if that happens after a good point of plugging in this initialization, then I guess SolrCore.getIndexReaderFactory() is the way to go. Thanks, Ryan From: Ryan Josal [rjo...@ri

RE: Correct way for getting SolrCore?

2013-02-05 Thread Ryan Josal
o the core container, which knows about all the cores. - Mark On Feb 5, 2013, at 4:09 PM, Ryan Josal wrote: > Hey guys, > > I am writing an UpdateRequestProcessorFactory plugin which needs to have > some initialization code in the init method. I need to build some > information

Correct way for getting SolrCore?

2013-02-05 Thread Ryan Josal
Hey guys, I am writing an UpdateRequestProcessorFactory plugin which needs to have some initialization code in the init method. I need to build some information about each SolrCore in memory so that when an update comes in for a particular SolrCore, I can use the data for the appropriate cor

RE: SolrJ DirectXmlRequest

2013-01-23 Thread Ryan Josal
Thanks Hoss, The issue mentioned describes a similar behavior to what I observed, but not quite. Commons-fileupload creates java.io.File objects for the temp files, and when those Files are garbage collected, the temp file is deleted. I've verified this by letting the temp files build up an

RE: SolrJ DirectXmlRequest

2013-01-09 Thread Ryan Josal
asticSearch Support http://sematext.com/ On Wed, Jan 9, 2013 at 12:03 PM, Ryan Josal wrote: > I also don't know what's creating them. Maybe Solr, but also maybe > Tomcat, maybe apache commons. I could change java.io.tmpdir to one with > more space, but the problem is tha

RE: SolrJ DirectXmlRequest

2013-01-09 Thread Ryan Josal
ne.apache.org Subject: Re: SolrJ DirectXmlRequest Hi Ryan, I'm not sure what is creating those upload files something in Solr? Or Tomcat? Why not specify a different temp dir via system property command line parameter? Otis Solr & ElasticSearch Support http://sematext.com/ On Jan 8,

SolrJ DirectXmlRequest

2013-01-08 Thread Ryan Josal
I have encountered an issue where using DirectXmlRequest to index data on a remote host results in eventually running out have temp disk space in the java.io.tmpdir directory. This occurs when I process a sufficiently large batch of files. About 30% of the temporary files end up permanent. Th