nt than my
interpretation above.
Erik
On Jul 13, 2009, at 4:58 AM, Gargate, Siddharth wrote:
I read somewhere that it is deprecated
see the 2nd paragraph in CHANGES.txt:
http://svn.apache.org/repos/asf/lucene/solr/trunk/CHANGES.txt
Erik
You can delete by query - url:some-word
Erik
On Jul 13, 2009, at 6:34 AM, Beats wrote:
HI,
i m using nutch to crawl and solr to index the document.
i want to delete the index containing a perticular word or pattern
in url
field.
Is there something like Prune Index tool in solr
Use the stopwords feature with a custom mispeled_words.txt and a
StopFilterFactory on the spell check field ;)
Erik
On Jul 13, 2009, at 8:27 PM, Jay Hill wrote:
We're building a spell index from a field in our main index with the
following configuration:
textSpell
de
/ExtractingRequestHandler
Erik
older into Solr.
Fairly straightforward to have some script that loops over a directory
and sends files (or file paths/URLs) to the extracting request handler.
Erik
ng. It
spreads query terms across multiple fields with field weights
individually controllable.
Erik
acets on Year with an
fq (filter query) set for each Manufacturer.
Erik
ext, which could be used for client-side
highlighting (see the showmatch parameter too).
Erik
.
Erik
returns lots of other useful trivia like the free memory, ulimit,
uptime, and such.
Erik
...@1411_9.pdf"
My schema does not, and is not intended to contain a 'title' field.
This update handler has been recently refactored, changing and
cleaning up the parameter names, etc. See http://wiki.apache.org/solr/ExtractingRequestHandler
for the latest details.
Erik
ming both of these point to the same Solr home and data directory,
a commit is needed on the HTTP process in order for it to pick up
changes made to the underlying index (that occurred without its
knowledge).
Erik
See http://issues.apache.org/jira/browse/SOLR-218 - Solr currently
does not have leading wildcard support enabled.
Erik
On Jul 20, 2009, at 8:09 AM, Jörg Agatz wrote:
Hallo Solr Users...
I tryed to search with a Wildcard at the beginning from a search.
for example, i will search
I was particularly surprised by the SOLR-64 numbers. What makes it's
response so huge (and thus slow) to return the entire tree of facet
counts?
Erik
On Jul 19, 2009, at 5:35 PM, Erik Hatcher wrote:
I've posted the details of some experiments I just did comparing/
c
roductTypeFa
cet:Shoes
&fq=gender:Womens&fq=categoryFacet:Sandals&fq=width:EE&fq=size:10.5
&fq=priceFacet:"$100.00+and+Under"&fq=personalityFacet:Sexy} hits=19
status=0 QTime=3689
What's the config of your dismax handler look like?
Erik
On Dec 24, 2009, at 11:36 AM, Walter Underwood wrote:
When do users do a query like that? --wunder
Well, SolrEntityProcessor "users" do :)
http://issues.apache.org/jira/browse/SOLR-1499
(which by the way I plan on polishing and committing over the
holidays)
Erik
e.org/solr/ClusteringComponent
Erik
tead, so that other filters can be specified from the client as well.
Erik
Use query.addFacetQuery(str) instead.
Erik
On Dec 30, 2009, at 10:16 PM, Jay Fisher wrote:
I'm using solrJ to construct a query and it works just fine until I
add the
following.
query.setFilterQueries("price:[*+TO+500]", "price:[500+TO+*]");
That generat
It's possible, but requires a custom DirectoryFactory implementation.
There isn't a built in factory to construct a RAMDirectory. You wire
it into solrconfig.xml this way:
class="[fully.qualified.classname]">
On Dec 31, 2009, at 5:06 AM, dipti khullar wrote:
Hi
Can somebody
me odd logic in the dismax parser with bq, though - where
if the bq parses to a BooleanQuery with a 1.0 boost then it could
filter instead of boost.
Erik
On Dec 31, 2009, at 4:07 AM, Ravi Gidwani wrote:
Hello:
I have a basic question:
I am using dismax, Solr 1.4. Let's sa
y and call again.
Erik
On Dec 31, 2009, at 9:29 AM, Smith G wrote:
Hello All,
I have no complete knowledge of query execution workflow
. I have an issue. I had one approach to edit all the user submitted
queries in the queryparser part ( for every request ), but later
eld is the same as a regular field in
practically every way on the search side of things.
Erik
You don't lose copyField capability with dynamic fields. You can copy
dynamic fields into a fixed field name like *_s => text or dynamic
fields into another dynamic field like *_s => *_t
Erik
On Jan 6, 2010, at 9:35 AM, A. Steven Anderson wrote:
Strictly speaking th
You probably aren't doing anything wrong, other than those patches are
a bit out of date with trunk. You might have to fight through getting
them current a bit, or wait until I or someone else can get to
updating them.
Erik
On Jan 6, 2010, at 11:52 AM, Thibaut Lassalle
onentry to get
analyzed stuff back as you see it in analysis.jsp on a per-document or
per-field text basis - if you're looking to leverage the analyzer
output in that fashion from a client.
Erik
On Jan 7, 2010, at 1:21 AM, MitchK wrote:
Hello Erick,
thank you for answering.
I
it wouldn't be q.alt though, just q, in the config file.
q.alt is typically *:*, it's the fall back query when no q is provided.
though, in thinking about it, q.alt would work here, but i'd use q
personally.
On Jan 6, 2010, at 9:45 PM, Andy wrote:
Let me make sure I understand you.
I'd ge
eeds to be a separate parameter.
Erik
community.
Thanks,
Erik
LucidWorks Certified Distribution for Solr 1.4 is available from Lucid
Imagination, free with registration. It now includes with a
comprehensive 375-page reference guide, and an installer, available
free at http://download.lucidimagination.com.
tution in the q part for $popularityboost
And yes, what you've done above is correct.
Erik
You can mix and match all sorts of things with Solr's flexible query
parsing capabilities.
See the great blog entry by Yonik here:
http://www.lucidimagination.com/blog/2009/03/31/nested-queries-in-solr/
Erik
On Jan 8, 2010, at 5:30 AM, Oliver Beattie wrote:
Can anyone help m
you to compare your solrconfig.xml and schema.xml files
to the ones that ship with Solr 1.4's example. You may want to adjust
your configurations a bit.
Erik
If you're using SolrJ, QueryResponse#getLimitingFacets() does what you
want, but still it is doing client-side filtering of the values less
than the number found.
Currently that's the only way to do it.
Erik
On Jan 7, 2010, at 5:32 PM, joeMcElroy wrote:
Hi there
If
On Jan 8, 2010, at 7:03 AM, Király Péter wrote:
Hi Erik,
the first link on page 33 on the Solr Reference Guide is a wrong one.
The text of the link http://localhost:8983/solr/select?q=video, but
the
link itself points to http://localhost:8080/solr/select?q=video (the
difference
is port
ng. The
VelocityResponseWriter will look for templates based on the request
handler name (qt parameter), so with
wt=velocity will default to looking for a dismax.vm template for
rendering.
Erik
On Jan 8, 2010, at 8:23 AM, Chantal Ackermann wrote:
Dear all,
happy New Year!
For
the same template.
It's for prototyping, anyway.
+1 for prototyping!
Erik
I think the StatsComponent will do everything you're asking for here:
http://wiki.apache.org/solr/StatsComponent
On Jan 8, 2010, at 9:37 AM, dbashford wrote:
I get the feeling what I need to accomplish isn't necessarily in the
spirit
of what solr is meant to do, but it's the problem I'm f
Give &debugQuery=true a try and see what each of those parse to.
What are your dismax settings? And for the fields you're querying
(pf/qf), what are their field types and analysis details?
Erik
On Jan 10, 2010, at 9:48 AM, brianeno wrote:
Hello, I am having trouble
if I'm wrong, but I don't think that it's true about a
reload working in the background. While a core is reloading (and
warming), it is unavailable for search. right? I think you have to
create a new core, and then swap to keep things alive constantly.
Erik
On Jan 11, 2010, at 7:33 AM, MitchK wrote:
Is the UpdateProcessor something that comes froms Lucene itself or
from
Solr?
It's at the Solr level - <http://lucene.apache.org/solr/api/org/apache/solr/update/processor/UpdateRequestProcessor.html
>
Erik
On Jan 11, 2010, at 5:50 AM, Shalin Shekhar Mangar wrote:
On Mon, Jan 11, 2010 at 4:15 PM, Erik Hatcher
wrote:
On Jan 11, 2010, at 4:51 AM, Peter A. Kirk wrote:
The reload feature actually sounds quite neat - it will reload "in
the
background", and "switch in&
#x27; to
only match as a phrase
Doesn't setting pf=people accomplish this?
Erik
ternative?
Of course it's tricky business though, impossible to do the right
thing for all cases within SolrQueryParser. Thankfully it is
pleasantly subclassable and overridable for this method.
Erik
fine.
Erik
On Jan 11, 2010, at 4:39 PM, Jeff Newburn wrote:
We have a solr plugin that would be much easier to write if commons-
lang was
available. Why does solr not have this library? Is there any
drawbacks to
pulling in the commons lang for StringUtils?
--
Jeff Newburn
Sof
ation takes:
quantRate = params.getFloat("quantRate", 0.01f);
minTokenLen = params.getInt("minTokenLen", 2);
Hope that helps.
Erik
*
http://svn.apache.org/repos/asf/lucene/solr/trunk/src/java/org/apache/solr/update/processor/TextProfileSignature.java
On Jan 12, 2010, at 9:15 AM, Andrew Clegg wrote:
Thanks Erik, but I'm still a little confused as to exactly where in
the Solr
config I set these parameters.
You'd configure them within the element, something like
this:
5
The example on the wiki page uses Lookup3Signa
What does a search of *:* give you?
As far as your steps, delete the index folder *before* restarting
Solr, not after. That might be the issue.
Erik
On Jan 12, 2010, at 9:23 AM, Lee Smith wrote:
Am I doing this right.
I have made changes to my schema so as per guide I done the
I'd look at the DataImportHandler console and try using some debugging
there to track down why only one document. I suspect it's a
configuration issue of your SQL query not picking up everything you
expect.
Erik
On Jan 12, 2010, at 9:33 AM, Lee Smith wrote:
Hi Eri
ject graph pieces you want are presented. Also, simply
$object will dump the toString() of the object, which gives a lot of
insight for many objects.
Erik
On Jan 13, 2010, at 7:28 PM, Sascha Szott wrote:
Hi Qiuyan,
Thanks a lot. It works now. When i added the line
#set($hl
yes, it is possible. and copying the index is exactly how to go about
it. what didn't work exactly?
be sure that the index directory goes under data/ and looks just like
your production environment.
Erik
On Jan 19, 2010, at 8:08 AM, jmf wrote:
Hi,
I'm using sol
cuments it
would match if that suggestion would be run as the query?
Wouldn't that require one to execute that query, so if you want to
show 10 suggestions, you'd hit Solr 10 times?
Not if you use faceting with the facet.prefix capability :) It gives
back counts per term suggested.
Erik
Where are you getting your solr-ruby code from? You can simply "gem
install" it to pull in an already pre-built gem.
I just ran the tests on trunk, all passed, with the output pasted below.
Erik
~/dev/solr/client/ruby/solr-ruby: rake test
(in /Users/erikhatcher/dev/solr/c
On Jan 20, 2010, at 6:32 AM, Siddhant Goel wrote:
On Wed, Jan 20, 2010 at 4:19 PM, Erik Hatcher
wrote:
Where are you getting your solr-ruby code from? You can simply "gem
install" it to pull in an already pre-built gem.
I'm just picking it up from the 1.4 release. I also
above statement that filter queries are not
analyzed is incorrect.
Erik
On Jan 20, 2010, at 9:34 AM, Shalin Shekhar Mangar wrote:
On Wed, Jan 20, 2010 at 7:40 PM, Erik Hatcher
wrote:
On Jan 20, 2010, at 8:11 AM, Ahmet Arslan wrote:
If they are really filter queries i.e. specified through
"fq" then they will
not be run through an analyzer.
Does
his:
fq={!raw f=field}value with spaces
Of course all of the above need to be URL encoded too.
+awardinstrument_s:Continuing +text:grant
This explains the problem exactly. Note how it parsed the second word
to the text field, not the field you specified.
Erik
esn't have that capability built-in. This is often best
implemented at your application tier level, and will be specific to
the technologies you use there.
Erik
sure, you could put a servlet filter in Solr's web.xml to capture
whatever you like.
another option would be to hook into Solr's logging and fire events/
data off elsewhere.
or perhaps a proxy in the middle that forwards requests on to Solr,
but captures however you like.
You'll be able to find them only after a commit.
One way to do this is index a timestamp with every document, and find
the latest ones using that field. There's an example of an automatic
timestamp field in the example schema.
Erik
On Jan 21, 2010, at 4:16 AM, Sand
You can do a search, sort by the special _docid_ "field" (underscores
mandatory) descending and the top documents listed will be the latest
added.
Like this, un-url-encoded: q=*:*&sort=_docid_ desc
Erik
On Jan 22, 2010, at 3:39 AM, Sandeep Tagore wrote:
Thanks
ighlighting
though?
Erik
On Jan 22, 2010, at 10:00 PM, Lance Norskog wrote:
No, the return order is not guaranteed.
On Fri, Jan 22, 2010 at 2:52 PM, Harsch, Timothy J. (ARC-TI)[PEROT
SYSTEMS] wrote:
Hi,
If I have a multiValued field type of text, and I put values
[cat,dog,green,blue] in it
You omitted the details.
Is there an "index" directory under your data directory? That's the
heart of the Lucene index there. Look at Solr's admin, it'll tell you
the data directory location it is using, be sure it is set where you
think it should be.
The schema browser is actually an Ajax client to Solr itself, using
the luke request handler to retrieve the field info. Take a look at
your Solr logs as you peruse the schema browse and you'll see the
requests being made. Just do that :)
Erik
On Jan 24, 2010, at 9:
Are you indexing an empty value? Or not indexing a field at all?
-field:[* TO *] will match documents that do not have the field at all.
Erik
On Jan 25, 2010, at 7:02 AM, Jan-Simon Winkelmann wrote:
Hi there,
i have a field defined in my schema as follows:
Valid values for the
Are you sending in more than one title per document, by chance?
Have you changed your configuration without reindexing the entire
collection, possibly?
Erik
On Jan 25, 2010, at 8:32 AM, EL KASMI Hicham wrote:
Thanks Otis,
The long message was an attempt to be as detailed as
There are some approaches outlined here that might be of interest:
http://wiki.apache.org/solr/HierarchicalFaceting
On Jan 24, 2010, at 2:54 AM, Andy wrote:
I'd like to provide a hierarchical faceting functionality.
An example would be location drill down such as USA -> New Y
All seems well now. The wiki does have its flakey moments though.
Erik
On Jan 26, 2010, at 1:23 AM, Teruhiko Kurosaka wrote:
In
http://lucene.apache.org/solr/
the wiki tab and "Docs (wiki)" hyper text in the side bar text after
expansion are the link to
http://wiki.apach
Barani -
Give us some details of what you tried, what you expected to happen,
and what actually happened.
Erik
On Jan 26, 2010, at 4:15 PM, JavaGuy84 wrote:
Hi,
I am trying to generate a dynamic fieldname using custom
transformers but
couldn't achieve the expected re
ot
finding it. But you're using a pretty old version of Solr and quite
likely something here has been fixed since.
Give Solr 1.4 a try.
Erik
On Jan 27, 2010, at 12:56 AM, ashokcz wrote:
Hi just looked at the analysis.jsp and found out what it does during
index /
query
maybe your project is better suited to using the dismax
parser, which doesn't support wildcard queries anyway.
Erik
On Jan 28, 2010, at 2:53 AM, Ranveer Kumar wrote:
Hi all,
How to remove/disable wildcard search in solr.
I have no requirement of wildcard.
is there any config
),
using the SolrJ library you won't ever see XML (nor would there even
be XML involved if configured for the binary protocol).
Erik
On Jan 28, 2010, at 2:47 AM, Manish Gulati wrote:
I am planning to use Solr to power search on the site. Our db is
mysql and we need to index some t
We need more details to evaluate - what exactly are you trying to
accomplish?
I'd tend towards the token filter approach since it would be more
general purpose for other indexing routes.
Erik
On Jan 28, 2010, at 2:10 AM, Abin Mathew wrote:
Hi
When the same thing can be
You can use the Luke request handler to request all the fields in the
index, in case that helps with your UI. Solr's Schema Browser uses
that request handler to introspect. And Solr Flare also uses it to
figure out which fields to show as facets.
Erik
On Jan 28, 2010, at
You can avoid one word terms by setting outputUnigrams="false" on the
ShingleFilterFactory configuration.
Erik
On Jan 28, 2010, at 11:29 PM, Christopher Ball wrote:
I am curious how I can query for multi-term phrases using the
TermsComponent?
The field I am searchin
ns for details.
Erik
On Jan 29, 2010, at 12:30 AM, Abin Mathew wrote:
Hi I want to generate my own customized query from the input string
entered
by the user. It should look something like this
*Search field : Microsoft*
*
Generated Query* :
description:microsoft +((tags:microsoft^1.5 t
When faced with this type of situation where the data is entirely
available at index-time, simply create an aggregated field that glues
the two pieces together, and facet on that.
Erik
On Jan 29, 2010, at 6:16 AM, Peter S wrote:
Hi,
I was wondering if anyone had come across
Creating values for every possible combination is what you're asking
Solr to do at query-time, and as far as I know there isn't really a
way to accomplish that like you're asking. Is the need really to be
arbitrary here?
Erik
On Jan 29, 2010, at 7:25 AM, Peter
is type of need that it'll
"generally" be less arbitrary and locking some things in during
indexing will be the pragmatic way to go for most cases.
Erik
On Jan 29, 2010, at 9:28 AM, Peter S wrote:
Well, it wouldn't be 'every' combination - more of
sounds like this is custom logic you need to code into your search
client. there's nothing in solr that can provide this for you
automatically (at the moment).
Erik
On Jan 31, 2010, at 7:36 AM, murali k wrote:
I have this keyword "clothes" , when a user searches
Can you give it a shot on Solr 1.4 instead? DIH has had numerous
enhancements/fixes since 1.3.
Erik
On Feb 1, 2010, at 8:42 AM, Vijayant Kumar wrote:
Hi,
I am trying to index some large set of data in solr using
dataimporthandler.
It is working fine for small set but when I am
tored only affects
whether you can get that value back in the documents returned from a
search, or not.
Erik
On Feb 1, 2010, at 7:12 PM, Matthieu Labour wrote:
Hi
on the following field
[...]
[...]
the following query works
{!lucene q.op=AND} [...] AND (status.message&
r to ignore a field. The example schema
actually even includes a fieldtype called "ignored" with these
settings too.
Erik
Out of curiosity, why are you deploying Solr 1.3 rather than Solr 1.4?
Sorry, but I don't know about the JBoss issues first hand myself.
Erik
On Feb 2, 2010, at 9:20 AM, Luca Molteni wrote:
Hello list,
I'm having some problem deploying solr to JBoss 5.
The probl
One thing I find awkward about convertType is that it is
JdbcDataSource specific, rather than field-specific. Isn't the
current implementation far too broad?
Erik
On Feb 3, 2010, at 1:16 AM, Noble Paul നോബിള്
नोब्ळ् wrote:
implicit conversion can cause problem
On Feb 3, 2010, at 5:36 AM, Noble Paul നോബിള്
नोब्ळ् wrote:
On Wed, Feb 3, 2010 at 3:31 PM, Erik Hatcher
wrote:
One thing I find awkward about convertType is that it is
JdbcDataSource
specific, rather than field-specific. Isn't the current
implementation far
too broad?
it is fe
There's some basic info for Jetty and Resin here:
http://wiki.apache.org/solr/SolrSecurity
Keep in mind the various URLs that Solr exposes though, so if you
aren't protecting /solr completely you'll want to be aware that /
update can add/update/delete anything, and so on.
is groupName a "string" field? If not, it probably should be. My
hunch is that you're analyzing that field and it is lowercased in the
index, and maybe even stemmed.
Try &q=*:*&facet=on&facet.field=groupName to see all the *indexed*
values of the groupName fiel
ming which can take a while.
Have you tried Solr 1.4? Faceting performance, for example, is
dramatically improved, among many other improvements.
Erik
On Feb 4, 2010, at 12:38 AM, Lance Norskog wrote:
Queries that start with minus or NOT don't work. You have to do this:
*:* AND -fieldX:[* TO *]
That's only true for subqueries. A purely negative single top-level
clause works fine with Solr.
Erik
On Wed, Feb 3,
What about using Tomcat instead? Tomcat has Windows service
capability already, right?
Erik
On Feb 4, 2010, at 2:18 PM, Roland Villemoes wrote:
Hi,
I need to have Solr/Jetty running as a Windows Service.
I am using the Lucid distribution.
Does anyone have a running example and
There is already a patch available to address that short-coming in
distributed search:
http://issues.apache.org/jira/browse/SOLR-1632
On Feb 11, 2010, at 6:56 AM, abhishes wrote:
Thanks really useful article.
I am wondering about this statement in the article
"Keep in mind that Solr
g the
object navigation of $response in the templates.
The output of $response, just to be clear, isn't really JSON, it's a
toString() that looks similar though. Or did you convert it to JSON
in some other fashion? /itas?q=mispeled&wt=json should also show the
spelling sug
aps I should submit this as my first patch to the Solr project :)
Not a bad idea! Contributions more than welcome.
Erik
When using EmbeddedSolrServer, you could simply set the solr.data.dir
system property or launch your process from the same working directory
where you are launching the HTTP version of Solr. Either of those
should also work to alleviate this issue.
Erik
On Feb 12, 2010, at 5:36
When a document has no value, are you still sending a postal_code
field in your post to Solr? Seems like you are.
Erik
On Feb 12, 2010, at 8:12 AM, nabil rabhi wrote:
in the schema.xml I have fileds with int type and default value
exp: stored="true"
default="
That would be the problem then, I believe. Simply don't post a value
to get the default value to work.
Erik
On Feb 12, 2010, at 10:18 AM, nabil rabhi wrote:
yes, sometimes the document has postal_code with no values , i still
post it
to solr
2010/2/12 Erik Hatcher
W
You didn't mention what your faceting parameters were, but what you
want to do is add a field to every document that specifies its
source. So add a "source" (or "type" maybe a better field name) field
specifying "news", "article", or "bl
Unfortunately the file request handler does not support bindary file
types (yet).
Lance's suggestion of hosting static content in another servlet
container context is the best solution for now.
Erik
On Feb 15, 2010, at 8:47 AM, Chantal Ackermann wrote:
Hi all,
Google d
won't some stemmers leave diacritics in the terms that ought to be
removed before indexing?
On Feb 21, 2010, at 4:57 PM, Shalin Shekhar Mangar wrote:
Hello,
Looking over the CharFilter franchise, it seems to me that the
ASCIIFoldingFilter is a perfect candidate for being a CharFilter as it
1201 - 1300 of 1860 matches
Mail list logo