Does anybody has any stats to share on how much time does DataImportHandler
takes to index a given set of data ?
I am currently indexing 18 millions rows in 1.5 - 2 hours by sending xmls to
solr.
From: Shalin Shekhar Mangar
To: solr-user@lucene.apache.org; c
> : > > Ok, so it wouldn't be possible to have a smaller, faster authoritative
> : > > shard for near-real-time updates while keeping the entire dataset in a
> : > > second shard which is updates less frequently?
>
> I believe Otis's point is that many people use distributed search across
> shards
Hi Guys,
Are you aware of any standard/specification (like JSR 168/286 for portals, CMIS
for CMS) for Search engines ?
Is there any such specification people are working on currently ?
Regards,
Sourav
CAUTION - Disclaimer *
This e-mail contains PRIVILEGED AND C
The syntax for the q param when using dismax is different from standard.
Check this out:
http://wiki.apache.org/solr/DisMaxRequestHandler#head-df8184dddf870336839490ba276ea6ac566d0bdf
q.alt under dismax is parsed using the standard query parser though:
http://wiki.apache.org/solr/DisMaxRequest
Hi,
I am implementing column specific query with q query parameter. for e.g.
?q=prdMainTitle_product_s:math & qt=dismaxrequest
The above query doesnt work while if I use the same query with q.alt
parameter, it works.
?q=&q.alt= prdMainTitle_product_s:math & qt=dismaxrequest
Please suggest, ho
I have reopened the issue. We will fix it completely in a day or two.
On Wed, Mar 4, 2009 at 6:30 PM, Walter Ferrara wrote:
> tried with
>
>
> but no luck, the dataDir parameter seems ignored, no matter what is written
> there
>
> On Wed, Mar 4, 2009 at 12:58 PM, Noble Paul നോബിള് नोब्ळ्
the dataimport.properties is created only after one successful import
.so it is available only from second import onwards. probably you can
create one manually and put it in the conf dir.
On Thu, Mar 5, 2009 at 12:52 AM, Garafola Timothy wrote:
> Thanks,
>
> I set up a another test instance of so
On Thu, Mar 5, 2009 at 6:06 AM, Steve Conover wrote:
> I'm doing some testing of a solr master/slave config and find that,
> after syncing my slave, I need to sleep for about 400ms after commit
> to "see" the new index state. i.e. if I don't sleep, and I execute a
> query, I get results that ref
Hello,
In my case, my query of "id_s_i_s_nm:(om_B00114162K*)" returned nothing but
query "id_s_i_s_nm:om_B00114162K*" returned the right result.
What's the difference between using () or not.
Thanks a lot,
Kevin
I'm doing some testing of a solr master/slave config and find that,
after syncing my slave, I need to sleep for about 400ms after commit
to "see" the new index state. i.e. if I don't sleep, and I execute a
query, I get results that reflect the prior state of the index.
I suspect this has somethin
On Wed, Mar 4, 2009 at 2:56 PM, Jonathan Ariel wrote:
> Hi everyone!
> So it seems like I ran into a bug with sdouble.
> I have a document with two fields.
> field1 is double
>
> stored="true" omitNorms="true"/>
> indexed="true" stored="true" omitNorms="true"/>
>
> when I index I send for both o
I'll do the obvious one first. :)
Have you tried Solr 1.3 or, even better, 1.4-dev nightly?
Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
- Original Message
> From: Jonathan Ariel
> To: solr-user@lucene.apache.org
> Sent: Wednesday, March 4, 2009 2:56:03 PM
> Sub
Hi everyone!
So it seems like I ran into a bug with sdouble.
I have a document with two fields.
field1 is double
when I index I send for both of them the same value (7300) and when I'm
querying I'm getting the following
7300
7.3E7
What do you think? Why am I getting different notati
Thanks,
I set up a another test instance of solr and ran a full import within
the DIH Development Console. I examined the query and found that
last_index_time is not getting set in the query. Yet the value does
get updated after a full import completes (outside of the development
console). Is t
I posted a while back with this problem and I've finally got it working
using the following method:
in solrconfig.xml:
id,title
0
then when making the request, I do a normal search for the item with the
necessary filter query (in my case discontinued:false) and set the
Hah. Sorry, I'm really out of it today.
The MoreLikeThisComponent doesn't seem to work for filtering using fq,
but the MoreLikeThisHandler does.
Problem solved, we'll just use the handler instead of a component.
Doug
On Mar 4, 2009, at 11:02 AM, Doug Steigerwald wrote:
Sorry. The example
17 feb 2009 kl. 21.26 skrev Grant Ingersoll:
I believe Karl Wettin submitted a Lucene patch for a Language
guesser: http://issues.apache.org/jira/browse/LUCENE-826 but it is
marked as won't fix.
The test case of LUCENE-1039 is a language classifier. I've use patch
to detect languages of
Also take a look at LuSql:
http://lab.cisti-icist.nrc-cnrc.gc.ca/cistilabswiki/index.php/LuSql
2009/3/4 Shalin Shekhar Mangar :
> On Wed, Mar 4, 2009 at 7:32 PM, Radha C. wrote:
>
>> Hi,
>>
>> I am working in a software concern. We are having some R&D base work like
>> making use of solr search
On Wed, Mar 4, 2009 at 12:24 PM, Fouad Mardini wrote:
> I have a multivalued field in my schema of type text_ws, values are of the
> form #int #int
> I need to be able to query on the first and sort on the second, this does
> not seem to be enabled out of the box
Can you put the two numbers in se
Hello,
I have a multivalued field in my schema of type text_ws, values are of the
form #int #int
I need to be able to query on the first and sort on the second, this does
not seem to be enabled out of the box
I looked around for a while and it seems the recommended approach is to
create a custom f
Hi Matt,
On Wed, Mar 4, 2009 at 9:52 PM, Matt Mitchell wrote:
> Hi,
>
> Have you looked at this page: http://wiki.apache.org/solr/SolrTomcat
Yes. I mimicked the SimpleInstall method
>
> It almost sounds like you're deploying twice? Putting the solr.war in
> webapps would be one way, and the oth
On Wed, Mar 4, 2009 at 11:04 AM, Jérôme Etévé wrote:
> Strange, we've got plenty of memory on this box and the swap is zero.
> But well, I'm happy we went around the problem. What's your experience
> with commits with ~10M docs ( and ~128 autowarming count in caches ) ?
Probably depends somewhat
Hi,
Have you looked at this page: http://wiki.apache.org/solr/SolrTomcat
It almost sounds like you're deploying twice? Putting the solr.war in
webapps would be one way, and the other would be a context config file +
using the web manager. If you're using the config/context, then don't put
the sol
On Wed, Mar 4, 2009 at 7:51 PM, Radha C. wrote:
> Thanks Shalin,
>
> We just stepped on solr. This information is very much useful for me. But
> before that I want some clear details about where to start..
> I want to test this in my local environment, so I need some basic
> information about how
Upgraded to solr 1.3, and also moved it to a different machine (more
CPU the rest is the same). All the problems seem to have gone away...
Should have upgraded from the start.
On Fri, Feb 27, 2009 at 2:50 PM, Laimonas Simutis wrote:
> Hey,
>
> my SOLR setup looks like the following:
>
> server ru
On Wed, Mar 4, 2009 at 1:21 PM, Yonik Seeley wrote:
> On Wed, Mar 4, 2009 at 5:25 AM, Jérôme Etévé wrote:
>> Great,
>>
>> It went down to less than 10 secs now :)
>> What I don't really understand is that my autowarmCount were pretty
>> low ( like 128 ) and still the autowarming of the caches we
Sorry. The examples on the wiki aren't working with the 'fq' to
filter the similarities. It just filters the actual queries.
http://localhost:8983/solr/mlt?q=id:SP2514N&mlt.fl=manu,cat&mlt.mindf=1&mlt.mintf=1&fq=popularity:6&mlt.displayTerms=details&mlt=true
The popularity of the doc found i
Hm. I checked out a clean Solr 1.3.0 and indexed the example docs and
set up a simple MLT handler the example queries on the Wiki work fine
(fq can filter out docs). Our build has a slight change to
QueryComponent so another query isn't done when we use localsolr+field
collapsing, but tha
'fq' seems to only work with finding the documents with your original
query, not for filtering the similar documents.
Doug
On Mar 4, 2009, at 9:28 AM, Otis Gospodnetic wrote:
Doug,
does the good old 'fq' not work with MLT? It should...
Otis
--
Sematext -- http://sematext.com/ -- Lucene
Thanks Shalin,
We just stepped on solr. This information is very much useful for me. But
before that I want some clear details about where to start..
I want to test this in my local environment, so I need some basic
information about how to start using this ( database and solr ). Do you have
some
Doug,
does the good old 'fq' not work with MLT? It should...
Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
- Original Message
> From: Doug Steigerwald
> To: solr-user@lucene.apache.org
> Sent: Wednesday, March 4, 2009 9:20:40 AM
> Subject: MoreLikeThis filterin
Is it possible to filter similarities found by the MLT component/
handler? Something like mlt.fq=site_id:86?
We have 32 cores in our Solr install, and some of those cores have up
to 8 sites indexed in them. Typically those cores will have one very
large site with a few hundred thousand ind
On Wed, Mar 4, 2009 at 7:32 PM, Radha C. wrote:
> Hi,
>
> I am working in a software concern. We are having some R&D base work like
> making use of solr search tool for searching our Oracle database
> content. I read through the documnets provided in the site, there I found
> the solr supports on
Hi,
I am working in a software concern. We are having some R&D base work like
making use of solr search tool for searching our Oracle database
content. I read through the documnets provided in the site, there I found
the solr supports only the document search and we have to provide the
document i
Hi all,
I am trying to setup a solr instance with Tomcat5 on a Fedora10
machine. Here is what I did,
1.) Copy the apache-solr-nightly.war to webapps/solr.war
2.) Set solr.solr.home in tomcat.conf
3.) Use the Manager interface of tomcat to deploy the webapp
But, while doing so, I get the following
On Wed, Mar 4, 2009 at 5:25 AM, Jérôme Etévé wrote:
> Great,
>
> It went down to less than 10 secs now :)
> What I don't really understand is that my autowarmCount were pretty
> low ( like 128 ) and still the autowarming of the caches were very
> slow.
>
> Can you explain more why it can be that
Can you explain the problem you are having? Is there a bug in the
SolrCore that you are working around? Or, are you just trying to
plugin your own Query Parser? If that is the case, there is a way to
do that already. You might find http://wiki.apache.org/solr/
SolrPlugins helpful.
-Gra
tried with
but no luck, the dataDir parameter seems ignored, no matter what is written
there
On Wed, Mar 4, 2009 at 12:58 PM, Noble Paul നോബിള് नोब्ळ् <
noble.p...@gmail.com> wrote:
> looks like a bug. must reopen the issue
>
> On Wed, Mar 4, 2009 at 5:26 PM, Noble Paul നോബിള് नोब्ळ्
May be you can also check
http://wiki.apache.org/solr/AnalyzersTokenizersTokenFiltersStemming is
discussed there...
On Wed, Mar 4, 2009 at 1:18 PM, Lukáš Vlček wrote:
> Hi,
> did you check Snowball stemmers (http://snowball.tartarus.org/)?
>
> Regards,
> Lukas
>
>
> On Wed, Mar 4, 2009 at 1:12 P
Hi,
did you check Snowball stemmers (http://snowball.tartarus.org/)?
Regards,
Lukas
On Wed, Mar 4, 2009 at 1:12 PM, dabboo wrote:
>
> Hi,
>
> I am trying to implement stemming in solr. If user searches for walk then
> all the records which have walk, walking, walks, walked etc should display.
>
Hi,
I am trying to implement stemming in solr. If user searches for walk then
all the records which have walk, walking, walks, walked etc should display.
Please suggest.
Thanks,
Amit Garg
--
View this message in context:
http://www.nabble.com/Stemming-in-Solr-tp22328850p22328850.html
Sent fr
looks like a bug. must reopen the issue
On Wed, Mar 4, 2009 at 5:26 PM, Noble Paul നോബിള് नोब्ळ्
wrote:
> On Wed, Mar 4, 2009 at 5:24 PM, Walter Ferrara wrote:
>> using:
>>
>>
>>
>>
>> doesn't work either
>
> dataDir="/multicore/core0" means the path is absolute.
> where did it cre
On Wed, Mar 4, 2009 at 5:24 PM, Walter Ferrara wrote:
> using:
>
>
>
>
> doesn't work either
dataDir="/multicore/core0" means the path is absolute.
where did it create?
>
> here the output:
>
> 2009-03-04 12:50:54.890::INFO: Logging to STDERR via
> org.mortbay.log.StdErrLog
> 2009-0
using:
doesn't work either
here the output:
2009-03-04 12:50:54.890::INFO: Logging to STDERR via
org.mortbay.log.StdErrLog
2009-03-04 12:50:54.968::INFO: jetty-6.1.3
4-mar-2009 12.50.55 org.apache.solr.servlet.SolrDispatchFilter init
INFO: SolrDispatchFilter.init()
4-mar-2009 12
Hi,
Can someone please tell me if we can write our own Custom Request Handler
and Custom Solr Core?
I want to call execute method of custom solrcore class instead of SolrCore
class.
Actually, I have to modify getQParser method of SolrCore class, so that it
shud start returning my custom plugin.
>
is not honored automatically. the tag has to be present in
solrconfig.xml and it should use this value.
but you can specify it as follows
then it should be fine.
can you just paste the log messages as solr starts
--Noble
On Wed, Mar 4, 2009 at 4:15 PM, Walter Ferrara wrote:
>
it also ignore dataDir directive in solr.xml, in fact adding:
doesn't change the behavior.
this seems a bug introduced somewhere after 2nd february
any clue?
On Tue, Mar 3, 2009 at 5:56 PM, Walter Ferrara wrote:
> there is a strange behavior which seems to affect hudson toda
Great,
It went down to less than 10 secs now :)
What I don't really understand is that my autowarmCount were pretty
low ( like 128 ) and still the autowarming of the caches were very
slow.
Can you explain more why it can be that slow ?
Cheers !
Jerome.
On Tue, Mar 3, 2009 at 8:00 PM, Yonik S
Normally you will need to filer by dates... you can do it in two ways...
http://fq=date_field[NOW-7DAY TO NOW]
http://...fq=date_field[2007-01-01T21:21:21 TO 2009-01-01T13:13:13]
I strongly recomend you to use /DAY in the first example. The search will be
faster as it is omitting hour-min-sec
On Mar 4, 2009, at 12:47 AM, The Flight Captain wrote:
Thanks for the DirectSolrConnection tip, that eliminated the need
for parsing
the XML as a string, and all that code need to instantiate a
container. I am
now Using SolrCore.getSolrCore(). This method is deprecated though,
what is
the s
50 matches
Mail list logo
