Re: How TEXT field make sortable?

> > Can some one help me how we can sort the text field. > You CANNOT sort on a "text" field. Sorting can only be done on an untokenized field (e.g string, sint, sfloat etc fields) Cheers Avlesh On Tue, Nov 10, 2009 at 11:44 AM, deepak agrawal wrote: > Can some one help me how we can sort the t

Re: A question about how to make schema.xml change take effect

Oh. Sorry, take back what I said. Most of my config change is at data-config.xml, not schema.xml. I just made a change for field data type in schema.xml and noticed that I have to restart tomcat. On Mon, Nov 9, 2009 at 10:37 PM, Ritesh Gurung wrote: > Well everytime you make change in schema.

Re: A question about how to make schema.xml change take effect

if your are using a multicore instance you may just reload the core On Tue, Nov 10, 2009 at 12:07 PM, Ritesh Gurung wrote: > Well everytime you make change in schema.xml file you need restart the > tomcat server. > > On Tue, Nov 10, 2009 at 11:59 AM, Bertie Shen wrote: >> Hey folks, >> >>  When

Re: A question about how to make schema.xml change take effect

Well everytime you make change in schema.xml file you need restart the tomcat server. On Tue, Nov 10, 2009 at 11:59 AM, Bertie Shen wrote: > Hey folks, > >  When I update schema.xml, I found most of time I do not need to restart > tomcat in order to make change take effect. But sometimes, I have

A question about how to make schema.xml change take effect

Hey folks, When I update schema.xml, I found most of time I do not need to restart tomcat in order to make change take effect. But sometimes, I have to restart tomcat server to make change take effect. For example, when I change a field data type from sint to tlong, I called http://host:port

Re: Are subqueries possible in Solr? If so, are they performant?

Thanks Otis for your response. Is it possible to get result of one solr query feed into another Solr Query? Issue which I am facing right now is:: I am getting results from one query and I just need 2 index attribute values . These index attribute values are used for form new Query to Solr. Si

Re: Are subqueries possible in Solr? If so, are they performant?

Thanks Otis for your response. Is it possible to get result of one solr query feed into another Solr Query? Issue which I am facing right now is:: I am getting results from one query and I just need 2 index attribute values . These index attribute values are used for form new Query to Solr. Si

How TEXT field make sortable?

Can some one help me how we can sort the text field. -- DEEPAK AGRAWAL +91-9379433455 GOOD LUCK.

Re: Solr Internal exception on startup...

This looks like a file system access control configuration problem, not a Solr, Lucene, or even Java problem. You could disable the various security things like SELinux and test it again. On Mon, Nov 9, 2009 at 1:14 PM, William Pierce wrote: > All, > > I realized that the stack trace I had sent

Re: [DIH] blocking import operation

DIH imports are really long running. There is a good chance that the connection times out or breaks in between. how about a callback? On Tue, Nov 10, 2009 at 12:12 AM, Sascha Szott wrote: > Hi all, > > currently, DIH's import operation(s) only works asynchronously. Therefore, > after submitting

Re: Specifying multiple documents in DataImportHandler dataConfig

HI Lance, I think you are discussing a different issue here. We are talking about each row from each table represents a document in index. You look to discuss about some documents may have multi-value fields which are stored in a separate table in RDBMS because of normalization. On Mon, Nov 9

Re: de-boosting certain facets during search

Paul, Inline below... On Nov 9, 2009, at 6:28 PM, Paul Rosen wrote: If I could just create the desired URL, I can probably work backwards and construct the correct ruby call. Right, this list will always serve you best if you take the Ruby out of the equation. solr-ruby, while cool and al

Re: Segment file not found error - after replicating

Madu, So are you saying that all slaves have the exact same index, and that index is exactly the same as the one on the master, yet only some of those slaves exhibit this error, while others do not? Mind listing index directories of 1) master 2) slave without errors, 3) slave with errors and d

Re: synonym payload boosting

David, when you get this working would you consider writing a case study on the wiki? Nothing complex, just something that describes how you did several customizations to create a new feature. On Mon, Nov 9, 2009 at 4:10 AM, Grant Ingersoll wrote: > > On Nov 9, 2009, at 4:41 AM, David Ginzburg wr

Re: Specifying multiple documents in DataImportHandler dataConfig

There is a more fundamental problem here: Solr/Lucene index only implements one table. If you have data from multiple tables in a normalized index, you have denormalize the multi-table DB schema to make a single-table Solr/Lucene index. Your indexing will probably be faster if you a join in SQL to

Re: keep index in production and snapshots in separate phisical disks

: Is there any way to make snapinstaller install the index in : spanpshot20091023124543 (for example) from another disk? I am asking this you're talking about the old script based replication correct? ... i don't think that's possible since it relied on hardlinks and atomic move operations. i

Re: Lowering ranking of certain documents while search in Solr

Some hard-won knowledge: don't be afraid to re-index. Changing the schema without re-indexing can lead to mountains of trouble. On Mon, Nov 9, 2009 at 5:36 PM, Lance Norskog wrote: > The ExternalFileField is the tool for this. > > It is a field type which reads an array of floating point values f

Re: Lowering ranking of certain documents while search in Solr

The ExternalFileField is the tool for this. It is a field type which reads an array of floating point values from a file, one per document. You can boost on it. (I don't know if sort works.) There is no direct documentation that I found. Here are some hints. http://www.lucidimagination.com/search

RE: Solr on OOM

Ok, I'll see if I can get their heap dump. Thanks. -Original Message- From: solr-user-return-29005-laurent.vauthrin=disney@lucene.apache.org [mailto:solr-user-return-29005-laurent.vauthrin=disney@lucene.apache .org] On Behalf Of Otis Gospodnetic Sent: Monday, November 09, 2009 2:1

RE: Segment file not found error - after replicating

Thanks Otis! Yes, I checked the index directories and they are 100% same, both timestamp and size wise. Not all the slaves face this issue. I would say roughly 50% has this trouble. Logs do not have any errors too :-( Any other things I should do/look at? Cheers Madu -Original Message--

Solr 1.4 - Pre release post (portuguese)

Hello all, I've blogged about the Solr 1.4 and some of its features in my blog. It's written in Brazilian Portuguese, hope you all can enjoy (thanks google translate). The link is: http://lucastex.com.br/2009/11/09/solr-1-4-mais-que-pronto/

Oddness with Phrase Query

I have a document with the title "Here, there be dragons" and a body. When I search for q = Here, there be dragons qf = title^2.0 body^0.8 qt = dismax Which is parsed as +DisjunctionMaxQuery((content:"here dragon"^0.8 | title:"here dragon"^2.0)~0.01) () I get the document as the first hit

Re: de-boosting certain facets during search

I'm still going around in a circle on this. I'm not sure why it's not sinking in... If I could just create the desired URL, I can probably work backwards and construct the correct ruby call. Here is the URL that I'm currently creating (I've added newlines here for readability): http://loca

Embedded Solr, creating new cores programatically

Hi folks, I am working on a project in which we would like to create new cores programatically within an embedded solr instance. My question is: How much of the directory/configuration file gruntwork do I have to do myself? I figure I have to create the solr.home directory myself, but do I have

Re: CPU Max Utilization

doFilter is a Servlet Filter method -- SolrDispatchFilter is a Servlet Filter and all requests go through that method. You ened to dig deeper in your profiler. Otis -- Sematext is hiring -- http://sematext.com/about/jobs.html?mls Lucene, Solr, Nutch, Katta, Hadoop, HBase, UIMA, NLP, NER, IR

Re: sanizing/filtering query string for security

Word of warning: Careful with q.alt=*:* if you are dealing with large indices! :) Otis -- Sematext is hiring -- http://sematext.com/about/jobs.html?mls Lucene, Solr, Nutch, Katta, Hadoop, HBase, UIMA, NLP, NER, IR - Original Message > From: Alexey Serba > To: solr-user@lucene.apache.o

Re: tracking solr response time

Bharat, No, you should not give the JVM so much memory. Give it enough to avoid overly frequent GC, but don't steal memory from the OS cache. Otis -- Sematext is hiring -- http://sematext.com/about/jobs.html?mls Lucene, Solr, Nutch, Katta, Hadoop, HBase, UIMA, NLP, NER, IR - Original Mes

Re: Segment file not found error - after replicating

It's hard to troubleshoot blindly like this, but have you tried manually comparing the contents of the index dir on the master and on the slave(s)? If they are out of sync, have you tried forcing of replication to see if one of the subsequent replication attempts gets the dirs in sync? Do you hav

Re: sanizing/filtering query string for security

> BTW, I have not used DisMax handler yet, but does it handle *:* properly? See q.alt DisMax parameter http://wiki.apache.org/solr/DisMaxRequestHandler#q.alt You can specify q.alt=*:* and q as empty string to get all results. > do you care if users issue this query I allow users to issue an empty

Re: Similar documents from multiple cores with different schemas

Chantal, What you described in the last sentence should work. You can search by example by using the whole or some portion of doc from core A as the query against core B. That is, more or less, what MLT does under the hood anyway. Otis -- Sematext is hiring -- http://sematext.com/about/jobs.h

Re: Are subqueries possible in Solr? If so, are they performant?

You can mimic them by combining 2 clauses with an AND. e.g. cookies vs. cookies AND vanilla Otis -- Sematext is hiring -- http://sematext.com/about/jobs.html?mls Lucene, Solr, Nutch, Katta, Hadoop, HBase, UIMA, NLP, NER, IR - Original Message > From: Vicky_Dev > To: solr-user@lucene.a

Re: Solr on OOM

Laurent, The autowarmCounts look biggest, but they are probably not causing OOMs. Maybe you can see how big the caches are right before you OOM. Or you can also start the JVM with -XX:+HeapDumpOnOutOfMemoryError and even specify the file where the heap should be dumped. You can then analyze it

Re: CPU Max Utilization

After doing some more testing, I've seen the performance decrease yet again. It happens after solr has been run for about 1/2 hour. I left my test running over the weekend and saw the CPU usage go down to a reasonable level at the end of the weekend. It is the same problem where the CPU has maximum

Re: sanizing/filtering query string for security

Yes, DisMax does handle the match-all *:* query. Otis -- Sematext is hiring -- http://sematext.com/about/jobs.html?mls Lucene, Solr, Nutch, Katta, Hadoop, HBase, UIMA, NLP, NER, IR - Original Message > From: michael8 > To: solr-user@lucene.apache.org > Sent: Mon, November 9, 2009 4:5

deployment questions

Hi, I have a java app that is deployed in jboss/tomcat container. I would like to add my solr index to it. I have read about this and it seems fairly straight forward, but im curious the best way to secure it. I require my users to login to my app to use it, so I want the search functions

Re: sanizing/filtering query string for security

Sounds like a nice approach you have done. BTW, I have not used DisMax handler yet, but does it handle *:* properly? IOW, do you care if users issue this query, or does DisMax treat this query string differently than standard request handler? Basically given my UI, I'm trying to *hide* the tot

Re: sanizing/filtering query string for security

I added some kind of pre and post processing of Solr results for this, i.e. If I find fieldname specified in query string in form of "fieldname:term" then I pass this query string to standard request handler, otherwise use DisMaxRequestHandler ( DisMaxRequestHandler doesn't break the query, at lea

Re: Solr Internal exception on startup...

All, I realized that the stack trace I had sent in my previous email was truncated to not include the solr portions.here is the fuller stack trace: SEVERE: Exception starting filter SolrRequestFilter org.apache.solr.common.SolrException: java.security.AccessControlException: access denie

Re: Solr Internal exception on startup...

Sorry...folks...I saw that there were two copies sent outBeen having some email snafus at my end...so apologize in advance for the duplicate email - Bill -- From: "William Pierce" Sent: Monday, November 09, 2009 12:49 PM To: Subject: So

Solr Internal exception on startup...

Folks: I am encountering an internal exception running solr on an Ubuntu 9.04 box, running tomcat 6. I have deposited the solr nightly bits (as of October 7) into the folder: /usr/share/tomcat6/lib The exception from the log says: Nov 9, 2009 8:26:13 PM org.apache.catalina.core.StandardConte

Solr Internal exception on startup...

Folks: I am encountering an internal exception running solr on an Ubuntu 9.04 box, running tomcat 6. I have deposited the solr nightly bits (as of October 7) into the folder: /usr/share/tomcat6/lib The exception from the log says: Nov 9, 2009 8:26:13 PM org.apache.catalina.core.StandardConte

Re: DocumentObjectBinder.getBean in solrj

On Mon, Nov 9, 2009 at 8:26 PM, Christian López Espínola wrote: > Hi, > > I need to create different beans from a search result, according to a > stored field with the classname. > What I'd find useful would be a getBean method in > DocumentObjectBinder, instead of the getBeans method (my list wou

default a parameter to a core's name

Hi, Is there a way for me to set up my solr.xml so that slave cores replicate from the master's identically-named cores by default, but I can override the core to replicate from if I wish? Something like this, where core1 and core2 on the slave default to replicating from foo/solr/core1 and foo/so

DocumentObjectBinder.getBean in solrj

Hi, I need to create different beans from a search result, according to a stored field with the classname. What I'd find useful would be a getBean method in DocumentObjectBinder, instead of the getBeans method (my list would have different class instances). Is there any workaround for this? If no

Solr on OOM

Hello, One of our deployed Solr (1.3) setup is having out of memory issues and I'm not sure how to troubleshoot it. I've read a few posts (including http://old.nabble.com/Debugging-Solr-memory-usage-heap-problems-ts883279 4.html#a8832794) but I think this situation is slightly different. H

Re: sanizing/filtering query string for security

Hi Julian, Saw you post on exactly the question I have. I'm curious if you got any response directly, or figured out a way to do this by now that you could share? I'm in the same situation trying to 'sanitize' the query string coming in before handing it to solr. I do see that characters like

Re: Are subqueries possible in Solr? If so, are they performant?

Hi Team, Is it possible to write subqueries in dismaxrequest handler? ~Vikrant Edoardo Marcora wrote: > > Does Solr have the ability to do subqueries, like this one (in SQL): > > SELECT id, first_name > FROM student_details > WHERE first_name IN (SELECT first_name > FROM student_details > WH

[DIH] blocking import operation

Hi all, currently, DIH's import operation(s) only works asynchronously. Therefore, after submitting an import request, DIH returns immediately, while the import process (in case a large amount of data needs to be indexed) continues asynchronously behind the scenes. So, what is the recommende

Re: Solr/lucene/java/etc. person sought near Washington, DC/USA

On Nov 9, 2009, at 10:36 AM, Rich Kulawiec wrote: (Incidentally, I tried reach the owner of this list to enquire whether or not this is appropriate, but didn't receive a response...so I took my best guess. If that's wrong, I apologize to everyone.) I personally think it's fine to post jo

Re: Similar documents from multiple cores with different schemas

> Or maybe it's > possible to tweak MoreLikeThis just to return the fields and terms that > could be used for a search on the other core? Exactly See parameter mlt.interestingTerms in MoreLikeThisHandler http://wiki.apache.org/solr/MoreLikeThisHandler You can get interesting terms and build query

Re: Wildcard searches within phrases to use proximity

On Sun, Nov 8, 2009 at 1:29 AM, AHMET ARSLAN wrote: > > > You can do it with the > > complexphrasequery parser in lucerne contrib (I think that's > > the name). You have to plug it in to solr though - someone > > has already donethis bit I'm not sure if it was controbbed > > back. > > I would be

Re: Question about the message "Indexing failed. Rolled back all changes."

On Sat, Nov 7, 2009 at 1:10 PM, Bertie Shen wrote: > > When I use > http://localhost:8180/solr/admin/dataimport.jsp?handler=/dataimport to > debug > the indexing config file, I always see the status message on the right part > Indexing failed. Rolled back all changes., even the > indexing proces

Re: dismax + wildcard

There are some open issues (not for 1.4 at this point) to make dismax more flexible or add wildcard handling, e.g: https://issues.apache.org/jira/browse/SOLR-756 https://issues.apache.org/jira/browse/SOLR-758 You might participate in those to try to get this in a future version and/or get a worki

Solr/lucene/java/etc. person sought near Washington, DC/USA

Skills: Required: solr, lucene, java Desirable: nutch, tika, maven, python and/or perl Experience: 2+ years, including some exposure to general search engine concepts Term: permanent preferred, but contract available depending on the individual Location:

Similar documents from multiple cores with different schemas

Hi all, my search for any postings answering the following question haven't produced any helpful hints so far. Maybe someone can point me into the right direction? Situation: I have two cores with slightly different schemas. Slightly means that some fields appear on both cores but there are

Re: Why doesn't highlighting work on this document?

That was exactly the problem, thanks! Jake Brownell wrote: By default the highlighter only considers the first 50k of text. See http://wiki.apache.org/solr/HighlightingParameters#hl.maxAnalyzedChars Obviously the larger the size, the longer highlighting will take. When I get no highlights, I

Re: [DIH] SqlEntityProcessor does not recognize onError attribute

Hi, Noble Paul നോബിള്‍ नोब्ळ् wrote: On Mon, Nov 9, 2009 at 4:24 PM, Sascha Szott wrote: Hi all, as stated in the Solr-WIKI, Solr 1.4 allows it to specify an onError attribute for *each* entity listed in the data config file (it is considered as one of the default attributes). Unfortunately,

Solr Training in Europe

Hi All, For those who are interested, the official Lucid Solr trainings are now available in Europe. The first training - "Introduction to Solr" is a 3 days training covering the basics and some of the more advance features of Solr. It is scheduled for 30th November (till 2nd December) and wil

Overwriting of column data from DataImportHandler

Hi, I am using solr 1.3 with DataImportHandler from a postgres db. I have a select statement similar to the below Select id, id as pk, name, description from my_table; and a data-config.xml Anyway my issue is that the data thats getting imported into the documents seem

Re: Highlighting is very slow

Nicolas Dessaigne wrote: > > Alternatively, you could use a copyfield with a maxChars limit as your > highlighting field. Works well in my case. > Thanks for the tip. We did think about doing something similar (only enabling highlighting for certain shorter fields) but we decided that perhaps

Re: [DIH] SqlEntityProcessor does not recognize onError attribute

On Mon, Nov 9, 2009 at 4:24 PM, Sascha Szott wrote: > Hi all, > > as stated in the Solr-WIKI, Solr 1.4 allows it to specify an onError > attribute for *each* entity listed in the data config file (it is considered > as one of the default attributes). > > Unfortunately, the SqlEntityProcessor does

Re: Highlighting is very slow

Hi Andrew, Alternatively, you could use a copyfield with a maxChars limit as your highlighting field. Works well in my case. See https://issues.apache.org/jira/browse/SOLR-538 Nicolas 2009/11/5 Andrew Clegg > > > Indeed -- it actually went slightly slower but only by a few seconds, I > suspec

RE: using different field for search and boosting

Se the Dismax Search Handler this handler support search on multiple fields and a relevancy biasing :) -Birger -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: 9. november 2009 14:35 To: solr-user@lucene.apache.org Subject: Re: using different field for s

Re: using different field for search and boosting

I'm not sure I understand this. Unless you're including model in the search, how can you expect model^4 to mean anything? And if you are including model, would just including it as an OR clause and boosting it work? Perhaps a couple of examples of queries you'd like to run and how you'd like boost

Re: synonym payload boosting

On Nov 9, 2009, at 4:41 AM, David Ginzburg wrote: I have found this https://issues.apache.org/jira/browse/SOLR-1485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel patch But i don't want to use any function, just the normal scoring and the similarity class I have written. Can

Re: How to import multiple RSS-feeds with DIH

On 09.11.2009 09:46 Noble Paul നോബിള്‍ नोब्ळ् wrote: > When you say , the second example does not work , what does it mean? > some exception?(if yes, please post the stacktrace) Very mysterious. Now it works but I am sure I got an exception before. All I remember is something like "java.io.IOExce

[DIH] SqlEntityProcessor does not recognize onError attribute

Hi all, as stated in the Solr-WIKI, Solr 1.4 allows it to specify an onError attribute for *each* entity listed in the data config file (it is considered as one of the default attributes). Unfortunately, the SqlEntityProcessor does not recognize the attribute's value -- i.e., in case an SQL

Re: synonym payload boosting

I have found this https://issues.apache.org/jira/browse/SOLR-1485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel patch But i don't want to use any function, just the normal scoring and the similarity class I have written. Can you point me to modifications I need (if any) ?

Re: solr and hibernate integration

so is that any plan to support in future version of solr ? or anyone is interesting to write one :) as i see that it can take advantages of solr features like facet, spell check etc. 2009/11/9 Noble Paul നോബിള്‍ नोब्ळ् > The point is that the usual complex POJO mapping does not work in > Solr.

Re: solr and hibernate integration

The point is that the usual complex POJO mapping does not work in Solr. For all the supported cases , SolrJ mapping works well To answer your question , I am not aware of anybody making it work w/ hibernate On Mon, Nov 9, 2009 at 1:54 PM, Kiwi de coder wrote: > hi, > > I had a project which is

Re: How to import multiple RSS-feeds with DIH

On Mon, Nov 9, 2009 at 1:26 PM, Michael Lackhoff wrote: > [A new thread for this particular problem] > > On 09.11.2009 08:44 Noble Paul നോബിള്‍ नोब्ळ् wrote: > >> The tried and tested strategy is to post the question in this mailing >> list w/ your data-config.xml. > > See my data-config.xml below

solr and hibernate integration

hi, I had a project which is required to index POJO and search it from database. however, the current support for POJO is only limited to field value, which still lack of support of complex domain object model like composite element, collection etc. hibernate search had done a great job that is