Re: Multiword synonym and query expansion

Have a look at the report about EuroVoc integration into Solr which gives you an idea about the problems and solutions with multiword synonyms and query expansion. http://www.ub.uni-bielefeld.de/~befehl/base/solr/eurovoc.html Regards Bernd Fehling Am 18.10.2012 02:36, schrieb Nicholas Ding: > H

Replication didn't work immediately after leader's SolrCore reload.

Hi, I am facing replication problem. I had added a shard replica after the leader's core had been reloaded. I had expected to start index replication, but it hadn't worked. Please give me some workaround advice. My operation commands are following. ZooKeeper localhost:2181 Solr Shard1 Leader loc

Re: Query related to data source

: I have installed lucidworks enterprise v2.1. In that, I want to create XML data source. : But on the data source page I am unable to find the Solr XML in the dropdown list. : Could you help me in this..?? Leena, this appears to be exactly the same as the question you posted yesterday, which

Re: 404 error for http://host:port/solr1-newmaster/dataimport

On 10/17/2012 1:24 PM, srinalluri wrote: Hi I am new to Solr 4.0, I am familiar with solr 3.6. I have set solr 4.0. I am getting 'There are no SolrCores running. ' message for http://host:port/solr1-newmaster/ URL. What does it mean, what should I do? I am getting 404 error for this : /solr1-ne

Re: What does _version_ field used for?

On 10/17/2012 11:37 AM, Nicholas Ding wrote: I have the same problem, does it mean I have to put _version_ field in every schema.xml? You would only *need* the field if updateLog is turned on in your updateHandler. If you have the field in your schema but updateLog is turned off, I would bet

Query related to data source

Hi, I have installed lucidworks enterprise v2.1. In that, I want to create XML data source. But on the data source page I am unable to find the Solr XML in the dropdown list. Could you help me in this..?? Thanks & regards, Leena Jawale The contents of this e-m

Re: Solr reports: "Can not read response from server" when running import

Hi Shawn, Thanks a lot for your guidance. I can import the database successfully now. Thanks once again. Regards, Romita Saha From: Shawn Heisey To: solr-user@lucene.apache.org, Date: 10/17/2012 09:49 PM Subject:Re: Solr reports: "Can not read response from server" when run

Re: DIH scheduling

Not quite. That patch has been submitted, but not compiled into the code. In the meantime you can get by just by having whatever task scheduler you have access to submit the HTTP request for DIH whenever you need to, cron on *nix systems, I know Windows systems have something that might work as we

Re: Sorl 4.0: ClassNotFoundException DataImportHandler

: : : And I have all the dist jar files in dist folder. I restarted the tomcat, : why I am still getting this error: : : java.lang.ClassNotFoundException: : org.apache.solr.handler.dataimport.DataImportHandler is the path "../../dist/" correct relative to the instanceDir for your solr core?

Re: Re: how solr4.0 and zookeeper run on weblogic

i make it work on weblogic. but when i add or update index ,it error <2012-10-17 ?Χ03?47·?3? CST> <2012-10-17 ?Χ03?47·?3? CST> <[weblogic.servlet.internal.WebAppServletContext@425eab87 - appName: 'solr', name: 'solr', context-path: '/solr', spec-version: '2.5'] Servlet failed with E

Re: Disable Caching

: If you are not searching against your master, and you shouldn't (and : it sounds like you aren't), then you don't have to worry about : disabling caches - they will just remain empty. You could comment : them out, but I think that won't actually disable them. FWIW: what i generall advocate is

CheckIndex question

Hi - with a corrupted core, 1. if I run CheckIndex with -fix, it will drop the hook to the corrupted segment, but the segment files are still there, when we have a lot of corrupted segments, we have to manually pick them out and remove them, is there a way the tool can suffix them or prefix them

Re: How to do exact match?

: I can put "chinese cuisines" and "chinese cuisine" as two different tokens. : But I was wondering if there is better way to do it, like tweaking : different FilterFactory. : : My problem is, if it's not exact match, when I search "cuisine", that would : match both, I don't want that happen. th

Semantics of group.ngroups for distributed queries (BUG or weak doc?)

(Yonick?) I want to do a distributed grouping query over multiple shards, using group.ngroups to find the total number of groups. It seems to be giving me the sum of ngroups for each shard, rather than the count of the union of the groups from each shard. Is this a bug or the “expected” behavio

Re: Error: _version_field must exist in schema

Hello! You can some find information about requirements of SolrCloud at http://wiki.apache.org/solr/SolrCloud . I don't know if _version_ is mentioned elsewhere. As for Websolr - I'm afraid I can't say anything about the cause of those errors without seeing the exception. -- Regards, Rafał K

Re: Error: _version_field must exist in schema

On Thu, Oct 18, 2012 at 12:09 AM, Rafał Kuć wrote: > Hello! > > The _version_ field is needed by some of Solr 4.0 functionality like > transaction log or partial documents update. If you want to use them, > just update your schema.xml and put the _version_ field definition > there. > > However if

Re: Error: _version_field must exist in schema

Hello! The _version_ field is needed by some of Solr 4.0 functionality like transaction log or partial documents update. If you want to use them, just update your schema.xml and put the _version_ field definition there. However if you don't want those, you can remove the transaction log configura

DIH scheduling

Hi everyone, Does Solr have out of the box data import handler scheduling ? This link looks like I need to run an additional JAR. http://wiki.apache.org/solr/DataImportHandler?highlight=%28%28DataImportHandler%29%29#Scheduling I need to invoke the import from .Net environment, so I'd like to avo

Re: How to do exact match?

You can use a "stemmer" to match very similar words, such as plurals. See: http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#Stemming Look at the "text_en" field type in the example schema. -- Jack Krupansky -Original Message- From: Nicholas Ding Sent: Wednesday, October 17

Sorl 4.0: ClassNotFoundException DataImportHandler

I have the following line in solrconfig.xml. And I have all the dist jar files in dist folder. I restarted the tomcat, why I am still getting this error: java.lang.ClassNotFoundException: org.apache.solr.handler.dataimport.DataImportHandler thanks Srini -- View this message in context: htt

Re: Disable Caching

Thanks for the replies. 2012/10/17 Otis Gospodnetic > Hi, > > If you are not searching against your master, and you shouldn't (and > it sounds like you aren't), then you don't have to worry about > disabling caches - they will just remain empty. You could comment > them out, but I think that

Re: Flushing RAM to disk

I do not know how to load an index from disk into a RAMDirectory in Solr. - Original Message - | From: "deniz" | To: solr-user@lucene.apache.org | Sent: Wednesday, October 17, 2012 12:15:52 AM | Subject: Re: Flushing RAM to disk | | I heard about MMapDirectory - actually my test env is u

Re: Datefaceting on multiple value in solr

: currently i have to do 3 request for all three values of name, with passing : "name" as fq parameter and given facet date range. Got it, the example of what you are looking for makes perfect sense. In general, faceting on the same field in different ways isn't supported (SOLR-1351 is an open

Re: WordDelimiterFilter and the dot character

Just for the archives - the removal of the "preservereOriginal" from the "query" analizer solved my problem. Thank you, Jack! You need to have separate "index" and "query" analyzers for that field type. The "query" analyzer would not have preserveOriginal="1", which would generate an extra te

404 error for http://host:port/solr1-newmaster/dataimport

Hi I am new to Solr 4.0, I am familiar with solr 3.6. I have set solr 4.0. I am getting 'There are no SolrCores running. ' message for http://host:port/solr1-newmaster/ URL. What does it mean, what should I do? I am getting 404 error for this : /solr1-newmaster/dataimport Does it mean it is no

Re: Any filter to map mutiple tokens into one ?

Jack, Now I have a direct evidence. I ran Solr under Eclipse and caught that NGramTokenizer was called from the edismax query parser with "*:*" as input text. I have filed a bug with jira: https://issues.apache.org/jira/browse/SOLR-3962 On 10/15/12 11:32 AM, T. Kuro Kurosaka wrote: On 10/15/

Re: solr4.0 LimitTokenCountFilterFactory NumberFormatException

: Anybody want to guess what's wrong with this code: Grrr... that's a abomination. https://issues.apache.org/jira/browse/SOLR-3961 -Hoss

Re: solr4.0 LimitTokenCountFilterFactory NumberFormatException

:-) great solution...will look funny in our production system. Am 17.10.2012 16:12 schrieb "Jack Krupansky" : > Anybody want to guess what's wrong with this code: > > String maxTokenCountArg = args.get("maxTokenCount"); > if (maxTokenCountArg == null) { > throw new IllegalArgumentException("**max

Re: What does _version_ field used for?

I have the same problem, does it mean I have to put _version_ field in every schema.xml? Thanks Nicholas On Wed, Oct 17, 2012 at 3:44 AM, Jun Wang wrote: > Ok, I got it, thanks > > 2012/10/17 Alexandre Rafalovitch > > > Yes, just make sure you have it in the scheme. Solr handles the rest. > >

Re: SolrCloud is not returning all results

I was adding the docs via command line, with a commit curl http://host:8983/solr/update/?commit=true -H "Content-Type: text/xml" --data-binary 'name="id">9235647339name="name">8983'; In some more testing... it does look like issuing another commit after this seems to "really" commit. cur

Re: How to do exact match?

I can put "chinese cuisines" and "chinese cuisine" as two different tokens. But I was wondering if there is better way to do it, like tweaking different FilterFactory. My problem is, if it's not exact match, when I search "cuisine", that would match both, I don't want that happen. Thanks Shunjia

Re: How to do exact match?

Hi, Aren't you contradicting yourself a bit here? You say you want exact matching, but then you say you want a query for "chinese cuisines" to match "chinese cuisine", which is not exact. Otis -- Search Analytics - http://sematext.com/search-analytics/index.html Performance Monitoring - http://se

Re: How to do exact match?

Hi, I have several tokens in a field containing more than one keyword, like "chinese food", "indian food", I want to do exact match. And even more, if the token is "chinese cuisine", but the query is ""chinese cuisines", I still want the query to match to token. Thanks Nicholas On Wed, Oct 17, 2

Re: SolrCloud is not returning all results

How are you issuing the commit that makes the docs visible? On Wed, Oct 17, 2012 at 12:15 PM, Scott Carlson wrote: > I'm trying a very simple setup, and I'm not getting the results I would > expect. > > Starting from : https://wiki.apache.org/solr/SolrCloud example C. I have > 4 instances runn

Re: Disable Caching

Hi, If you are not searching against your master, and you shouldn't (and it sounds like you aren't), then you don't have to worry about disabling caches - they will just remain empty. You could comment them out, but I think that won't actually disable them. Warmup queries you can just comment ou

RE: Disable Caching

Yes Anderson, you don't need cache for master, neither warming. -Original Message- From: Anderson vasconcelos [mailto:anderson.v...@gmail.com] Sent: Wednesday, October 17, 2012 9:55 PM To: solr-user Subject: Disable Caching Hi I have a server that just index data and sincronize this dat

SolrCloud is not returning all results

I'm trying a very simple setup, and I'm not getting the results I would expect. Starting from : https://wiki.apache.org/solr/SolrCloud example C. I have 4 instances running locally. I verify the cloud setup in the UI, that there are two servers per shard, and they are all green. I added a

Re: solr4.0 LimitTokenCountFilterFactory NumberFormatException

I'd think the last line should be this instead: maxTokenCount = Integer.parseInt(maxTokenCountArg); On 10/17/2012 11:11 AM, Jack Krupansky wrote: Anybody want to guess what's wrong with this code: String maxTokenCountArg = args.get("maxTokenCount"); if (maxTokenCountArg == null) { throw new

Re: solr4.0 LimitTokenCountFilterFactory NumberFormatException

Anybody want to guess what's wrong with this code: String maxTokenCountArg = args.get("maxTokenCount"); if (maxTokenCountArg == null) { throw new IllegalArgumentException("maxTokenCount is mandatory."); } maxTokenCount = Integer.parseInt(args.get(maxTokenCountArg)); Hmmm... try this "workaround

Re: ICUTokenizer ArrayIndexOutOfBounds

calling reset() is mandatory part of the consumer lifecycle before calling incrementToken(), see: https://lucene.apache.org/core/4_0_0/core/org/apache/lucene/analysis/TokenStream.html A lot of people don't consume these correctly, thats why these tokenizers now try to throw exceptions if you do i

solr4.0 LimitTokenCountFilterFactory NumberFormatException

Hi, I am trying to upgrade from Solr 3.5 to Solr 4.0. I read the following in the example solrconfig: I tried that as follows: ... ... The LimitTokenCountFilterFactory configured like that crashes the startup of th

Re: How to do exact match?

The answer is "Yes." Solr and Lucene are quite flexible. You neglected to offer any details about your specific use case which might bias the answer one way or the other. What is some sample data and some sample queries? -- Jack Krupansky -Original Message- From: Nicholas Ding Sent

Re: Issue using SpatialRecursivePrefixTreeFieldType

Nice! On Oct 17, 2012, at 10:50 AM, Eric Khoury [via Lucene] wrote: I'm using the X axis for time availability start and end (total minutes since Jan 2012), each asset can have multiple rectangles (multiple avail start and end). My original design had a bounding rect of 20 years (0 - 10,000,0

Re: how solr4.0 and zookeeper run on weblogic

Did it work for you? You probably also have to set -Djetty.port=8080 in order for local ZK not to be started on port 9983. It's confusing, but you can also edit solr.xml to achieve the same. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com Solr Training - www.solrtraini

RE: Issue using SpatialRecursivePrefixTreeFieldType

I'm using the X axis for time availability start and end (total minutes since Jan 2012), each asset can have multiple rectangles (multiple avail start and end). My original design had a bounding rect of 20 years (0 - 10,000,000 minutes), with certain assets available for the whole time. Since

Re: solrcloud: what if ZK instances are evanescent?

As far as I can tell (and please someone correct me if I'm wrong), currently it's best to restart your Solr servers (probably on a rolling basis) pointing to the new ZK machine and not pointing at the old one. I believe there's some work afoot both with ZK and Solr to be more robust in this situati

Re: Several indexes

You've got it On Wed, Oct 17, 2012 at 10:04 AM, blopez wrote: > Thank you both. > > At the end I decided to implement the multi-core approach. I think it's the > fastest and easiest solution, and now it's working fine with two cores. > > By the way, to check if it's implemented properly... e

Re: Several indexes

Thank you both. At the end I decided to implement the multi-core approach. I think it's the fastest and easiest solution, and now it's working fine with two cores. By the way, to check if it's implemented properly... each 'core folder' (in my case core0, core1, ...) needs its 'bin', 'conf' and 'd

Re: how to boost query term after tokenizer

Hi, I think that`s not the way you can do it, because you cannot give a hint to your analyzer, which text fragment is more relevant than another at runtime. There is no marker so a filter process cannot know, which terms are to boost. You could write your own filter and let it read a file with som

Re: WordDelimiterFilter and the dot character

On 10/17/2012 7:24 AM, dirk wrote: Hi, I had a very similar Problem while searching in a bibliographic field called "signatur". I could solve it by the help of additional Filterclasses. At the moment I use the following Filters. Then it works for me: ...

Re: solr 4 tika config

Hi, Try the new post.jar in version 4.0.0 It will allow you to say java -Dauto -Drecursive -Dfiletypes=ppt -jar post.jar "d:\myfiles" You can inspect your Solr log file to see what ExtractingRequestHandler URLs are actually called for each -- Jan Høydahl, search solution architect Cominvent A

ICUTokenizer ArrayIndexOutOfBounds

Hi, I've been playing around with using the ICUTokenizer from 4.0.0. Using the code below, I was receiving an ArrayIndexOutOfBounds exception on the call to tokenizer.incrementToken(). Looking at the ICUTokenizer source, I can see why this is occuring (usableLength defaults to -1).

Re: Solr reports: "Can not read response from server" when running import

On 10/17/2012 12:29 AM, Romita Saha wrote: Hi Dave, I followed your guidance and loaded my database in MySQL. Presently the url reads like this: url = "jdbc:mysql://localhost:8983/var/lib/mysql/camerasys" The bin address in my.cnf file is : bind-address = 127.0.0.1 However the issue still per

Re: WordDelimiterFilter and the dot character

Oh, and I forgot to mention that you should try your field type and query terms in the Solr Admin analyzer page. There you can see what sequence is generated for the query. -- Jack Krupansky -Original Message- From: Farkas István Sent: Wednesday, October 17, 2012 9:33 AM To: solr-use

Re: differences of LockFactory between solr 3.6.1 and 4.0.0?

On Wed, Oct 17, 2012 at 9:33 AM, Bernd Fehling wrote: > Hi list, > > while checking the runtime behavior of solr 4.0.0 I recognized that the > handling > of write.lock seams to be different. > > With solr 3.6.1 after calling optimize the index is optimzed and write.lock > removed. > This tells m

differences of LockFactory between solr 3.6.1 and 4.0.0?

Hi list, while checking the runtime behavior of solr 4.0.0 I recognized that the handling of write.lock seams to be different. With solr 3.6.1 after calling optimize the index is optimzed and write.lock removed. This tells me everything is flushed to disk and its save to copy the index. With so

Re: WordDelimiterFilter and the dot character

Hm, that makes sense, thank you, I will try this one. Regards, Istvan You need to have separate "index" and "query" analyzers for that field type. The "query" analyzer would not have preserveOriginal="1", which would generate an extra term that would not match the exact term sequence that wa

Re: WordDelimiterFilter and the dot character

You need to have separate "index" and "query" analyzers for that field type. The "query" analyzer would not have preserveOriginal="1", which would generate an extra term that would not match the exact term sequence that was indexed. A query of "123 2012" would not split any terms and hence not

Re: WordDelimiterFilter and the dot character

Hi, I had a very similar Problem while searching in a bibliographic field called "signatur". I could solve it by the help of additional Filterclasses. At the moment I use the following Filters. Then it works for me: ...

WordDelimiterFilter and the dot character

Hello, I've ran into an interesting problem. I am using Solr 3.5 on an Ubuntu server. I have some data with a code field, which contains some identifiers (mostly) in the following format: E.123/2012. I've set up a fieldType for this code field: | | If I search for the exact co

Re: Flushing RAM to disk

Deniz: Unless you have a _proven_ bottleneck that this will address, I'd just let Solr/Lucene do their thing without interference. Explicitly using a RAM directory is one of those things that _seems_ like would be a Good Thing, but outside of very specialized situations it often isn't worth the ef

Re: results with no default sort order...

You probably have to do that at the application layer, there's no good way that I know of to do this in Solr. That is, get the response (which contains the original query) and re-sort the results list before display. Best Erick On Wed, Oct 17, 2012 at 12:13 AM, trilok2000 wrote: > Hi there, > >

Re: Search multiple tags within multiple categories

Hi, It sounds like you want to use Solr as classifier, which is doable. Take a bunch of text for some category and index it as one doc. Make sure it has a field with category name. Do that for each category. Then use tags to search against this index and return the field with category name. Otis

Re: Charfilter keep "dates" but skeep "number"

Thank you Erik, Probably right to put this business rule above processing or via a updateRequestProcessorChain. Thanks again, I love this forum, so efficient. -- View this message in context: http://lucene.472066.n3.nabble.com/Charfilter-keep-dates-but-skip-number-tp4014049p4014211.html Sent

Re: Query related to data source in lucid imagination

Leena - First, best to deal with LucidWorks topics at our support forum at http://support.lucidworks.com For this particular issue, I believe the issue is likely that you've installed LucidWorks on a Windows server and used spaces in the installation path. See

Re: Several indexes

Jochen's suggestion is a good one. Alternately you could just index all the fields into a single schema with, say, a "type" field to use in a filter query to separate the searches. Which you choose is largely a matter of taste. Unless there are a LOT of documents the penalty for having unused fiel

Re: Several indexes

You probably should try a multi core installation: http://wiki.apache.org/solr/CoreAdmin should get you started. Am 17.10.2012 12:21, schrieb blopez: > Hi all, > > I'm facing a problem that I think is easier to solve than I really > think. > > Overview: I have an application working on Solr which

Re: Charfilter keep "dates" but skeep "number"

This kind of thing doesn't lend itself to OOB filters, I'd recommend one of two approaches: 1> put the logic in your indexing process, easy if you use SolrJ 2> create a custom element to an updateRequestProcessorChain that modifies the document. This seems daunting, but it's actually quit

Re: Datefaceting on multiple value in solr

Thanks Chris, but i want something like below, docid:1 name=test date=oct12 docid:7 name=test1 date=oct13 docid:13 name=test3 date=oct12 docid:2 name=test date=oct12 docid:8 name=test1 date=oct13 docid:14 name=test3 date=oct13 docid:3 name=test date=oct13 docid:9 nam

Query related to data source in lucid imagination

Hi, I have installed lucidworks enterprise v2.1. In that, I want to create XML data source. But on the data source page I am unable to find the Solr XML in the dropdown list. Could you help me in this..?? Thanks & regards, Leena Jawale The contents of this e-ma

Several indexes

Hi all, I'm facing a problem that I think is easier to solve than I really think. Overview: I have an application working on Solr which manages indexing and retrieval operations. Everything's working fine, I can index some docs (for example schema with attributes A, B and C) in a Solr index and

DIH throws NullPointerException when using dataimporter.functions.escapeSql with parent entities

Hi folks, I am currently migrating our Solr servers from a 4.0.0 nightly build (aprox. November 2011, which worked very well) to the newly released 4.0.0 and am running into some issues concerning the existing DataImportHandler configuratiions. Maybe you have an idea where I am going wrong here.

Re: Having trouble getting boosting queries to work with multiple terms

Several ideas there, thanks guys. I'll re-evaluate how I build and use the index from now on. Asfand Qazi On 16/10/12 17:35, Tomás Fernández Löbbe wrote: I think sorting should work too, as I suggested before. In this case (because by coincidence you need alphabetic sort on the type) "sort=ty

Re: java.io.IOException: Malformed chunk who can help me?

At least one of those messages seem to imply that perhaps you secured your servlet and the security manager can't log you in. If that was not the intention, maybe you need to create an exclusion public zone for that specific URL. Regards, Alex. Personal blog: http://blog.outerthoughts.com/ Link

DIH: Variables and pk-attribute in database.xml

Hi all In the DIH configfile "database.xml" I defined an entity like this: ... With this definition, the full-load runs fine, but as soon as the delta-loads run, I get a huge number (I guess 1 for every delta-record) of warnings who say "WARNING: Unable to resolve var

Re: Can we retrieve deleted records before optimized

You could split your index. There are some tools available, e.g. this one on github https://github.com/HON-Khresmoi/hash-based-index-splitter does hash based index splitting. You could probably start with the tool and modify it for your needs (like moving docs with certain timestamp criteria to ano

Re: What does _version_ field used for?

Ok, I got it, thanks 2012/10/17 Alexandre Rafalovitch > Yes, just make sure you have it in the scheme. Solr handles the rest. > > Regards, >Alex. > Personal blog: http://blog.outerthoughts.com/ > LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch > - Time is the quality of nature that

Re: What does _version_ field used for?

Yes, just make sure you have it in the scheme. Solr handles the rest. Regards, Alex. Personal blog: http://blog.outerthoughts.com/ LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch - Time is the quality of nature that keeps events from happening all at once. Lately, it doesn't seem to b

Re: What does _version_ field used for?

Is that said we just need to add this filed, and there is no more work? 2012/10/17 Rafał Kuć > Hello! > > It is used internally by Solr, for example by features like partial > update functionality and update log. > > -- > Regards, > Rafał Kuć > Sematext :: http://sematext.com/ :: Solr - Lucene

Re: What does _version_ field used for?

Hello! It is used internally by Solr, for example by features like partial update functionality and update log. -- Regards, Rafał Kuć Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch - ElasticSearch > I ma moving to solr4.0 from beta version. There is a exception was thrown, > Cause

What does _version_ field used for?

I ma moving to solr4.0 from beta version. There is a exception was thrown, Caused by: org.apache.solr.common.SolrException: _version_field must exist in schema, using indexed="true" stored="true" and multiValued="false" (_version_ does not exist) at org.apache.solr.update.VersionInfo.getAn