RE: solr numeric range queries

2010-04-14 Thread Sandhya Agarwal
Sure. Will take a look. Thanks, Ankit. -Original Message- From: Ankit Bhatnagar [mailto:abhatna...@vantage.com] Sent: Wednesday, April 14, 2010 6:52 PM To: 'solr-user@lucene.apache.org' Subject: RE: solr numeric range queries Hi Sandhya, On a different note - if you are using Solr1.4 o

RE: DIH

2010-04-14 Thread Sandhya Agarwal
Thanks a lot, Lance. So, are these part of solr 1.4 release ? -Original Message- From: Lance Norskog [mailto:goks...@gmail.com] Sent: Thursday, April 15, 2010 9:53 AM To: solr-user@lucene.apache.org Subject: Re: DIH FileListEntityProcessor -> BinFileDataSource -> TikaEntityProcessor (I

Re: DIH

2010-04-14 Thread Lance Norskog
FileListEntityProcessor -> BinFileDataSource -> TikaEntityProcessor (I think) FLEP walks the directory and supplies a separate record per file. BFDS pulls the file and supplies it to TikaEntityProcessor. BinFileDataSource is not documented, but you need it for binary data streams like PDF & Word.

Re: Need help with StackOverflowError

2010-04-14 Thread Lance Norskog
com.mysql.jdbc.StatementImpl.executeSimpleNonQuery(StatementImpl.java:1545) at com.mysql.jdbc.RowDataDynamic.close(RowDataDynamic.java:201) at com.mysql.jdbc.ResultSetImpl.realClose(ResultSetImpl.java:7624) at com.mysql.jdbc.ResultSetImpl.close(ResultSetImpl.java:908) at

Re: Tree Component for much Categories.

2010-04-14 Thread Lance Norskog
Each document can store all of the sub-categories that it belongs to, as a multiValued field. You would need to get all of these categories when indexing a document. From a DB, this wcan be done with a recursive search in a stored procedure. On 4/14/10, stockii wrote: > > Hello aaagain ;) > > Im

DIH

2010-04-14 Thread Sandhya Agarwal
Hello, We want to design a solution where we have one polling directory (data source directory) containing the xml files, of all data that must be indexed. These XML files contain a reference to the content file. So, we need another datasource that must be created for the content files. Could s

Re: dismax and date boosts

2010-04-14 Thread Lance Norskog
Wait- it's in a database? That's much simpler. The select should supply the date as an SQL Date or Timestamp type. The DIH will get this directly and store it as a Solr tdate. You should not have to do any arithmetic or formatting of date strings. This may need a few layers of SQL functions. On

Re: Units/Currency range searching

2010-04-14 Thread Lance Norskog
Oooh! Interesting problem. Here are two avenues to explore. (No guarantees.) Function queries may work in range queries (don't know the syntax). So, if you store in a normalized currency, you can give the exchange rate as an argument to the mult() function. Function queries are slow so another ap

Re: [ANN] Zoie Solr Plugin - Zoie Solr Plugin enables real-time update functionality for Apache Solr 1.4+

2010-04-14 Thread qaz
do you mean that the plugin for solr doesn't have all the functionalities of the standalone zoie or do you mean zoie just simply cannot handle large indexes? by really really small, what exactly are we talking about here? are there any better ways for NRT? maybe in solr 1.5? thanks -- View this

DIH questions

2010-04-14 Thread Blargy
I have a root entity item with 2 sub-entities. Is there any way I can defer the calculation of a ScriptTransformer to after the 2 sub-entities are processed? I need to access the variables from both the sub-entities in order to add a 3 variable using the ScriptTransformer.

Re: Experience with indexing billions of documents?

2010-04-14 Thread Jason Rutherglen
Tom, Yes, we've (Biz360) indexed 3 billion and upwards... If indexing is the issue (or rather re-indexing) we used SOLR-1301 with Hadoop to re-index efficiently (ie, in a timely manner). For querying we're currently using the out of the box Solr distributed shards query mechanism, which is hard (r

Re: Need help with StackOverflowError

2010-04-14 Thread Blargy
Does anyone know if this would help? onError : (abort|skip|continue) . The default value is 'abort' . 'skip' skips the current document. 'continue' continues as if the error did not happen . Solr1.4 -- View this message in context: http://n3.nabble.com/Need-help-with-StackOverflowError-tp70445

RE: Benchmarking Solr

2010-04-14 Thread Lesyshyn, Erica
Hi, I agree with Jean-Sebastien. JMeter is great! The threads in my test plan are configured to use an "Access Log Sampler". This allows you to feed your production requests through JMeter, simulating production traffic. When I launch the test, it has access to about 3 million production querie

Re: negative query OR positive query

2010-04-14 Thread Ahmet Arslan
> Using Solr 1.4 I wanted to construct a query that returns > documents that > have a particular field value or are missing the field. The > first thing I > came up with was: > > field1:particularvalue OR -field1:[* TO *] > > It turns out the -field1:[* TO *] was being ignored. If > particularval

Reading a parameter from a String.

2010-04-14 Thread Bruno
I need to change a parameter from within a query string. :* AND requestid:100 AND timestamp:[2010-04-13T20:30:00.000Z TO 2010-04-13T21:00:00.000Z] AND source:"LogCollector-risidev3was2.201002020100._opt_ISI_logs.FNM.stdout_ISIREG_10.02.01_02.00.00.txt.tar.gz-stdout_ISIREG_10.02.01_02.00.00.txt.FNM

Tree Component for much Categories.

2010-04-14 Thread stockii
Hello aaagain ;) Im searching for the best solution to search in many categories and sub-Categories. My Setup is that. - The Client Search for something in one Category. - The client does only send the search-string and the Main-Category. - The client is an iPhone app, no website or similar. -

Re: Displaying fieldValueCache stats in Solr 1.4 admin/stats page

2010-04-14 Thread Koji Sekiguchi
SandeepTagore wrote: Thanks a lot for your quick response Yonik. It displays fieldValueCache's configuration details but it doesn't display the updated values when we refresh the page. Other caches are working fine. name: fieldValueCache class: org.apache.solr.search.FastLRUCache version

Re: Benchmarking Solr

2010-04-14 Thread Shawn Heisey
On 4/12/2010 9:57 AM, Shawn Heisey wrote: On 4/12/2010 8:51 AM, Paolo Castagna wrote: There are already two related pages: - http://wiki.apache.org/solr/SolrPerformanceFactors - http://wiki.apache.org/solr/SolrPerformanceData Why not to create a new page? - http://wiki.apache.org/solr/Benc

negative query OR positive query

2010-04-14 Thread Jon Brock
Hi, Using Solr 1.4 I wanted to construct a query that returns documents that have a particular field value or are missing the field. The first thing I came up with was: field1:particularvalue OR -field1:[* TO *] It turns out the -field1:[* TO *] was being ignored. If particularvalue wasn't found

Re: dismax and date boosts

2010-04-14 Thread Shawn Heisey
On 4/14/2010 8:12 AM, Shawn Heisey wrote: On 4/12/2010 9:29 PM, Lance Norskog wrote: During indexing: the basic Solr XmlUpdateHandler does not have a facility for this. In the DataImportHandler you can add Javascript that takes your 'seconds since epoch', adds the delta between your epoch and 1/

RE: solr numeric range queries

2010-04-14 Thread Ankit Bhatnagar
Hi Sandhya, On a different note - if you are using Solr1.4 or later, take a look at solr trie range support. http://www.lucidimagination.com/blog/2009/05/13/exploring-lucene-and-solrs-trierange-capabilities/ Ankit -Original Message- From: Sandhya Agarwal [mailto:sagar...@opentext.com

Units/Currency range searching

2010-04-14 Thread Luke Tebbs
Hello everyone, I'm trying to find a way to search a range using units with on-the-fly conversion for currency, for instance - [* TO 200USD] obviously most metrics could just be stored in one unit for the whole dataset and converted prior to the query but my records could have entries in any

RE: solr numeric range queries

2010-04-14 Thread Sandhya Agarwal
Thanks Erik. I did read through the document mentioned, but was a little surprised that there is no direct syntax for "<=", "<" etc;. Hence, was confirming. Thanks, Sandhya -Original Message- From: Erik Hatcher [mailto:erik.hatc...@gmail.com] Sent: Wednesday, April 14, 2010 5:09 PM To

Re: solr numeric range queries

2010-04-14 Thread Erik Hatcher
On Apr 14, 2010, at 6:09 AM, Sandhya Agarwal wrote: Hello, As I understand, we have to use the syntax { * TO } or [ * TO ], for queries less than or less than or equal to , etc; Where is a numeric field. There is no direct < or <= syntax supported. Is that correct ? That's c

solr numeric range queries

2010-04-14 Thread Sandhya Agarwal
Hello, As I understand, we have to use the syntax { * TO } or [ * TO ], for queries less than or less than or equal to , etc; Where is a numeric field. There is no direct < or <= syntax supported. Is that correct ? Thanks, Sandhya

Re: HTMLStripCharFilterFactory configuration problem

2010-04-14 Thread Sven Maurmann
Hi, please note that you get the stored value of the field as a result and not the indexed one. Cheers, Sven --On Wednesday, April 14, 2010 02:54:52 PM +0530 Ranveer Kumar wrote: Hi all, I am facing problem to configure HTMLStripCharFilterFactory. following is the schema :

HTMLStripCharFilterFactory configuration problem

2010-04-14 Thread Ranveer Kumar
Hi all, I am facing problem to configure HTMLStripCharFilterFactory. following is the schema : when I am checking with analysis.jsp it giving true result. But in m

Re: Displaying fieldValueCache stats in Solr 1.4 admin/stats page

2010-04-14 Thread SandeepTagore
Thanks a lot for your quick response Yonik. It displays fieldValueCache's configuration details but it doesn't display the updated values when we refresh the page. Other caches are working fine. name:fieldValueCache class: org.apache.solr.search.FastLRUCache version:1.0 descript