Re: Regex Search at Solr

2013-10-03 Thread Furkan KAMACI
I will go with that. I've just wondered about could I do it with existence test data or not. 2013/10/4 Otis Gospodnetic > Maybe storing the protocol info in a separate field would be cleaner. > > Otis > Solr & ElasticSearch Support > http://sematext.com/ > On Oct 3, 2013 3:20 AM, "Furkan KAMACI

Re: Got error: Filter execution threw an exception

2013-10-03 Thread Shawn Heisey
On 10/3/2013 8:03 PM, Brian Robinson wrote: > Hi Shawn, > Thanks for responding. Just saw this email. I did go to the logging tab > in the admin page, but it never finished loading. I'm using collection1, > and I'm using the traditional config. Here is my complete code, with > $options omitted for

Re: How to get values of external file field(s) in Solr query?

2013-10-03 Thread Mikhail Khludnev
On Fri, Oct 4, 2013 at 12:24 AM, Peter Keegan wrote: > But how to get the values for docs that match some arbitrary query? You can specify eff in fl param. it's implied by http://docs.lucidworks.com/display/solr/Function+Queries -- Sincerely yours Mikhail Khludnev Principal Engineer, Grid Dyn

Indexing file system contents

2013-10-03 Thread Sadler, Anthony
Hi all: I've had a quick look through the archives but am struggling to find a decent search query (a bad start to my solr career), so apologies if this has been asked multiple times before, as I'm sure it has. We've got several windows file servers across several locations and we'd like to in

Solr client in CPP

2013-10-03 Thread Neeraj Pandey
Hi all, My application is in cpp and I want to integrate solr with my application. Can any body tell me whether there is a solar client in cpp ?

FileNotFoundException

2013-10-03 Thread tamanjit.bin...@yahoo.co.in
Hi, We migrated to Solr 4.3 from 3.5 yesterday. We use multicore Master Slave architecture and use external scripts to sync the slaves. Every 2-3 hours cores on our slaves start going down (not all but some. We have about 17 cores). And the logs show the following exception: 1256587 [http-bio-/0.0

Re: Doing time sensitive search in solr

2013-10-03 Thread Darniz
i am assuming there is no solution or i have to handle it at index time. Any solr experts please -- View this message in context: http://lucene.472066.n3.nabble.com/Doing-time-sensitive-search-in-solr-tp4092273p4093414.html Sent from the Solr - User mailing list archive at Nabble.com.

WikipediaTokenizer documentation - never mind

2013-10-03 Thread Ken Krugler
Hi all, Sorry for the noise - I finally realized that the script I was running was using some Java code (EnwikiContentSource, from Lucene benchmark) to explicitly set up fields and then push the results to Solr. -- Ken == Where's

Specifying Response Timeout SolrJ

2013-10-03 Thread Karthick Duraisamy Soundararaj
I am using solrj in my java client to talk to the solr servers. I want the solr query to timeout if I dont get the complete response within X amount of time. In other words, I dont want my thread to wait indefinitely for the response and I want a TimeoutException if solr response takes longer than

Re: Got error: Filter execution threw an exception

2013-10-03 Thread Brian Robinson
Also, if it sheds any light, before this error started appearing, I was running into some OOM errors with PHP. Before that, I had reloaded Solr a couple of times, since I updated schema.xml. All I did in schema.xml was remove some fields, though. On 10/3/2013 9:03 PM, Brian Robinson wrote: Hi

Re: Got error: Filter execution threw an exception

2013-10-03 Thread Brian Robinson
Hi Shawn, Thanks for responding. Just saw this email. I did go to the logging tab in the admin page, but it never finished loading. I'm using collection1, and I'm using the traditional config. Here is my complete code, with $options omitted for security: $options = array ( 'hostname' =>

Re: Got error: Filter execution threw an exception

2013-10-03 Thread Brian Robinson
Something else strange...I pinged Solr with PHP in my desktop browser and didn't get a response back, neither a success nor a failure. But when I navigate to /solr/admin/ping on the server, it shows a status of "OK". I can also execute a deleteByQuery command without error, but both addDocumen

Re: Got error: Filter execution threw an exception

2013-10-03 Thread Shawn Heisey
On 10/3/2013 6:02 PM, Brian Robinson wrote: > I'm using PHP Pecl to create my index, and am getting an error that I > can't figure out. I'm using Solr version 4.3.1. > > I know I'm supposed to provide the log errors, but strangely, I checked > solr.log in the apache-tomcat/logs/ directory, and the

Re: SolrCloud. Scale-test by duplicating same index to the shards and make it behave each index is different (uniqueId).

2013-10-03 Thread Otis Gospodnetic
Hi, I don't know. But, unless something outside Solr is a bottleneck, it may be wise to see if you can speed up indexing. Maybe we can help here... Otis Solr & ElasticSearch Support http://sematext.com/ On Oct 1, 2013 9:29 AM, "Thomas Egense" wrote: > Hello everyone, > I have a small challenge

Re: solr cpu usage

2013-10-03 Thread Otis Gospodnetic
Hi, More CPU cores means more concurrency. This is good if you need to handle high query rates. Faster cores mean lower query latency, assuming you are not bottlenecked by memory or disk IO or network IO. So what is ideal for you depends on your concurrency and latency needs. Otis Solr & Elast

Re: Regex Search at Solr

2013-10-03 Thread Otis Gospodnetic
Maybe storing the protocol info in a separate field would be cleaner. Otis Solr & ElasticSearch Support http://sematext.com/ On Oct 3, 2013 3:20 AM, "Furkan KAMACI" wrote: > I have two questions: > * > * > *First one:* > > I have a url field at my index. I have some supported protocols. i.e. htt

WikipediaTokenizer documentation

2013-10-03 Thread Ken Krugler
Hi all, Where's the documentation on the WikipediaTokenizer? Specifically I'm wondering how pieces from the source XML get mapped to field names in the Solr schema. For example, seems to be going into the "date" field for an example schema I've got. And goes into "body". But is there any w

Got error: Filter execution threw an exception

2013-10-03 Thread Brian Robinson
Hello, Starting a new thread on this problem... I'm using PHP Pecl to create my index, and am getting an error that I can't figure out. I'm using Solr version 4.3.1. I know I'm supposed to provide the log errors, but strangely, I checked solr.log in the apache-tomcat/logs/ directory, and the

Re: Adding attributes to Solr fields ?

2013-10-03 Thread Shawn Heisey
On 10/3/2013 4:36 PM, jimmy nguyen wrote: I'd like to get something like this in Solr: 1 Jane Doe John Doe 0123456789 1234567890 2345678901 This way it is easy to link the 2 first phone numbers to Jane Doe and the last one to John Doe. Attributes like that are not something that Solr will

Adding attributes to Solr fields ?

2013-10-03 Thread jimmy nguyen
Hi all, is it possible to add attributes to our Solr fields ? I'm indexing GATE-annotated documents into solr. The annotations produced by my GATE application usually have several features (for example, Person.title, Person.name, Person.phoneNumber...). Now each of my documents may contain more

Re: Filter execution threw an exception

2013-10-03 Thread Brian Robinson
Sorry, I'll get that information and start a new thread. On 10/3/2013 4:50 PM, Shawn Heisey wrote: On 10/3/2013 3:12 PM, Brian Robinson wrote: I'm using PHP Pecl to create my index, and am getting an error that I can't figure out. I've pared my code down to the below. I've verified that the dat

Re: Filter execution threw an exception

2013-10-03 Thread Shawn Heisey
On 10/3/2013 3:12 PM, Brian Robinson wrote: I'm using PHP Pecl to create my index, and am getting an error that I can't figure out. I've pared my code down to the below. I've verified that the database query is pulling in data correctly, and the $solrDocs array has the expected number of items, b

Filter execution threw an exception

2013-10-03 Thread Brian Robinson
Hello, I'm using PHP Pecl to create my index, and am getting an error that I can't figure out. I've pared my code down to the below. I've verified that the database query is pulling in data correctly, and the $solrDocs array has the expected number of items, but I'm getting an error thrown by

Re: How to get values of external file field(s) in Solr query?

2013-10-03 Thread Peter Keegan
In 4.3, frange query using an external file works for both q and fq. The Solr wiki and SIA both state that ExternalFileField does not support searching. Was the search/filter capability added recently, or is it not supported? Thanks, Peter On Wed, Jun 26, 2013 at 4:59 PM, Upayavira wrote: > T

Is there a way to know what documents are part of commit

2013-10-03 Thread Phani Chaitanya
Is there a way in Solr to know what documents are committed as part of the commit request rather than from the client side which sends docs to Solr ? - just out of curiosity. For example, below is the order of the requests: index doc1 index doc2 commit --> return IDs of doc1, doc2 index doc3 ind

Re: Limiting access to portions of the admin interface

2013-10-03 Thread Shawn Heisey
On 10/3/2013 1:02 PM, Shawn Heisey wrote: You could always put a proxy front end (with apache's mod_rewrite or something similar) Thinking about this after I sent it, I realized you can't use mod_rewrite, you would actually need to use a true proxy module. Apologies! Thanks, Shawn

Re: Limiting access to portions of the admin interface

2013-10-03 Thread Shawn Heisey
On 10/3/2013 12:35 PM, Shawn Heisey wrote: You'll run into strong resistance for putting any security features into Solr itself. We'd rather work on search, not spend all our time making and fixing security mechanisms, plus taking heat anytime they don't work as advertised and somebody loses mil

Re: Limiting access to portions of the admin interface

2013-10-03 Thread Bruce Pennypacker
Thanks for the detailed response. This is perfect for me to go back and show the folks here why locking it down wouldn't be a good idea. -Bruce On Thu, Oct 3, 2013 at 2:35 PM, Shawn Heisey wrote: > On 10/3/2013 12:16 PM, Bruce Pennypacker wrote: > >> We're running solr 4.1.0 in a production e

Re: Limiting access to portions of the admin interface

2013-10-03 Thread Shawn Heisey
On 10/3/2013 12:16 PM, Bruce Pennypacker wrote: We're running solr 4.1.0 in a production environment along with a number of mirrored staging environments. We provide full access to the admin console to our developers & qa on the staging environments. We'd like to be able to provide them with li

Limiting access to portions of the admin interface

2013-10-03 Thread Bruce Pennypacker
We're running solr 4.1.0 in a production environment along with a number of mirrored staging environments. We provide full access to the admin console to our developers & qa on the staging environments. We'd like to be able to provide them with limited access to the production admin pages so that

Re: App server?

2013-10-03 Thread Michael Sokolov
On 10/02/2013 06:44 PM, Mark wrote: Is Jetty sufficient for running Solr or should I go with something a little more enterprise like tomcat? Any others? FWIW we use tomcat for all of our installs, and it works fine. I don't claim it's any better than Jetty, but it doesn't cause any problems,

Re: App server?

2013-10-03 Thread Tomás Fernández Löbbe
You may also want to take a look at this Jira: https://issues.apache.org/jira/browse/SOLR-4792 for Solr 5.0 (trunk) Tomás On Thu, Oct 3, 2013 at 10:41 AM, Michael Sokolov < msoko...@safaribooksonline.com> wrote: > On 10/02/2013 06:44 PM, Mark wrote: > >> Is Jetty sufficient for running Solr or

Re: Solr External Scripts Replication Issue

2013-10-03 Thread tamanjit.bin...@yahoo.co.in
Found the solution. It was related to solrdeletionpolicy. Phew!!! -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-External-Scripts-Replication-Issue-tp4093343p4093356.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr External Scripts Replication Issue

2013-10-03 Thread tamanjit.bin...@yahoo.co.in
Also once in a while it gives the following exception: org.apache.solr.common.SolrException: Error opening new searcher at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1434) at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1546) at org.apache.solr.c

Solr External Scripts Replication Issue

2013-10-03 Thread tamanjit.bin...@yahoo.co.in
Hi, We use a Master-Slave architecture and use rsyncing to sync the slaves. It was working fine till 3.5 version. It is giving issues on migrating to 4.3 version. Now after I have commited incremental changes on master and optimize the index and run snappuller, snapinstaller, readercycle on slaves

Re: AW: Exact Date Search

2013-10-03 Thread soumikghosh05
Thanks a lot. it is working now -- View this message in context: http://lucene.472066.n3.nabble.com/Exact-Date-Search-tp4093273p4093341.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Exact Date Search

2013-10-03 Thread soumikghosh05
Thanks a lot. It is working now. -- View this message in context: http://lucene.472066.n3.nabble.com/Exact-Date-Search-tp4093273p4093340.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Unable to deplay solr 4.3.0 on jboss EAP 6.1 in mode full JavaEE 6

2013-10-03 Thread Shawn Heisey
On 8/14/2013 5:16 AM, Roland Everaert wrote: > For the past months I have deplaoyed and used SOLR 4.3.0 on a JBOSS EAP 6.1 > using the standalone configuration. > > Now due to the addition of a new service, I have to start jboss with a > modified version of the standalone-full.xml configuration fi

Re: Adding Custom Score

2013-10-03 Thread Yonik Seeley
If you're using solr, things may work out of the box without using "classes". https://cwiki.apache.org/confluence/display/solr/Function+Queries -Yonik On Thu, Oct 3, 2013 at 3:36 AM, Ankit Kumar wrote: > In Lucene i need to add custom score using function query classes . How to > do it?

Re: Adding Custom Score

2013-10-03 Thread Jack Krupansky
What are your specific requirements? -- Jack Krupansky -Original Message- From: Ankit Kumar Sent: Thursday, October 03, 2013 3:36 AM To: solr-user@lucene.apache.org Subject: Adding Custom Score In Lucene i need to add custom score using function query classes . How to do it?

AW: AW: Solr grouping performace

2013-10-03 Thread Sandro Zbinden
About the performance I can't say too much but what I would recommend to do is that you loop over the results. The first query gives you the number of groups (ngroups) q=*:*&groups=true&group.ngroups=true&group.field=myfield&start=0&rows=1 And after that you execute the other queries in a

Re: AW: Solr grouping performace

2013-10-03 Thread Alok Bhandari
Thanks for reply Sandro. My requirement is that I need all groups and then build compact data from it to send to server. I am not sure about how much RAM should be allocated to JVM instance to make it serve requests faster , any inputs on that are welcome. -- View this message in context: http

AW: Exact Date Search

2013-10-03 Thread Sandro Zbinden
Hey Soumik Did you read the http://wiki.apache.org/solr/SolrQuerySyntax page. It has some examples with dates. It is important that you index your field as a solr date field 1. Exact Matching: q= modify_date:" 2012-07-06T9:23:43Z " 2. Less than: q= modify_date:{* TO 2012-07-06T9:23:43Z } 3. M

Re: massive memory consumption of grouping feature

2013-10-03 Thread Furkan KAMACI
Hi Alok; Please do not reply an old message at mail list. Users may not see the question. Instead of that start a new thread and give a link to original one. 2013/10/3 Alok Bhandari > Did find any solution to this. I am also facing the same issue. > > > > -- > View this message in context: > h

AW: Solr grouping performace

2013-10-03 Thread Sandro Zbinden
Hey Alok I don't think that the group performance is bad on integer fields. But try to load all results in one query is very memory consuming. Did you try to only load the first 1000 results with rows=1000 and start=0 ? To get the total group count you can use the group.ngroups=true param. B

Solr grouping performace

2013-10-03 Thread Alok Bhandari
Hello , I am using solr 4.0 , I want to group entries on one of the int field , I need all the groups and group.limit is 1. I am getting very slow performance and some times I am getting OutOfMemory also. My index is having 20 million records and out of which my search result returns 1 million do

Re: Wild card on field search

2013-10-03 Thread Dmitry Kan
actually, it isn't possible to define a tokenizer on a string field, therefore you should use custom TextField. To enable the wildcards: 1. trailing wildcard prepa* should work off the shelf 2. leading wildcard *test can be enabled with the following filter (with our own settings, entire filter h

Re: massive memory consumption of grouping feature

2013-10-03 Thread Alok Bhandari
Did find any solution to this. I am also facing the same issue. -- View this message in context: http://lucene.472066.n3.nabble.com/massive-memory-consumption-of-grouping-feature-tp4031895p4093297.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Exact Date Search

2013-10-03 Thread Upayavira
modify_date:[* TO 2012-07-06T9:23:43Z] modify_date:[2012-07-06T9:23:43Z TO *] On Thu, Oct 3, 2013, at 09:18 AM, soumikghosh05 wrote: > I have a date filed modify_date and the field value is > 2012-08-09T11:23:43Z , > 2011-09-02T12:23:43Z and 2012-07-06T9:23:43Z for 3 docs. > > User provided a da

Search for non empty fields in a index with denormalized tables

2013-10-03 Thread SandroZbinden
Hi there I have a patient and image that are denormalized for the solr index (see the image attached) Now I want to select all patients that have no image. I would usually do this with the following query: select?*q=-image_imgid:[0 TO *]* and then group by patient_patid

Exact Date Search

2013-10-03 Thread soumikghosh05
I have a date filed modify_date and the field value is 2012-08-09T11:23:43Z , 2011-09-02T12:23:43Z and 2012-07-06T9:23:43Z for 3 docs. User provided a date in the search form for an example 2012-07-06T9:23:43Z. 1. I wanted to get the doc who's modify date is matching with the user supplied date.

Re: Newbie to Solr

2013-10-03 Thread Mamta Alshi
Hey Alex, Thank you for your suggestion. Thanks, Mamta Sent from my iPhone On Oct 2, 2013, at 4:31 AM, Alexandre Rafalovitch wrote: > Mamta, > > You are trying to do multiple things at once. Slow down before you drown. > > Use the default Solr distribution. That runs embedded server. Do not s

Wild card on field search

2013-10-03 Thread soumikghosh05
I want to store the below string into Title field. this is a test title prepared for solar wild card query. I want to query the it with the below string. *test title prepa* What type of field type I should use? (string or TextField) and what type of tokenizer I should use? what would be my qu

Adding Custom Score

2013-10-03 Thread Ankit Kumar
In Lucene i need to add custom score using function query classes . How to do it?

Regex Search at Solr

2013-10-03 Thread Furkan KAMACI
I have two questions: * * *First one:* I have a url field at my index. I have some supported protocols. i.e. http and https. How can I list the urls at my index that has is not a supported url? (which query parser do you suggest for such kind of purposes)? http://www.google.com/sfdsd sfsdf sfdsf/

slow reindexing

2013-10-03 Thread Jai
what i am doing? i am querying from one core and reindexing data to another core. Why? i am querying using regular expression, it give me results but do not tell how many unique values found and with their individual counts. (facet). i am querying and reindexing in another core on same machine wit