Re: indexing dovecot mailbox

2016-05-22 Thread Andreas Meyer
Hello! The files I want to index are IMAP-folders of dovecot, Maildir. bitmachine1:/home/a.meyer/Postfach/cur # file 1461583672.Vfe03I1000f4M981621.bitmachine1:2,S 1461583672.Vfe03I1000f4M981621.bitmachine1:2,S: SMTP mail, ASCII text I can read them with the Midnight Commeander. Has it somethin

How to use a regex search within a phrase query?

2016-05-22 Thread Erez Michalak
Hey, I'm developing a search application based on SOLR 5.3.1, and would like to add to it regex search capabilities on a specific tokenized text field named 'content'. Is it possible to combine the default regex syntax within a phrase query (and moreover, within a proximity search)? If so, pleas

creation of a cor fails

2016-05-22 Thread Andreas Meyer
Hello! Got a problem with the creation of a core using a fresh installation. # ll insgesamt 16 drwxr-x--- 2 solr users 4096 22. Mai 13:54 data -rw-r- 1 solr users 977 22. Mai 13:37 log4j.properties drwxr-x--- 2 solr users 4096 22. Mai 13:54 logs -rw-r--r-- 1 solr users6 22. Mai 13:54 sol

Re: indexing dovecot mailbox

2016-05-22 Thread Ahmet Arslan
Hi Andreas, Exactly, SimplePostTool does not recognize/support the file-ending. If they are text files, you can change file exception to *.txt, post tool will grab them. If you have some code to read those files, you can use SolrJ to roll your own indexer https://lucidworks.com/blog/2012/02/14

Re: How to use a regex search within a phrase query?

2016-05-22 Thread Ahmet Arslan
Hi Erez, I don't think it is possible to combine regex with phrase out-of-the-box. However, there is https://issues.apache.org/jira/browse/LUCENE-5205 for the task. Can't you define your query in terms of pure regex? something like /[0-9]{3} .* [0-9]{4}/ ahmet On Sunday, May 22, 2016 1:37 PM,

highlight don't work if df not specified

2016-05-22 Thread michael solomon
Hi, I'm I query multiple fields in solr: q=normal_text:"bla bla"&title:"bla bla" I turn on the highlighting, but it doesn't work even when I fill hl.fl. it work when I fill df(default field) parameter, but then it's highlights only one field. What the problem? Thanks, michael

Re: highlight don't work if df not specified

2016-05-22 Thread Ahmet Arslan
Hi, q=normal_text:"bla bla"&title:"bla bla" should be q=+normal_text:"bla bla" +title:"bla bla" On Sunday, May 22, 2016 4:52 PM, michael solomon wrote: Hi, I'm I query multiple fields in solr: q=normal_text:"bla bla"&title:"bla bla" I turn on the highlighting, but it doesn't work even

Re: highlight don't work if df not specified

2016-05-22 Thread michael solomon
Thanks Ahmet, It was mistake in the question, sorry, in the quey I wrote it properly. On Sun, May 22, 2016 at 5:06 PM, Ahmet Arslan wrote: > Hi, > > q=normal_text:"bla bla"&title:"bla bla" > > should be > q=+normal_text:"bla bla" +title:"bla bla" > > > > On Sunday, May 22, 2016 4:52 PM, michael

Re: highlight don't work if df not specified

2016-05-22 Thread Ahmet Arslan
Hi, Weird, are your fields stored? On Sunday, May 22, 2016 5:14 PM, michael solomon wrote: Thanks Ahmet, It was mistake in the question, sorry, in the quey I wrote it properly. On Sun, May 22, 2016 at 5:06 PM, Ahmet Arslan wrote: > Hi, > > q=normal_text:"bla bla"&title:"bla bla" > > should

Re: highlight don't work if df not specified

2016-05-22 Thread michael solomon
On Sun, May 22, 2016 at 5:18 PM, Ahmet Arslan wrote: > Hi, > > Weird, are your fields stored? > > > > On Sunday, May 22, 2016 5:14 PM, michael solomon > wrote: > Thanks Ahmet, > It was mistake in the question, sorry, in the quey I wrote it properly. > > > On Sun, May 22, 2016 at 5:06 PM, Ahme

Re: highlight don't work if df not specified

2016-05-22 Thread Ahmet Arslan
Hi, What happens when you increase hl.maxAnalyzedChars? OR hl.q=blah blah&hl.fl=normal_text,title Ahmet On Sunday, May 22, 2016 5:24 PM, michael solomon wrote: On Sun, May 22, 2016 at 5:18 PM, Ahmet Arslan wrote: > Hi, > > Weird, are your fields stored? > > > > On Sunday, May 22, 2016

RE: How to use a regex search within a phrase query?

2016-05-22 Thread Erez Michalak
Thanks you Ahmet for the JIRA reference - it looks really promising and I'll check it out. Regarding your question - once a piece of text is tokenized, it seems like there is no way to perform a regex query across term boundaries. The pure regex is good as long I'm querying for a single term.

Re: creation of a cor fails

2016-05-22 Thread Andreas Meyer
Hello! It must have something to do with the init-script and the solr.in.sh. As long as I start solr from within a console with bin/solr start then there is no problem creating a core. As soon as I start solr with service solr start the creation of a core fails. Even if I comment the SOLR_HOME="

Re: creation of a cor fails

2016-05-22 Thread Erick Erickson
Possibly a permissions problem? Are you running as different users in the two situations? And do note that sometimes Solr gets a little confused if you try to create the same core multiple times without cleaning out the directories. Best, Erick On Sun, May 22, 2016 at 9:19 AM, Andreas Meyer wro

Re: How to use a regex search within a phrase query?

2016-05-22 Thread Erick Erickson
Erez: Before going too far down this path, understand that even if you can get this syntax to work, you're going to pay a _very_ significant performance hit if you have any decent size corpus. Conceptually, what happens is that all the terms that the regex matches are made into clauses. So let's t

Re: creation of a cor fails

2016-05-22 Thread Andreas Meyer
Hello! I run as root in both situations. If I start solr with service solr start and then do a ./solr create -c zzz it fails with ERROR: Error CREATEing SolrCore 'zzz': Unable to create core [zzz] Caused by: /var/solr/data/zzz/data If I do the same a second time, I get ERROR: Core 'zzz' already

Re: indexing dovecot mailbox

2016-05-22 Thread Andreas Meyer
Hi! I have no idea how to use the MailEntityProcessor or how to start it. Greetings Andreas Ahmet Arslan schrieb am 22.05.16 um 00:52:59 Uhr: > > > Hi, > > You might be also interested in the MailEntityProcessor of DataImportHandler. > > https://cwiki.apache.org/confluence/display/solr/

Sort different groups using different sort orders

2016-05-22 Thread Junaid Surve
Hi All I have a peculiar challenge. Can we sort different groups using different sort orders in Solr 6.0 Currently I have to make 1 call for each group as my sort orders are different for each group. There are only 3 groups that I am going to get as output. Regards Junaid

Re: creation of a cor fails

2016-05-22 Thread Erick Erickson
What does the Solr log show? That often has more root causes than the return to the client. Best, Erick On Sun, May 22, 2016 at 10:13 AM, Andreas Meyer wrote: > Hello! > > I run as root in both situations. If I start solr with service solr start > and then do a ./solr create -c zzz it fails with

Parallel SQL and function queries?

2016-05-22 Thread Timothy Potter
How would I do something like: find all docs using a geofilt, e.g. SELECT title_s FROM movielens WHERE location_p='{!geofilt d=90 pt=37.773972,-122.431297 sfield=location_p}' This fails with: {"result-set":{"docs":[ {"EXCEPTION":"java.util.concurrent.ExecutionException: java.io.IOException: --

Re: Parallel SQL doesn't support >, >=, <, <= syntax?

2016-05-22 Thread Timothy Potter
Thanks Joel, see: SOLR-9146 On Sat, May 21, 2016 at 3:39 PM, Joel Bernstein wrote: > Also agreed we should throw an exception in this scenario until it's > implemented. > > Joel Bernstein > http://joelsolr.blogspot.com/ > > On Sat, May 21, 2016 at 5:34 PM, Joel Bernstein wrote: > >> Yes, current

Re: Parallel SQL and function queries?

2016-05-22 Thread Joel Bernstein
I didn't have a chance yet to fully formulate a strategy for using the qparser plugins through the SQL interface. In the initial release there is a back door that allows you tack on any parameters you want, and they should be passed through to Solr. There are no test cases for this, but I can add

Re: Parallel SQL and function queries?

2016-05-22 Thread Joel Bernstein
Actually, I just reviewed the code and it's not passing through the params as I described. I think this is important to have working so we can support the qparser plugins through filter queries. I'll create a ticket for this and work up a patch for this. Joel Bernstein http://joelsolr.blogspot.co

Re: creation of a cor fails

2016-05-22 Thread Andreas Meyer
I just see that solr runs as the user solr when started by root with service solr start. From within the console startet it runs as user root and the creation of a core does not fail then. I must be a permissionproblem when solr runs as the user solr altough all the files and folders in /var/solr

Re: Parallel SQL and function queries?

2016-05-22 Thread Joel Bernstein
I opened SOLR-9148 and added a patch to pass through filter queries. I also saw that there is one kind of geo filter that uses the Solr range syntax (filtering by rectangle): store:[45,-94 TO 46,-93] This should work with the current SQL interface. We should check with David Smiley and see if t

Auto Suggestion in solr

2016-05-22 Thread Mugeesh Husain
Hello everyone, I am looking for some suggestion for auto-suggest like imdb.com. just type "samp" in search box in imdb.com site. results are returned 1. Based on popularity 2. Even results with space are shown give. Example: "Sam Page" So, I am looking for this kind of auto suggestion, please