How to enable JMX to monitor Jetty
Hi list, how do I correctly enable JMX in Solr 6 so that I can monitor Jetty's thread pool? The first step is to set ENABLE_REMOTE_JMX_OPTS="true" in bin/solr.in.sh. This will give me JMX access to JVM properties (garbage collection, class loading etc.) and works fine. However, this will not give me any Jetty specific properties. I've tried manually adding jetty-jmx.xml from the jetty 9 distribution to server/etc/ and then starting Solr with 'java ... start.jar etc/jetty-jmx.xml'. This works fine and gives me access to the right properties, but seems wrong. I could similarly copy the contents of jetty-jmx.xml into jetty.xml but this is not much better either. Is there a correct way for this? Thanks! Georg
Re: Solr join between documents
Ok, thanks for your answer! That's what I thought but just wanted to be sure. Best regards, Elisabeth 2016-05-21 2:02 GMT+02:00 Erick Erickson : > Gosh, I'm not even sure how to start to form such a query. > > Let's see, you have StreetB in some city identified by postal code P. > > Is what you're wanting "return me all pairs of documents within that > postal code that have all the terms matching and the polygons enclosing > those streets plus some distance intersect"? > > Seems difficult. > > Best, > Erick > > On Thu, May 19, 2016 at 8:35 AM, elisabeth benoit > wrote: > > Hello all, > > > > I was wondering if there was a solr solution for a problem I have (and > I'm > > not the only one I guess) > > > > We use solr as a search engine for addresses. We sometimes have requests > > with let's say for instance > > > > street A close to street B City postcode > > > > I was wondering if some kind of join between two documents is possible in > > solr? > > > > The query would be: find union of two documents matching all words in > query. > > > > Those documents have a latitude and a longitude, and we would fix a max > > distance between two documents to be eligible for a join. > > > > Is there a way to do this? > > > > Best regards, > > Elisabeth >
Re: Information for solr-user@lucene.apache.org
And, these response are just weird. Do they mean this user list is obsolete? is solr no longer supported via a user list where we can ask questions? On 5/21/16 9:08 AM, solr-user-h...@lucene.apache.org wrote: Hi! This is the ezmlm program. I'm managing the solr-user@lucene.apache.org mailing list. I'm working for my owner, who can be reached at solr-user-ow...@lucene.apache.org. No information has been provided for this list. --- Administrative commands for the solr-user list --- I can handle administrative requests automatically. Please do not send them to the list address! Instead, send your message to the correct command address: To subscribe to the list, send a message to: To remove your address from the list, send a message to: Send mail to the following for info and FAQ for this list: Similar addresses exist for the digest list: To get messages 123 through 145 (a maximum of 100 per request), mail: To get an index with subject and author for messages 123-456 , mail: They are always returned as sets of 100, max 2000 per request, so you'll actually get 100-499. To receive all messages with the same subject as message 12345, send a short message to: The messages should contain one line or word of text to avoid being treated as sp@m, but I will ignore their content. Only the ADDRESS you send to is important. You can start a subscription for an alternate address, for example "john@host.domain", just add a hyphen and your address (with '=' instead of '@') after the command word: To stop subscription for this address, mail: In both cases, I'll send a confirmation message to that address. When you receive it, simply reply to it to complete your subscription. If despite following these instructions, you do not get the desired results, please contact my owner at solr-user-ow...@lucene.apache.org. Please be patient, my owner is a lot slower than I am ;-) --- Enclosed is a copy of the request I received. Return-Path: Received: (qmail 68327 invoked by uid 99); 21 May 2016 13:08:32 - Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 21 May 2016 13:08:32 + Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 5FE77C223F; Sat, 21 May 2016 13:08:32 + (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.12 X-Spam-Level: X-Spam-Status: No, score=-0.12 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, WEIRD_PORT=0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id f8ZdhY4qqJS5; Sat, 21 May 2016 13:08:31 + (UTC) Received: from mail-yw0-f178.google.com (mail-yw0-f178.google.com [209.85.161.178]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id F1DE85F343; Sat, 21 May 2016 13:08:30 + (UTC) Received: by mail-yw0-f178.google.com with SMTP id x194so133283653ywd.0; Sat, 21 May 2016 06:08:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding; bh=8E8fo6cUZgiwLyigoru6t7Y1eGoLyyrrNsxsrxC7z2Q=; b=Y5in/IeBqx6TN06Rl3dtaYVdW3jqzWm20vW46k+NUr2z2AL9+3qQPx4hgogkk4xfSk RJgHne+Rki1S4qU6+D5pD9QJePw5B+fm9A5bl7oMozl5UFmwWOAAUd41dbX9LBYumo/2 5mIPMvJFS+Ru+1kt9Qd4f8aiIf1jmk8fiHLwLNQ9JKhx7y0vZd2N/Q6+f40jCyi1rFro oEHes13s00riXATsdDV5dIkPd1OVSNC3J+C2Moe5Nn4X9kOsbgul3LpdYiiuIQYcqcuw xz9LFKOwJ3EbCq0GKF+sk4i5UUaZbX7AInS2gHMrdNHkxktBsoU8tr36X05KQ8CA2I89 Sh4Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=8E8fo6cUZgiwLyigoru6t7Y1eGoLyyrrNsxsrxC7z2Q=; b=IFIJieLyb6JCKlIAVy7jZONu18DULolIzqbhaT89wmvTW6KyOVkoYYelnd9PKSOAhK 3R4i5CSKk+Cw0T6YkhF8P1SF/jt9zoRaniuFY1qrxbJOX7M8b7RmAdsTfsq4cZhR7mMn IhWP3Z7yyhgo2RgayUL0z7uQw/jb4ovyoZK/Ryb1Ny7rodkuXcD/kcQPFsEGquF3IEqk BzZrddn7bk0IhmPwurFgsmE2ygXdgz8yaFx71EizW0+rQ73s9lhFkTVguKKAg4AWEKhF QVYqiMHg4ogiZm7jf/6HlnGaWNJvdncO8vbl1vumSTTnz/V0GfTkOOd5h5H6nauJbX6b mIKQ== X-Gm-Message-State: AOPr4FXspV1PleDBfvZ+p
Re: Information for solr-user@lucene.apache.org
Let's try this one (solr-user-digest-subscr...@lucene.apache.org) - maybe a real person will answer there. On 5/21/16 9:09 AM, Carl Roberts wrote: And, these responses are just wierd. Do they mean this user list is obsolete? Is solr no longer supported via a user list where we can ask questions? On 5/21/16 9:08 AM, solr-user-h...@lucene.apache.org wrote: Hi! This is the ezmlm program. I'm managing the solr-user@lucene.apache.org mailing list. I'm working for my owner, who can be reached at solr-user-ow...@lucene.apache.org. No information has been provided for this list. --- Administrative commands for the solr-user list --- I can handle administrative requests automatically. Please do not send them to the list address! Instead, send your message to the correct command address: To subscribe to the list, send a message to: To remove your address from the list, send a message to: Send mail to the following for info and FAQ for this list: Similar addresses exist for the digest list: To get messages 123 through 145 (a maximum of 100 per request), mail: To get an index with subject and author for messages 123-456 , mail: They are always returned as sets of 100, max 2000 per request, so you'll actually get 100-499. To receive all messages with the same subject as message 12345, send a short message to: The messages should contain one line or word of text to avoid being treated as sp@m, but I will ignore their content. Only the ADDRESS you send to is important. You can start a subscription for an alternate address, for example "john@host.domain", just add a hyphen and your address (with '=' instead of '@') after the command word: To stop subscription for this address, mail: In both cases, I'll send a confirmation message to that address. When you receive it, simply reply to it to complete your subscription. If despite following these instructions, you do not get the desired results, please contact my owner at solr-user-ow...@lucene.apache.org. Please be patient, my owner is a lot slower than I am ;-) --- Enclosed is a copy of the request I received. Return-Path: Received: (qmail 68327 invoked by uid 99); 21 May 2016 13:08:32 - Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 21 May 2016 13:08:32 + Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 5FE77C223F; Sat, 21 May 2016 13:08:32 + (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.12 X-Spam-Level: X-Spam-Status: No, score=-0.12 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, WEIRD_PORT=0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id f8ZdhY4qqJS5; Sat, 21 May 2016 13:08:31 + (UTC) Received: from mail-yw0-f178.google.com (mail-yw0-f178.google.com [209.85.161.178]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id F1DE85F343; Sat, 21 May 2016 13:08:30 + (UTC) Received: by mail-yw0-f178.google.com with SMTP id x194so133283653ywd.0; Sat, 21 May 2016 06:08:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding; bh=8E8fo6cUZgiwLyigoru6t7Y1eGoLyyrrNsxsrxC7z2Q=; b=Y5in/IeBqx6TN06Rl3dtaYVdW3jqzWm20vW46k+NUr2z2AL9+3qQPx4hgogkk4xfSk RJgHne+Rki1S4qU6+D5pD9QJePw5B+fm9A5bl7oMozl5UFmwWOAAUd41dbX9LBYumo/2 5mIPMvJFS+Ru+1kt9Qd4f8aiIf1jmk8fiHLwLNQ9JKhx7y0vZd2N/Q6+f40jCyi1rFro oEHes13s00riXATsdDV5dIkPd1OVSNC3J+C2Moe5Nn4X9kOsbgul3LpdYiiuIQYcqcuw xz9LFKOwJ3EbCq0GKF+sk4i5UUaZbX7AInS2gHMrdNHkxktBsoU8tr36X05KQ8CA2I89 Sh4Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=8E8fo6cUZgiwLyigoru6t7Y1eGoLyyrrNsxsrxC7z2Q=; b=IFIJieLyb6JCKlIAVy7jZONu18DULolIzqbhaT89wmvTW6KyOVkoYYelnd9PKSOAhK 3R4i5CSKk+Cw0T6YkhF8P1SF/jt9zoRaniuFY1qrxbJOX7M8b7RmAdsTfsq4cZhR7mMn IhWP3Z7yyhgo2RgayUL0z7uQw/jb4ovyoZK/Ryb1Ny7rodkuXcD/kcQPFsEGquF3IEqk BzZrddn7bk0IhmPwurFgsmE2ygXdgz8yaFx71EizW0+rQ73s9lhFkTVguKKAg4AWEKhF QVYqiMHg4ogiZm7jf/6HlnGaWNJvdncO8vbl1vumSTTnz/V0GfTkOOd5h5H6nauJbX6b mIKQ== X-Gm-Message-State: AOPr4FXspV1PleDBfvZ+pDSRP4LfZeqSLUt
Re: Information for solr-user@lucene.apache.org
Hi Carl, This address is valid, any subscribed user received a copy of your email. solr-user@lucene.apache.org Andrea On 21 May 2016 15:10, "Carl Roberts" wrote: > And, these response are just weird. Do they mean this user list is > obsolete? is solr no longer supported via a user list where we can ask > questions? > > On 5/21/16 9:08 AM, solr-user-h...@lucene.apache.org wrote: > >> Hi! This is the ezmlm program. I'm managing the >> solr-user@lucene.apache.org mailing list. >> >> I'm working for my owner, who can be reached >> at solr-user-ow...@lucene.apache.org. >> >> No information has been provided for this list. >> >> --- Administrative commands for the solr-user list --- >> >> I can handle administrative requests automatically. Please >> do not send them to the list address! Instead, send >> your message to the correct command address: >> >> To subscribe to the list, send a message to: >> >> >> To remove your address from the list, send a message to: >> >> >> Send mail to the following for info and FAQ for this list: >> >> >> >> Similar addresses exist for the digest list: >> >> >> >> To get messages 123 through 145 (a maximum of 100 per request), mail: >> >> >> To get an index with subject and author for messages 123-456 , mail: >> >> >> They are always returned as sets of 100, max 2000 per request, >> so you'll actually get 100-499. >> >> To receive all messages with the same subject as message 12345, >> send a short message to: >> >> >> The messages should contain one line or word of text to avoid being >> treated as sp@m, but I will ignore their content. >> Only the ADDRESS you send to is important. >> >> You can start a subscription for an alternate address, >> for example "john@host.domain", just add a hyphen and your >> address (with '=' instead of '@') after the command word: >> >> >> To stop subscription for this address, mail: >> >> >> In both cases, I'll send a confirmation message to that address. When >> you receive it, simply reply to it to complete your subscription. >> >> If despite following these instructions, you do not get the >> desired results, please contact my owner at >> solr-user-ow...@lucene.apache.org. Please be patient, my owner is a >> lot slower than I am ;-) >> >> --- Enclosed is a copy of the request I received. >> >> Return-Path: >> Received: (qmail 68327 invoked by uid 99); 21 May 2016 13:08:32 - >> Received: from pnap-us-west-generic-nat.apache.org (HELO >> spamd1-us-west.apache.org) (209.188.14.142) >> by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 21 May 2016 13:08:32 >> + >> Received: from localhost (localhost [127.0.0.1]) >> by spamd1-us-west.apache.org (ASF Mail Server at >> spamd1-us-west.apache.org) with ESMTP id 5FE77C223F; >> Sat, 21 May 2016 13:08:32 + (UTC) >> X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org >> X-Spam-Flag: NO >> X-Spam-Score: -0.12 >> X-Spam-Level: >> X-Spam-Status: No, score=-0.12 tagged_above=-999 required=6.31 >> tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, >> RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, >> RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, WEIRD_PORT=0.001] >> autolearn=disabled >> Authentication-Results: spamd1-us-west.apache.org (amavisd-new); >> dkim=pass (2048-bit key) header.d=gmail.com >> Received: from mx1-lw-us.apache.org ([10.40.0.8]) >> by localhost (spamd1-us-west.apache.org [10.40.0.7]) >> (amavisd-new, port 10024) >> with ESMTP id f8ZdhY4qqJS5; Sat, 21 May 2016 13:08:31 + (UTC) >> Received: from mail-yw0-f178.google.com (mail-yw0-f178.google.com >> [209.85.161.178]) >> by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) >> with ESMTPS id F1DE85F343; >> Sat, 21 May 2016 13:08:30 + (UTC) >> Received: by mail-yw0-f178.google.com with SMTP id x194so133283653ywd.0; >> Sat, 21 May 2016 06:08:30 -0700 (PDT) >> DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; >> d=gmail.com; s=20120113; >> >> h=subject:to:references:from:message-id:date:user-agent:mime-version >> :in-reply-to:content-transfer-encoding; >> bh=8E8fo6cUZgiwLyigoru6t7Y1eGoLyyrrNsxsrxC7z2Q=; >> >> b=Y5in/IeBqx6TN06Rl3dtaYVdW3jqzWm20vW46k+NUr2z2AL9+3qQPx4hgogkk4xfSk >> >> RJgHne+Rki1S4qU6+D5pD9QJePw5B+fm9A5bl7oMozl5UFmwWOAAUd41dbX9LBYumo/2 >> >> 5mIPMvJFS+Ru+1kt9Qd4f8aiIf1jmk8fiHLwLNQ9JKhx7y0vZd2N/Q6+f40jCyi1rFro >> >> oEHes13s00riXATsdDV5dIkPd1OVSNC3J+C2Moe5Nn4X9kOsbgul3LpdYiiuIQYcqcuw >> >> xz9LFKOwJ3EbCq0GKF+sk4i5UUaZbX7AInS2gHMrdNHkxktBsoU8tr36X05KQ8CA2I89 >> Sh4Q== >> X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; >> d=1e100.net; s=20130820; >> h=x-gm-message-state:subject:to:references:from:message-id:date >> :user-agent:mime-version:in-reply-to:content-transfer-encoding; >> bh=8E8fo6cUZgiwLyigoru6t7Y1eGoLyyrrNsxsrxC7z2Q=; >> >> b=
Parallel SQL doesn't support >, >=, <, <= syntax?
this gives expected result:
SELECT title_s, COUNT(*) as cnt
FROM movielens
WHERE genre_ss='action' AND rating_i='[4 TO 5]'
GROUP BY title_s
ORDER BY cnt desc
LIMIT 5
but using >= 4 doesn't give same results (my ratings are 1-5):
SELECT title_s, COUNT(*) as cnt
FROM movielens
WHERE genre_ss='action' AND rating_i >= 4
GROUP BY title_s
ORDER BY cnt desc
LIMIT 5
on the Solr side, I see queries forumlated as:
2016-05-21 14:53:43.096 INFO (qtp1435804085-1419) [c:movielens
s:shard1 r:core_node1 x:movielens_shard1_replica1] o.a.s.c.S.Request
[movielens_shard1_replica1] webapp=/solr path=/export
params={q=((genre_ss:"action")+AND+(rating_i:"4"))&distrib=false&fl=title_s&sort=title_s+desc&wt=json&version=2.2}
hits=2044 status=0 QTime=0
which is obviously wrong ... known issue or should I open a JIRA?
In general, rather than crafting an incorrect query that gives the
wrong results, we should throw an exception stating that the syntax is
not supported.
Re: Information for solr-user@lucene.apache.org
On 5/21/2016 7:09 AM, Carl Roberts wrote: > And, these response are just weird. Do they mean this user list is > obsolete? is solr no longer supported via a user list where we can > ask questions? You received one other reply, but that reply was sent to the list, and I do not know if you are subscribed or not. I am sending this directly to you as well as to the list. Your message was sent successfully, as evidenced by the fact that I am replying to it. This is a very active list. So far I have received 798 messages in May 2016 alone. There are a lot of subscribers, but I do not know what the exact number is. The message I am replying to here *did* go to the list, but I do not know how to tell whether it was sent from a subscribed address, or manually released to the list by a moderator. Reading the response you got from ezmlm that you forwarded, it sounds like you tried to send your previous message to both of these addresses, which will not get it to the list: solr-user-i...@lucene.apache.org solr-user-ow...@lucene.apache.org I'm not sure how you inferred that the list is obsolete from the response you included. I don't see anything in that response to indicate that it's dead. To make it to the list without human intervention, your message must be sent from a subscribed address to solr-user@lucene.apache.org. All the details you need to get subscribed to Solr mailing lists is here: http://lucene.apache.org/solr/resources.html#mailing-lists Thanks, Shawn
Re: Parallel SQL doesn't support >, >=, <, <= syntax?
Yes, currently only Solr range syntax is supported. The SQL greater, less
than syntax isn't yet supported.
This isn't explicitly stated in the docs, which would be a good first step.
Supporting SQL greater and less then predicates should not be too
difficult. Feel free to create a jira ticket for this.
Joel Bernstein
http://joelsolr.blogspot.com/
On Sat, May 21, 2016 at 10:55 AM, Timothy Potter
wrote:
> this gives expected result:
>
> SELECT title_s, COUNT(*) as cnt
> FROM movielens
> WHERE genre_ss='action' AND rating_i='[4 TO 5]'
> GROUP BY title_s
> ORDER BY cnt desc
> LIMIT 5
>
> but using >= 4 doesn't give same results (my ratings are 1-5):
>
> SELECT title_s, COUNT(*) as cnt
> FROM movielens
> WHERE genre_ss='action' AND rating_i >= 4
> GROUP BY title_s
> ORDER BY cnt desc
> LIMIT 5
>
> on the Solr side, I see queries forumlated as:
>
> 2016-05-21 14:53:43.096 INFO (qtp1435804085-1419) [c:movielens
> s:shard1 r:core_node1 x:movielens_shard1_replica1] o.a.s.c.S.Request
> [movielens_shard1_replica1] webapp=/solr path=/export
>
> params={q=((genre_ss:"action")+AND+(rating_i:"4"))&distrib=false&fl=title_s&sort=title_s+desc&wt=json&version=2.2}
> hits=2044 status=0 QTime=0
>
> which is obviously wrong ... known issue or should I open a JIRA?
>
> In general, rather than crafting an incorrect query that gives the
> wrong results, we should throw an exception stating that the syntax is
> not supported.
>
Re: Parallel SQL doesn't support >, >=, <, <= syntax?
Also agreed we should throw an exception in this scenario until it's
implemented.
Joel Bernstein
http://joelsolr.blogspot.com/
On Sat, May 21, 2016 at 5:34 PM, Joel Bernstein wrote:
> Yes, currently only Solr range syntax is supported. The SQL greater, less
> than syntax isn't yet supported.
>
> This isn't explicitly stated in the docs, which would be a good first step.
>
> Supporting SQL greater and less then predicates should not be too
> difficult. Feel free to create a jira ticket for this.
>
>
> Joel Bernstein
> http://joelsolr.blogspot.com/
>
> On Sat, May 21, 2016 at 10:55 AM, Timothy Potter
> wrote:
>
>> this gives expected result:
>>
>> SELECT title_s, COUNT(*) as cnt
>> FROM movielens
>> WHERE genre_ss='action' AND rating_i='[4 TO 5]'
>> GROUP BY title_s
>> ORDER BY cnt desc
>> LIMIT 5
>>
>> but using >= 4 doesn't give same results (my ratings are 1-5):
>>
>> SELECT title_s, COUNT(*) as cnt
>> FROM movielens
>> WHERE genre_ss='action' AND rating_i >= 4
>> GROUP BY title_s
>> ORDER BY cnt desc
>> LIMIT 5
>>
>> on the Solr side, I see queries forumlated as:
>>
>> 2016-05-21 14:53:43.096 INFO (qtp1435804085-1419) [c:movielens
>> s:shard1 r:core_node1 x:movielens_shard1_replica1] o.a.s.c.S.Request
>> [movielens_shard1_replica1] webapp=/solr path=/export
>>
>> params={q=((genre_ss:"action")+AND+(rating_i:"4"))&distrib=false&fl=title_s&sort=title_s+desc&wt=json&version=2.2}
>> hits=2044 status=0 QTime=0
>>
>> which is obviously wrong ... known issue or should I open a JIRA?
>>
>> In general, rather than crafting an incorrect query that gives the
>> wrong results, we should throw an exception stating that the syntax is
>> not supported.
>>
>
>
indexing dovecot mailbox
Hello! Bear with me, I am new to solr and everything is very complex. Don't know how the thing is working. I installed solr-5.5.1.tgz and got it running. Try to index a mailbox of dovecot with # bin/post -c myfiles /home/a.meyer/Postfach after I copied solr-schema.xml to /opt/solr/server/solr/myfiles/conf as schema.xml, but no files other than dovecot.index.log and dovecot.mailbox.log are indexed. # bin/post -c myfiles /home/a.meyer/Postfach /usr/lib64/jvm/jre/bin/java -classpath /opt/solr/dist/solr-core-5.5.1.jar -Dauto=yes -Dc=myfiles -Ddata=files -Drecursive=yes org.apache.solr.util.SimplePostTool /home/a.meyer/Postfach SimplePostTool version 5.0.0 Posting files to [base] url http://localhost:8983/solr/myfiles/update... Entering auto mode. File endings considered are xml,json,jsonl,csv,pdf,doc,docx,ppt,pptx,xls,xlsx,odt,odp,ods,ott,otp,ots,rtf,htm,html,txt,log Entering recursive mode, max depth=999, delay=0s Indexing directory /home/a.meyer/Postfach (2 files, depth=0) POSTing file dovecot.index.log (text/plain) to [base]/extract POSTing file dovecot.mailbox.log (text/plain) to [base]/extract Indexing directory /home/a.meyer/Postfach/cur (0 files, depth=1) Indexing directory /home/a.meyer/Postfach/new (0 files, depth=1) Indexing directory /home/a.meyer/Postfach/tmp (0 files, depth=1) 2 files indexed. COMMITting Solr index changes to http://localhost:8983/solr/myfiles/update... Time spent: 0:00:02.976 I was hoping the post command would index the email in /home/a.meyer/Postfach/cur, but it doesn't. The content of this folder looks like this: -rw--- 1 a.meyer users 4764 25. Apr 13:27 1461583672.Vfe03I1000f4M981621.bitmachine1:2,S -rw--- 1 a.meyer users 276318 26. Apr 17:48 1461685694.Vfe03I1000f6M202284.bitmachine1:2,S -rw--- 1 a.meyer users 4578 27. Apr 17:16 1461770179.Vfe03I10010aM756286.bitmachine1:2,S -rw--- 1 a.meyer users 16981 3. Mai 10:12 1462263159.Vfe03I1000c5M88.bitmachine1:2,RS What did I miss? Could need some help with this one. Kind regards Andreas
Re: indexing dovecot mailbox
Hi Meyer, Not sure what "mailbox of dovecot" is, but SimplePostTool can recognize certain file types. They (xml,json,...,log) are actually listed in the log msg in your email. Can you describe the format of the files that you want to index? Are they text files? ahmet On Sunday, May 22, 2016 1:16 AM, Andreas Meyer wrote: Hello! Bear with me, I am new to solr and everything is very complex. Don't know how the thing is working. I installed solr-5.5.1.tgz and got it running. Try to index a mailbox of dovecot with # bin/post -c myfiles /home/a.meyer/Postfach after I copied solr-schema.xml to /opt/solr/server/solr/myfiles/conf as schema.xml, but no files other than dovecot.index.log and dovecot.mailbox.log are indexed. # bin/post -c myfiles /home/a.meyer/Postfach /usr/lib64/jvm/jre/bin/java -classpath /opt/solr/dist/solr-core-5.5.1.jar -Dauto=yes -Dc=myfiles -Ddata=files -Drecursive=yes org.apache.solr.util.SimplePostTool /home/a.meyer/Postfach SimplePostTool version 5.0.0 Posting files to [base] url http://localhost:8983/solr/myfiles/update... Entering auto mode. File endings considered are xml,json,jsonl,csv,pdf,doc,docx,ppt,pptx,xls,xlsx,odt,odp,ods,ott,otp,ots,rtf,htm,html,txt,log Entering recursive mode, max depth=999, delay=0s Indexing directory /home/a.meyer/Postfach (2 files, depth=0) POSTing file dovecot.index.log (text/plain) to [base]/extract POSTing file dovecot.mailbox.log (text/plain) to [base]/extract Indexing directory /home/a.meyer/Postfach/cur (0 files, depth=1) Indexing directory /home/a.meyer/Postfach/new (0 files, depth=1) Indexing directory /home/a.meyer/Postfach/tmp (0 files, depth=1) 2 files indexed. COMMITting Solr index changes to http://localhost:8983/solr/myfiles/update... Time spent: 0:00:02.976 I was hoping the post command would index the email in /home/a.meyer/Postfach/cur, but it doesn't. The content of this folder looks like this: -rw--- 1 a.meyer users 4764 25. Apr 13:27 1461583672.Vfe03I1000f4M981621.bitmachine1:2,S -rw--- 1 a.meyer users 276318 26. Apr 17:48 1461685694.Vfe03I1000f6M202284.bitmachine1:2,S -rw--- 1 a.meyer users 4578 27. Apr 17:16 1461770179.Vfe03I10010aM756286.bitmachine1:2,S -rw--- 1 a.meyer users 16981 3. Mai 10:12 1462263159.Vfe03I1000c5M88.bitmachine1:2,RS What did I miss? Could need some help with this one. Kind regards Andreas
Re: indexing dovecot mailbox
Hi, You might be also interested in the MailEntityProcessor of DataImportHandler. https://cwiki.apache.org/confluence/display/solr/Uploading+Structured+Data+Store+Data+with+the+Data+Import+Handler#UploadingStructuredDataStoreDatawiththeDataImportHandler-EntityProcessors On Sunday, May 22, 2016 3:46 AM, Ahmet Arslan wrote: Hi Meyer, Not sure what "mailbox of dovecot" is, but SimplePostTool can recognize certain file types. They (xml,json,...,log) are actually listed in the log msg in your email. Can you describe the format of the files that you want to index? Are they text files? ahmet On Sunday, May 22, 2016 1:16 AM, Andreas Meyer wrote: Hello! Bear with me, I am new to solr and everything is very complex. Don't know how the thing is working. I installed solr-5.5.1.tgz and got it running. Try to index a mailbox of dovecot with # bin/post -c myfiles /home/a.meyer/Postfach after I copied solr-schema.xml to /opt/solr/server/solr/myfiles/conf as schema.xml, but no files other than dovecot.index.log and dovecot.mailbox.log are indexed. # bin/post -c myfiles /home/a.meyer/Postfach /usr/lib64/jvm/jre/bin/java -classpath /opt/solr/dist/solr-core-5.5.1.jar -Dauto=yes -Dc=myfiles -Ddata=files -Drecursive=yes org.apache.solr.util.SimplePostTool /home/a.meyer/Postfach SimplePostTool version 5.0.0 Posting files to [base] url http://localhost:8983/solr/myfiles/update... Entering auto mode. File endings considered are xml,json,jsonl,csv,pdf,doc,docx,ppt,pptx,xls,xlsx,odt,odp,ods,ott,otp,ots,rtf,htm,html,txt,log Entering recursive mode, max depth=999, delay=0s Indexing directory /home/a.meyer/Postfach (2 files, depth=0) POSTing file dovecot.index.log (text/plain) to [base]/extract POSTing file dovecot.mailbox.log (text/plain) to [base]/extract Indexing directory /home/a.meyer/Postfach/cur (0 files, depth=1) Indexing directory /home/a.meyer/Postfach/new (0 files, depth=1) Indexing directory /home/a.meyer/Postfach/tmp (0 files, depth=1) 2 files indexed. COMMITting Solr index changes to http://localhost:8983/solr/myfiles/update... Time spent: 0:00:02.976 I was hoping the post command would index the email in /home/a.meyer/Postfach/cur, but it doesn't. The content of this folder looks like this: -rw--- 1 a.meyer users 4764 25. Apr 13:27 1461583672.Vfe03I1000f4M981621.bitmachine1:2,S -rw--- 1 a.meyer users 276318 26. Apr 17:48 1461685694.Vfe03I1000f6M202284.bitmachine1:2,S -rw--- 1 a.meyer users 4578 27. Apr 17:16 1461770179.Vfe03I10010aM756286.bitmachine1:2,S -rw--- 1 a.meyer users 16981 3. Mai 10:12 1462263159.Vfe03I1000c5M88.bitmachine1:2,RS What did I miss? Could need some help with this one. Kind regards Andreas
