Scale out postgresql

2019-03-28 Thread Mariel Cherkassky
Hey,
I was searching for a solution to scale my postgresql instance in the
cloud. I'm aware of that that I can create many read only replicas in the
cloud and it would improve my reading performance. I wanted to hear what
solution are you familiar with ? Are there any sharding solution that are
commonly used (citus ? pg_shard ?) My instance has many dbs (one per
customer) and big customers can generate a load of load on others..



Thanks.


Re: Scale out postgresql

2019-03-28 Thread Sam R.
Hi!
With following kinds of keywords, it is possible to find / search for cloud 
native (SQL) implementations e.g. with google: 
cloud native sql database
E.g. CockroachDB, YugaByteDB.
I do not know are you planning to do it by other means (by yourself).
I myself would be interested, has someone had experiences with such? Is HA 
provided "ready made? Is HA working fine and does it recover/handle all 
situations well, or is additional algorithms needed to be implemented in 
addition on top e.g. for automatic recovery (by "myself").
I could start an other email chain, if this chain is meant more for something 
else.
Best RegardsSam

 
 
  On to, maalisk. 28, 2019 at 12:10, Mariel 
Cherkassky wrote:   Hey,I was searching for a 
solution to scale my postgresql instance in the cloud. I'm aware of that that I 
can create many read only replicas in the cloud and it would improve my reading 
performance. I wanted to hear what solution are you familiar with ? Are there 
any sharding solution that are commonly used (citus ? pg_shard ?) My instance 
has many dbs (one per customer) and big customers can generate a load of load 
on others..


Thanks.  


Re: Scale out postgresql

2019-03-28 Thread Mariel Cherkassky
Hey Sam,
Are you familiar with scale solutions that arent in the cloud ?

‫בתאריך יום ה׳, 28 במרץ 2019 ב-18:10 מאת ‪Sam R.‬‏ <‪[email protected]
‬‏>:‬

> Hi!
>
> With following kinds of keywords, it is possible to find / search for
> cloud native (SQL) implementations e.g. with google:
>
> cloud native sql database
>
> E.g. CockroachDB, YugaByteDB.
>
> I do not know are you planning to do it by other means (by yourself).
>
> I myself would be interested, has someone had experiences with such? Is HA
> provided "ready made? Is HA working fine and does it recover/handle all
> situations well, or is additional algorithms needed to be implemented in
> addition on top e.g. for automatic recovery (by "myself").
>
> I could start an other email chain, if this chain is meant more for
> something else.
>
> Best Regards
> Sam
>
>
> On to, maalisk. 28, 2019 at 12:10, Mariel Cherkassky
>  wrote:
> Hey,
> I was searching for a solution to scale my postgresql instance in the
> cloud. I'm aware of that that I can create many read only replicas in the
> cloud and it would improve my reading performance. I wanted to hear what
> solution are you familiar with ? Are there any sharding solution that are
> commonly used (citus ? pg_shard ?) My instance has many dbs (one per
> customer) and big customers can generate a load of load on others..
>
>
>
> Thanks.
>
>


Re: Scale out postgresql

2019-03-28 Thread Sumedh Pathak
Disclaimer, I work for Citus Data.

You can check out www.citusdata.com. We aim to scale 
out PostgreSQL, and offer it both in the cloud and on-prem. Happy to put you in 
touch with the right people if you have more questions.

Thanks,
Sumedh


From: Mariel Cherkassky 
Sent: Thursday, March 28, 2019 9:19 AM
To: [email protected]
Cc: PostgreSQL mailing lists
Subject: Re: Scale out postgresql

Hey Sam,
Are you familiar with scale solutions that arent in the cloud ?

‫בתאריך יום ה׳, 28 במרץ 2019 ב-18:10 מאת ‪Sam R.‬‏ 
<‪[email protected]‬‏>:‬
Hi!

With following kinds of keywords, it is possible to find / search for cloud 
native (SQL) implementations e.g. with google:

cloud native sql database

E.g. CockroachDB, YugaByteDB.

I do not know are you planning to do it by other means (by yourself).

I myself would be interested, has someone had experiences with such? Is HA 
provided "ready made? Is HA working fine and does it recover/handle all 
situations well, or is additional algorithms needed to be implemented in 
addition on top e.g. for automatic recovery (by "myself").

I could start an other email chain, if this chain is meant more for something 
else.

Best Regards
Sam


On to, maalisk. 28, 2019 at 12:10, Mariel Cherkassky
mailto:[email protected]>> wrote:
Hey,
I was searching for a solution to scale my postgresql instance in the cloud. 
I'm aware of that that I can create many read only replicas in the cloud and it 
would improve my reading performance. I wanted to hear what solution are you 
familiar with ? Are there any sharding solution that are commonly used (citus ? 
pg_shard ?) My instance has many dbs (one per customer) and big customers can 
generate a load of load on others..



Thanks.


Re: LIMIT OFFSET with DB view vs plain SQL

2019-03-28 Thread Raj Gandhi
+ pgsql-performance

On Thu, Mar 28, 2019 at 6:41 PM Raj Gandhi  wrote:

> Hi everyone,
>
>
>
> I’m using LIMIT offset with DB view. Looks like query planner is applying
> the LIMIT for DB view at the end after processing all rows.
>
> When running same SQL that was used to create the DB view, LIMIT is
> applied earlier so the query is much faster.
>
>
>
> Explain plan using DB view
>
> https://explain.depesz.com/s/gzjQ
>
>
>
> Explain plan using raw SQL
>
> https://explain.depesz.com/s/KgwO
>
>
>
> In both tests LIMIT was 100 with offset  = 0.
>
> Is there any way to force DB view to apply limit earlier?
>
>
>
> Thanks,
>
> Raj
>