Hardware for writing/updating 12,000,000 rows per hour
Would it be possible to achieve 12,000,000 writes/updates on a single server? If so what kind of hardware should I be looking for?
Re: Hardware for writing/updating 12,000,000 rows per hour
As most about 2000 characters. On Fri, Jul 26, 2019 at 3:03 PM Ron wrote: > On 7/26/19 2:56 PM, Arya F wrote: > > Would it be possible to achieve 12,000,000 writes/updates on a single > > server? If so what kind of hardware should I be looking for? > > That's only 3,333 modifications/second. How big are your records? > > -- > Angular momentum makes the world go 'round. > > >
Re: Hardware for writing/updating 12,000,000 rows per hour
On Fri, Jul 26, 2019 at 3:24 PM Tom Lane wrote: > [ please don't top-post ] > > Arya F writes: > > On Fri, Jul 26, 2019 at 3:03 PM Ron wrote: > >> On 7/26/19 2:56 PM, Arya F wrote: > >>> Would it be possible to achieve 12,000,000 writes/updates on a single > >>> server? If so what kind of hardware should I be looking for? > > >> That's only 3,333 modifications/second. How big are your records? > > > As most about 2000 characters. > > Do you need 3K independent commits per second? Or can you batch them? > Even just turning off synchronous_commit would move the goalposts > pretty far in terms of the storage hardware you'll need for this. > > regards, tom lane > I think I can modify my application to do a batch update. Right now the server has an HDD and it really can't handle a lot of updates and inserts per second. Would changing to a regular SSD be able to easily do 3000 updates per second?
Re: Hardware for writing/updating 12,000,000 rows per hour
On Sat, Jul 27, 2019 at 11:49 AM farjad.farid < farjad.fa...@checknetworks.com> wrote: > With this kind of design requirements it is worth considering hardware > "failure & recovery". Even SSDs can and do fail. > > It is not just a matter of just speed. RAID disks of some kind, depending > on the budget is worth the effort. > > > > -Original Message- > From: Alvaro Herrera > Sent: 2019 July 26 22:39 > To: Arya F > Cc: Tom Lane ; Ron ; > pgsql-general@lists.postgresql.org > Subject: Re: Hardware for writing/updating 12,000,000 rows per hour > > On 2019-Jul-26, Arya F wrote: > > > I think I can modify my application to do a batch update. Right now > > the server has an HDD and it really can't handle a lot of updates and > > inserts per second. Would changing to a regular SSD be able to easily > > do 3000 updates per second? > > That's a pretty hard question in isolation -- you need to consider how > many indexes are there to update, whether the updated columns are indexed > or not, what the datatypes are, how much locality of access you'll have ... > I'm probably missing some other important factors. (Of course, you'll have > to tune various PG server settings to find your sweet spot.) > > I suggest that should be measuring instead of trying to guess. A > reasonably cheap way is to rent a machine somewhere with the type of > hardware you think you'll need, and run your workload there for long > enough, making sure to carefully observe important metrics such as table > size, accumulated bloat, checkpoint regime, overall I/O activity, and so on. > > -- > Álvaro Herrerahttps://www.2ndQuadrant.com/ > PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services > > > Hi Farjad I was thinking of having physical or logical replication. Or is having RAID a must if I don't want to lose data?
will postgresql-12-postgis-2.5 become available in the postgres repository?
Hello Everyone I installed Postgresql 11 using the Postgresql apt repository listed below deb http://apt.postgresql.org/pub/repos/apt/ buster-pgdg main and I was also able to install postgresql-11-postgis-2.5 I have now installed Postgresql 12, but no package named postgresql-12-postgis-2.5 exists yet. Will this package soon become available in the postgres apt repository?
