Re: pg_upgrade: can I use same binary for old & new?

2025-07-05 Thread Ron Johnson
On Sat, Jul 5, 2025 at 3:19 PM Pierre Fortin wrote: > On Sat, 05 Jul 2025 14:30:20 -0400 Tom Lane wrote: > > Forgive my ignorance; always trying to learn more... :) > > >p...@pfortin.com writes: > >> On Sat, 5 Jul 2025 11:11:32 -0700 Adrian Klaver wrote: > >>> How did you measure above? > > > >>

Re: pg_upgrade: can I use same binary for old & new?

2025-07-05 Thread Ron Johnson
On Sat, Jul 5, 2025 at 2:24 PM wrote: > On Sat, 5 Jul 2025 11:11:32 -0700 Adrian Klaver wrote: > > >On 7/5/25 09:52, Pierre Fortin wrote: > > >> Wanting to upgrade from: > >> PostgreSQL 15.13 on x86_64-mageia-linux-gnu, > >> compiled by gcc (Mageia 15.1.0-1.mga10) 15.1.0, 64-bit > >> to: > >> PG

Re: pg_upgrade: can I use same binary for old & new?

2025-07-05 Thread Ron Johnson
On Sat, Jul 5, 2025 at 2:11 PM Adrian Klaver wrote: > On 7/5/25 09:52, Pierre Fortin wrote: > > Hi, > > > > [Hope this gets through after dumping DKIM-ignorant mail provider.] > > > > Wanting to upgrade from: > > PostgreSQL 15.13 on x86_64-mageia-linux-gnu, > > compiled by gcc (Mageia 15.1.0-1.mg

Re: Corrupt btree index includes rows that don't match

2025-07-04 Thread Ron Johnson
On Fri, Jul 4, 2025 at 9:49 AM Erik Johnston wrote: > Hi, a quick update: > > - We have discovered that the corruption was present from before libicu > update. > - We ran `pg_amcheck --index state_groups_state_type_idx --heapallindexed > matrix`, which returned nothing > - We believe that means t

Re: Corrupt btree index includes rows that don't match

2025-07-04 Thread Ron Johnson
On Fri, Jul 4, 2025 at 5:50 AM wrote: > > One coincidence is that we started seeing the first symptoms of this > > around the same time as libicu was updated with a security patch. > > However, postgres hasn’t been restarted and doesn’t reference the > > new version in its process maps. Plus stat

Re: PLPGSQL - store fetched records in array of record

2025-07-02 Thread Ron Johnson
On Wed, Jul 2, 2025 at 8:21 AM Durumdara wrote: > Hello! > > I have to store some fetched records into two lists (arrays) to work with > them. > There's almost certainly a way to do what you need done without using arrays. Might require a bit of rethinking, though. -- Death to , and butter sa

Re: Simulate a PITR in postgresql 16

2025-06-30 Thread Ron Johnson
Using PgBackRest might be more convenient, since it handles everything you need, is multithreaded, never removes too many wal files, compresses files if you want and also encrypts them if you want. (In 2025, I also leave pg_wal on the same mount point as data/. Disk space is plentiful and it's ju

Re: password rules

2025-06-28 Thread Ron Johnson
On Sat, Jun 28, 2025 at 9:59 AM Peter J. Holzer wrote: > On 2025-06-27 19:00:36 +0200, raphi wrote: > > > > > > Am 26.06.2025 um 14:27 schrieb Peter J. Holzer: > > > On 2025-06-25 17:55:12 +0200, raphi wrote: > > > > Am 25.06.2025 um 17:33 schrieb Peter J. Holzer: > > > > > On 2025-06-25 14:42:26

Re: analyze-in-stages post upgrade questions

2025-06-27 Thread Ron Johnson
On Fri, Jun 27, 2025 at 9:35 AM Zechman, Derek S wrote: > > > We recently performed an upgrade from pg14 (14.18) to pg16 (16.9) and > performed the analyze-in-stages post upgrade. It has been noticed that > some plans changed to use hash joins instead of nested loops. Further > investigation fo

Re: Retrieving current date

2025-06-19 Thread Ron Johnson
On Thu, Jun 19, 2025 at 2:23 AM sivapostg...@yahoo.com < sivapostg...@yahoo.com> wrote: > Hello, > May be a very basic question. We all here are new to Linux / PostgreSQL > > Ubuntu Server 22.04 > PostgreSQL 15 > PgAdmin4 6.16 > > When I run the following query in pg_admin > > Select today_now >

Re: db maintanance problem VACUUM FULL

2025-06-12 Thread Ron Johnson
On Thu, Jun 12, 2025 at 9:24 AM Laurenz Albe wrote: > On Thu, 2025-06-12 at 15:14 +0200, Pavol Sekeres wrote: > > We recently updated our production database to PostgreSQL 12.22 from the > 9.6.24 version. > > We didn't want to make a big jump. > > But you should have. v12 is out of support. > T

Re: db maintanance problem VACUUM FULL

2025-06-12 Thread Ron Johnson
On Thu, Jun 12, 2025 at 9:14 AM Pavol Sekeres wrote: > Hi, > > We recently updated our production database to PostgreSQL 12.22 from the > 9.6.24 version. > Will you soon make another jump to a supported version? > We didn't want to make a big jump. > It is around 2 TB in size with one stand-by

Re: Is it correct to raise an exception in a domain check

2025-06-10 Thread Ron Johnson
On Tue, Jun 10, 2025 at 4:53 PM Logan Grosz wrote: > Hi, > > I have a `DOMAIN` on `JSONB`. I need to verify the shape of the JSON, so I > have a check expression written in PL/pgSQL. The docs say > > > Each constraint must be an expression producing a Boolean result > > Would it be correct to rai

Re: Regarding fillfactor use case for only delete ops

2025-06-07 Thread Ron Johnson
On Sat, Jun 7, 2025 at 7:53 AM Laurenz Albe wrote: > On Fri, 2025-06-06 at 09:59 -0400, Ron Johnson wrote: > > On Fri, Jun 6, 2025 at 8:57 AM Laurenz Albe > wrote: > > > On Fri, 2025-06-06 at 14:10 +0530, Durgamahesh Manne wrote: > > > > Can we generate a fill f

Re: Regarding fillfactor use case for only delete ops

2025-06-06 Thread Ron Johnson
On Fri, Jun 6, 2025 at 4:36 AM Durgamahesh Manne wrote: > Hi Team > > Can we generate a fill factor for tables that have delete ops ? > > Does the fill factor really work and help to minimize the bloat for tables > that have delete ops? > > I have parent table with weekly partitions So for every

Re: Regarding fillfactor use case for only delete ops

2025-06-06 Thread Ron Johnson
On Fri, Jun 6, 2025 at 8:57 AM Laurenz Albe wrote: > On Fri, 2025-06-06 at 14:10 +0530, Durgamahesh Manne wrote: > > Can we generate a fill factor for tables that have delete ops ? > > > > Does the fill factor really work and help to minimize the bloat for > tables that have delete ops? > > > > I

Re: Sudden increase in n_dead_tup with no corresponding insert/update/delete

2025-06-04 Thread Ron Johnson
Note also that 15.6 is about 18 months old. Upgrading really does only take a few minutes, if you download the binaries before installation. On Wed, Jun 4, 2025 at 2:37 PM Matthew Tice wrote: > > > On Jun 3, 2025, at 6:23 PM, David Rowley wrote: > > > > On Wed, 4 Jun 2025 at 07:22, Matthew Tic

Re: Yet more ROLE changes in v18 beta1???

2025-06-04 Thread Ron Johnson
On Wed, Jun 4, 2025 at 1:53 PM Adrian Klaver wrote: > > > On 6/4/25 9:39 AM, Dominique Devienne wrote: > > On Wed, Jun 4, 2025 at 5:29 PM Adrian Klaver > wrote: > >>> $ ./myruntests.csh tests_pdgm_schemas -t "..." --pq-version > >>> Connected to ... (17.4, server 18.0) > >> > >> What is '(17.4,

Re: Changing a varchar(7) domain into text directly in pg_type

2025-05-28 Thread Ron Johnson
Foreign key "code tables" are ubiquitous in good database design; another example is zip/postal codes and cities. Statuses are another standard usage. Thus, what you're doing is absolutely bog-standard. (In your case, I would add "taxonomy_edition" to the species table. You get more information

Re: get speed help

2025-05-19 Thread Ron Johnson
Hi, > I mean any manual > I have a small code, that searches some 1 billion records in 1 > seconds thru index simple case -- I want to test that with postgres > > > On Mon, May 19, 2025 at 10:14 PM Ron Johnson > wrote: > >> Spinning rust? SSD? NVMe? SATA? SCSI

Re: get speed help

2025-05-19 Thread Ron Johnson
small table > indexed on that char - 20 field , say 16 gb ram, amd normal power processor > no parallel processing, to know it, the speed in single processor > > On Mon, May 19, 2025 at 9:55 PM Ron Johnson > wrote: > >> On Mon, May 19, 2025 at 12:12 PM Dias Thomas >> wr

Re: get speed help

2025-05-19 Thread Ron Johnson
On Mon, May 19, 2025 at 12:12 PM Dias Thomas wrote: > Hello all, > Could i get a help, postgres 1 billion records indexed table, search > speed in a normal machine, no parallel processing ... for a knowledge ?? > 1. How big are the records? 2. How big are the keys? 3. What is a normal machine?

Re: Upgrading PG11 to PG17 without dump/restore

2025-05-01 Thread Ron Johnson
On Thu, May 1, 2025 at 9:06 AM Durumdara wrote: > Hello! > > There is a heavily used server, with older debian, and PG11. > The data is more than 1,2 TB. > The PG_Upgrade is not possible because of lesser space and too old debian. > > As we see now we have only one way to move this server. > 1.)

Re: Index not used in certain nested views but not in others

2025-04-30 Thread Ron Johnson
On Wed, Apr 30, 2025 at 3:51 PM Markus Demleitner < msdem...@ari.uni-heidelberg.de> wrote: > Dear List, > > I know how tedious mails with a subject of the type "I don't understand > what the planner does" are, but on this one I'm really stumped. > Regrettably, the situation is also a bit complex.

Re: Changing default fillfactor for the whole database

2025-04-27 Thread Ron Johnson
On Sat, Apr 26, 2025 at 10:31 PM Marcelo Fernandes wrote: > Hi there, > > I have a scenario where virtually all user tables in the database will > need to > have a lower fill factor. > > It would have been handy to have a way to set this default, but as of now, > I > don't think the default can b

Re: Order of update

2025-04-20 Thread Ron Johnson
On Sun, Apr 20, 2025 at 5:35 AM Thiemo Kellner wrote: > Very interesting. But is the sort overhead worth it? Why not make the > constraint deferrable before the update and switch back afterwards? > The role which runs the UPDATE might not have the priv to ALTER TABLE ... ALTER CONSTRAINT. -- D

Re: verify checksums online

2025-04-18 Thread Ron Johnson
On Fri, Apr 18, 2025 at 5:18 PM Jeremy Schneider wrote: > i should know the answer to this... but asking anyway > > i think there had been some mailing list discussions years ago? the > pg_checksum utility in core still can't do an online check right? > https://www.postgresql.org/docs/17/app-pgc

Re: Cannot turn track_counts on

2025-04-17 Thread Ron Johnson
On Thu, Apr 17, 2025 at 5:13 AM Anton Shepelev wrote: > Daniel Gustafsson: > > > Also, is this by any chance a managed instance like Amazon > > RDS or Azure, or is it a local database under your > > control? > > It is a normal installation on a Linux machine, and my > company has full root access

Re: Best Tool for PostgreSQL Auditing and Storing Audit Logs Separately

2025-04-16 Thread Ron Johnson
On Wed, Apr 16, 2025 at 3:42 PM Nico Williams wrote: > On Wed, Apr 16, 2025 at 02:43:59PM -0400, Ron Johnson wrote: > > You'll have to bring that up with the PgAudit maintainer. Note, though, > > that the purpose of PgAudit is not "recreate the database from audi

Re: Best Tool for PostgreSQL Auditing and Storing Audit Logs Separately

2025-04-16 Thread Ron Johnson
On Wed, Apr 16, 2025 at 3:15 PM Achilleas Mantzios < a.mantz...@cloud.gatewaynet.com> wrote: > On 16/4/25 21:43, Ron Johnson wrote: > > > You'll have to bring that up with the PgAudit maintainer. Note, though, > that the purpose of PgAudit is not "recreate the da

Re: Best Tool for PostgreSQL Auditing and Storing Audit Logs Separately

2025-04-16 Thread Ron Johnson
n Wed, Apr 16, 2025 at 1:35 PM Achilleas Mantzios < a.mantz...@cloud.gatewaynet.com> wrote: > On 16/4/25 15:36, Ron Johnson wrote: > > > pgaudit is statement-level, not transaction-level; that's its nature. > This is the same as log_statement. > > ok, but log_statement p

Re: Best Tool for PostgreSQL Auditing and Storing Audit Logs Separately

2025-04-16 Thread Ron Johnson
pgaudit is statement-level, not transaction-level; that's its nature. This is the same as log_statement. On Wed, Apr 16, 2025 at 5:10 AM Achilleas Mantzios - cloud < a.mantz...@cloud.gatewaynet.com> wrote: > On 4/15/25 12:14, KENAN ÇİFTÇİ wrote: > > Hi, > > You can use pgaudit and pgauditlogtofi

Re: Fwd: Identify system databases

2025-04-15 Thread Ron Johnson
On Tue, Apr 15, 2025 at 3:11 PM Tom Lane wrote: > "David G. Johnston" writes: > > On Tue, Apr 15, 2025 at 11:20 AM Adrian Klaver < > adrian.kla...@aklaver.com> > > wrote: > >> If what you say is true why does initdb lack an option to not create > >> them on creating a cluster? > > > By creating

Re: To take backup of Postgresql Database without large objects

2025-04-11 Thread Ron Johnson
On Fri, Apr 11, 2025 at 8:56 AM sivapostg...@yahoo.com < sivapostg...@yahoo.com> wrote: > Hello, > > Using PostgreSQL 15.1, compiled by Visual C++ build 1914, 64-bit in > Windows 10. > That's 11 patch releases behind current. > Trying to take backup of a database, using pg_dump, where one table

Re: Archive logging not cleaning up pg_wal directory

2025-04-10 Thread Ron Johnson
On Thu, Apr 10, 2025 at 8:29 AM Justin Swanhart wrote: > Hi, > > I have the following in my postgresql.conf for archive logging: > archive_command='test ! -f /var/lib/postgresql/prod_archive_logs/%f && cp > %p /var/lib/postgresql/prod_archive_logs/%f' > > This command is properly copying the log

Re: PgBackRest fails due to filesystem full

2025-04-09 Thread Ron Johnson
Try creating a new stanza, and doing a full backup from it. On Wed, Apr 9, 2025 at 1:49 AM KK CHN wrote: > > > On Tue, Apr 8, 2025 at 10:28 PM Greg Sabino Mullane > wrote: > >> On Mon, Apr 7, 2025 at 5:32 AM KK CHN wrote: >> >>> *ERROR: [082]: WAL segment 000101EB00*4B was not arch

Re: Wal file query

2025-04-08 Thread Ron Johnson
You cannot connect to the Primary while connected to the Replica, except via postgres_fdw. Even then, it might not work, since the replica replicates _fdw definitions. These exist on the primary: pg_current_wal_lsn() pg_replication_slots pg_stat_replication These exist on the replica: pg_last_

Re: Any industry best practise to overcome this specific malware "pg_mem"

2025-04-05 Thread Ron Johnson
On Wed, Apr 2, 2025 at 11:31 AM Adrian Klaver wrote: > On 4/2/25 08:18, Bharani SV-forum wrote: > > Hello MVP's > > Good Morning > > Any industry best practise to overcome this specific malware "pg_mem". > > > > url = > > > https://www.aquasec.com/blog/pg_mem-a-malware-hidden-in-the-postgres-proc

Re: Bloated toast table with empty associated table

2025-04-05 Thread Ron Johnson
On Thu, Mar 20, 2025 at 7:40 AM Paul Allen wrote: > Hello. > > Preconditions. > > I have some empty table and constantly try to execute `insert ... on > conflict do update ...` on it. My data in row which I try to insert is > invalid by violation of foreing key constraint, so I am getting error >

Re: Performance issues during pg_restore -j with big partitioned table

2025-04-04 Thread Ron Johnson
On Wed, Apr 2, 2025 at 1:32 PM Dimitrios Apostolou wrote: > Hello list. > > My database includes one table with 1000 partitions, all of them rather > sizeable. I run: > >pg_restore -j12 --no-tablespaces --disable-triggers --exit-on-error > --no-owner --no-privileges -n public -d newdb custom_

Re: Issue installing postgis on RHEL9

2025-04-02 Thread Ron Johnson
On Wed, Apr 2, 2025 at 12:29 PM Danny Im wrote: > Hello, > > I am having issues trying to install the postgis30_13 package on a RHEL9 > host. Attempting to install the package gives me this error: > > $ sudo dnf install postgis30_13 > Updating Subscription Management repositories. > Zabbix 6.0 LT

Re: BTREE index: field ordering

2025-03-28 Thread Ron Johnson
On Fri, Mar 28, 2025 at 9:35 AM Laurenz Albe wrote: > On Fri, 2025-03-28 at 13:38 +0100, Moreno Andreo wrote: > > Postgres 16.4 (planning to go on 17.4) > > I'm creating some indexes based on some slow query reported by logs. > > These queries involve a WHERE with more than 5 fields, that are

Re: size of attributes table is too big

2025-03-25 Thread Ron Johnson
a table with size over 500GB. It is going to take a couple of hours I > presume. > > Also, I hope aggressive vacuuming will prevent us from this situation. > > Regards > Siraj > > > > > On Wed, Mar 19, 2025 at 11:27 PM Ron Johnson > wrote: > >> On Wed, M

Re: Experience and feedback on pg_restore --data-only

2025-03-24 Thread Ron Johnson
Why are you regularly having emergencies requiring the restoration of multi-TB tables to databases with lots of cruft? Fixing that would go a long way towards eliminating your problems with pg_restore. On Mon, Mar 24, 2025 at 11:51 AM Dimitrios Apostolou wrote: > On Mon, 24 Mar 2025, Adrian Kla

Re: Experience and feedback on pg_restore --data-only

2025-03-21 Thread Ron Johnson
On Fri, Mar 21, 2025 at 2:36 PM Dimitrios Apostolou wrote: > On Thu, 20 Mar 2025, Dimitrios Apostolou wrote: > > > Rationale: > > > > When restoring a backup in an emergency situation, it's fine to run > > pg_restore as superuser and get an exact replica of the dumped db. > How often do you have

Re: Export operation efficiency in read replica

2025-03-20 Thread Ron Johnson
On Thu, Mar 20, 2025 at 7:52 AM Siraj G wrote: > Hello Experts! > > I have a DB with 1TB in size serving needs of one of our critical > applications. I have a requirement to take export of the DB on a daily > basis, but want to carry out this operation in read replica. The postgresql > version is

Re: Bloated toast table with empty associated table

2025-03-20 Thread Ron Johnson
records. And... it did just that. But what *must* PG do when it discovers a constraint violation 99% of the way through inserting those 100 records? That's right: remove the records. Thus, you get bloat. > On Thu, Mar 20, 2025 at 4:28 PM Ron Johnson > wrote: > > > > On Th

Re: Bloated toast table with empty associated table

2025-03-20 Thread Ron Johnson
ot;vacuumdb -d the_db -t > controlzone_passage". How often you run it depends on how quickly it > bloats. > > Seems like it is the only solution for now. > The autovacuum daemon can't know/see everything. > On Thu, Mar 20, 2025 at 4:03 PM Ron Johnson > wrote: &

Re: size of attributes table is too big

2025-03-19 Thread Ron Johnson
On Wed, Mar 19, 2025 at 1:06 PM Siraj G wrote: > Hello! > > I have a PG (v16) instance which is occupying around 1TB of storage. Out > of this, around 350GB is occupied by the table pg_catalog.pg_attribute. > Why is the catalog table's size so big? > > Here are the sizes: > > pg_attribute > 338 G

Re: Cannot pg_dump_all anymore...

2025-03-18 Thread Ron Johnson
On Tue, Mar 18, 2025 at 5:14 AM E-BLOKOS wrote: > I got this error: > > pg_dump: error: query returned 0 rows instead of one: EXECUTE > dumpBaseType('794978') > > any clue to solve it? > PG version? Whole command line, including all error messages? -- Death to , and butter sauce. Don't boil m

Re: Creating a new database on a different file system

2025-03-17 Thread Ron Johnson
On Mon, Mar 17, 2025 at 4:30 PM Laurenz Albe wrote: > On Mon, 2025-03-17 at 14:33 -0400, Ron Johnson wrote: > > On Mon, Mar 17, 2025 at 11:18 AM Laurenz Albe > wrote: > > > On Mon, 2025-03-17 at 15:51 +0100, Luca Ferrari wrote: > > > > On Mon, Mar 17, 2025 at

Re: Creating a new database on a different file system

2025-03-17 Thread Ron Johnson
On Mon, Mar 17, 2025 at 11:18 AM Laurenz Albe wrote: > On Mon, 2025-03-17 at 15:51 +0100, Luca Ferrari wrote: > > On Mon, Mar 17, 2025 at 3:49 PM Ian Dauncey > wrote: > > > We have created a few databases on the file system defined in the > postgresql.conf, > > > but now I would like to create a

Re: #1 - Known bug (memory related) with respect to Aurora postgresql 13.16.3

2025-03-17 Thread Ron Johnson
Aurora is very nonstandard. Thus, "we" don't support it. Having said that... "report running out of memory" smells like work_mem is set too high. On Mon, Mar 17, 2025 at 3:12 PM Bharani SV-forum wrote: > Team > Any one faced similar issue with Ver 13.16.X > > > > - Forwarded Message -

Re: Query optimization

2025-03-13 Thread Ron Johnson
On Thu, Mar 13, 2025 at 11:48 PM Durgamahesh Manne < maheshpostgr...@gmail.com> wrote: > On Fri, 14 Mar, 2025, 09:11 Ron Johnson, wrote: > >> On Thu, Mar 13, 2025 at 11:25 PM Durgamahesh Manne < >> maheshpostgr...@gmail.com> wrote: >> >>> On Fri, M

Re: Query optimization

2025-03-13 Thread Ron Johnson
On Thu, Mar 13, 2025 at 11:25 PM Durgamahesh Manne < maheshpostgr...@gmail.com> wrote: > On Fri, Mar 14, 2025 at 8:19 AM Ron Johnson > wrote: > >> On Thu, Mar 13, 2025 at 10:16 PM Durgamahesh Manne < >> maheshpostgr...@gmail.com> wrote: >> [snip] >

Re: Query optimization

2025-03-13 Thread Ron Johnson
On Thu, Mar 13, 2025 at 10:16 PM Durgamahesh Manne < maheshpostgr...@gmail.com> wrote: [snip] > Hi Adrian Klaver > > 1) Postgres version. > select version(); > version > > -

Re: Moving from Linux to Linux?

2025-03-12 Thread Ron Johnson
On Wed, Mar 12, 2025 at 4:16 PM Paul Foerster wrote: > Hi Ron, > > > On 12 Mar 2025, at 17:59, Ron Johnson wrote: > > > > Developers making DDL changes on production databases? > > Of course not. But I can't block developer databases. That'd make a few

Re: Moving from Linux to Linux?

2025-03-12 Thread Ron Johnson
On Wed, Mar 12, 2025 at 12:48 PM Paul Foerster wrote: > Hi Christophe, > > > On 12 Mar 2025, at 12:16, Christophe Pettus wrote: > > > > You *can* apply DDL while logical replication is going on, as long as > you do so in a disciplined way. This generally means applying it to the > subscriber be

Re: hide data from admins

2025-03-11 Thread Ron Johnson
On Tue, Mar 11, 2025 at 9:48 PM Siraj G wrote: > Hello Experts! > > What are the features available in Postgresql to hide PII (personal > identifiable information) from the Admin team? Like in Oracle we have data > vault and data redaction, I am looking for similar features in > PostgreSQL.We do

Re: Moving from Linux to Linux?

2025-03-11 Thread Ron Johnson
On Tue, Mar 11, 2025 at 2:35 PM Paul Foerster wrote: > Hi Devrim, Thomas, Adrian, Ron, Joe, > > answering to myself as answering to five postings in one go is impossible. > 🤣 > > > Are there any obstacles that definitely make that a no-go? Do I risk > corruption?

Re: Moving from Linux to Linux?

2025-03-11 Thread Ron Johnson
On Tue, Mar 11, 2025 at 12:23 PM Paul Foerster wrote: > Hi, > > we are considering changing the PostgreSQL platform from SUSE SLE to Red > Hat. To keep service interruptions as short as possible, the idea is to set > up a streaming replication from the SUSE server to be replaced to a > temporary

Re: Duplicate Key Values

2025-03-11 Thread Ron Johnson
Do you *currently* take regular backups? We'd be glad to show you how to take regular logical backups. On Tue, Mar 11, 2025 at 10:29 AM mark bradley wrote: > An "interesting" effect of reindexing is that all the records that were > dups in the nodes table were deleted, both copies. > > Also, al

Re: psql and regex not like

2025-03-09 Thread Ron Johnson
On Thu, Mar 6, 2025 at 6:11 AM hubert depesz lubaczewski wrote: > On Thu, Mar 06, 2025 at 04:37:56AM -0500, Ron Johnson wrote: > > This statement runs great from the psql prompt. Does exactly what I > want. > > select datname from pg_database WHERE datname !~ 'template|p

Re: [EXTERNAL] Re: Asking for OK for a nasty trick to resolve PG CVE-2025-1094 i

2025-03-08 Thread Ron Johnson
Since it's a 24x7 app, you have database replication, virtual IPs and a fail-over manager in case a server crashes? Anyway, read through the PG 15 release notes. If none really affect you, then stay on 15.3. You're certain to miss *something*, though, or not understand the ramifications. And be

Re: Asking for OK for a nasty trick to resolve PG CVE-2025-1094 i

2025-03-08 Thread Ron Johnson
On Thu, Mar 6, 2025 at 3:12 AM Laurenz Albe wrote: > [redirecting to pgsql-general] > > On Thu, 2025-03-06 at 07:39 +, Abraham, Danny wrote: > > I have many customers using PG 15.3 happily, and I cannot just snap > upgrade them all to 15.12. > > Why do you think you cannot do that? > In the l

psql and regex not like

2025-03-07 Thread Ron Johnson
This statement runs great from the psql prompt. Does exactly what I want. select datname from pg_database WHERE datname !~ 'template|postgres' ORDER BY datname; But it doesn't work so well from the bash prompt. Not escaping the "!" generates a bunch of garbage, while escaping throws an sql synta

Re: No. Of wal files generated

2025-03-07 Thread Ron Johnson
overwritten, purges old ones when not needed etc. Even compresses and encrypts them if you want. > > > Regards. > > > > On Sat, 8 Mar 2025, 01:37 Ron Johnson, wrote: > >> inotifywait can log every file creation and deletion in a directory. >> >> Hones

Re: No. Of wal files generated

2025-03-07 Thread Ron Johnson
cess and > archival process. > > So I want to check how many wal file got created in x minutes and how many > .ready files got created in those x minutes. > > > > Regards, > Atul > > On Fri, 7 Mar 2025, 22:45 Ron Johnson, wrote: > >> On Fri, Mar 7, 2025 at 10:

Re: No. Of wal files generated

2025-03-07 Thread Ron Johnson
On Fri, Mar 7, 2025 at 10:59 AM Atul Kumar wrote: > Hi, > > Please could you help me by sharing any redhat linux command through which > I can count the no. of wal files and no. of ".ready" files generated in > last 10 minutes. > What problem are you trying to solve? -- Death to , and butter s

Re: Quesion about querying distributed databases

2025-03-06 Thread Ron Johnson
On Thu, Mar 6, 2025 at 10:47 AM Igor Korot wrote: > Hi, > > On Thu, Mar 6, 2025, 7:32 AM Greg Sabino Mullane > wrote: > >> On Wed, Mar 5, 2025 at 9:44 PM me nefcanto wrote: >> >>> Anyway, that's why I asked you guys. However, encouraging me to go back >>> to monolith without giving solutions on

Re: psql and regex not like

2025-03-06 Thread Ron Johnson
On Thu, Mar 6, 2025 at 4:59 AM Dominique Devienne wrote: > On Thu, Mar 6, 2025 at 10:38 AM Ron Johnson > wrote: > > This statement runs great from the psql prompt. Does exactly what I > want. > > select datname from pg_database WHERE datname !~ 'template|po

Re: Quesion about querying distributed databases

2025-03-05 Thread Ron Johnson
On Wed, Mar 5, 2025 at 9:44 PM me nefcanto wrote: > I once worked with a monolithic SQL Server database with more than 10 > billion records and about 8 Terabytes of data. A single backup took us more > than 21 days. It was a nightmare. > 25 years ago (meaning *much* slower hardware), I managed a

Re: Duplicate Key Values

2025-03-05 Thread Ron Johnson
records by specifying another column with a different value; On Wed, Mar 5, 2025 at 6:14 PM mark bradley wrote: > Hi Ron, > > The key is an integer. I'm using pGAdmin4 and recently updated to the > latest version. > > The records are not all identical, some have NULL values

Re: Duplicate Key Values

2025-03-05 Thread Ron Johnson
On Wed, Mar 5, 2025 at 12:36 PM mark bradley wrote: > Although I did not enter them, somehow duplicate primary key values have > appeared in one of my tables. > Is it a text/varchar column? Has the distro been upgraded "recently", or maybe streamed from an older Linux system to a newer Linux sy

Re: end of COPY

2025-03-05 Thread Ron Johnson
On Wed, Mar 5, 2025 at 10:53 AM Greg Sabino Mullane wrote: > On Wed, Mar 5, 2025 at 10:22 AM Marc Millas > wrote: > >> Then the flow contains a single line: \. to my understanding this means >> end of the copy >> >> but, Postgres generates an error : invalid input syntax for type numeric >> "\."

Re: end of COPY

2025-03-05 Thread Ron Johnson
On Wed, Mar 5, 2025 at 10:22 AM Marc Millas wrote: > Hi, > on a Postgres 16 DB running on a redhat 8.5 x86 machineI want to input > some data using copy from stdin > so.. more that 700 000 lines goes well. > Then the flow contains a single line: \. > to my understanding this means end of the copy

Re: Review my steps for rollback to restore point

2025-03-04 Thread Ron Johnson
Chandran, 1. For PITR, you should use a tool like PgBackRest. It handles all $PGDATA and WAL archiving. It's multithreaded, too, 2. pg_restore is just for logical backups. 3. Streaming Replication is for *hot standby*, not backups. On Tue, Mar 4, 2025 at 10:00 AM chandan Kumar wr

Re: create_immv issue on aws Ubuntu even after create extention

2025-03-02 Thread Ron Johnson
nt is this works perfectly on all local machines with > exact same versions and same data. > > Regards. > On 2/28/25 22:24, Ron Johnson wrote: > > On Fri, Feb 28, 2025 at 11:41 AM Krishnakant Mane > wrote: > >> Hello all. >> >> I am not able to use create_im

Re: create_immv issue on aws Ubuntu even after create extention

2025-02-28 Thread Ron Johnson
When you know that the SELECT statement runs on the local machines, then on each server, run these SQL statements: SHOW search_path; SELECT * FROM pg_extension; On Fri, Feb 28, 2025 at 12:26 PM Krishnakant Mane wrote: > > On 2/28/25 22:53, Ron Johnson wrote: > > > Differ

Re: create_immv issue on aws Ubuntu even after create extention

2025-02-28 Thread Ron Johnson
On Fri, Feb 28, 2025 at 11:41 AM Krishnakant Mane wrote: > Hello all. > > I am not able to use create_immv in postgresql 16.6 even after installing > it and doing create extention. > > I did a git clone of the repository and then make sudo make install to > install it. > > The issue is not happen

Re: Long Running query and trace potential issues

2025-02-28 Thread Ron Johnson
On Fri, Feb 28, 2025 at 6:50 AM KK CHN wrote: > List > > postgres=# SELECT PID, now() - pg_stat_activity.query_start AS duration, > query, state FROM pg_stat_activity WHERE (now() - pg > _stat_activity.query_start) > interval '5 minutes' AND state = 'active'; > pid |duration |

Re: Corruption of few tables

2025-02-26 Thread Ron Johnson
On Wed, Feb 26, 2025 at 9:06 AM Greg Sabino Mullane wrote: > On Wed, Feb 26, 2025 at 2:21 AM sivapostg...@yahoo.com < > sivapostg...@yahoo.com> wrote: > >> issue in PostgreSQL 15.7 >> > > Still missing a ton of bug fixes - Postgres 15 is on version 15.12. Try to > get that upgraded. > And it tak

Re: Deleting idle connections

2025-02-24 Thread Ron Johnson
On Mon, Feb 24, 2025 at 5:50 PM Yongye Serkfem wrote: > Hi Everyone! > I am having a series of idle connections and unable to delete them with a > single command. Any help in realizing this would be greatly appreciated. > This will kill idle connections older than two hours: select pid, pg_termi

Re: COLLATION update in 13.1

2025-02-24 Thread Ron Johnson
On Mon, Feb 24, 2025 at 6:53 AM Matthias Apitz wrote: [snip] > pgsql -Usisis sisis > > sisis=# REINDEX (VERBOSE) DATABASE sisis; > sisis=# ALTER COLLATION "de_DE.utf8" REFRESH VERSION; > ALTER COLLATION > > Correct? > > Just reindex those with text columns. create or replace view dba.all_indices

Re: v18 virtual columns

2025-02-20 Thread Ron Johnson
On Thu, Feb 20, 2025 at 8:07 AM Dominique Devienne wrote: > Hi. I've just read > https://www.dbi-services.com/blog/postgresql-18-virtual-generated-columns/ > > and I'm wondering whether there will be a way to ALTER existing STORED > generated columns, to be virtual? W/o rewriting the whole table

Re: Loading the latest N rows into the cache seems way too fast.

2025-02-17 Thread Ron Johnson
On Mon, Feb 17, 2025 at 4:51 PM Tom Lane wrote: > Ron Johnson writes: > > On Mon, Feb 17, 2025 at 4:36 PM Tom Lane wrote: > >> It's not pulling in the TOAST storage where the bytea column lives. > >> (pg_prewarm wouldn't have either, without special

Re: Loading the latest N rows into the cache seems way too fast.

2025-02-17 Thread Ron Johnson
On Mon, Feb 17, 2025 at 4:36 PM Tom Lane wrote: > Ron Johnson writes: > > The bigint "id" column in "mytbl" is populated from a sequence, and so is > > monotonically increasing: the newest records will have the biggest id > > values. > > The ta

Loading the latest N rows into the cache seems way too fast.

2025-02-17 Thread Ron Johnson
PG 9.6.24 and PG 14.15, if it matters. (Yes, 9.6 is really EOL. I don't control that.) (I could use pg_prewarm, but the table is much bigger than RAM, and last_block value only has the newest record if data has never been deleted. The oldest records regularly get deleted, and then the table is v

Re: The performance issues caused by upgrading PostgreSQL to version 16.3.

2025-02-17 Thread Ron Johnson
On Mon, Feb 17, 2025 at 2:55 AM 馬 騰飛 wrote: > Dear PostgreSQL Community, > > I hope this message finds you well. I am reaching out to seek your > technical assistance regarding a performance issue we encountered after > upgrading our PostgreSQL version from 12.19 to 16.3. > We have noticed a sign

Re: Help in vetting outcome of "vacuumdb --analyze-in-stages" - during DB Upgrade from EC2- PGS - Community Edn ver 13.X to 14.X

2025-02-16 Thread Ron Johnson
On Sun, Feb 16, 2025 at 8:13 AM Y_Bharani_mbsv wrote: > Team > Good Morning. > As part of DB upgrade from EC2 - PGS - community Edn Ver 13.X to 14.X > I followed steps of "pg_upgrade" and had executed the last step (post > successful db migration) > > vacuumdb --analyze-in-stages > > and later no

Re: Bash profile

2025-02-15 Thread Ron Johnson
at 2:17 PM Yongye Serkfem wrote: > I am upgrading from version 12.7 to 15.7 > > On Sat, Feb 15, 2025, 2:15 PM Ron Johnson wrote: > >> On Sat, Feb 15, 2025 at 2:01 PM Yongye Serkfem >> wrote: >> >>> Hi Everyone! >>> I would appreciate any assista

Re: Bash profile

2025-02-15 Thread Ron Johnson
On Sat, Feb 15, 2025 at 2:01 PM Yongye Serkfem wrote: > Hi Everyone! > I would appreciate any assistance with configuring the bash profile to run > two different postgresql versions. Specifically V12.7 and 15.7 > Create a bash function that exports PGDATA to the relevant directory, based on the

Re: psql command line editing

2025-02-13 Thread Ron Johnson
On Wed, Feb 12, 2025 at 3:29 PM Adrian Klaver wrote: > On 2/12/25 12:03, Ron Johnson wrote: > > On Wed, Feb 12, 2025 at 2:29 PM Tom Lane > <mailto:t...@sss.pgh.pa.us>> wrote: > > > There's got to be something in your shell config which says "use

Re: psql command line editing

2025-02-12 Thread Ron Johnson
On Wed, Feb 12, 2025 at 2:29 PM Tom Lane wrote: > Ron Johnson writes: > > On Wed, Feb 12, 2025 at 1:50 PM Rich Shepard > > wrote: > >> My web searches suggest that using the psql command line I'm limited to > >> moving the cursor one character at

Re: psql command line editing

2025-02-12 Thread Ron Johnson
On Wed, Feb 12, 2025 at 1:50 PM Rich Shepard wrote: > My web searches suggest that using the psql command line I'm limited to > moving the cursor one character at a time. Is there a way to use a small > editor, e.g., joe on linux, to move by words or to the begining and end of > the line? The P

Re: Table copy

2025-02-05 Thread Ron Johnson
Could there have been a network hiccup? Or some sort of timeout? If I needed to transfer 360GB of data, I'd probably do something old school like: 1. write a PowerShell script to export a set of rows into a csv file, 7zip compress it, then rsync or scp it to the target. 2. Write a bash script to

Re: old OS

2025-02-04 Thread Ron Johnson
https://ora2pg.darold.net/ It can access remote Oracle databases, and migrate LOB columns to bytea. Worked quite well for me on a database 3x that size. On Tue, Feb 4, 2025 at 3:28 PM Marc Millas wrote: > Hi Tom, > > the data in the redhat 6.5 machine is NOT in Postgres, its in an old > Oracle

Re: Lookup tables

2025-02-04 Thread Ron Johnson
On Tue, Feb 4, 2025 at 12:05 PM Rob Sargent wrote: > > > > On 2/4/25 10:03, Ron Johnson wrote: > > On Tue, Feb 4, 2025 at 11:31 AM Michał Kłeczek wrote: > [snip] > >> >> The query to register a visit is: >> insert into restaurant_visit >> se

Re: Lookup tables

2025-02-04 Thread Ron Johnson
On Tue, Feb 4, 2025 at 11:31 AM Michał Kłeczek wrote: [snip] > > The query to register a visit is: > insert into restaurant_visit > select $user, current_date, restaurant_id, $rating > from restaurant where name = $restaurant_name > > > It is now completely unclear what it means to change the nam

Re: Lookup tables

2025-02-04 Thread Ron Johnson
On Tue, Feb 4, 2025 at 9:28 AM Rich Shepard wrote: > Should lookup tables have a numeric FK column as well as the description > column? > Does your lookup table just have one column? (That's what your question seems to imply, but that makes no sense, since the whole point of a lookup table is t

  1   2   3   4   5   6   7   8   9   10   >