Insert into on conflict, data size upto 3 billion records

2021-02-13 Thread Karthik Kumar Kondamudi
Hi, I'm looking for suggestions on how I can improve the performance of the below merge statement, we have a batch process that batch load the data into the _batch tables using Postgres and the task is to update the main target tables if the record exists else into it, sometime these batch table c

Re: Fwd: Carto ODBC_FDW issue "ERROR: Connecting to driver" from PG to DB2

2018-04-11 Thread karthik kumar
>> > I'm not a networking guru, but it sure looks like something is trying to > connect with an IPv6 loopback address. To me, this is the smoking gun. > > > > yes that much we figured it out here. Question is, why is isql able to connect, but not fdw via psql. At the end both isql and fdw should

Re: Fwd: Carto ODBC_FDW issue "ERROR: Connecting to driver" from PG to DB2

2018-04-11 Thread karthik kumar
This is the error we see in the ODBC trace log ODBC][586][1523477070.240690][__handles.c][450] Exit:[SQL_SUCCESS] Environment = 0x556f874716a0 [ODBC][586][1523477070.240741][SQLSetEnvAttr.c][182] Entry: Environment = 0x556f874716a0 Attribute = S

Re: Fwd: Carto ODBC_FDW issue "ERROR: Connecting to driver" from PG to DB2

2018-04-11 Thread karthik kumar
Hello Adrian I built fdw with debug option and ran it with debug option. Here is the output postgres=# select * from odbc_testt; DEBUG: StartTransactionCommand DEBUG: StartTransaction DEBUG: name: unnamed; blockState: DEFAULT; state: INPROGR, xid/subid/cid: 0/1/0, nestlvl: 1, children:

Re: Fwd: Carto ODBC_FDW issue "ERROR: Connecting to driver" from PG to DB2

2018-04-09 Thread karthik kumar
On Mon, Apr 9, 2018 at 7:52 PM, Adrian Klaver wrote: > On 04/09/2018 02:37 PM, karthik kumar wrote: > >> >> >> On Mon, Apr 9, 2018 at 5:13 PM, Adrian Klaver > <mailto:adrian.kla...@aklaver.com>> wrote: >> >> On 04/09/2018 02:10 PM, karthik

Re: Fwd: Carto ODBC_FDW issue "ERROR: Connecting to driver" from PG to DB2

2018-04-09 Thread karthik kumar
On Mon, Apr 9, 2018 at 5:13 PM, Adrian Klaver wrote: > On 04/09/2018 02:10 PM, karthik kumar wrote: > >> >> >> >> >> On 04/09/2018 01:01 PM, karthik kumar wrote: >> >> Hi Guru's, >> >> I am trying to access few table pres

Fwd: Carto ODBC_FDW issue "ERROR: Connecting to driver" from PG to DB2

2018-04-09 Thread karthik kumar
On 04/09/2018 01:01 PM, karthik kumar wrote: > Hi Guru's, > > I am trying to access few table present in DB2 LUW from postgres database. > All commands work fine, however when I try to select data from table it > throws error: > > pg@a92a3741d40e:~/odbc_fdw$ psql -d pos

Carto ODBC_FDW issue "ERROR: Connecting to driver" from PG to DB2

2018-04-09 Thread karthik kumar
Hi Guru's, I am trying to access few table present in DB2 LUW from postgres database. All commands work fine, however when I try to select data from table it throws error: pg@a92a3741d40e:~/odbc_fdw$ psql -d postgres psql (10.1) Type "help" for help. postgres=# create extension odbc_fdw; CREATE