PostgreSQL Volume Question
Hi, I'm new to the community. Recently, I've been involved in a project that develops a social network data analysis service (and my client's DBMS is based on PostgreSQL). I need to gather huge volume of unstructured raw data for this project, and the problem is that with PostgreSQL, it would be so dfficult to handle this kind of data. Are there any PG extension modules or methods that are recommended for my project? Thanks in advance.
Re: PostgreSQL Volume Question
Well I think my question is somewhat away from my intention cause of my poor understanding and questioning :( Actually, I have 1TB data and have hardware spec enough to handle this amount of data, but the problem is that it needs too many join operations and the analysis process is going too slow right now. I've searched and found that graph model nicely fits for network data like social data in query performance. Should I change my DB (I mean my DB for analysis)? or do I need some other solutions or any extension? Thanks On Thu, Jun 14, 2018 at 3:36 PM, Melvin Davidson wrote: > > > On Thu, Jun 14, 2018 at 6:30 PM, Adrian Klaver > wrote: > >> On 06/14/2018 02:33 PM, Data Ace wrote: >> >>> Hi, I'm new to the community. >>> >>> Recently, I've been involved in a project that develops a social network >>> data analysis service (and my client's DBMS is based on PostgreSQL). >>> I need to gather huge volume of unstructured raw data for this project, >>> and the problem is that with PostgreSQL, it would be so dfficult to handle >>> this kind of data. Are there any PG extension modules or methods that are >>> recommended for my project? >>> >> >> In addition to Ravi's questions: >> >> What does the data look like? >> >> What Postgres version? >> >> How is the data going to get from A <--> B, local or remotely or both? >> >> Is there another database or program involved in the process? >> >> >>> Thanks in advance. >>> >> >> >> -- >> Adrian Klaver >> adrian.kla...@aklaver.com >> >> > In addition to Ravi's and Adrian's questions: > > What is the hardware configuration? > > -- > *Melvin Davidson* > *Maj. Database & Exploration Specialist* > *Universe Exploration Command – UXC* > Employment by invitation only! >
Re: PostgreSQL Volume Question
I appreciate everyone's feedback and help and will consider everyone's input. Thanks again. On Fri, Jun 15, 2018 at 9:26 AM, Data Ace wrote: > Well I think my question is somewhat away from my intention cause of my > poor understanding and questioning :( > > > > Actually, I have 1TB data and have hardware spec enough to handle this > amount of data, but the problem is that it needs too many join operations > and the analysis process is going too slow right now. > > > > I've searched and found that graph model nicely fits for network data like > social data in query performance. > > > > Should I change my DB (I mean my DB for analysis)? or do I need some other > solutions or any extension? > > > Thanks > > On Thu, Jun 14, 2018 at 3:36 PM, Melvin Davidson > wrote: > >> >> >> On Thu, Jun 14, 2018 at 6:30 PM, Adrian Klaver > > wrote: >> >>> On 06/14/2018 02:33 PM, Data Ace wrote: >>> >>>> Hi, I'm new to the community. >>>> >>>> Recently, I've been involved in a project that develops a social >>>> network data analysis service (and my client's DBMS is based on >>>> PostgreSQL). >>>> I need to gather huge volume of unstructured raw data for this project, >>>> and the problem is that with PostgreSQL, it would be so dfficult to handle >>>> this kind of data. Are there any PG extension modules or methods that are >>>> recommended for my project? >>>> >>> >>> In addition to Ravi's questions: >>> >>> What does the data look like? >>> >>> What Postgres version? >>> >>> How is the data going to get from A <--> B, local or remotely or both? >>> >>> Is there another database or program involved in the process? >>> >>> >>>> Thanks in advance. >>>> >>> >>> >>> -- >>> Adrian Klaver >>> adrian.kla...@aklaver.com >>> >>> >> In addition to Ravi's and Adrian's questions: >> >> What is the hardware configuration? >> >> -- >> *Melvin Davidson* >> *Maj. Database & Exploration Specialist* >> *Universe Exploration Command – UXC* >> Employment by invitation only! >> > >
Re: using graph model with PostgreSQL
I think's its a forked PostgreSQL, try AgensGraph: https://www.postgresql.org/download/products/8/ On Wed, Aug 15, 2018 at 7:09 AM, 김세훈 wrote: > Hi there, > > currently I'm using PostgreSQL with PostGIS extension to handle geospatial > data. > > In my project I need to apply some graph algorithms like MST for some > network of GPS coordinates. > > I know there is some way of using Neo4j with PostgreSQL but is there any > other way to construct > > graph model within PostgreSQL environment? > > Any external modules would be welcomed. > > > Thanks. > > >
Re: How to retrieve the partition info for each partition table?
Hi everyone. Kindly remove me from the email list. Than you.
On Wed, Oct 24, 2018 at 11:58 AM Igor Neyman wrote:
>
>
> *From:* Yuxia Qiu [mailto:yuxiaq...@gmail.com ]
> *Sent:* Wednesday, October 24, 2018 1:29 PM
> *To:* pgsql-general@lists.postgresql.org
> *Subject:* How to retrieve the partition info for each partition table?
>
>
>
> HI,
>
>
>
>I have created some partition table, as example bellow:
>
> CREATE TABLE public.measurement
>
> (
>
> city_id integer NOT NULL,
>
> logdate date NOT NULL,
>
> peaktemp integer,
>
> unitsales integer
>
> ) PARTITION BY RANGE (logdate) ;
>
>
>
> CREATE TABLE public.measurement_y2006m02 PARTITION OF public.measurement
>
> FOR VALUES FROM ('2006-02-01') TO ('2006-03-01');
>
>
>
> CREATE TABLE public.measurement_y2006m03 PARTITION OF public.measurement
>
> FOR VALUES FROM ('2006-03-01') TO ('2006-04-01');
>
>
>
> I know how to get a list partition tables for above example by calling :
>
> SELECT i.inhrelid::regclass AS child
>
> FROM pg_inherits i
>
> WHERE i.inhparent = 'public.measurement'::regclass;
>
>
>
> My question is: how to get the value boundary for each partition table
> like bellow?
>
> measurement_y2006m02 FROM ('2006-02-01') TO ('2006-03-01')
>
> measurement_y2006m03 FROM ('2006-03-01') TO ('2006-04-01')
>
>
>
> Thanks,
>
> Yuxia
>
>
>
> Better yet:
>
>
>
> SELECT relname, pg_get_expr(relpartbound, oid) FROM pg_class WHERE
> relpartbound IS NOT NULL;
>
>
>
> Regards,
>
> Igor Neyman
>
>
>
>
>
