Help | Site Map
Connecting Tech Pros Worldwide
 
 
LinkBack Thread Tools
  #1  
Old November 23rd, 2005, 01:42 AM
Dino Vliet
Guest
 
Posts: n/a
Default can postgresql handle these large tables

Hi folks,
I'm busy with analyzing some data and therefore will
have to store 2 big tables containing 50 million obs &
25 million obs. Selecting some interesting obs can
decrease these tables with maybe a factor 10 but
eventually I will have to combine them using a join.
These tables contain almost 20 colums and after
selecting the appropriate ones I will have maybe 10
colums.

Off course I will have to make use of indexes and try
to optimize the settings in postgresql.conf file like:

geqo=true
geqo_treshold=11
geqo_effort= 1
geqo_generations=5

But my main question is whether postgresql will be
able to handle these large volumes of data, or should
I ask whether my hardware will be capable of working
with these large tables.

Answers, Ideas, remarks...everything is welcome folks,
Many thanks in advance, it is MUCH appreciated what is
done in this list!!






__________________________________
Do you Yahoo!?
Yahoo! Mail - Helps protect you from nasty viruses.
http://promotions.yahoo.com/new_mail

---------------------------(end of broadcast)---------------------------
TIP 7: don't forget to increase your free space map settings

  #2  
Old November 23rd, 2005, 01:42 AM
Gaetano Mendola
Guest
 
Posts: n/a
Default Re: can postgresql handle these large tables

Dino Vliet wrote:[color=blue]
> Hi folks,
> I'm busy with analyzing some data and therefore will
> have to store 2 big tables containing 50 million obs &
> 25 million obs. Selecting some interesting obs can
> decrease these tables with maybe a factor 10 but
> eventually I will have to combine them using a join.
> These tables contain almost 20 colums and after
> selecting the appropriate ones I will have maybe 10
> colums.
>
> Off course I will have to make use of indexes and try
> to optimize the settings in postgresql.conf file like:
>
> geqo=true
> geqo_treshold=11
> geqo_effort= 1
> geqo_generations=5[/color]

These value will affect only if you join more then "geqo_threshold"
tables, it doesn't depend on the number of column and/or
rows number.


Regards
Gaetano Mendola
 

Bookmarks

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are Off
[IMG] code is Off
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

What is Bytes?

We are a network of experts and professionals in IT and software development that help one another with answers to tough questions and share insights. Get the best answers to your questions from over network members.
Post your question now . . .
It's fast and it's free

Popular Articles