473,396 Members | 1,693 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,396 software developers and data experts.

How large? Any precaution for a large db?

I have to handle a very big (~50 gigabyte) database (quite all in a
table), and I am going to use mysql.

Can mysql handle all that ammount of data?

What problems I am going to have?
Should I take any precaution?

Is some other database-engine more suitable for this work?
Posgresql maybe?

Thx in advance

Tac
Jul 20 '05 #1
2 1606
T.A.C. One wrote:
I have to handle a very big (~50 gigabyte) database (quite all in a
table), and I am going to use mysql.

Can mysql handle all that ammount of data?
If operating system can handle files large enough for the need, then
MySQL should handle it as well.
What problems I am going to have?
Should I take any precaution?
Well with that amount of data I'm sure you are using indexes, if you are
not, you will be soon ;) .. You might need to check your backup plans
also, because it's not very easy and fast to backup that kind of data
amounts.
Is some other database-engine more suitable for this work?
Posgresql maybe?


If you are not tied to Windows, then Postgresql gives very good
alternative to MySQL. IMHO Postgresql is better for large database
systems while MySQL suits better for small database systems. But nothing
stops you from using either one for all the cases.
Jul 20 '05 #2
Hi,

I have a MySQL DB which currently weighs in at around 200MB and will
be up in the GBs before long. It serves two purposes, collecting
transaction data and enabling reporting on that data.

More complex queries tend to run quite slowly. I've indexed the
appropriate columns which has sped things up a lot, however I notice
from running 'top', that when running such a query, MySQL grabs a good
99.9% of the CPU time.

As the DB gets larger and the site busier, am I going to be wise to
perhaps offload daily transaction data into a separate reporting DB,
preferably on a separate box, and keep the transaction DB small and
lean? Or would this be unnecessary, and provided I have enough HD
space / RAM / CPU power, I'll be OK?

Thanks in advance,

Rob
Jul 20 '05 #3

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

0
by: Constandinos Mavromoustakis | last post by:
CFP: CLADE 2004-Challenges of Large Applications in Distributed Environments ------------------------------------------------- PhD student - Dept.Informatics at Aristotle University of...
36
by: Andrea Griffini | last post by:
I did it. I proposed python as the main language for our next CAD/CAM software because I think that it has all the potential needed for it. I'm not sure yet if the decision will get through, but...
3
by: WinstonSmith | last post by:
Hello everyone, I got a problem about GC when creating large fields (some MB), set reference to null and call GC.Collect. Not all virtual mem is released. Situation improved in .net 1.1 but not...
0
by: Dirk Försterling | last post by:
Hi all, a few days ago, I upgraded from PostgreSQL 7.2.1 to 7.4, following the instructions in the INSTALL file, including dump and restore. All this worked fine without any error (message). ...
1
by: Dirk Försterling | last post by:
Hi, sorry for reposting, but it seems my message just hit nothing but air. If I posted to the wrong list or did something else wrong with the message, please let me know. I really want to...
24
by: Salad | last post by:
Every now and then I see ads that state something like "Experience with Large Databases ...multi-gig...blah-de-blah" And I have to laugh. What's the difference between a large or small database? ...
18
by: Zero | last post by:
Hi, I am calculating an integer to the pwer of a large integer, e.g. 2^5000. It turns out that the result I always get is zero. I am sure that the result is too large to store in such type...
5
by: Louis LeBlanc | last post by:
Hey folks. I'm new to the list, and not quite what you'd call a DB Guru, so please be patient with me. I'm afraid the lead up here is a bit verbose . . . I am working on an application that...
4
by: =?Utf-8?B?U2VyZ2Vp?= | last post by:
Dear staff Can I get your assistance with \3GB (LARGEADDRESSAWARE) switch in mixed mode process built by VS 2008, please? I have a mixed mode application: C# GUI calling native C++ DLL through...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: ryjfgjl | last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.