473,383 Members | 1,834 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,383 software developers and data experts.

MySql Cluster transaction Performance

I'd appreciate any help/suggestions you people working with MySql
cluster can offer.
I'm hoping MySql Cluster can help us with a high volume need.

Our needs are (at max load) 10M Million inserts per hour. Each record
is narrow (20 columns mostly numeric).
We then update those 10M records...running some simple math
calculations.
We then categorize them (another update pass)
We then insert them to Sybase db
I can then delete these records and get on to the next customers (which
have been streaming in the meantime).

I'm thinking Solaris 9 on v440. 16GB Ram.
4 servers (ndb nodes)

What is the best config?
I know there are issues on replicas and fragments that help in that
decision.
Is 2 replicas @ 2 fragments ok...how many replicas are enough...how
many fragments?
What questions do I ask to help make that decision?

Perhaps something like this would work?
Server #1. Mgmt Server
MySql Server
NDB Node
Server #2 MySql Server
NDB Node
Server #3 NDB Node
Server #4 NDB Node

What transaction activity numbers can I expect?

Can a 4node v440 with 16GB ram handle such volume?...are there rules of
thumb for such calculations?
Perhaps I don'd need a 440...and something less will do...again what
goes into that calculation?

This is (I think) high volume. 21M inserts/hr, 20M updates/hr. I wonder
how failsafe MySql Cluster is and what if any additional steps I need
to add.
Should I be thinking about writing data to disk for persistence
protection?
Is that within Cluster setting I should be using or via some external
method?
What is the recovery time bringing on down/back online a node?...lets
say with 8GB data)

Best location to store that persistent data (local disk raid 5 or raid
10 or SAN )...what questions answers help me with that decision?

I expect you who have used Clustering will have quick rule of thumb
answers or issues I also need to consider so I'd like to hear from
you.

Many thanks.
David

Feb 9 '06 #1
0 1387

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

5
by: sandy | last post by:
Hi All, I am a newbie to MySQL and Python. At the first place, I would like to know what are the general performance issues (if any) of using MySQL with Python. By performance, I wanted to...
33
by: Joshua D. Drake | last post by:
Hello, I think the below just about says it all: http://www.commandprompt.com/images/mammoth_versus_dolphin_500.jpg Sincerely, Joshua Drake
39
by: Mairhtin O'Feannag | last post by:
Hello, I have a client (customer) who asked the question : "Why would I buy and use UDB, when MySql is free?" I had to say I was stunned. I have no experience with MySql, so I was left sort...
1
by: Rosny | last post by:
From the article http://software.newsforge.com/software/05/01/27/170244.shtml?tid=132&tid=75&tid=131&tid=13 "Flickr runs on MySQL, the most popular open source database, and it has from the...
1
by: nd02tsk | last post by:
Hello Does PostgreSQL provide anything comparable with the functionality of MySQL Cluster? I appreciate all information. Thank you. Tim
1
by: Good Man | last post by:
Hi there I've noticed some very weird things happening with my current MySQL setup on my XP Laptop, a development machine. For a while, I have been trying to get the MySQL cache to work....
13
by: Jim Hubbard | last post by:
I have a client that desires a new application for use at several stores in different cities. He wants "real time" access to all store data and the ability to continue to run locally even if the...
4
by: ThunderMusic | last post by:
Hi, We have many servers setup as a cluster. When one server crashes, another one take the relay... We want to know if it's possible (I suppose it is) to make a Windows service developed with .NET...
0
Coldfire
by: Coldfire | last post by:
Since i cannot show the differences in a two-column like table. I am first putting MS SQL Server 2005 and then MySQL 5.x. MS SQL Server 2005 Brief Overview - SQL Server is a full-fledged...
1
by: CloudSolutions | last post by:
Introduction: For many beginners and individual users, requiring a credit card and email registration may pose a barrier when starting to use cloud servers. However, some cloud server providers now...
0
by: Faith0G | last post by:
I am starting a new it consulting business and it's been a while since I setup a new website. Is wordpress still the best web based software for hosting a 5 page website? The webpages will be...
0
by: ryjfgjl | last post by:
In our work, we often need to import Excel data into databases (such as MySQL, SQL Server, Oracle) for data analysis and processing. Usually, we use database tools like Navicat or the Excel import...
0
by: taylorcarr | last post by:
A Canon printer is a smart device known for being advanced, efficient, and reliable. It is designed for home, office, and hybrid workspace use and can also be used for a variety of purposes. However,...
0
by: aa123db | last post by:
Variable and constants Use var or let for variables and const fror constants. Var foo ='bar'; Let foo ='bar';const baz ='bar'; Functions function $name$ ($parameters$) { } ...
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.