473,395 Members | 1,568 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,395 software developers and data experts.

How to make Huge Arrays in C++ using GCC?

Hi,
I need to make 5 double arrays with the size of 1000*1000, namely
double [10000][10000], for some Monte Carlo simulations.
I have a server with 4GB RAM and lots of pagefile.

I used new in GCC 3.4.2 integrated in DEV C++ 4.9.9 on Windows Adv. Server 2003.
Unfortunately, I can only get an array with 7000*7000 elements.

Would you help me solve the problem?
Please!
TIA
Apr 29 '08 #1
2 1697
r035198x
13,262 8TB
Hi,
I need to make 5 double arrays with the size of 1000*1000, namely
double [10000][10000], for some Monte Carlo simulations.
I have a server with 4GB RAM and lots of pagefile.

I used new in GCC 3.4.2 integrated in DEV C++ 4.9.9 on Windows Adv. Server 2003.
Unfortunately, I can only get an array with 7000*7000 elements.

Would you help me solve the problem?
Please!
TIA
Do you absolutely have to use 5 double[10000][10000] arrays? Is creating class that represents that array structure allowed?
Apr 29 '08 #2
weaknessforcats
9,208 Expert Mod 8TB
Use disc files for arrays this large. Format them so the doubles are asscessible randomly using seek.

You should just need a few doubles in the program itself.

Otherwise, you rely on swapping and you are countering OS limits.

There's not reason you can't process a terabyte of data so long as you don't try to do it memory.

When I have seen this done a lot more than 5 files were used. The array structure was distributed over many files.

Have you considered SQL Server?
Apr 29 '08 #3

Sign in to post your reply or Sign up for a free account.

Similar topics

10
by: Fabian | last post by:
Are there any speed issues in javascript with having really large arrays? I know if the array gets large enough, bandwidth and download time can be an issue, but does it take inordinate amounts of...
3
by: dpriver | last post by:
I have to initialize a huge constant array of structures(60000~100000), used as a lookup table , but it failed with System.InvalidProgramException when the items reach 18400. and if I change the...
6
by: ad | last post by:
I have a huge sting array, there are about 1000 element in it. How can I divide the huge array into small ones, and there are one 10 elements in a small one array?
6
by: Michael Gray | last post by:
VS 2003 VB.net Win2000 SP4 The System.Array class seems to be limited to 32 bit addresses, meaning that one can only assign 2^32 elements. Is there any way that I can have an array that...
5
by: Naamat | last post by:
Hello, I am the sample FPSEPublish (http://blog.baeke.info/blog/_archives/2005/3/3/393158.html) code to upload a document to Sharepoint (WSS). This works perfectly for samll documents. ...
8
by: luke.yolanda | last post by:
is anyone know how to implement a huge 2-D array? such as ' unsigned char a; ' I compile and run it in VC 6.0, but it show me an error.... thank you guys
1
by: vipinvarkey | last post by:
hello; i need to create a very long array in c of the foll specification: a however i get an error telling that the array's size is too large.the help file advices either to use malloc or...
3
by: john | last post by:
I am VERY new to C++ (1st semester) put not so new to coding and programming (SQL, VB, etc). We are learning about classes. I have a program that needs to call many instances (i think this is...
8
by: sarega | last post by:
Hi, I have two very huge arrays, the second array contains some of the elements of array1 and also different elements, both are not of the same size, have to find only the elements that are not...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: ryjfgjl | last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.