473,386 Members | 1,796 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,386 software developers and data experts.

writing multi dimensional array of data to text file

does anyone have any suggestions for writing a two dimensional array of
data to a file.

Currently, I have an array of 5 columns, with 1000 elements per array.
I know that I can use a for next loop to go through each data point in
the array and use the streamwriter class for each individual data point
and write each point individually to the file.

I would like to simplify this by simply writing the entire array to
file.

My array could be as big as 100,000 elements, so I'd like to find a
more efficient method,.

thanks

Jan 17 '07 #1
4 4511
Take a look at
System.Runtime.Serialization.Formatters.Binary.Bin aryFormatter and see if
that will help you out. Or did you need for that data to be human readable?

<da*******@yahoo.comwrote in message
news:11*********************@m58g2000cwm.googlegro ups.com...
does anyone have any suggestions for writing a two dimensional array of
data to a file.

Currently, I have an array of 5 columns, with 1000 elements per array.
I know that I can use a for next loop to go through each data point in
the array and use the streamwriter class for each individual data point
and write each point individually to the file.

I would like to simplify this by simply writing the entire array to
file.

My array could be as big as 100,000 elements, so I'd like to find a
more efficient method,.

thanks

Jan 17 '07 #2
Ultimately it will need to be presented in a text file, and may likely
even need to be exported to Excel. If I need to save it as a binary
first and then convert to text (or numeric), so be it.

I'm really suprised that there is not a method to invoke the writing of
an entire array to a text file. Seems like it would be a common need
for programmers.

Jan 17 '07 #3
The question there is portability and reusability. Presemably, when you
write out to file for later resue you would use the same program to read it
back in. When the need arises that some other program is expected to
reconstruct the data (i.e. the human factor) then you have to be a bit more
explicit.

Is it for an IBM, then you have to export in EBSIDC
Is it for a PC, the ASCII will prolly suit you fine.
Does it need to go over the web, then perhaps XML is the key for you.
The tried and true way is as a simple Byte(), of course who can read that?

While the need may be ever present in a programmer's world, don't sell
yourself short that the solution is prewrapped. It is bad enough that a lot
of functionality is prewrapped and the libraries are bloated to the hilt.
But because we are programmers, we know how to create our own utilities to
accomplish our tasks as needed.

Rather than use an array, perhaps you can use an arraylist, or even better
system.collection.collectionbase? Nest your data as needed then provide a
nice little tostring() method or serialize(filename) method. Another option
is to pass the Array into a custom array serializer, to minimize the bloat
while you are working with the data.

<da*******@yahoo.comwrote in message
news:11**********************@38g2000cwa.googlegro ups.com...
Ultimately it will need to be presented in a text file, and may likely
even need to be exported to Excel. If I need to save it as a binary
first and then convert to text (or numeric), so be it.

I'm really suprised that there is not a method to invoke the writing of
an entire array to a text file. Seems like it would be a common need
for programmers.

Jan 17 '07 #4
Thanks for the suggestions.

I'm involed in a project for data acquisition, where the data is coming
into my application at high rates (can be up to 1MgHz, in chunks of a
few thousand samplesas single data types). Generally, the end user
needs to store the data to a text file or excel. As excel cannot keep
up with the higher data transfer rates (as well as excessive file
sizes), the text file is the preffered saving method. The end user
only needs to access the data via a text file format.

I'll certainly investigate some of your recommendations for a solution.

Thanks again, it is very apprecaited.

Jan 17 '07 #5

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

2
by: iop | last post by:
Hello there, I'd like to "parse" an entire multi-dimension array like this : APP APP without knowing "framework" or "config" or anything passed as variables... 'cause it's simple to call...
2
by: ip4ram | last post by:
I used to work with C and have a set of libraries which allocate multi-dimensional arrays(2 and 3) with single malloc call. data_type **myarray =...
4
by: Robert P. | last post by:
I can easily store a one-dimensional array in viewstate ( see Test1 ) If I try storing a multi-dimensional array in the viewstate it's crapping out on me when it goes to serialize the array (not...
4
by: entitledX | last post by:
Hi, I'm trying to use the HDF library to read a few HDF files that I need to process. The data in each file varies in rows, but the columns remain constant. Because of that, I had dynamically...
4
by: Balaskas Evaggelos | last post by:
Hi, does anyone know how i can sort a multi-dimensional array by a specific field ? for example i want to sort arr where n=2, but i need the data of every array to follow that order. ...
8
by: per9000 | last post by:
Hi all, I have a two-dimensional array of data, f.x int's. We can imagine that the array is "really large". Now I want the data in it and store this in a one-dimensional array. The obvious...
4
by: Paul David Buchan | last post by:
Hello, I'm attempting to write a program to read in database files (.dbf). When I do it all as a single procedure in main, everything works. However, what I really want, is to pass the database...
152
by: vippstar | last post by:
The subject might be misleading. Regardless, is this code valid: #include <stdio.h> void f(double *p, size_t size) { while(size--) printf("%f\n", *p++); } int main(void) { double array = { {...
4
by: =?Utf-8?B?SGVucmlrIFNjaG1pZA==?= | last post by:
Hi, consider the attached code. Serializing the multi-dimensional array takes about 36s vs. 0.36s for the single-dimensional array. Initializing the multi-dimensional array takes about 4s...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: ryjfgjl | last post by:
If we have dozens or hundreds of excel to import into the database, if we use the excel import function provided by database editors such as navicat, it will be extremely tedious and time-consuming...
0
by: ryjfgjl | last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.