c++ stream to memory address

[Dan Elliott]

I am working on some tricky code and need some help from the experts.

I have several large data structures (uBLAS matrices) that must be written
to a pre-allocated (by another program) chunk of static memory. Currently
our code emulates this behavior using BOOST::serializ e archives. According
to the documentation, these archive objects will write to a given ostream.
We would like to define an ostream that writes to this address without
copying these large data structures to a buffer.

I am open to any elegant solution (if one exists), but we are currently
attempting to set the memory given to us as the buffer used by an ostream.
Again, if there is a better way, we would gladly use it. I am providing the
above information to emphasize that we are pretty tied to using c++ streams
for our i/o with the static memory.

Below is a *simple* example that I cannot get to work. I am using vacpp on
AIX.

Thank you in advance for any help provided.

- dan

struct X
{
short pad;
short version;
int x;
int y;
int z;
};
int main() {

X dummy;
dummy.x = 5;
dummy.y = 5;
dummy.z = 5;
short a = 20;

cout << "The sizeof dummy is " << sizeof(dummy) << endl;

stringbuf *tempBuf = new stringbuf(ios_b ase::out|ios_ba se::binary);
streambuf *testBuf =
tempBuf->pubsetbuf((cha r*)(&(dummy.ver sion)),sizeof(d ummy)-2);

cout << "pubsetbuf: " << (void*)testBuf << " vs " << (void*)tempBuf <<
endl;

ostream ofs(tempBuf);

cout << "dummy.vers ion addr: " << &(dummy.version ) << endl <<"dummy
addr: " << &(dummy) << endl << "ofs good?: " << ofs.good() << endl;

ofs << a << 21;

cout << dummy.version << " " << dummy.x << " " << dummy.y << " " <<
dummy.z << endl;
}

[Dan Elliott]

"Dan Elliott" <da************ ************@no Spam.org> wrote in message
news:5h******** ***@dfw-service2.ext.ra y.com...

Below is a *simple* example that I cannot get to work. I am using vacpp on AIX.

Thank you in advance for any help provided.

- dan

struct X
{
short pad;
short version;
int x;
int y;
int z;
};
int main() {

X dummy;
dummy.x = 5;
dummy.y = 5;
dummy.z = 5;
short a = 20;

cout << "The sizeof dummy is " << sizeof(dummy) << endl;

stringbuf *tempBuf = new stringbuf(ios_b ase::out|ios_ba se::binary);
streambuf *testBuf =
tempBuf->pubsetbuf((cha r*)(&(dummy.ver sion)),sizeof(d ummy)-2);

cout << "pubsetbuf: " << (void*)testBuf << " vs " << (void*)tempBuf <<
endl;

ostream ofs(tempBuf);

cout << "dummy.vers ion addr: " << &(dummy.version ) << endl <<"dummy
addr: " << &(dummy) << endl << "ofs good?: " << ofs.good() << endl;

ofs << a << 21;

cout << dummy.version << " " << dummy.x << " " << dummy.y << " " <<
dummy.z << endl;
}

Here is the output from this example program:

The sizeof dummy is 16
pubsetbuf: 11001d470 vs 11001d470
dummy.version addr: fffffffffffe662
dummy addr: fffffffffffe660
ofs good?: 1
0 5 5 5
0 5 5 5

What am I doing wrong?

[Uenal Mutlu]

"Dan Elliott" wrote

I am working on some tricky code and need some help from the experts.

I have several large data structures (uBLAS matrices) that must be written
to a pre-allocated (by another program) chunk of static memory. Currently
our code emulates this behavior using BOOST::serializ e archives. According
to the documentation, these archive objects will write to a given ostream.
We would like to define an ostream that writes to this address without
copying these large data structures to a buffer.

I am open to any elegant solution (if one exists), but we are currently
attempting to set the memory given to us as the buffer used by an ostream.
Again, if there is a better way, we would gladly use it. I am providing the
above information to emphasize that we are pretty tied to using c++ streams
for our i/o with the static memory.
Try this method:

// writing to memory using ostrstream:
char szBuf[1024] = "";
ostrstream os(szBuf, sizeof(szBuf));
os << "test data\n"
<< "more test data\n";

Below is a *simple* example that I cannot get to work. I am using vacpp on
AIX.

Thank you in advance for any help provided.

- dan

struct X
{
short pad;
short version;
int x;
int y;
int z;
};
int main() {

X dummy;
dummy.x = 5;
dummy.y = 5;
dummy.z = 5;
short a = 20;

cout << "The sizeof dummy is " << sizeof(dummy) << endl;

stringbuf *tempBuf = new stringbuf(ios_b ase::out|ios_ba se::binary);
streambuf *testBuf =
tempBuf->pubsetbuf((cha r*)(&(dummy.ver sion)),sizeof(d ummy)-2);

cout << "pubsetbuf: " << (void*)testBuf << " vs " << (void*)tempBuf <<
endl;

ostream ofs(tempBuf);

cout << "dummy.vers ion addr: " << &(dummy.version ) << endl <<"dummy
addr: " << &(dummy) << endl << "ofs good?: " << ofs.good() << endl;

ofs << a << 21;

cout << dummy.version << " " << dummy.x << " " << dummy.y << " " <<
dummy.z << endl;
}

[Dan Elliott]

"Dan Elliott" <da************ ************@no Spam.org> wrote in message
news:5h******** ***@dfw-service2.ext.ra y.com...

*snip*

I am using vacpp on AIX.

Here is another example of code that I feel should (but doesn't) use
pre-allocated memory as the buffer for an iostream (or ostream) object:

char szBuf[1024] = "test data\nmore test data\n";
stringbuf myStringBuf;
myStringBuf.pub setbuf(szBuf,10 24);
iostream myIostream(&myS tringBuf);
myIostream << "hello hi\nhow are you doing\n";

The memory pointed to by szBuf has not been modified by the iostream
operation. I am at a loss here!

- dan

[Dan Elliott]

Thank you for the reply.

I am under the impression that ostrstream is no longer a part of the
standard. If so, it cannot be used on this project.

Thank you,

dan

"Uenal Mutlu" <52************ ***@t-online.de> wrote in message
news:d4******** *****@news.t-online.com...

"Dan Elliott" wrote

I am working on some tricky code and need some help from the experts.

I have several large data structures (uBLAS matrices) that must be written to a pre-allocated (by another program) chunk of static memory. Currently our code emulates this behavior using BOOST::serializ e archives. According to the documentation, these archive objects will write to a given ostream. We would like to define an ostream that writes to this address without
copying these large data structures to a buffer.

I am open to any elegant solution (if one exists), but we are currently
attempting to set the memory given to us as the buffer used by an ostream. Again, if there is a better way, we would gladly use it. I am providing the above information to emphasize that we are pretty tied to using c++ streams for our i/o with the static memory.

Try this method:

// writing to memory using ostrstream:
char szBuf[1024] = "";
ostrstream os(szBuf, sizeof(szBuf));
os << "test data\n"
<< "more test data\n";

Below is a *simple* example that I cannot get to work. I am using vacpp on AIX.

Thank you in advance for any help provided.

- dan

struct X
{
short pad;
short version;
int x;
int y;
int z;
};
int main() {

X dummy;
dummy.x = 5;
dummy.y = 5;
dummy.z = 5;
short a = 20;

cout << "The sizeof dummy is " << sizeof(dummy) << endl;

stringbuf *tempBuf = new stringbuf(ios_b ase::out|ios_ba se::binary);
streambuf *testBuf =
tempBuf->pubsetbuf((cha r*)(&(dummy.ver sion)),sizeof(d ummy)-2);

cout << "pubsetbuf: " << (void*)testBuf << " vs " << (void*)tempBuf << endl;

ostream ofs(tempBuf);

cout << "dummy.vers ion addr: " << &(dummy.version ) << endl <<"dummy
addr: " << &(dummy) << endl << "ofs good?: " << ofs.good() << endl;

ofs << a << 21;

cout << dummy.version << " " << dummy.x << " " << dummy.y << " " <<
dummy.z << endl;
}

[red floyd]

Dan Elliott wrote:

Thank you for the reply.

I am under the impression that ostrstream is no longer a part of the
standard. If so, it cannot be used on this project.

Thank you,

dan

[redacted]

True, but std::ostringstr eam *is* part of the standard.

#include <sstream>

[Default User]

red floyd wrote:

Dan Elliott wrote:

Thank you for the reply.

I am under the impression that ostrstream is no longer a part of the standard. If so, it cannot be used on this project.

Thank you,

dan [redacted]

True,

No, not true. The strstream stuff is deprecated. It's still available
and probably will be for some time to come.

One definitely should try to avoid it in new code, of course.
but std::ostringstr eam *is* part of the standard.

Yes, this would be the better choice.

Brian

[Dan Elliott]

"red floyd" <no*****@here.d ude> wrote in message
news:h8******** ********@newssv r13.news.prodig y.com...

Dan Elliott wrote:

I am under the impression that ostrstream is no longer a part of the
standard. If so, it cannot be used on this project.

Thank you,

dan

[redacted]

True, but std::ostringstr eam *is* part of the standard.

#include <sstream>

Great, but I do not see a constructor that will allow me to do what my
original post was asking for: I want to write to a pre-allocated memory
address. I am writing a lot of data to this address, so I do not want to
use a stream that will force me to copy to memory controlled (and
untouchable by me) by the stream and then copy to the pre-allocated memory.

In addition, I have tried directing the stringbuf object belonging to a
ostringstream to use the pre-allocated memory with negative results. The
code I have posted will show an example of what I have tried.

Thanks for your help. I am totally clueless at this point.

- dan

[Ron Natalie]

Dan Elliott wrote:

Great, but I do not see a constructor that will allow me to do what my
original post was asking for: I want to write to a pre-allocated memory
address.

Use the deprecated strstream interface.
It writes to a managed hunka-char array rather than a string object.

[Alf P. Steinbach]

* Dan Elliott:

I am working on some tricky code and need some help from the experts.

I have several large data structures (uBLAS matrices) that must be written
to a pre-allocated (by another program) chunk of static memory. Currently
our code emulates this behavior using BOOST::serializ e archives. According
to the documentation, these archive objects will write to a given ostream.
We would like to define an ostream that writes to this address without
copying these large data structures to a buffer.

I am open to any elegant solution (if one exists), but we are currently
attempting to set the memory given to us as the buffer used by an ostream.
Again, if there is a better way, we would gladly use it. I am providing the
above information to emphasize that we are pretty tied to using c++ streams
for our i/o with the static memory.

Below is a *simple* example that I cannot get to work. I am using vacpp on
AIX.

Thank you in advance for any help provided.

- dan

struct X
{
short pad;
short version;
int x;
int y;
int z;
};
int main() {

X dummy;
dummy.x = 5;
dummy.y = 5;
dummy.z = 5;
short a = 20;

cout << "The sizeof dummy is " << sizeof(dummy) << endl;

stringbuf *tempBuf = new stringbuf(ios_b ase::out|ios_ba se::binary);
streambuf *testBuf =
tempBuf->pubsetbuf((cha r*)(&(dummy.ver sion)),sizeof(d ummy)-2);

cout << "pubsetbuf: " << (void*)testBuf << " vs " << (void*)tempBuf <<
endl;

ostream ofs(tempBuf);

cout << "dummy.vers ion addr: " << &(dummy.version ) << endl <<"dummy
addr: " << &(dummy) << endl << "ofs good?: " << ofs.good() << endl;

ofs << a << 21;
Here you're converting the integer value 20 (of 'a') to character codes.
cout << dummy.version << " " << dummy.x << " " << dummy.y << " " <<
dummy.z << endl;
}

--
A: Because it messes up the order in which people normally read text.
Q: Why is it such a bad thing?
A: Top-posting.
Q: What is the most annoying thing on usenet and in e-mail?