Connecting Tech Pros Worldwide Help | Site Map

data jam/preserves

 
LinkBack Thread Tools Search this Thread
  #1  
Old November 14th, 2006, 11:25 PM
keindl@gmail.com
Guest
 
Posts: n/a
Default data jam/preserves

I heard that Python or maybe Ruby has a feature that transforms a
complex data structure into something simple data structure that can be
saved into a file. For example a structure containing several lists,
vectors set etc. is transformed into a possible long vector of
integeres. The transformation is reversible. This way it is easy to
save and load the state of a running application.

Is there something like this for C++? I have the following application
in mind: I'd like to write parallel C++ code with MPI but I need to
pass very complex data (built with the STL) between the nodes. MPI is
very simplistic to this is a difficult task. If I had an encode/decode
function pair that creates a vector of integers from any data, then
this encoded simplified data preserve can be passed easily between the
nodes.

Nandor


  #2  
Old November 14th, 2006, 11:55 PM
keindl@gmail.com
Guest
 
Posts: n/a
Default Re: data jam/preserves

I remember now that what I am looking for is the C++ version of the
pickle module in Python.

Nandor

  #3  
Old November 15th, 2006, 08:05 PM
doug turnbull
Guest
 
Posts: n/a
Default Re: data jam/preserves

keindl@gmail.com wrote:
Quote:
I heard that Python or maybe Ruby has a feature that transforms a
complex data structure into something simple data structure that can be
saved into a file. For example a structure containing several lists,
vectors set etc. is transformed into a possible long vector of
integeres. The transformation is reversible. This way it is easy to
save and load the state of a running application.
>
Is there something like this for C++? I have the following application
in mind: I'd like to write parallel C++ code with MPI but I need to
pass very complex data (built with the STL) between the nodes. MPI is
very simplistic to this is a difficult task. If I had an encode/decode
function pair that creates a vector of integers from any data, then
this encoded simplified data preserve can be passed easily between the
nodes.
>
Nandor
Maybe this will help,
http://www.parashift.com/c++-faq-lit...alization.html

  #4  
Old November 15th, 2006, 08:15 PM
mlimber
Guest
 
Posts: n/a
Default Re: data jam/preserves

doug turnbull wrote:
Quote:
keindl@gmail.com wrote:
Quote:
I heard that Python or maybe Ruby has a feature that transforms a
complex data structure into something simple data structure that can be
saved into a file. For example a structure containing several lists,
vectors set etc. is transformed into a possible long vector of
integeres. The transformation is reversible. This way it is easy to
save and load the state of a running application.

Is there something like this for C++? I have the following application
in mind: I'd like to write parallel C++ code with MPI but I need to
pass very complex data (built with the STL) between the nodes. MPI is
very simplistic to this is a difficult task. If I had an encode/decode
function pair that creates a vector of integers from any data, then
this encoded simplified data preserve can be passed easily between the
nodes.

Nandor
>
Maybe this will help,
http://www.parashift.com/c++-faq-lit...alization.html
And this:

http://boost.org/libs/serialization/doc/index.html

Cheers! --M

 

Bookmarks

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Popular Articles

What is Bytes?

We are a network of experts and professionals in IT and software development that help one another with answers to tough questions and share insights. Get the best answers to your questions from over 220,840 network members.