473,385 Members | 1,872 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,385 software developers and data experts.

Text files read multiple files into single file, and then recreate the multiple files

Hiya,

The title says it all really, but im a newbie to python sort of. I can
read in files and write files no probs.

But what I want to do is read in a couple of files and output them to
one single file, but then be able to take this one single file and
recreate the files I put into it.

Im really at a loss as to how I go about recovering the files?
obviously if i scan for a string that specifys the start and end of
each file, theres the chance that the file might contain this term to
which would split the files into unwanted chucks of file, which wouldnt
be wanted.

Any ideas? code snippets?

Im very grateful!

Jul 18 '05 #1
4 3036
go*************@hotmail.com wrote:
Hiya,

The title says it all really, but im a newbie to python sort of. I can
read in files and write files no probs.

But what I want to do is read in a couple of files and output them to
one single file, but then be able to take this one single file and
recreate the files I put into it.
A ZIP archive perhaps?
See the zipfile module.

Im really at a loss as to how I go about recovering the files?
obviously if i scan for a string that specifys the start and end of
each file, theres the chance that the file might contain this term to
which would split the files into unwanted chucks of file, which wouldnt
be wanted.


ZIP archives are binary compressed files. Is this okay or do
you require the file to be a text file?

--Irmen
Jul 18 '05 #2
Would like to use text files, its really for my own learning,

but I suppose a Zip would work

cheers

Jul 18 '05 #3
go*************@hotmail.com writes:
Would like to use text files, its really for my own learning,

but I suppose a Zip would work


How about outputing a file as:

LENGTH=######
<file-contents>

in your joined file? That's a minimalistic archive format - one ASCII
header line that provides just enough information to extract the
file. Be sure to open all files [rw]b, though.

<mike
--
Mike Meyer <mw*@mired.org> http://www.mired.org/home/mwm/
Independent WWW/Perforce/FreeBSD/Unix consultant, email for more information.
Jul 18 '05 #4
go*************@hotmail.com wrote:
Hiya,

The title says it all really, but im a newbie to python sort of. I can read in files and write files no probs.

But what I want to do is read in a couple of files and output them to
one single file, but then be able to take this one single file and
recreate the files I put into it.

Im really at a loss as to how I go about recovering the files?
obviously if i scan for a string that specifys the start and end of
each file, theres the chance that the file might contain this term to
which would split the files into unwanted chucks of file, which wouldnt be wanted.

Any ideas? code snippets?

Im very grateful!

Ok, for the seperating of the records you could something like this.
This function returns a generator that can iterate thru your records.
Py> #Single file multi-record seperator
.... def recordbreaker(record, seperator='#NextRecord#'):
.... seplen = len(seperator)
.... rec = open(record ,'rb')
.... a =[]
.... for line in rec:
.... sep = line.find(seperator)
.... if sep != -1:
.... a.append(line[:sep])
.... out = ''.join(a)
.... a =[]
.... a.append(line[sep+seplen:].lstrip())
.... yield out
.... else:
.... a.append(line)
.... if a:
.... yield ''.join(a)
.... rec.close()
....
Py> # to use it directly
Py> records = recordbreaker('myrecords.txt')
Py> first_record = records.next()
Py> second_record = records.next()
Py> # or you can do this
Py> for record in records:
Py> print record

Getting them in a single file is easy, and will be an excercise left to
the reader.
The fileinput module is your friend it is in the standard library.
Be sure to check it out if you haven't already.
hth,
M.E.Farmer

Jul 18 '05 #5

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

7
by: jsale | last post by:
I have made an ASP.NET web application that connects to SQL Server, reading and writing data using classes. I was recommended to use session objects to store the data per user, because each user...
12
by: Adam J. Schaff | last post by:
I am writing a quick program to edit a binary file that contains file paths (amongst other things). If I look at the files in notepad, they look like: ...
6
by: Kevin Chambers | last post by:
Hi all-- In an attempt to commit an Access MDB to a versioning system (subversion), I'm trying to figure out how to convert a jet table's metadata to text, a la SaveAsText. The end goal is to...
10
by: joelagnel | last post by:
hi friends, i've been having this confusion for about a year, i want to know the exact difference between text and binary files. using the fwrite function in c, i wrote 2 bytes of integers in...
0
by: Masa Ito | last post by:
I have pipe delimited (and comma/tab) files that I read with JET using a schema file. Occasionally a field has multiple quotes (") inside a single field - which chokes the line (the rest of the...
6
by: arne.muller | last post by:
Hello, I've come across some problems reading strucutres from binary files. Basically I've some strutures typedef struct { int i; double x; int n; double *mz;
9
by: andy.z | last post by:
If 2 people try to access the same text file at the same time to write to it - what happens in PHP ? What I mean is - presumably the first will be ok - But what will the second person actually...
1
by: Xah Lee | last post by:
Text Processing with Emacs Lisp Xah Lee, 2007-10-29 This page gives a outline of how to use emacs lisp to do text processing, using a specific real-world problem as example. If you don't know...
6
by: John Salerno | last post by:
Before I try this and destroy my computer :) I just wanted to see if this would even work at all. Is it possible to read a binary file such as an mp3 or an avi, put its contents into a new file,...
0
by: taylorcarr | last post by:
A Canon printer is a smart device known for being advanced, efficient, and reliable. It is designed for home, office, and hybrid workspace use and can also be used for a variety of purposes. However,...
0
by: aa123db | last post by:
Variable and constants Use var or let for variables and const fror constants. Var foo ='bar'; Let foo ='bar';const baz ='bar'; Functions function $name$ ($parameters$) { } ...
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.