Hi,
I'm having a problem using the zipfile module in Windows 2000 sp4. When I
use it to zip a small file it works fine, but large file doesnt. Here's the
error msg i get...
---------------------------------------------------------------------
dynamite4_db_ar chive.py", line 45, in ?
file.write(name , os.path.basenam e(name), zipfile.ZIP_DEF LATED)
File "C:\Python22\li b\zipfile.py", line 426, in write
zinfo.file_size ))
OverflowError: long int too large to convert to int
---------------------------------------------------------------------
I've read a couple of problems with this module with long int, and it says
it's a know problem in Python earlier than 2.3
So I upgraded to 2.3 and i'm still getting the error msg. I'm not proficient
at python so I'm not sure what to do at this point. The file I'm currently
trying to zip is about 2.5GB.
Here's my code that's causing the error...
----------------------------------------------------------------------
currentDirFiles = os.listdir(mydi r) #list log file in dir
os.mkdir(todays _dir)
for item in currentDirFiles : #find the file with the date from 7 days ago
file_to_zip = mydir + item
destination = todays_dir + str('/') + item + str('_') + todays_date +
str('.zip')
print "\n" + file_to_zip + "\n" + destination
file = zipfile.ZipFile (destination, "w")
for name in glob.glob(file_ to_zip):
file.write(name , os.path.basenam e(name), zipfile.ZIP_DEF LATED)
file.close()
---------------------------------------------------------------------
Any help would be appreciated. TIA
LC 1 2917
lco> dynamite4_db_ar chive.py", line 45, in ?
lco> file.write(name , os.path.basenam e(name), zipfile.ZIP_DEF LATED)
lco> File "C:\Python22\li b\zipfile.py", line 426, in write
lco> zinfo.file_size ))
lco> OverflowError: long int too large to convert to int
...
lco> for name in glob.glob(file_ to_zip):
lco> file.write(name , os.path.basenam e(name), zipfile.ZIP_DEF LATED)
How about you write the file in chunks? I'm not familiar with the zipfile
module, but it looks like writestr will do the job for you. My guess is
something like
...
file = zipfile.ZipFile (destination, "w", zipfile.ZIP_DEF LATE)
for name in glob.glob(file_ to_zip):
...
f = open(name)
data = f.read(8192)
while data:
file.writestr(o s.path.basename (name), data)
data = f.read(8192)
f.close()
file.close()
might do the trick. (The zipfile module's interface to writing data looks a
bit odd to me.)
Skip This thread has been closed and replies have been disabled. Please start a new discussion. Similar topics |
by: stewart.midwinter |
last post by:
I've been experimenting with the python zipfile module, and have run
into a snag.
I'm able to create a new zipfile with the module's ZipFile class and
add files to it. After closing the file, I'm able to view the contents
of it with WinZip. I can also confirm that it is a python zip file by
using the is_zipfile() method. All good so far. However, under some
circumstances, I am unable to later read the file and extract its
contents. ...
|
by: Waguy |
last post by:
Hi all,
I am new to python and want to create a process to unzip large numbers of
zip files I get from a SOAP application. The files all have a ZIP extention
and can be unzipped using WinZip.
However when I try opening the files using zlib or zipfile modules I get the
following error:
Traceback (most recent call last):
|
by: Hari Sekhon |
last post by:
I do
import zipfile
zip=zipfile.ZipFile('d:\somepath\cdimage.zip')
zip.namelist()
then either of the two:
A) file('someimage.iso','w').write(zip.read('someimage.iso'))
|
by: Ritesh Raj Sarraf |
last post by:
Hi,
I've got a problem here.
def compress_the_file(zip_file_name, files_to_compress, sSourceDir):
"""
Condenses all the files into one single file for easy transfer
"""
try:
|
by: OriginalBrownster |
last post by:
This will probably sound like a very dumb question.
I am trying to zip some files within a directory.
I want to zip all the files within a directory called "temp"
and have the zip archive saved in a directory with temp called ziptemp
I was trying to read up on how to use the zipfile module python
provides, but I cannot seem to find adequate documentation on function
itself.
| |
by: =?utf-8?B?5Lq66KiA6JC95pel5piv5aSp5rav77yM5pyb5p6B |
last post by:
I made a C/S network program, the client receive the zip file from the
server, and read the data into a variable. how could I process the
zipfile directly without saving it into file.
In the document of the zipfile module, I note that it mentions the
file-like object? what does it mean?
class ZipFile( file]])
Open a ZIP file, where file can be either a path to a file (a
string) or a file-like object.
|
by: towers |
last post by:
Hi
I'm probably doing something stupid but I've run into a problem
whereby I'm trying to add a csv file to a zip archive - see example
code below.
The csv just has several rows with carriage return line feeds (CRLF).
However after adding it to an archive and then decompressing the line
endings have been converted to just line feeds (LF).
|
by: Larry Bates |
last post by:
I'm trying to learn about subclassing new style classes and the first project I
went to do needs to subclass zipfile to add some methods.
Why does this:
import zipfile
class walkZip(zipfile):
pass
|
by: Neil Crighton |
last post by:
I'm using the zipfile library to read a zip file in Windows, and it
seems to be adding too many newlines to extracted files. I've found
that for extracted text-encoded files, removing all instances of '\r'
in the extracted file seems to fix the problem, but I can't find an
easy solution for binary files.
The code I'm using is something like:
from zipfile import Zipfile
z = Zipfile(open('zippedfile.zip'))
|
by: marktang |
last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look !
Part I. Meaning of...
|
by: jinu1996 |
last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth.
The Art of Business Website Design
Your website is...
| |
by: Hystou |
last post by:
Overview:
Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
|
by: tracyyun |
last post by:
Dear forum friends,
With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
|
by: agi2029 |
last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own....
Now, this would greatly impact the work of software developers. The idea...
|
by: conductexam |
last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one.
At the time of converting from word file to html my equations which are in the word document file was convert into image.
Globals.ThisAddIn.Application.ActiveDocument.Select();...
|
by: TSSRALBI |
last post by:
Hello
I'm a network technician in training and I need your help.
I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs.
The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols.
I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
|
by: adsilva |
last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
| |
by: 6302768590 |
last post by:
Hai team
i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
| |