Uncompressing 64-bit Zip Files?

ScottO

Is anyone aware of native dotnet code to uncompress 64-bit Zip files?
Everything I have found so far can only uncompress files inside a zip file
up to 9Gig.

Any thoughts?

Thanks in advanced,

Scott

Nov 16 '05 #1

Subscribe Reply

3642

Jeffrey Tan[MSFT]

Hi ScottO,

Thanks for posting in this group.

Can you tell me what does your "64-bit" zip file mean? Also, what is "9Gig"?

Thank you for your patience and cooperation. If you have any questions or
concerns, please feel free to post it in the group. I am standing by to be
of assistance.

Best regards,
Jeffrey Tan
Microsoft Online Partner Support
Get Secure! - www.microsoft.com/security
This posting is provided "as is" with no warranties and confers no rights.

Nov 16 '05 #2

ScottO

Jeff,

To be more specific Winzip 9.0 can compress files over 4 Gig now. It uses
"64-bit extensions". PK 2.0's normal limitation is 4 Gig.
http://www.winzip.com/wzdic.htm

I tried to uncompress a file that contained over 9 gigs of data using
SharpZipLib <big shout out!!!> but it throw an error after 7.6 Gig. After we
made some INTs to LONGs and some other modification the entire 9 Gig
uncompressed. Next steps are to see if it really works or just pretended to
work <grin>. Then we'll try to make the same changes to the compression
routine. The GZip library in SharpZipLib might allow me to compress a 9 Gig
but I haven't tested it yet.

It is truly AMAZING to take a 7.7 Gig ASCII file (with a lot of spaces in
it) compress down to 200 MB. Then compress the compressed file a second time
to a mere 4.5 MB!

I think I am good shape now but any comments on compression and .NET are
greatly appreciated.

Scott

""Jeffrey Tan[MSFT]"" <v-*****@online.mi crosoft.com> wrote in message
news:cX******** ******@cpmsftng xa10.phx.gbl...

Hi ScottO,

Thanks for posting in this group.

Can you tell me what does your "64-bit" zip file mean? Also, what is "9Gig"?
Thank you for your patience and cooperation. If you have any questions or
concerns, please feel free to post it in the group. I am standing by to be
of assistance.

Best regards,
Jeffrey Tan
Microsoft Online Partner Support
Get Secure! - www.microsoft.com/security
This posting is provided "as is" with no warranties and confers no rights.

Nov 16 '05 #3

John Reilly

"Jeffrey Tan[MSFT]" wrote:

Hi ScottO,

Thanks for posting in this group.

Can you tell me what does your "64-bit" zip file mean? Also, what is
"9Gig"?

Thank you for your patience and cooperation. If you have any
questions or concerns, please feel free to post it in the group. I am
standing by to be of assistance.

Best regards,
Jeffrey Tan
Microsoft Online Partner Support
Get Secure! - www.microsoft.com/security
This posting is provided "as is" with no warranties and confers no
rights.

I think is means deflate64 an extension to the Zip file format to allow
extremely large files to be handled (2^64). It uses a 64k window for
compressing as well as extensions to the file format.

-jr-

Nov 16 '05 #4

Jeffrey Tan[MSFT]

Hi Scott,

Thanks very much for your feedback.

I am glad you have workaround this issue. I think the reason of needing
change "int" to "long" may be that, long is System.Int64 type in .Net, and
it is 64-bit, when applying compress algorithm, "int" may overflow for big
file.

For your other compress issue, I think it is due to the algorithm. It seems
that SharpZipLib is a free and open source library. You may discover its
root cause in the source code.

Also, I think you may consult the SharpZipLib related issue at that
compony's web site, you may get more help there, because more people use
SharpZipLib there. :-)

Thank you for your patience and cooperation. If you have any questions or
concerns, please feel free to post it in the group. I am standing by to be
of assistance.

Best regards,
Jeffrey Tan
Microsoft Online Partner Support
Get Secure! - www.microsoft.com/security
This posting is provided "as is" with no warranties and confers no rights.

Nov 16 '05 #5

John Reilly

Hi Scott,

If you are interested in good compression then you might try Bzip2
which tends to compress a little better than Zip compressors. I think
it will handle very large files also.

I am also interested in the changes you made to SharpZipLib which I use
a little myself.
Cheers,

-jr-
ScottO wrote:

Jeff,

To be more specific Winzip 9.0 can compress files over 4 Gig now. It
uses "64-bit extensions". PK 2.0's normal limitation is 4 Gig.
http://www.winzip.com/wzdic.htm

I tried to uncompress a file that contained over 9 gigs of data using
SharpZipLib <big shout out!!!> but it throw an error after 7.6 Gig.
After we made some INTs to LONGs and some other modification the
entire 9 Gig uncompressed. Next steps are to see if it really works
or just pretended to work <grin>. Then we'll try to make the same
changes to the compression routine. The GZip library in SharpZipLib
might allow me to compress a 9 Gig but I haven't tested it yet.

It is truly AMAZING to take a 7.7 Gig ASCII file (with a lot of
spaces in it) compress down to 200 MB. Then compress the compressed
file a second time to a mere 4.5 MB!

I think I am good shape now but any comments on compression and .NET
are greatly appreciated.

Scott

Nov 16 '05 #6

Norm Johanson

I'm using SharpZipLib now and I was curious if you found PKZip to be
faster then SharpZipLib when called from C#. I'm not too concern
about size I need speed. I'm also only working with byte arrays not
files.

If anybody has any other suggestions on the fastest compression
library I would greatly appreciate it.

Nov 16 '05 #7

Jeffrey Tan[MSFT]

Hi Scott,

Does our reply make sense to you? Do you still have any concern on this
issue?

Please feel free to post. Thanks

Best regards,
Jeffrey Tan
Microsoft Online Partner Support
Get Secure! - www.microsoft.com/security
This posting is provided "as is" with no warranties and confers no rights.

Nov 16 '05 #8

Similar topics

1539

numarray on 64 bits

by: Marc Poinot | last post by:

Did anybody use numarray on a 64 bits platform ? (e.g. SGI/Irix) The package works on our 64 bits platforms... using 32 bits mode, but not using 64 mode. Big crash in _ufunc... Is there a flag to set somewhere, trick, hint, noway ? -MP- ----------------------------------------------------------------------- Marc POINOT Alias: marcvs Email: poinot@onera.fr ONERA -MFE/DSNA/ELSA Tel: 01.46.73.42.84 Info:...

Python

2255

DB2 UDB 64-bits

by: Odd Bjørn Andersen | last post by:

I was asked to install db2 udb workgroup edition (version 7.2) 64-bits on AIX. But I cannot find that we have a CD with that software. Only Enterprise Edition. Is it correct that you have to install Enterprise (Server) Edition if you want 64-bits DB2 UDB (both version 7 and 8) on AIX ? And that Workgroup (Server) Edition doesn't come in 64-bits, only 32 ? -- Regards

DB2 Database

4123

Interesting bug

by: Dave Vandervies | last post by:

I just fixed a bug that some of the correctness pedants around here may find useful as ammunition. The problem was that some code would, very occasionally, die with a segmentation violation error. (Not as infrequent as some bugs that have been discussed here in the past, but maybe once in an overnight run of the program when it was configured to aggressively exercise the section that the bug was in.) It was easy enough to trap the...

C / C++

15551

Invalid length for a Base-64 char array ,Invalid_Viewstate

by: some one | last post by:

I have kind of wired problem, I using httpwebrequest to post form data to server , in the GetResponse stage a WebException occurred, after tracing the actual error that occurs on the server, I found the follows. Invalid length for a Base-64 char array. Description: An unhandled exception occurred during the execution of the current web request. Please review the stack trace for more information about

ASP.NET

2170

DB2 UDB Version 8 Workgroup Edition 64 bits, sources ????

by: mel_apiso | last post by:

Hi, we have an AIX 5.3 OS, and we purchased DB2 UDB version 8 Workgroup Edition. We want to install 64 bits version, but the source CD's that we have say: WORKGROUP SERVER EDITION Version 8.1 for AIX 5L

DB2 Database

2708

kernel hangs after "UNCOMPRESSING KERNEL OK BOOTING KERNEL"

by: yogesh | last post by:

I have compiled kernel 2.4.18 . I have followed the following sequence ... as make mrproper make xconfig make dep make make modules make modules_install then copied system.map and bzimage to boot directory..

C / C++

4094

db2 8.1 for solaris 64 bit for AMD

by: Mary Lei | last post by:

Does anyone know the link to obtain the tarball for db2 8.1 for solaris running on AMD 64 bit ? This is the entire db2 installation on a new system that does not have db2. Thanks.

DB2 Database

10702

Shifting unsigned long long values by 64 bits

by: krunalb | last post by:

Hi, I am trying to shift unsigned long long value by 64 bits and this is what i get #include <stdio.h> int main() { unsigned short shiftby= 64;

C / C++

2327

a=0100; print a ; 64 how to reverse this?

by: mosi | last post by:

Problem: how to get binary from integer and vice versa? The simplest way I know is: a = 0100 a 64 but: a = 100 (I want binary number) does not work that way.

Python

2373

Invalid_Viewstate exception with Invalid character in a Base-64 st

by: =?Utf-8?B?UGF1bCBQaGlsbGlwcw==?= | last post by:

I have read many things about this but I haven't got a clear vision on what to do if anything about this. I have a system that tries to find holes in my web site. One of the things it has found and has been sent to me is an Invalid_Viewstate exception. I will provide the stack trace below. If you read down the stack trace it talks about "Invalid chararcter in a base-64

ASP.NET

8999

What is ONU?

by: marktang | last post by:

ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...

General

8836

Changing the language in Windows 10

by: Hystou | last post by:

Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...

Windows Server

9575

Problem With Comparison Operator <=> in G++

by: Oralloy | last post by:

Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed. This is as boiled down as I can make it. Here is my compilation command: g++-12 -std=c++20 -Wnarrowing bit_field.cpp Here is the code in...

C / C++

9256

Discussion: How does Zigbee compare with other wireless protocols in smart home applications?

by: tracyyun | last post by:

Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...

General

6803

Access Europe - Using VBA to create a class based on a table - Wed 1 May

by: isladogs | last post by:

The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...

Microsoft Access / VBA

6080

Couldn’t get equations in html when convert word .docx file to html file in C#.

by: conductexam | last post by:

I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one. At the time of converting from word file to html my equations which are in the word document file was convert into image. Globals.ThisAddIn.Application.ActiveDocument.Select();...

C# / C Sharp

3322

transfer the data from one system to another through ip address

by: 6302768590 | last post by:

Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system

C# / C Sharp

2798

How to add payments to a PHP MySQL app.

by: muto222 | last post by:

How can i add a mobile payment intergratation into php mysql website.

PHP

2223

Comprehensive Guide to Website Development in Toronto: Expert Insights from BSMN Consultancy

by: bsmnconsultancy | last post by:

In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...

General