Array Capacity > 2Gb ?

[Christian Reizlein]

Im making a MD5 file checking program and im trying to read a file which is
larger than 2Gb. and i come across the problem that Arrays in VB.net cannot
have more than 2gb capacity, when i try to create an array of the file
length i get an overflow. is that possible? is there any workaround?

I know its going to be a lot of memory consumming to load all the file into
an array but i just dont care about that.
Any suggestions?

Thanks,
Smoke

[Andrew Morton]

Christian Reizlein wrote:

Im making a MD5 file checking program and im trying to read a file
which is larger than 2Gb. and i come across the problem that Arrays
in VB.net cannot have more than 2gb capacity, when i try to create an
array of the file length i get an overflow. is that possible? is
there any workaround?
I know its going to be a lot of memory consumming to load all the
file into an array but i just dont care about that.
Any suggestions?

You could read the file in chunks of, say, 32KB (seeing as that's the size
of the OS's buffer AFAIK).

Andrew

[=?Utf-8?B?RmFtaWx5IFRyZWUgTWlrZQ==?=]

You shouldn't need the entire file in memory at once to do that...

"Christian Reizlein" wrote:

Im making a MD5 file checking program and im trying to read a file which is
larger than 2Gb. and i come across the problem that Arrays in VB.net cannot
have more than 2gb capacity, when i try to create an array of the file
length i get an overflow. is that possible? is there any workaround?

I know its going to be a lot of memory consumming to load all the file into
an array but i just dont care about that.
Any suggestions?

Thanks,
Smoke

[Christian Reizlein]

Well, im reading it in chunks, but anyway i need a array of bytes to use as
buffer to put the read contents and that has to be the total lenght of the
file

"Andrew Morton" <ak*@in-press.co.uk.invalidwrote in message
news:66*************@mid.individual.net...

Christian Reizlein wrote:

>Im making a MD5 file checking program and im trying to read a file
which is larger than 2Gb. and i come across the problem that Arrays
in VB.net cannot have more than 2gb capacity, when i try to create an
array of the file length i get an overflow. is that possible? is
there any workaround?
I know its going to be a lot of memory consumming to load all the
file into an array but i just dont care about that.
Any suggestions?

You could read the file in chunks of, say, 32KB (seeing as that's the size
of the OS's buffer AFAIK).

Andrew

[Tom Shelton]

On 2008-04-09, Christian Reizlein <cr*******@hotmail.comwrote:

Thanks you so much for your tips, i where able to override the read method
of the filestream and raise events and control the data beign readed trough
the position property, i didnt figured that out early.

Thanks once again :)

I'm glad it helped :)

--
Tom Shelton