size limit for byte array?

[Ron]

Hello,

I am trying to read a list of files from an FTP server
(mainframe) to a byte array using sockets as follows, but
not getting all the files in a given directory:

private readonly static int BUFFER_SIZE = 3300;
private byte[] buffer = new byte[BUFFER_SIZE];
private Encoding ASCII = Encoding.ASCII;

Socket socket = null;
int bytes;
string temp = "";

socket = CreateDataSocket(); //get connection here
SendCommand("NLST " + mask);

//while(true){

Array.Clear(buffer, 0, buffer.Length);
bytes = socket.Receive(buffer, buffer.Length, 0);
temp += ASCII.GetString(buffer, 0, bytes);
Console.WriteLine(temp);

//if( bytes < buffer.Length) break;
//}

I was originally looping in a while loop but got less than
if I just increased BUFFER_SIZE and just picked up
whatever temp would hold in one pass. At 3300 I get 2900
bytes worth of data. At 4096 I still only get 2900 or so
bytes of data into temp. There are about 5000 bytes of
data in this directory. What can I do to get all the
bytes of data into temp?

Thanks,
Ron

[Lasse Vågsæther Karlsen]

Ron wrote:

Hello,

I am trying to read a list of files from an FTP server
(mainframe) to a byte array using sockets as follows, but
not getting all the files in a given directory:

<snip>

Sockets are streaming in nature, and while you might create a 16KB byte
array on one end and send off using 1 statement, you're not really
guaranteed to get it back in one call to Receive on the other end.

For all you know, you can get any number of blocks of data, ranging from
1 byte and upwards in size.

Instead of breaking the loop on "less than full buffer", try breaking it
on "empty buffer".

--
Lasse Vågsæther Karlsen
http://www.vkarlsen.no/
mailto:la***@vkarlsen.no
PGP KeyID: 0x0270466B

[Jon Skeet [C# MVP]]

Lasse Vågsæther Karlsen <la***@vkarlsen.no> wrote:

I am trying to read a list of files from an FTP server
(mainframe) to a byte array using sockets as follows, but
not getting all the files in a given directory:

<snip>

Sockets are streaming in nature, and while you might create a 16KB byte
array on one end and send off using 1 statement, you're not really
guaranteed to get it back in one call to Receive on the other end.

For all you know, you can get any number of blocks of data, ranging from
1 byte and upwards in size.

Instead of breaking the loop on "less than full buffer", try breaking it
on "empty buffer".

And after doing that, try using a StringBuilder instead of string
concatenation - the current implementation will become horribly slow if
you get a large file.

--
Jon Skeet - <sk***@pobox.com>
http://www.pobox.com/~skeet
If replying to the group, please do not mail me too