473,396 Members | 1,970 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,396 software developers and data experts.

Reading FTP Data in stream

I have a datadump from internal equipment that is about 500 megs. The
file is dumped every morning in a comma delinated format. Instead of
downloading this file to the client and then processing it is there any
way to stream the data into the client and read/parse it as it comes
in?

The file is on our intranet....

Example file:

Name: Data.csv

Example file structure:
-10,30,50,28
-12,29,49,28
.... on and on for about 500 megs....

-Peter

Nov 21 '05 #1
5 1590
If you can find an ftp library that can hand you back a stream, you can
use my csv parser which handles streams to parse the csv data as it
comes in, http://www.csvreader.com .

Nov 21 '05 #2
On 9 Aug 2005 07:44:44 -0700, "shriop" <sh****@hotmail.com> wrote:
If you can find an ftp library that can hand you back a stream, you can
use my csv parser which handles streams to parse the csv data as it
comes in, http://www.csvreader.com .


Xceed FTP for .NET lets you get a stream - there are currently two
ways:

GetDownloadStream: Retrieves a direct access to the readonly data
stream being received, beginning at the specified offset.

FtpClient.ReceiveFile Method: can take a stream as a parameter

for more info: http://www.xceedsoft.com/products/ftpnet
--
Alex Leblanc
Xceed Software Inc.
http://www.xceedsoft.com

Check out our advanced .NET grid and Windows Forms UI controls

Email: xL*******@xceedsoft.com (remove the first 'x')
Nov 21 '05 #3
Some time ago I modified the FTP library "FTP Client Class Library" at
www.gotdotnet.com to work with streams -- both reading from a stream for
uploading, and writing to a stream for downloading.

I provided the original author with a copy of my changes. My understanding
was she was going to make it available, but I'm not sure if she actually
has. If not, let me know and I can send you a copy.

Richard Rosenheim
"pmclinn" <pm*****@gmail.com> wrote in message
news:11**********************@g43g2000cwa.googlegr oups.com...
I have a datadump from internal equipment that is about 500 megs. The
file is dumped every morning in a comma delinated format. Instead of
downloading this file to the client and then processing it is there any
way to stream the data into the client and read/parse it as it comes
in?

The file is on our intranet....

Example file:

Name: Data.csv

Example file structure:
-10,30,50,28
-12,29,49,28
... on and on for about 500 megs....

-Peter

Nov 21 '05 #4
She hasn't modified it yet apparently. Thanks.

Richard L Rosenheim wrote:
Some time ago I modified the FTP library "FTP Client Class Library" at
www.gotdotnet.com to work with streams -- both reading from a stream for
uploading, and writing to a stream for downloading.

I provided the original author with a copy of my changes. My understanding
was she was going to make it available, but I'm not sure if she actually
has. If not, let me know and I can send you a copy.

Richard Rosenheim
"pmclinn" <pm*****@gmail.com> wrote in message
news:11**********************@g43g2000cwa.googlegr oups.com...
I have a datadump from internal equipment that is about 500 megs. The
file is dumped every morning in a comma delinated format. Instead of
downloading this file to the client and then processing it is there any
way to stream the data into the client and read/parse it as it comes
in?

The file is on our intranet....

Example file:

Name: Data.csv

Example file structure:
-10,30,50,28
-12,29,49,28
... on and on for about 500 megs....

-Peter


Nov 21 '05 #5
I tried emailing you my revision of the class library, but the email was
bounced back. Do you have a better email address than the gmail account?

Richard Rosenheim
"pmclinn" <pm*****@gmail.com> wrote in message
news:11*********************@g43g2000cwa.googlegro ups.com...
She hasn't modified it yet apparently. Thanks.

Richard L Rosenheim wrote:
Some time ago I modified the FTP library "FTP Client Class Library" at
www.gotdotnet.com to work with streams -- both reading from a stream for
uploading, and writing to a stream for downloading.

I provided the original author with a copy of my changes. My understanding was she was going to make it available, but I'm not sure if she actually
has. If not, let me know and I can send you a copy.

Richard Rosenheim
"pmclinn" <pm*****@gmail.com> wrote in message
news:11**********************@g43g2000cwa.googlegr oups.com...
I have a datadump from internal equipment that is about 500 megs. The
file is dumped every morning in a comma delinated format. Instead of
downloading this file to the client and then processing it is there any way to stream the data into the client and read/parse it as it comes
in?

The file is on our intranet....

Example file:

Name: Data.csv

Example file structure:
-10,30,50,28
-12,29,49,28
... on and on for about 500 megs....

-Peter

Nov 21 '05 #6

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

6
by: KevinD | last post by:
assumption: I am new to C and old to COBOL I have been reading a lot (self teaching) but something is not sinking in with respect to reading a simple file - one record at a time. Using C, I am...
3
by: Nick | last post by:
I have found a class that compresses and uncompresses data but need some help with how to use part of it below is the deflate method which compresses the string that I pass in, this works OK. At...
21
by: JoKur | last post by:
Hello, First let me tell you that I'm very new to C# and learning as I go. I'm trying to write a client application to communicate with a server (that I didn't write). Each message from the...
5
by: Dave A | last post by:
I have an application that does lots of socket communications all asynchronously via the TcpClient class. The code has been working 99.9999% of the time (yeah one of those bugs) but occasionally...
2
by: Joe | last post by:
Anyone can suggest the best method of reading XML and adding data to ListView? Here is the xml data structure:: <xml> <site> <url>http://www.yahoo.com</url> <lastupdate></lastupdate>...
8
by: T Driver | last post by:
Anyone have any idea how I can do the following? I have a connection to an XML file on a site I do not control, getting a string representation of the xml data that I can then feed to my...
3
by: rsk | last post by:
Hi Friends, I have the following code which reads the hexadecimal data from the "data.txt" file into the arrays. But when i run this code it is reading some garbage data after reading all the...
21
by: Stephen.Schoenberger | last post by:
Hello, My C is a bit rusty (.NET programmer normally but need to do this in C) and I need to read in a text file that is setup as a table. The general form of the file is 00000000 USNIST00Z...
8
by: Peter Bradley | last post by:
Hi, I wonder if anyone can help me out? I'm trying to implement an EPP (rfc4934 and rfc4930) client. So far I've managed to connect and authorise using an X509 Certificate. This should...
2
by: =?Utf-8?B?VHJlY2l1cw==?= | last post by:
Hello, Newsgroupians: In regards to reading a stream, I know we use the Read() method. One could implement reading a stream using a while-loop. while (stream.Read(buffer, 0, buffer.Length) !=...
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
0
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.