FILES WITH C# (VS 2003)

[Macisu]

Hi

I need to open flat files using C#.
I need to work very fast, but when I used StreamReader, This is very slow.

Anybody knows how to work FILES very fast using C#.
I need to read 3 millions of records at least a minute.

How can i access FILES very fast (flat files)?

Thanks for your help

Macisu

[Nicholas Paldino [.NET/C# MVP]]

Macisu,

Are you running a race or something? That is an awful amount of records
to be reading.

How are you processing them? Just saying that it is very slow isn't
really good enough, since we can't see how you are processing the stream
(there may be optimizations you can make which you aren't).
--
- Nicholas Paldino [.NET/C# MVP]
- mv*@spam.guard.caspershouse.com

"Macisu" <Ma****@discussions.microsoft.com> wrote in message
news:86**********************************@microsof t.com...

Hi

I need to open flat files using C#.
I need to work very fast, but when I used StreamReader, This is very slow.

Anybody knows how to work FILES very fast using C#.
I need to read 3 millions of records at least a minute.

How can i access FILES very fast (flat files)?

Thanks for your help

Macisu

[Robbe Morris [C# MVP]]

Check out this guy's comments on the FileStream class and large files.

http://www.geekswithblogs.net/johnsperfblog

--
2004 and 2005 Microsoft MVP C#
Robbe Morris
http://www.masterado.net

Earn $$$ money answering .NET Framework
messageboard posts at EggHeadCafe.com.
http://www.eggheadcafe.com/forums/merit.asp

"Macisu" <Ma****@discussions.microsoft.com> wrote in message
news:86**********************************@microsof t.com...

Hi

I need to open flat files using C#.
I need to work very fast, but when I used StreamReader, This is very slow.

Anybody knows how to work FILES very fast using C#.
I need to read 3 millions of records at least a minute.

How can i access FILES very fast (flat files)?

Thanks for your help

Macisu

[Macisu]

I need to load the file in SQL SERVER.

This file has information about savings accounts and is necesary to load
very fast for other tasks. For Now, I used bulk insert copy.

But, When i used Visual Basic 6, this is very fast using
Open File for input #1
etc.
why?
What can i do using c#?


"Nicholas Paldino [.NET/C# MVP]" wrote:

Macisu,

Are you running a race or something? That is an awful amount of records
to be reading.

How are you processing them? Just saying that it is very slow isn't
really good enough, since we can't see how you are processing the stream
(there may be optimizations you can make which you aren't).
--
- Nicholas Paldino [.NET/C# MVP]
- mv*@spam.guard.caspershouse.com

"Macisu" <Ma****@discussions.microsoft.com> wrote in message
news:86**********************************@microsof t.com...

Hi

I need to open flat files using C#.
I need to work very fast, but when I used StreamReader, This is very slow.

Anybody knows how to work FILES very fast using C#.
I need to read 3 millions of records at least a minute.

How can i access FILES very fast (flat files)?

Thanks for your help

Macisu

[Nicholas Paldino [.NET/C# MVP]]

Macisu,

Did you check the link that was posted in the other reply? It shows
some ways of using the FileStream that improve performance by quite a bit.

You also haven't shown how you are processing the file, and your
algorithm could be part of the problem as well.
--
- Nicholas Paldino [.NET/C# MVP]
- mv*@spam.guard.caspershouse.com

"Macisu" <Ma****@discussions.microsoft.com> wrote in message
news:C7**********************************@microsof t.com...

I need to load the file in SQL SERVER.

This file has information about savings accounts and is necesary to load
very fast for other tasks. For Now, I used bulk insert copy.

But, When i used Visual Basic 6, this is very fast using
Open File for input #1
etc.
why?
What can i do using c#?


"Nicholas Paldino [.NET/C# MVP]" wrote:

Macisu,

Are you running a race or something? That is an awful amount of
records
to be reading.

How are you processing them? Just saying that it is very slow isn't
really good enough, since we can't see how you are processing the stream
(there may be optimizations you can make which you aren't).
--
- Nicholas Paldino [.NET/C# MVP]
- mv*@spam.guard.caspershouse.com

"Macisu" <Ma****@discussions.microsoft.com> wrote in message
news:86**********************************@microsof t.com...

> Hi
>
> I need to open flat files using C#.
> I need to work very fast, but when I used StreamReader, This is very
> slow.
>
> Anybody knows how to work FILES very fast using C#.
> I need to read 3 millions of records at least a minute.
>
> How can i access FILES very fast (flat files)?
>
> Thanks for your help
>
> Macisu

[Willy Denoyette [MVP]]

Inline.

Willy.

"Macisu" <Ma****@discussions.microsoft.com> wrote in message
news:C7**********************************@microsof t.com...

I need to load the file in SQL SERVER.

This file has information about savings accounts and is necesary to load
very fast for other tasks. For Now, I used bulk insert copy.

But, When i used Visual Basic 6, this is very fast using
Open File for input #1
etc.
why?
What can i do using c#?

If you can do it using VB6,you can do it with C#, of course without seeing
any it's impossible to tell what issues you have.
I guess, the problem is not the file reading, but the DB insert's that are
slowing down the process.

"Nicholas Paldino [.NET/C# MVP]" wrote:

Macisu,

Are you running a race or something? That is an awful amount of
records
to be reading.

How are you processing them? Just saying that it is very slow isn't
really good enough, since we can't see how you are processing the stream
(there may be optimizations you can make which you aren't).
--
- Nicholas Paldino [.NET/C# MVP]
- mv*@spam.guard.caspershouse.com

"Macisu" <Ma****@discussions.microsoft.com> wrote in message
news:86**********************************@microsof t.com...

> Hi
>
> I need to open flat files using C#.
> I need to work very fast, but when I used StreamReader, This is very
> slow.
>
> Anybody knows how to work FILES very fast using C#.
> I need to read 3 millions of records at least a minute.
>
> How can i access FILES very fast (flat files)?
>
> Thanks for your help
>
> Macisu

[Jon Skeet [C# MVP]]

Macisu <Ma****@discussions.microsoft.com> wrote:

I need to open flat files using C#.
I need to work very fast, but when I used StreamReader, This is very slow.

Could you post a short but complete program which demonstrates the
problem?

See http://www.pobox.com/~skeet/csharp/complete.html for details of
what I mean by that.

--
Jon Skeet - <sk***@pobox.com>
http://www.pobox.com/~skeet
If replying to the group, please do not mail me too