Extracting specific fields from a log file and export it to csv file using C#

[Vishal P Patil]

This is the code that I have written in C# which shows the contains in the sample.log file.

class FileRead
    {
        public void ReadData()
        {
            FileStream fs = new FileStream("sample.log", FileMode.Open, FileAccess.Read);
            StreamReader sr = new StreamReader(fs);
            sr.BaseStream.Seek(0, SeekOrigin.Begin);
            string str = sr.ReadLine();
            while (str != null)
            {
                Console.WriteLine("{0}", str);
                str = sr.ReadLine();
            }
            sr.Close();
            fs.Close();
            Console.ReadLine();
        }
        public static void Main (string[] args)
        {
            FileRead fr = new FileRead();
            fr.ReadData();
        }
    }
 

->The sample.log file contains following data fields
sample.log:
8=FIX.4.3
9=61
35=5
34=1
49=ID E
50=FX
52=2010 1219-18:05:01.522
56 =SAXOQUOTE
10=1 71

8=FIX.4.3
9=81
35=A
49=SAXOQUO TE
56=IDE
34=1
57=FX
52=201012 19-18:06:02
369=1
98=0
108=30
141 =Y
10=082

8=FIX.4.3
9=85
35=1
49=SAXOQUO TE
56=IDE
34=2
57=FX
52=201012 19-18:06:02
369=1
112=20101219-18:06:02
10=053


->Now the problem is I just wanted to print the specific fields from sample.log file in column wise manner or export the specific fields in csv file.
->That is the output should be like this :

Output:
9=61 35=5 52=20101219-18:05:01.522
9=81 35=A 52=20101219-18:06:02
9=85 35=1 52=20101219-18:06:02

Please help me with this.

[Rabbit]

It looks like there's a delimiter. You could just use that to get the fields you want.

[Vishal P Patil]

thanks for your reply.

[Vishal P Patil]

This is the code that I have written in C# which shows the contains in the sample.log file which is 110MB in size. I have added the while loop which will check till end of file and print all the records, but I am not getting the first record and also not getting each record in new line

using System;
using System.IO;
using System.Text;
 
    class Program
    {
        static void Main(string[] args)
        {
 
            FileStream fs = new FileStream("sample.log", FileMode.Open, FileAccess.Read);
            StreamReader sr = new StreamReader(fs);
            string StrFromFile = sr.ReadLine();
 
            StringBuilder ResultStr = new StringBuilder();
 
          while ((StrFromFile = sr.ReadLine()) != null)
          { 
            // your separator char seems to be char 1
            string[] SplitStrs = StrFromFile.Split(new char[] {(char)1});        
            for (int i = 0; i < SplitStrs.Length; i++)
            {   
                if (SplitStrs[i].StartsWith("52="))
                {
                    ResultStr.Append(SplitStrs[i] + " ");
                }
                else if (SplitStrs[i].StartsWith("55="))
                {
                    ResultStr.Append(SplitStrs[i] + " ");
                }
                else if (SplitStrs[i].StartsWith("132="))
                {
                    ResultStr.Append(SplitStrs[i] + " ");
                }
                else if (SplitStrs[i].StartsWith("133="))
                {
                    ResultStr.Append(SplitStrs[i] + " ");
                }
                else if (SplitStrs[i].StartsWith("35="))
                {
                    ResultStr.Append(SplitStrs[i] + " ");
                }   
            }  
         }
            Console.WriteLine(ResultStr);
            sr.Close();
            fs.Close();
            Console.ReadKey();
        }

This is some data from sample.log file :
**sample.log:**

8=FIX.4.39=6335 =049=SAXOQUOTE5 6=IDE34=457=FX5 2=20101219-18:06:32369=310 =003
8=FIX.4.39=6135 =034=449=IDE50= FX52=20101219-18:06:32.13056= SAXOQUOTE10=169
8=FIX.4.39=6335 =049=SAXOQUOTE5 6=IDE34=557=FX5 2=20101219-18:07:02369=410 =003
8=FIX.4.39=6135 =034=549=IDE50= FX52=20101219-18:07:02.50156= SAXOQUOTE10=170

Also I am not getting why it is not showing the first record and how do I write this result to CSV file?

I am getting output like this,
35=0 52=20101219-18:06:32.130 35=0 52=20101219-18:07:02 35=0 52=20101219-18:07:02.501

but I want the output like this,
35=0 52=20101219-18:06:32.130
35=0 52=20101219-18:07:02
35=0 52=20101219-18:07:02.501

Please help me with this.

[Rabbit]

After each line, you need to append a new line. Right now you're only appending spaces.

[Vishal P Patil]

Thanks for your help.
I got the result in new line per record.

Output :
35=5 52=20101219-18:05:01.522
35=A 52=20101219-18:06:01.504
35=A 52=20101219-18:06:02
35=1 52=20101219-18:06:02
35=R 52=20101219-18:06:01.847 55=EUR/USD

Now how do I export this output in CSV file?

This is the code :

using System;
using System.IO;
using System.Text;
 
    class Program
    {
        static void Main(string[] args)
        {
 
            FileStream fs = new FileStream("sample.log", FileMode.Open, FileAccess.Read);
            StreamReader sr = new StreamReader(fs);
            string StrFromFile;
            StringBuilder ResultStr = new StringBuilder();
 
 
          while ((StrFromFile = sr.ReadLine()) != null)
          { 
            // your separator char seems to be char 1
            string[] SplitStrs = StrFromFile.Split(new char[] {(char)1});        
            for (int i = 0; i < SplitStrs.Length; i++)
            {   
                if (SplitStrs[i].StartsWith("52="))
                {
                    ResultStr.Append(SplitStrs[i] + " ");
                }
                else if (SplitStrs[i].StartsWith("55="))
                {
                    ResultStr.Append(SplitStrs[i] + " ");
                }
                else if (SplitStrs[i].StartsWith("132="))
                {
                    ResultStr.Append(SplitStrs[i] + " ");
                }
                else if (SplitStrs[i].StartsWith("133="))
                {
                    ResultStr.Append(SplitStrs[i] + " ");
                }
                else if (SplitStrs[i].StartsWith("35="))
                {
                    ResultStr.Append(SplitStrs[i] + " ");
                }   
            }
 
            Console.WriteLine(ResultStr);
            ResultStr.Length = 0;
         }
            sr.Close();
            fs.Close();
            Console.ReadKey();
        }
    }

[Rabbit]

You'll need a stream writer object to write a file.